-- Logs begin at Tue 2022-09-06 09:50:21 UTC, end at Tue 2022-09-06 12:36:18 UTC. -- Sep 06 10:27:29.379463 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 10:27:29.390143 ncdv-master-1 devstack@keystone.service[92867]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 10:27:29 2022] *** Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: nodename: ncdv-master-1 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: machine: x86_64 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: clock source: unix Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: pcre jit disabled Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: detected number of CPU cores: 4 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: current working directory: / Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: detected binary path: /usr/bin/uwsgi-core Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: your processes number limit is 47680 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: your memory page size is 4096 bytes Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: detected max file descriptor number: 2048 Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: lock engine: pthread robust mutexes Sep 06 10:27:29.390718 ncdv-master-1 devstack@keystone.service[92867]: thunder lock: enabled Sep 06 10:27:29.391614 ncdv-master-1 devstack@keystone.service[92867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 10:27:29.391614 ncdv-master-1 devstack@keystone.service[92867]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 10:27:29.439776 ncdv-master-1 devstack@keystone.service[92867]: Python main interpreter initialized at 0x5627877509c0 Sep 06 10:27:29.439776 ncdv-master-1 devstack@keystone.service[92867]: python threads support enabled Sep 06 10:27:29.439776 ncdv-master-1 devstack@keystone.service[92867]: your server socket listen backlog is limited to 100 connections Sep 06 10:27:29.439776 ncdv-master-1 devstack@keystone.service[92867]: your mercy for graceful operations on workers is 90 seconds Sep 06 10:27:29.440165 ncdv-master-1 devstack@keystone.service[92867]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 10:27:29.440236 ncdv-master-1 devstack@keystone.service[92867]: *** Operational MODE: preforking *** Sep 06 10:27:29.440494 ncdv-master-1 devstack@keystone.service[92867]: *** uWSGI is running in multiple interpreter mode *** Sep 06 10:27:29.440494 ncdv-master-1 devstack@keystone.service[92867]: spawned uWSGI master process (pid: 92867) Sep 06 10:27:29.440704 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Sep 06 10:27:29.441584 ncdv-master-1 devstack@keystone.service[92867]: spawned uWSGI worker 1 (pid: 92878, cores: 1) Sep 06 10:27:29.441681 ncdv-master-1 devstack@keystone.service[92867]: spawned uWSGI worker 2 (pid: 92879, cores: 1) Sep 06 10:27:29.443283 ncdv-master-1 devstack@keystone.service[92867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 10:27:34.113349 ncdv-master-1 devstack@keystone.service[92879]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:27:34.113349 ncdv-master-1 devstack@keystone.service[92879]: from cryptography.utils import int_from_bytes Sep 06 10:27:34.114173 ncdv-master-1 devstack@keystone.service[92879]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:27:34.114173 ncdv-master-1 devstack@keystone.service[92879]: from cryptography.utils import int_from_bytes Sep 06 10:27:34.114334 ncdv-master-1 devstack@keystone.service[92878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:27:34.114334 ncdv-master-1 devstack@keystone.service[92878]: from cryptography.utils import int_from_bytes Sep 06 10:27:34.114880 ncdv-master-1 devstack@keystone.service[92878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 10:27:34.114880 ncdv-master-1 devstack@keystone.service[92878]: from cryptography.utils import int_from_bytes Sep 06 10:27:34.172824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 10:27:34.172824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 10:27:34.172824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] command line args: [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 10:27:34.172824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 10:27:34.173190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 10:27:34.173271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ================================================================================ {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 10:27:34.173347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 10:27:34.173428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] admin_token = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.173505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] command line args: [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 10:27:34.173581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] config_dir = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.173655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 10:27:34.173731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.173806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ================================================================================ {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 10:27:34.173886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] config_source = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.173962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] admin_token = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] debug = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] config_dir = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] config_source = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] debug = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.174974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_config_append = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_dir = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_file = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_config_append = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_dir = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_file = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.175964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.176943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.177005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.177636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.177776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.177854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.177931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] publish_errors = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] publish_errors = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.178950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] standard_threads = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] standard_threads = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] use_journal = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] use_json = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.179937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] use_stderr = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] use_syslog = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] use_journal = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] use_json = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.180579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] use_stderr = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.180724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] use_syslog = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.180873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 10:27:34.180942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.181928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.182992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.183907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.184980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.185950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.186958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.187953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.188975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.189950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.190955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.191939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.192942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.193984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.194888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.195061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.195142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.195307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.195385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.199971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.200925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.201946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.external = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.202942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.password = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] auth.token = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.external = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.203967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.password = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] auth.token = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.204968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.205919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.206978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.207940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.208854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.209969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.210920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.211974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.212922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.213864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.214967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.215942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.216021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.216184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.216261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.216412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.216491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.217940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.218888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.219866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.220959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.221992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.222922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.223276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.223436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.223574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.223814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.223964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.224916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.225874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.226963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.227901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.228927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.229909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.230932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.231989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.232067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.232139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.232266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.232872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.232951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] role.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] role.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.233937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] role.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] role.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.234934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.235003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.235090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.235159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.235993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.236887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.237864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.238942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.239930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.240944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.241903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.242994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.243856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.244986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.connection = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.245931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.246956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.connection = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.247882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.248971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 10:27:34.249690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.249908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.250146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.250395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.250633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.250879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.251141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.251383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.251672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 10:27:34.251838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 10:27:34.283110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.283282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.283360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.283448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.283565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.283656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.291996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.292216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.321646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.321879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.322026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.322263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.378378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.378646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.433496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.433657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.434113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.434350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.511891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.512991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.513072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.513207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.540362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.540495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.540659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.540758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.540877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.540957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.541822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.552784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.553011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.570919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.571077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.571176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.571296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.571379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.571515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.571597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92878) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 10:27:34.588853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.589062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 10:27:34.589151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.589300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 10:27:34.589408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.589607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 10:27:34.589699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.589844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 10:27:34.589926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.590894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.600772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.616958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.617559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.617631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.617631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.617839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.617981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.618934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.619036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.619114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.619114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.639148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.639936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.640610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.640894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.641419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.641708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.645609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.645867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.646149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.646403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.646689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.647111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.652579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.652869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.653580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.653870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.657550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.657843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.658135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.658417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.658500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.658710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.658793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.658995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.659098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.659290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.659485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.659578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.659775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.660082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.660361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.660636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.675322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.675599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.676704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.676985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.679480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.680955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.682680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.682977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.684138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.684508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.687254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.688821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.690363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.692323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.693656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.693954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.694239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.694523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.694811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.695125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.695451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.695757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.696054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.696452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.696745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.697039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.711443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.711730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.711999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.712263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.713656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.713948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.714229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.714498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.719705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.721235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.721907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.722751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.723047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.723634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.725146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.725426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.725675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.726012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.726304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.726594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.726982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.728262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.728564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.728849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.729151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.729440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.738510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.747489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.747844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.747844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.748193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.756019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.758479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.761260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.761655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.765223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.766771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.766955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.768416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.770385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.770469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.770469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.770579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.770579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.770579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.775592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.777064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.777162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.778622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.780578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.780874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.781160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.781452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.782232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.783714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.784004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.784287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.790688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.790986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.791300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.792170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.792880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.792880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.798270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=92878) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.798560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=92879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 10:27:34.802778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.802998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92878) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.803925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 10:27:34.836284 ncdv-master-1 devstack@keystone.service[92878]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5627877509c0 pid: 92878 (default app) Sep 06 10:27:34.837255 ncdv-master-1 devstack@keystone.service[92879]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5627877509c0 pid: 92879 (default app) Sep 06 10:27:34.839811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf5e8-a8d2-494a-b432-958f52bfd105 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:34.840100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf5e8-a8d2-494a-b432-958f52bfd105 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:34.840373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf5e8-a8d2-494a-b432-958f52bfd105 None None] PATH_INFO: `/v3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:34.844578 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Sep 6 10:27:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:42.728087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:42.728603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:42.728684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:42.732955 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:42.738311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:42.738709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:42.738862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:42.816138 ncdv-master-1 devstack@keystone.service[92878]: INFO dbcounter [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] Registered counter for database keystone Sep 06 10:27:42.835560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG oslo_db.sqlalchemy.engines [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:27:42.842373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writer thread running {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:27:43.022552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG passlib.handlers.bcrypt [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=92878) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 10:27:43.022965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG passlib.handlers.bcrypt [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92878) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 10:27:43.081560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:43.083198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:43.212102 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 10:27:43.716528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:43.794977 ncdv-master-1 devstack@keystone.service[92879]: INFO dbcounter [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] Registered counter for database keystone Sep 06 10:27:43.816369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG oslo_db.sqlalchemy.engines [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 10:27:43.823234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writer thread running {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 10:27:43.940957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e5c5-bf22-4bfd-98ea-cf30cab7c250 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:43.945166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:43.945794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:43.946073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:43.946342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:43.954324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:44.005727 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 10:27:44.006016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b3a76-c700-4f47-b328-81adb92ecdfb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:44.017254 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Sep 6 10:27:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:27:44.023191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:44.040354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec755ddb-ec1d-47f8-bc63-3d7de4d9e5eb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:44.045369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:44.046455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:44.046740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:44.047033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] PATH_INFO: `/v3/projects/bd30074e8f6b499db04c6cc2b896adb1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:44.048488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd30074e8f6b499db04c6cc2b896adb1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:44.098566 ncdv-master-1 devstack@keystone.service[92878]: WARNING keystone.common.rbac_enforcer.enforcer [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 10:27:44.098905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbbf42-735a-49d3-97ab-88de6949c1f8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:44.103570 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Sep 6 10:27:44 2022] GET /identity/v3/projects/bd30074e8f6b499db04c6cc2b896adb1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:46.241837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16c51-a424-45e1-8ee2-b326430236da None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:46.242401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16c51-a424-45e1-8ee2-b326430236da None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:46.242401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16c51-a424-45e1-8ee2-b326430236da None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:46.246406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:27:46.252256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:46.252689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:46.252808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:46.273002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:46.274567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:46.282326 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 10:27:46.609999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16c51-a424-45e1-8ee2-b326430236da None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:46.622709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16c51-a424-45e1-8ee2-b326430236da None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:46.628674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8f933-1049-4c02-9bc3-8f9b827ce894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:46.629677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f933-1049-4c02-9bc3-8f9b827ce894 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:46.630178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f933-1049-4c02-9bc3-8f9b827ce894 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:46.630626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f933-1049-4c02-9bc3-8f9b827ce894 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:46.638761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f933-1049-4c02-9bc3-8f9b827ce894 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:46.640564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f933-1049-4c02-9bc3-8f9b827ce894 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:46.649215 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Sep 6 10:27:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:27:46.654835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:46.663950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca607-d7d3-4c48-9d33-285bbe5bbe53 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:46.668334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356d97e-0008-4ed9-80cd-c6b8506733c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:46.669454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356d97e-0008-4ed9-80cd-c6b8506733c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:46.669732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356d97e-0008-4ed9-80cd-c6b8506733c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:46.670003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356d97e-0008-4ed9-80cd-c6b8506733c6 admin admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:46.671312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356d97e-0008-4ed9-80cd-c6b8506733c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:46.673156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356d97e-0008-4ed9-80cd-c6b8506733c6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:46.674658 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Sep 6 10:27:46 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:48.935248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6243add-975a-44a2-a8dc-5ec29502b589 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:48.935745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6243add-975a-44a2-a8dc-5ec29502b589 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:48.935827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6243add-975a-44a2-a8dc-5ec29502b589 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:48.936114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8103268-5588-42d8-b292-349576e48e82 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:48.936484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8103268-5588-42d8-b292-349576e48e82 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:48.936664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8103268-5588-42d8-b292-349576e48e82 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:48.937107 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:48.937961 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:27:48.942307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:48.942592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:48.942870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:48.942959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:48.943244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:48.943517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:48.961638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:48.962813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:48.986148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG passlib.handlers.bcrypt [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=92879) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 10:27:48.993078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG passlib.handlers.bcrypt [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92879) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 10:27:49.036431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:49.044739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:49.154552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:27:49.158116 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:49.477242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:49.487994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:49.502678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:49.584132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2cac8-8d81-41a2-96e5-dda196a20bb1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:49.587774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:49.590003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193df9-0546-4236-b69d-f3ddfdc23e27 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:49.618361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:49.619003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:49.619314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:49.619641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:49.627943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:49.628811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:49.629099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:49.629377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:49.632153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:27:49.640720 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:27:49.641649 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:27:49.642511 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:27:49.647819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:49.698026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:49.699585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:49.729497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:49.753477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf2b9f-5bd3-4c8d-9806-a3a90600b1a3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:49.788244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:49.788852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:49.789130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:49.789399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:49.790059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:49.790360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:49.791774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:49.796974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:49.800947 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:27:49.804322 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:49.806464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:49.809775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:49.905361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae5d64-a087-4ec0-beaf-3a3f3e336bb0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:49.913485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70cb5f-07cc-49c4-876a-483eb1af01c4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:49.941191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:49.942044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:49.942330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:49.942606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:49.948119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:49.948742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:49.949021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:49.949292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:49.950423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:49.951934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:49.953532 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 10/17] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:27:49 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:49.959265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:49.975781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:50.069256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:50.070136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731bd70-deb2-45db-8968-ae729f5cfa0b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:50.070715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:27:50.095342 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:27:50.096421 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:27:50.098223 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:27:50.098223 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:27:50.098223 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:27:50.098223 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 8/18] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:27:50.102504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:50.112238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:50.112872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:50.113158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:50.113436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:50.114558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:50.116036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:50.117569 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 11/19] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:50.123235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:50.157441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:50.202903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:50.205099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc47172-295a-4d26-a7a1-125d8f3fca48 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:50.222244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8be2e-4ad3-40e0-bef2-9fa86584afc8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:50.239349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:50.239960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:50.240246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:50.240523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:50.241166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:50.241473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:50.242865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa09e3-36b8-4a5d-998f-839da86c5879 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:50.255903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:50.256499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:50.256775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:50.257045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:50.257754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.domain.id=default, user.id=a9bd1fec8f644330ae0ff1570223a1be) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:50.258057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:50.259511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e5655-1c81-4db6-8f86-03cd659d39af None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:50.260168 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 9/20] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:50.266913 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 12/21] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Sep 6 10:27:50 2022] GET /identity/v3/role_assignments?user.id=a9bd1fec8f644330ae0ff1570223a1be&scope.domain.id=default&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:52.622861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc494f56-fe03-4e7a-9671-1950c370d7ef None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:52.624065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc494f56-fe03-4e7a-9671-1950c370d7ef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:52.624574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc494f56-fe03-4e7a-9671-1950c370d7ef None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:52.626112 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 10/22] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:52.631748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8263-98ec-4cbf-9ee1-2ca61dcdab35 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:52.632177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8263-98ec-4cbf-9ee1-2ca61dcdab35 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:52.632352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff8263-98ec-4cbf-9ee1-2ca61dcdab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:52.660084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-daff8263-98ec-4cbf-9ee1-2ca61dcdab35 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:52.661323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-daff8263-98ec-4cbf-9ee1-2ca61dcdab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:52.758473 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:52.953770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97203-1808-4e9e-83ea-da2fd5ffcded None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:52.954086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97203-1808-4e9e-83ea-da2fd5ffcded None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:52.954332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97203-1808-4e9e-83ea-da2fd5ffcded None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:52.955957 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 11/24] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:52.961356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63cd8-336b-490e-ac23-692b966fa20d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:52.961653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63cd8-336b-490e-ac23-692b966fa20d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:52.961938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63cd8-336b-490e-ac23-692b966fa20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:52.987996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0bf63cd8-336b-490e-ac23-692b966fa20d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:52.989194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0bf63cd8-336b-490e-ac23-692b966fa20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:53.082289 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:27:53.209023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb2a5-e775-403c-9279-4195c3c691e9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.209023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb2a5-e775-403c-9279-4195c3c691e9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.209023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb2a5-e775-403c-9279-4195c3c691e9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.209023 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 12/26] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:53.214823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07857ab-c95c-4a3e-909b-9650e5a1e5af None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.215143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07857ab-c95c-4a3e-909b-9650e5a1e5af None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.215993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07857ab-c95c-4a3e-909b-9650e5a1e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.228363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:53.244373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d07857ab-c95c-4a3e-909b-9650e5a1e5af None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:53.249835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d07857ab-c95c-4a3e-909b-9650e5a1e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:53.337668 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 15/27] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:53.403934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb2a5-e775-403c-9279-4195c3c691e9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:53.518298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb3a6-d93f-416b-b1f4-aa9f20b683f5 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.518487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb3a6-d93f-416b-b1f4-aa9f20b683f5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.518708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb3a6-d93f-416b-b1f4-aa9f20b683f5 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.520009 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 16/28] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:27:53.527061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.527061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.527259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.529586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb2a5-e775-403c-9279-4195c3c691e9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:53.544953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:53.563710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:53.564961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:53.581010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:53.581672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.581955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.582251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.627818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:27:53.634492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:27:53.635353 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:27:53.636164 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:27:53.647640 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 13/29] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:27:53.655957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:53.685246 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:53.688258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:53.763373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:53.795712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af706-011b-46bc-b48b-9642b2a87a3c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:53.847485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:53.848471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.848972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.849462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.870211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:53.873684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:53.928194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f561ed-8698-40c7-8581-9acb65aa75d6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:27:53.929852 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:27:53.930685 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:27:53.931500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:27:53.931500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:27:53.931500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:27:53.939136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 18/31] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:27:53.943031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:53.991060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:53.992026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:53.992499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:53.992960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:53.993888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:53.994737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:53.996391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:54.011109 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 14/32] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:54.012225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:54.053005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:54.130404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b68470-1af8-4c37-9d7f-3527a49f3c73 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:54.169616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:54.170566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.171095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.171586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.172455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:54.173223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ababe10-cada-48f6-a1f4-1b629d697571 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:54.174306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:54.190885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:54.208773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:54.209488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.209759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.210077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.210769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:54.211100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:54.212485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:54.230515 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 19/33] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:54.231804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:54.339895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9fe2d-d31c-4e29-8e64-c9539d581616 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:54.378282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:54.378919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.379309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.379589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.380820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:54.382346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:54.384268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 20/34] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:27:54 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:54.385058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:54.443369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:54.453767 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 15/35] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 6 10:27:54 2022] POST /identity/v3/roles => generated 219 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:27:54.454895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:54.521250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025945d-8fac-44f9-9bd6-1fa3408d8389 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:54.565972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:54.566825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.567280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.568343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.569205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:54.570783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:54.647701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:54.658938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab571d-98c8-4921-bad4-51a2c2f63000 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:54.699278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392833-8342-420e-9306-f991e84d38d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:54.700887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392833-8342-420e-9306-f991e84d38d4 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.701175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392833-8342-420e-9306-f991e84d38d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.701454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392833-8342-420e-9306-f991e84d38d4 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.702367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20392833-8342-420e-9306-f991e84d38d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:54.704120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20392833-8342-420e-9306-f991e84d38d4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:54.775445 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 21/36] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 6 10:27:54 2022] POST /identity/v3/roles => generated 225 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:27:54.776425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:54.804876 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 16/37] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:27:54 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:27:54.807660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80385-efd8-4761-801e-e12ee099cbce None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.807966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80385-efd8-4761-801e-e12ee099cbce None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.808284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80385-efd8-4761-801e-e12ee099cbce None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.811549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 17/38] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:54.811549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9d01f-b4dc-4626-913d-cf67ac7b5528 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.811772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9d01f-b4dc-4626-913d-cf67ac7b5528 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.811967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9d01f-b4dc-4626-913d-cf67ac7b5528 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.815133 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 18/39] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:54.818036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13382741-504c-4eec-80e5-32eb89dc1380 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.818330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13382741-504c-4eec-80e5-32eb89dc1380 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.818607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13382741-504c-4eec-80e5-32eb89dc1380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.845508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-13382741-504c-4eec-80e5-32eb89dc1380 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:54.848262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13382741-504c-4eec-80e5-32eb89dc1380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:54.941719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:27:54.943862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:54.944447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:54.944925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:54.945811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8b3f5-0596-4879-a631-8b61508f5aea None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:54.948810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:54.976567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:54.978184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:54.990811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:55.000801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:55.000801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:55.000801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:55.000801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:55.000801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:55.000801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 22/41] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:55.003651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:55.066559 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:55.120782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758f98f-00e2-4921-b244-aa3910fcbc86 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:55.159437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:55.160087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:55.160377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:55.160664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] PATH_INFO: `/v3/domains/default/users/a9bd1fec8f644330ae0ff1570223a1be/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:55.162845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a9bd1fec8f644330ae0ff1570223a1be, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:55.164402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:55.269744 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Sep 6 10:27:55 2022] PUT /identity/v3/domains/default/users/a9bd1fec8f644330ae0ff1570223a1be/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:27:55.311079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:55.320278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:55.408190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:55.427800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037b2f3-e242-4f39-8fe2-204e4216470f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:55.446964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:55.472940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bc6bb-cc72-4117-9489-7f7e7ede9b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:55.473562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc6bb-cc72-4117-9489-7f7e7ede9b3d None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:55.473849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc6bb-cc72-4117-9489-7f7e7ede9b3d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:55.474128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc6bb-cc72-4117-9489-7f7e7ede9b3d None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:55.474808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bc6bb-cc72-4117-9489-7f7e7ede9b3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:55.476303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bc6bb-cc72-4117-9489-7f7e7ede9b3d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:55.520285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a08cb-6dee-4bb8-b652-f947c23ecfef None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:55.553510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:55.554138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:55.554426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:55.554703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:55.555836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:55.557286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:55.559606 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 24/44] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:55.564964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:55.567348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 21/45] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 6 10:27:55 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:27:55.676872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:55.680745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f7f9d-35b6-48d0-9f23-ea58656d90ae None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:55.719680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de04e1-bdc4-4d6f-a59e-42a903fc95c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:55.720302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de04e1-bdc4-4d6f-a59e-42a903fc95c4 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:55.720584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de04e1-bdc4-4d6f-a59e-42a903fc95c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:55.720859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de04e1-bdc4-4d6f-a59e-42a903fc95c4 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:55.721517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de04e1-bdc4-4d6f-a59e-42a903fc95c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:55.723002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de04e1-bdc4-4d6f-a59e-42a903fc95c4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:55.810863 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:27:55 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:27:57.443925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534495-1885-4107-9e9f-528c83b4447a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:57.444441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534495-1885-4107-9e9f-528c83b4447a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:57.444528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c534495-1885-4107-9e9f-528c83b4447a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:57.445822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 22/47] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:27:57.451202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ab3c9-0c8d-4d79-bbf7-06aaa62652f9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:57.451594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ab3c9-0c8d-4d79-bbf7-06aaa62652f9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:57.451759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ab3c9-0c8d-4d79-bbf7-06aaa62652f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:57.470323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cd2ab3c9-0c8d-4d79-bbf7-06aaa62652f9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:57.471873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd2ab3c9-0c8d-4d79-bbf7-06aaa62652f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:57.538843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:57.868365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c534495-1885-4107-9e9f-528c83b4447a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:57.937922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:57.972182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5984-9f38-4391-8067-6c32fc451bb9 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:57.972570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5984-9f38-4391-8067-6c32fc451bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:57.972917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5984-9f38-4391-8067-6c32fc451bb9 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:57.974288 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 27/49] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:27:57.976025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c534495-1885-4107-9e9f-528c83b4447a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:57.979630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:57.979916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:57.980193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:57.998380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:27:57.999592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:27:58.011686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.012838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.013123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.013395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.023356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:27:58.029179 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:27:58.030007 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:27:58.030748 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 23/50] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:27:58.035950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:58.069110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 28/51] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:27:58.134171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a804c-6f32-4656-aff2-3713ae88d099 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:58.159592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:58.168086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.168696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.168982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.169289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.169956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:58.170343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:58.171714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:58.180201 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 24/52] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:58.186249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:58.201154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:58.283001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890ec5e-eb70-437e-a699-5680b59c8c78 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:58.315441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.316062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.316346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.316621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.317730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:58.319248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:58.320848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 29/53] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:27:58 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:58.326759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:58.397397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:58.432543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c882-1c70-4673-aaf2-6e7c34eea0f8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:58.466551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.467212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.467499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.467778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.468907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:58.470351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:58.471939 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 25/54] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:27:58.477694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:58.484817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:58.503875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7754f7-d72b-4f4c-b462-1abf32cfe130 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:58.533296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:58.537949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.538578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.538870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.539237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.540352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:58.541809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:58.544042 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 30/55] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:58.550443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:27:58.579517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e35ee6-37a9-4f17-b940-a884ab3be03d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:58.613699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.614240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.614524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.614810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.615578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.domain.id=default, user.id=a9bd1fec8f644330ae0ff1570223a1be) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:27:58.615889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:58.617332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60222fd4-b5e2-4398-95b8-9890e08a4e44 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:58.626419 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 26/56] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Sep 6 10:27:58 2022] GET /identity/v3/role_assignments?user.id=a9bd1fec8f644330ae0ff1570223a1be&scope.domain.id=default&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:27:58.650619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444f4e2-ad5a-4bdf-842b-c1af6f11ae2a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:27:58.687437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310aec7-be7f-4643-aee1-3614416b954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:27:58.688069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310aec7-be7f-4643-aee1-3614416b954a None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:27:58.688355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310aec7-be7f-4643-aee1-3614416b954a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:27:58.688632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310aec7-be7f-4643-aee1-3614416b954a None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:27:58.689301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310aec7-be7f-4643-aee1-3614416b954a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:27:58.690814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310aec7-be7f-4643-aee1-3614416b954a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:27:58.762273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:27:58.768394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 31/57] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Sep 6 10:27:58 2022] POST /identity/v3/projects => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:28:00.954883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263b1b-d238-44eb-a764-2141e3c4dfd5 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:00.955382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263b1b-d238-44eb-a764-2141e3c4dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:00.955478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263b1b-d238-44eb-a764-2141e3c4dfd5 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:00.956809 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 27/58] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:00.961889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:00.962251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:00.962446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:00.980865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:00.982043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:01.048742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:01.379556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263b1b-d238-44eb-a764-2141e3c4dfd5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:01.479291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263b1b-d238-44eb-a764-2141e3c4dfd5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:01.498370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:01.512080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b339e2-2612-422c-9660-fe57c4c192cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:01.512702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b339e2-2612-422c-9660-fe57c4c192cd None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:01.512991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b339e2-2612-422c-9660-fe57c4c192cd None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:01.519158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b339e2-2612-422c-9660-fe57c4c192cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:01.519158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b339e2-2612-422c-9660-fe57c4c192cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:01.519158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b339e2-2612-422c-9660-fe57c4c192cd None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:01.519158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 28/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:01.523062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:01.619539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c939f9-d0cb-4148-bb21-1c8dbb7e11b6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:01.647934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:01.653929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f552c-64f7-4d30-afda-a7c2366524e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:01.654527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f552c-64f7-4d30-afda-a7c2366524e3 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:01.654811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f552c-64f7-4d30-afda-a7c2366524e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:01.655126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f552c-64f7-4d30-afda-a7c2366524e3 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:01.656563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f552c-64f7-4d30-afda-a7c2366524e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:01.657219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f552c-64f7-4d30-afda-a7c2366524e3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:01.759160 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 33/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:01 2022] POST /identity/v3/users => generated 275 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:04.918636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5312-d9fb-40b2-b137-57467ee53a27 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:04.919109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5312-d9fb-40b2-b137-57467ee53a27 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:04.920595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5312-d9fb-40b2-b137-57467ee53a27 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:04.920595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 29/62] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:04.926263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073f11-4c65-4f19-941c-e5acaf370671 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:04.927057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073f11-4c65-4f19-941c-e5acaf370671 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:04.927490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073f11-4c65-4f19-941c-e5acaf370671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:04.952002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-56073f11-4c65-4f19-941c-e5acaf370671 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:04.953206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56073f11-4c65-4f19-941c-e5acaf370671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:05.037581 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 34/63] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:05.313960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea08d-6085-4c20-b073-500ee1d00dbf None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.314252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea08d-6085-4c20-b073-500ee1d00dbf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.314782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea08d-6085-4c20-b073-500ee1d00dbf None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.316358 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 30/64] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:05.321880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.322265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.322551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.345174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:05.346387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:05.361159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7703e5-66f3-48ad-9e4b-1e7faac779c8 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.361791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7703e5-66f3-48ad-9e4b-1e7faac779c8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.362272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7703e5-66f3-48ad-9e4b-1e7faac779c8 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.363871 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 31/65] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:05.384837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.385437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.385945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.418831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:05.420600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:05.454913 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:05.523373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:05.545034 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 32/67] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:05.602062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:05.680866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a08942-05bb-4688-845a-f76484ef1b85 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:05.730476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec830e-aa78-4083-80e6-2d6fc3903ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:05.731181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec830e-aa78-4083-80e6-2d6fc3903ed0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.731470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec830e-aa78-4083-80e6-2d6fc3903ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.731747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec830e-aa78-4083-80e6-2d6fc3903ed0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.752068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec830e-aa78-4083-80e6-2d6fc3903ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-85ec830e-aa78-4083-80e6-2d6fc3903ed0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:05.757041 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:05.757905 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:05.759121 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 36/68] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:28:05.768733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:05.852997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cacda-59be-4f23-bf27-f110fe5307cd None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.853284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cacda-59be-4f23-bf27-f110fe5307cd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.853472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cacda-59be-4f23-bf27-f110fe5307cd None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.854827 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 37/69] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:05.866990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f777-e89f-4faf-9abc-91a6f4e1410c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.867303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f777-e89f-4faf-9abc-91a6f4e1410c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.867584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479f777-e89f-4faf-9abc-91a6f4e1410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.911220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d2287-3e4f-4cf9-a90a-58fcd81f9995 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:05.916023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3479f777-e89f-4faf-9abc-91a6f4e1410c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:05.917997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3479f777-e89f-4faf-9abc-91a6f4e1410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:05.931100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:05.952211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:05.953193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.953937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.954678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.955550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:05.956005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:05.957682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:05.968196 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 33/70] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:05.969019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:05.991546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 38/71] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:05.997034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844cdc-3835-47c7-8d76-f918d019ed72 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:05.997331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844cdc-3835-47c7-8d76-f918d019ed72 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:05.997614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844cdc-3835-47c7-8d76-f918d019ed72 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:05.998904 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 39/72] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:06.003053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844cdc-3835-47c7-8d76-f918d019ed72 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.038315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.085428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e08ce-ccc3-46c5-8ef2-f0d54835c78d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.109722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844cdc-3835-47c7-8d76-f918d019ed72 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.123346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.124360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.124792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.125212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.136047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:06.141659 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:06.142631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:06.143415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:06.145294 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 34/73] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:06.146226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.152337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c819476-3c80-4b10-90f4-99b586241184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.153403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819476-3c80-4b10-90f4-99b586241184 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.153858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819476-3c80-4b10-90f4-99b586241184 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.154355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c819476-3c80-4b10-90f4-99b586241184 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.168806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c819476-3c80-4b10-90f4-99b586241184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-5c819476-3c80-4b10-90f4-99b586241184 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:06.173765 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:06.174601 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:06.175728 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 40/74] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:06.176341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.176403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.176714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.195929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:06.197206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:06.201758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.262394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfe7d7-74a2-497e-8145-4e318f45b9ba None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.275200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 41/75] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:06.275200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.297777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.314215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.315257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.315549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.316048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.335862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.337351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.339047 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 35/76] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:06.343943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.375076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edabbf9-ec4b-41c8-be54-524d8f6b56c8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.409915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.410520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.410801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.411106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.418103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:06.418103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.418103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.422438 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 42/77] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:06.427791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.449530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.453843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1fb37-39c0-4254-b721-31408a78d232 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.491285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.491905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.492185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.492464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.493133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:06.493441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.494875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.503723 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 36/78] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:06.504291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.535074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.550265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04947f9-bba4-4ad7-aca8-cc454f73a26f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.588317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.588955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.589769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.590047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.591192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.593184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.595620 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 43/79] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:06.599888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.621651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c199e9-9c01-4fc8-bf0a-1097f6732a45 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.655563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.656109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.656397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.656674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.685246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.700042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e43db-f5f7-4f79-89d2-32b1a1ac8d99 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.724426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.725888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.734776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.735451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.735739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.736021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.737153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.738611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.744862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 44/80] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:06.744862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.767515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.826760 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 37/81] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:06.827617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.844761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b4f1-bbcc-4828-a3f0-ac3e6a7c0415 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.879354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.880021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.880387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.880572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.881765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.883272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.884851 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 45/82] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:06.885906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.887269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:06.927638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137322-8058-4d47-bd93-2ef762fa847a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:06.960804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:06.961390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:06.961680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:06.961976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:06.962614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:06.964098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:06.978291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:06.986989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7987c56-16ba-41da-902a-dd55cb097286 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.019545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.020168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.020450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.020726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.031130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:07.035956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:07.036941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:07.037715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 46/83] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:07.038941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.073345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 38/84] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:06 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:07.073345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.150959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3344e-412f-45e5-8f09-3477997ca385 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.182512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e39e8-0f7d-4a2e-8c90-ba82857f8ac9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.187504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.188135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.188421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.188696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.205937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:07.218278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:07.225541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.226197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.226487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.226767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.227996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.229527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.236689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 39/85] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:07.236689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.283825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.285568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.358162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2d984-48b6-4b6c-811f-4aabb9204af7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.397987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.398330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.398609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.398885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.410185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 47/86] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:07.411830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.475645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:07.487406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:07.491568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.493092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.537034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369f349-9568-449e-bf28-7cfa17cb78c9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.576686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.577304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.577591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.577868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.578537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:07.578842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.580278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.589153 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 48/87] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:07.594991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.615253 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 40/88] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:07.616136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.708745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:07.720015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb8af6-a662-4630-b974-5c5495f49627 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.727114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03105-1f7e-40f7-b851-5b8f9090b057 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.735068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:07.755655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.756428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.756779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.757122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.757917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=81a0409391cd41d29788abb688691db1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:07.758321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.759947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.766545 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 49/89] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/role_assignments?user.id=81a0409391cd41d29788abb688691db1&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:07.767246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.767378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.768130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.768424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.768705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.769852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.771409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.773215 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 41/90] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:07.774111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:07.935502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09138-00cf-4881-a7d7-d7f2cc073537 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.941371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc893c21-a42a-4110-a0a6-5f1da100c2da None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:07.976448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:07.977720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:07.977956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:07.978290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:07.980107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:07.982220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:07.988411 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 50/91] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:07.989042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:08.023975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:08.025312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:08.025804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:08.026272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:08.028544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:08.030886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:08.031883 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 42/92] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:08.033486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:08.071067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:08.078119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:08.188991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72292f00-659c-49c1-b869-a3a76fd53bd5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:08.209375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866cc06-2d00-44e0-86c9-7025320cf61c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:08.259037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:08.259956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:08.260421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:08.260877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:08.261823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=a9bd1fec8f644330ae0ff1570223a1be) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:08.262316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:08.263974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:08.272161 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 51/93] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:07 2022] GET /identity/v3/role_assignments?user.id=a9bd1fec8f644330ae0ff1570223a1be&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:08.273607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:08.274428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:08.274896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:08.275425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:08.275936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:08.400498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:08.402519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:08.451048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1d60-bafa-4bd5-8f09-58f8bbcf429a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:08.466909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:08.473754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:08.515140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:08.515140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:08.515140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:08.515140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:08.527114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] RBAC: Adding query filter params (role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=81a0409391cd41d29788abb688691db1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:08.527114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:08.543297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:08.562226 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 52/94] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:08 2022] GET /identity/v3/role_assignments?user.id=81a0409391cd41d29788abb688691db1&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:08.679173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 43/95] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:08.688212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:08.858631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969610f-0cb1-40da-8047-33c2a80d8563 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:08.893473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7402-5afe-4b49-ae62-3dc47360bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:08.894445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7402-5afe-4b49-ae62-3dc47360bc8d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:08.894959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7402-5afe-4b49-ae62-3dc47360bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:08.895487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7402-5afe-4b49-ae62-3dc47360bc8d None admin] PATH_INFO: `/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:08.896881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b7402-5afe-4b49-ae62-3dc47360bc8d None admin] RBAC: Authorizing `identity:get_project(project_id=9fef1bb13e574fbbaa5907a8fd7af2e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:08.898577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b7402-5afe-4b49-ae62-3dc47360bc8d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:08.900779 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 53/96] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:08 2022] GET /identity/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:08.909688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:09.036285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88183-9831-46a7-acda-e62b4e71751a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:09.057687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:09.072152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:09.072785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:09.073066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:09.073344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:09.074597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=9fef1bb13e574fbbaa5907a8fd7af2e1, user.id=81a0409391cd41d29788abb688691db1) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:09.074904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:09.076394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88bb57-e927-4367-b3cb-00ec49426b64 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:09.082004 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 44/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:08 2022] GET /identity/v3/role_assignments?user.id=81a0409391cd41d29788abb688691db1&scope.project.id=9fef1bb13e574fbbaa5907a8fd7af2e1&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:10.009829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd338cb4-ea5a-4812-a1bd-616d023fdbbc None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:10.010678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd338cb4-ea5a-4812-a1bd-616d023fdbbc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:10.011169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd338cb4-ea5a-4812-a1bd-616d023fdbbc None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:10.012958 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 54/98] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:10.017977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:10.018384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:10.018774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:10.046656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:10.048819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10d4b-f6ea-4e83-9b7d-1475437d1b03 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:10.050222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:10.050664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10d4b-f6ea-4e83-9b7d-1475437d1b03 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:10.051114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10d4b-f6ea-4e83-9b7d-1475437d1b03 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:10.052591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 55/99] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:10.060814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8856-50c9-4984-9be9-54ba5cd5992c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:10.062027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8856-50c9-4984-9be9-54ba5cd5992c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:10.062716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8856-50c9-4984-9be9-54ba5cd5992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:10.100959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-614f8856-50c9-4984-9be9-54ba5cd5992c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:10.102146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-614f8856-50c9-4984-9be9-54ba5cd5992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:10.178307 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 45/100] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:10.184765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:10.227728 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 56/101] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:10.735233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:10.745636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ba5f-85e8-4830-8abc-ae9f068a5361 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:10.747937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ba5f-85e8-4830-8abc-ae9f068a5361 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:10.749563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ba5f-85e8-4830-8abc-ae9f068a5361 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:10.751090 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 57/102] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:10.757925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:10.758382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:10.759677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:10.802532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:10.803788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:10.919241 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 58/103] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:10.919938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:10.934174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b380-dd78-4f3f-93eb-3f5e7c23a600 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:10.961993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:11.000476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.001454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.001882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.002302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.025240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8461-dd43-40d4-9b57-b02d71164ff6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.026754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:11.027549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:11.039863 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:11.041046 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:11.042005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:11.044347 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 46/104] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:11.049770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:11.068493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.069137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.069431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.069718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.072576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:11.074595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:11.076204 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 59/105] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:11.082668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:11.255427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c760b-22ef-482f-a285-739459a3d198 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.260790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a00c9-f99b-4d6a-aa07-6cf4ad98aea4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.297077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.298071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.298553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.298997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.299822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:11.301423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:11.318336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.318966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.319430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.319794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.320413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:11.320730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:11.322135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:11.330451 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 47/106] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:11.336012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:11.395846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:11.407071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 60/107] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:28:11 2022] POST /identity/v3/projects => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:11.408395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:11.441359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:11.501361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b396a-d525-465c-b67e-f1addee567ad None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.588056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.588722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.589554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.589828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] PATH_INFO: `/v3/users/e5f60dab9dea4895ba08b8a833e36fbb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.605563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f3e1-34ed-4ebc-8ce5-2aa3d7932f81 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.630063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] RBAC: Authorizing `identity:get_user(user_id=e5f60dab9dea4895ba08b8a833e36fbb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:11.631660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:11.633570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 48/108] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:11 2022] GET /identity/v3/users/e5f60dab9dea4895ba08b8a833e36fbb => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:11.643856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:11.693867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.694514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.694786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.695089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.718401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:11.724258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:11.725121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:11.725868 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:11.726450 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 61/109] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:11.733874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:11.829278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:11.837376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c415f-e70e-4941-95d9-8ee4ccf9d41a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.876554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.877152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.877435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.877706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.878264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3a7ff-ccc1-478c-a04c-217c79d14be8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:11.883856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:11.955806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:11.956874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.957402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.957883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.958770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:11.959314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:11.961057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7ba7-060f-4abc-8854-e4129b2ace01 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:11.973004 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 62/110] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:11.974559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25120f52-edd0-4abb-b2a4-9b24f5edbd51 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.979214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25120f52-edd0-4abb-b2a4-9b24f5edbd51 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.979943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25120f52-edd0-4abb-b2a4-9b24f5edbd51 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.981594 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 63/111] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:11.987730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:11.988365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:11.988864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:11.999200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:12.002258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:12.027360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:12.031953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:12.184455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 64/112] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:12.185271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.201908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:12.229569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 49/113] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:12.236063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.286744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:12.320945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6876-0102-4cb3-9c24-0bc6a877efb6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:12.365078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602a3a-8fb4-4fb7-8c61-108c5e481567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:12.366528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602a3a-8fb4-4fb7-8c61-108c5e481567 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.366976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602a3a-8fb4-4fb7-8c61-108c5e481567 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.367423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602a3a-8fb4-4fb7-8c61-108c5e481567 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.369168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6602a3a-8fb4-4fb7-8c61-108c5e481567 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:12.371765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6602a3a-8fb4-4fb7-8c61-108c5e481567 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:12.374088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 65/114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:12 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:12.375280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d2a49-c49a-427f-9309-75fc712e0e34 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:12.375783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3404-5417-4c24-9e95-fe3dbf8b74fb None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.376211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3404-5417-4c24-9e95-fe3dbf8b74fb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.376631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3404-5417-4c24-9e95-fe3dbf8b74fb None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.383201 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 66/115] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:12.384963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48dbd-e113-4c52-8c90-a1a03fa6e451 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.385399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48dbd-e113-4c52-8c90-a1a03fa6e451 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.386751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48dbd-e113-4c52-8c90-a1a03fa6e451 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.392771 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 67/116] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:12.392771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48dbd-e113-4c52-8c90-a1a03fa6e451 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.417157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8725695-f414-49ad-8914-d117aeab484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:12.417859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8725695-f414-49ad-8914-d117aeab484b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.418281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8725695-f414-49ad-8914-d117aeab484b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.418448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8725695-f414-49ad-8914-d117aeab484b None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.419582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8725695-f414-49ad-8914-d117aeab484b None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:12.421107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8725695-f414-49ad-8914-d117aeab484b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:12.423118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 50/117] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:12 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:12.424501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d436-7f79-438b-a7b2-fa58ac28d109 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.424847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d436-7f79-438b-a7b2-fa58ac28d109 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.425279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0d436-7f79-438b-a7b2-fa58ac28d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.444638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c2b0d436-7f79-438b-a7b2-fa58ac28d109 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:12.445965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c2b0d436-7f79-438b-a7b2-fa58ac28d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:12.515493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:12.523764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48dbd-e113-4c52-8c90-a1a03fa6e451 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:12.535045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 51/118] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:12.535045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.535045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.535045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.559832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:12.561329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:12.569673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:12.570362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.570644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.570917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.572216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:12.574305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:12.589468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 68/119] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:12 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:12.589468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.594703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:12.659745 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 52/120] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:12.660683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.695713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84166d0c-b8d9-4cc3-9e28-1fe13cb3bf2a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:12.748341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:12.749006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.749298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.749581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.750308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] RBAC: Adding query filter params (role.id=9bcc153a83184ffc9c91cf100a6dbab2, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=e5f60dab9dea4895ba08b8a833e36fbb) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:12.750627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:12.752929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:12.764752 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 69/121] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:12 2022] GET /identity/v3/role_assignments?user.id=e5f60dab9dea4895ba08b8a833e36fbb&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=9bcc153a83184ffc9c91cf100a6dbab2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:12.765351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.829636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e878d7-8955-440a-894a-19cad42fa25c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:12.873164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:12.899063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:12.899736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:12.900081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:12.900365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:12.916049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:12.931880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:12.937821 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:12.938721 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:12.939517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 53/122] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:12.953058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:12.984825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051e6e6-d089-4941-885f-7856c2c8e98f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.029924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.031325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.031612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.031893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352/users/81a0409391cd41d29788abb688691db1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.038088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bef669158b14670adfd7ad3888a7352, user_id=81a0409391cd41d29788abb688691db1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:13.039659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:13.123311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 70/123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:12 2022] PUT /identity/v3/projects/3bef669158b14670adfd7ad3888a7352/users/81a0409391cd41d29788abb688691db1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:13.124391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.129017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a74b-0601-4656-8e8b-398cf62ecf6f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.172204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.172878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.173566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.173909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.174606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:13.174912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:13.176445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:13.191691 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 54/124] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:13.193132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.254896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:13.348023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f55b2-73d2-4d67-a2e8-3e73db808210 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.389298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.389944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.390220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.390496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.392348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eb2e7-dab4-4f06-aa12-bf21ce703e2d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.395622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:13.403518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:13.408406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:13.414379 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 71/125] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:13.415178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.430341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.430972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.431292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.431571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.442969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:13.448775 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:13.449713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:13.450489 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 55/126] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:13.451185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.518186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc341af3-bb5a-458d-ae45-9bdb39b5bf41 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.552987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.553625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.553910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.554190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.555384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:13.556848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:13.558443 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 72/127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:13.563294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.563685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e1afe-14e6-49c5-8bf1-4036a7523f59 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.566672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:13.602736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.603542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.603932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.604219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.605042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:13.605351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:13.606860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:13.617176 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 56/128] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:13.618302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.640600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:13.704630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f2fe-03ec-4424-936a-00b9c792ef1f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.723329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44482f40-861b-4576-809e-f2a7bfac7386 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:13.760509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.761668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.761948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.762218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.763429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:13.764930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:13.766585 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 57/129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:13.767394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.772410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:13.772977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:13.775121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:13.775405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:13.776069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:13.781436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:13.782976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:13.802821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 73/130] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:13.803680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:13.843374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:13.966078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88358d5-80c1-4543-9700-9d62f9a3074c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.011594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.012197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e151f-11e6-4dc2-b4a3-9cbde966cbd7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.012335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.012513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.012765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.013981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.015688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.019803 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 58/131] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:13 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:14.019803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:14.060144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:14.085723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.086791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.087303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.087803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352/users/a9bd1fec8f644330ae0ff1570223a1be/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.092722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bef669158b14670adfd7ad3888a7352, user_id=a9bd1fec8f644330ae0ff1570223a1be, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.094686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.127800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c99451-46fd-4195-a217-bf4c91318e96 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.129339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:14.163567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.164270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.164552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.164827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.166086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.168155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.170151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 59/132] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:14 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:14.170972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:14.253749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 74/133] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:13 2022] PUT /identity/v3/projects/3bef669158b14670adfd7ad3888a7352/users/a9bd1fec8f644330ae0ff1570223a1be/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:14.256960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:14.285768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ac227-fcbf-4736-9f49-e101607f9d8e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.324437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.325050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.325339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.325617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.326990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.328855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.331390 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 60/134] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:14 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:14.341174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:14.392297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:14.460868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e7cd9-f763-445c-b27a-c1c5e9e1f879 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.477636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c0478-3573-41d8-918f-115f8f11d1e8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.498175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.498937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.499253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.499535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352/users/81a0409391cd41d29788abb688691db1/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.502009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bef669158b14670adfd7ad3888a7352, user_id=81a0409391cd41d29788abb688691db1, role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.503728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.540390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3c920-8174-403f-9757-1932ef82942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.541055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3c920-8174-403f-9757-1932ef82942a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.541338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3c920-8174-403f-9757-1932ef82942a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.541613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3c920-8174-403f-9757-1932ef82942a None admin] PATH_INFO: `/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.543799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3c920-8174-403f-9757-1932ef82942a None admin] RBAC: Authorizing `identity:get_project(project_id=9fef1bb13e574fbbaa5907a8fd7af2e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.544821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3c920-8174-403f-9757-1932ef82942a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.546625 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 75/135] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:14 2022] GET /identity/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:14.547639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26106-a940-4cdd-a2c0-3c2278aec428 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.547932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26106-a940-4cdd-a2c0-3c2278aec428 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.548206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26106-a940-4cdd-a2c0-3c2278aec428 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.549458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 76/136] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:14.555087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.563963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.563963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.574160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:14.575439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:14.622198 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 61/137] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:14 2022] PUT /identity/v3/projects/3bef669158b14670adfd7ad3888a7352/users/81a0409391cd41d29788abb688691db1/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:14.623099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:14.659436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:14.672599 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 77/138] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:14.769199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:14.780180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f941-4f6c-4be7-a555-c8a4312c9c66 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:14.817947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:14.818641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:14.818916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:14.819217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] PATH_INFO: `/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1/users/81a0409391cd41d29788abb688691db1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:14.821248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] RBAC: Authorizing `identity:create_grant(project_id=9fef1bb13e574fbbaa5907a8fd7af2e1, user_id=81a0409391cd41d29788abb688691db1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:14.822772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:14.932237 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 62/139] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:14 2022] PUT /identity/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1/users/81a0409391cd41d29788abb688691db1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:15.142590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:15.279215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f371dd-c893-49f9-aff9-b8d44ab2f26a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:15.320241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962050-86f6-47fb-84f0-305277ee62db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:15.321245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962050-86f6-47fb-84f0-305277ee62db None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:15.321718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962050-86f6-47fb-84f0-305277ee62db None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:15.322258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962050-86f6-47fb-84f0-305277ee62db None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:15.324284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962050-86f6-47fb-84f0-305277ee62db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:15.325944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962050-86f6-47fb-84f0-305277ee62db None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:15.327733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 78/140] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:15.333337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:15.460864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead552c-e0db-4527-891a-653ed5c2ff7f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:15.500293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee86070-c280-4c1d-a659-8cf601c3b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:15.500919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee86070-c280-4c1d-a659-8cf601c3b3d5 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:15.501206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee86070-c280-4c1d-a659-8cf601c3b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:15.501484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee86070-c280-4c1d-a659-8cf601c3b3d5 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:15.502150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee86070-c280-4c1d-a659-8cf601c3b3d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:15.503655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee86070-c280-4c1d-a659-8cf601c3b3d5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:15.634098 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 63/141] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:15 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:15.757246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e710f8-e9ab-49b0-b90f-f7db55d708bf None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:15.757885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e710f8-e9ab-49b0-b90f-f7db55d708bf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:15.758360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e710f8-e9ab-49b0-b90f-f7db55d708bf None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:15.760034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 79/142] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:15.771075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46ffb7-ec39-4240-b422-d9ab6b81992f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:15.771788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46ffb7-ec39-4240-b422-d9ab6b81992f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:15.772277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46ffb7-ec39-4240-b422-d9ab6b81992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:15.800585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bf46ffb7-ec39-4240-b422-d9ab6b81992f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:15.802307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bf46ffb7-ec39-4240-b422-d9ab6b81992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:15.814497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:15.900977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 64/143] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:16.144819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed04db-9c76-483b-80e3-54c512a07879 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:16.145315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed04db-9c76-483b-80e3-54c512a07879 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:16.145387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed04db-9c76-483b-80e3-54c512a07879 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:16.146805 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 80/144] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:16.152809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:16.153380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:16.153846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:16.174386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:16.175915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:16.257404 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 65/145] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:16.564491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed04db-9c76-483b-80e3-54c512a07879 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:16.630585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:16.691559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed04db-9c76-483b-80e3-54c512a07879 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:16.731977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:16.732618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:16.732897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:16.733427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:16.744241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:16.749205 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:16.750036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:16.751226 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 81/146] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:16.756833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:16.781441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:16.874872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:16.893038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916ddb-885e-4498-b930-0e14949e2d25 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:16.906555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2da56-a6ff-49de-abd0-8319b2e42043 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:16.909833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:16.934367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:16.935085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:16.935288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:16.935561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:16.946587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:16.952442 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:16.953323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:16.954064 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 82/147] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:28:16.959268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:16.960092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:16.960929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:16.961352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:16.961811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:16.962746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:16.964435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:16.965998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:16.979154 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 66/148] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:16.998015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.075310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d08b49-c554-4a60-b796-13851cb22984 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.112180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.116464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.116464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.116464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.116464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:17.116464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.116464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.126057 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 83/149] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:17.131903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.172481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:17.225250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7c7dd-b821-4204-a805-cd993daeea09 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.243823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb872-052f-4ff7-913d-c039f648b0aa None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.279919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.280557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.280837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.281430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.282612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.284281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.285891 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 84/150] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:17 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:17.291404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.324496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.325162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.325452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.325733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] PATH_INFO: `/v3/users/e5f60dab9dea4895ba08b8a833e36fbb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.326898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] RBAC: Authorizing `identity:get_user(user_id=e5f60dab9dea4895ba08b8a833e36fbb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.328454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.330045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 67/151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:16 2022] GET /identity/v3/users/e5f60dab9dea4895ba08b8a833e36fbb => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:17.352098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.358578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:17.404732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab582e1-594a-4730-8e5e-407fa7cd3c19 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.407594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:17.441008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.441616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.441895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.442167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.499974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc491a0-49e2-47ca-8fc6-17898a9aefd9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.516467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.517971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.537746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.538395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.538683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.538965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.540160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.542190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.544214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 68/152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:17 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:17.550624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.640157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:17.649296 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 85/153] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:28:17.650063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:17.661641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.685174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a96ed-59db-4815-87ae-fdd69cc41f94 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.734156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f7347-83ed-4abd-8938-9608b36ec16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.734830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7347-83ed-4abd-8938-9608b36ec16f None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.735415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7347-83ed-4abd-8938-9608b36ec16f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.735758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7347-83ed-4abd-8938-9608b36ec16f None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352/users/e5f60dab9dea4895ba08b8a833e36fbb/roles/9bcc153a83184ffc9c91cf100a6dbab2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.737744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f7347-83ed-4abd-8938-9608b36ec16f None admin] RBAC: Authorizing `identity:create_grant(project_id=3bef669158b14670adfd7ad3888a7352, user_id=e5f60dab9dea4895ba08b8a833e36fbb, role_id=9bcc153a83184ffc9c91cf100a6dbab2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.739257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f7347-83ed-4abd-8938-9608b36ec16f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.765495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969861e1-675c-4613-a808-72382e9d6116 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.804016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.804925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.805294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.805555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.806971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.808536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:17.810203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 86/154] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:17 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:17.816251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:17.853435 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 69/155] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:17 2022] PUT /identity/v3/projects/3bef669158b14670adfd7ad3888a7352/users/e5f60dab9dea4895ba08b8a833e36fbb/roles/9bcc153a83184ffc9c91cf100a6dbab2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:17.919457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:17.957142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8660102-03b9-451a-8d15-cdc6aff560f5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:17.995359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:17.995555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535030a-2822-4b91-9562-f06a427b3d0d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.995657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535030a-2822-4b91-9562-f06a427b3d0d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.995949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535030a-2822-4b91-9562-f06a427b3d0d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.996050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:17.996289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:17.996596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:17.997432 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 70/156] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:17.997531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=81a0409391cd41d29788abb688691db1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:17.997657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:17.999204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae3a8-8c4c-4758-b8ff-327230f61306 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:18.006085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 87/157] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:17 2022] GET /identity/v3/role_assignments?user.id=81a0409391cd41d29788abb688691db1&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:18.012584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e03b93-c184-45ab-b8ce-318b8b2a671b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:18.012891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e03b93-c184-45ab-b8ce-318b8b2a671b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:18.013243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e03b93-c184-45ab-b8ce-318b8b2a671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:18.047522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b4e03b93-c184-45ab-b8ce-318b8b2a671b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:18.048753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b4e03b93-c184-45ab-b8ce-318b8b2a671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:18.152341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 71/158] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:18.228288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2566-0916-46e7-89d5-52b07f846581 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:18.228779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2566-0916-46e7-89d5-52b07f846581 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:18.228861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2566-0916-46e7-89d5-52b07f846581 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:18.230630 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 88/159] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:18.236217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:18.236504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:18.236782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:18.261365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:18.262597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:18.325724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:18.336805 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 72/160] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:18.596184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2566-0916-46e7-89d5-52b07f846581 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:18.805273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2566-0916-46e7-89d5-52b07f846581 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:18.847661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:18.851645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:18.852210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:18.852750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:18.853024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:18.866192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:18.871768 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:18.872700 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:18.873481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 89/161] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:18.884125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:19.027250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4f6f-69ef-4a62-a995-edeef7e34e57 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:19.040790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:19.079378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:19.080343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.080844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.081319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.082310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:19.082857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:19.087213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:19.103389 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 73/162] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:19.110565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:19.230266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:19.244799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ca4f7-34cd-4716-a1af-35cf16c13ca3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:19.312992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9e11-8f16-40d9-90c1-6add9793b506 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:19.324628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b4af3-1713-414a-ba7d-8211688c0890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:19.325268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4af3-1713-414a-ba7d-8211688c0890 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.325539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4af3-1713-414a-ba7d-8211688c0890 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.325813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4af3-1713-414a-ba7d-8211688c0890 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.346199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b4af3-1713-414a-ba7d-8211688c0890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d18b4af3-1713-414a-ba7d-8211688c0890 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:19.351030 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:19.351876 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:19.352675 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:19.353337 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 90/163] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:19.354863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3acc-e2ef-417a-a533-41a96444cfe5 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.356688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3acc-e2ef-417a-a533-41a96444cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.357016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3acc-e2ef-417a-a533-41a96444cfe5 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.364810 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 91/164] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:19.370187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c3acc-e2ef-417a-a533-41a96444cfe5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:19.391970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba057-db68-4fcb-8171-ccea20e19039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:19.392620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba057-db68-4fcb-8171-ccea20e19039 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.392905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba057-db68-4fcb-8171-ccea20e19039 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.393182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba057-db68-4fcb-8171-ccea20e19039 None admin] PATH_INFO: `/v3/users/a9bd1fec8f644330ae0ff1570223a1be` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.394327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba057-db68-4fcb-8171-ccea20e19039 None admin] RBAC: Authorizing `identity:get_user(user_id=a9bd1fec8f644330ae0ff1570223a1be)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:19.395821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba057-db68-4fcb-8171-ccea20e19039 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:19.397544 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 74/165] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:19 2022] GET /identity/v3/users/a9bd1fec8f644330ae0ff1570223a1be => generated 247 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:19.405751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.406040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.406321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.444687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:19.445890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:19.475388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:19.577246 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 75/166] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:19.578127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:19.656033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:19.658176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c3acc-e2ef-417a-a533-41a96444cfe5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:19.729774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b121b0-b2d8-458d-a378-f6c7c11fa34f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:19.752424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:19.753035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.753314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.753586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.754350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:19.754654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:19.756337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:19.779222 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 92/167] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:19.785817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:19.793636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:19.793636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:19.793636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:19.793636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:19.930571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:19.932646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:20.000178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e35e3-ebe2-439e-9d5d-db0eadb06d8b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:20.035411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:20.039028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:20.050105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:20.056692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:20.056692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:20.056692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:20.056692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:20.057662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:20.059368 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 93/168] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:19 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:20.065682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:20.141020 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 76/169] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:20.162221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:20.217155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b828f-fa93-484c-b104-60854b5b4648 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:20.290924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:20.292169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:20.292390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:20.292676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:20.367257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782848-f76b-4865-97bf-c70abea48a73 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:20.399385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:20.419494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:20.420899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:20.449988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:20.450641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:20.450903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:20.451214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:20.452351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:20.453798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:20.455446 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 77/170] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:20 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:20.456213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:20.499033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:20.560447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 94/171] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:28:20.564294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:20.690777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4da3a-dcbe-4d31-9669-6ce158768917 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:20.703377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:20.749172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b278-139c-4c48-be9d-31b127515c68 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:20.797608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:20.798265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:20.798549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:20.798825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:20.810377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:20.811132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:20.811416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:20.811690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:20.812529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=a9bd1fec8f644330ae0ff1570223a1be) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:20.812841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:20.814305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:20.820628 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 95/172] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:20 2022] GET /identity/v3/role_assignments?user.id=a9bd1fec8f644330ae0ff1570223a1be&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:20.821384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:20.823918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:20.826561 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:20.827441 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:20.828306 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 78/173] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:20.836105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:21.040762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01473ec2-e497-4cfa-9a6a-7840b5e1179f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:21.058294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:21.084796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730adbb-6a58-4aef-8042-2e62194a90c8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:21.095871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f7674-66fe-4e0c-8a56-4205a5c41416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:21.096548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7674-66fe-4e0c-8a56-4205a5c41416 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.096831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7674-66fe-4e0c-8a56-4205a5c41416 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.097107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7674-66fe-4e0c-8a56-4205a5c41416 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.099492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f7674-66fe-4e0c-8a56-4205a5c41416 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:21.101128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f7674-66fe-4e0c-8a56-4205a5c41416 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:21.102862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 96/174] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:20 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:21.109005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38597332-7853-4ff4-a5a2-d55716227efd None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.109297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38597332-7853-4ff4-a5a2-d55716227efd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.109556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38597332-7853-4ff4-a5a2-d55716227efd None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.111107 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 97/175] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:21.113277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce47d5-8e6b-4bb9-ae72-10d91582e6e3 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.113561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce47d5-8e6b-4bb9-ae72-10d91582e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.113838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce47d5-8e6b-4bb9-ae72-10d91582e6e3 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.119796 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 98/176] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:21.120871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce47d5-8e6b-4bb9-ae72-10d91582e6e3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:21.129092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:21.130008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.130501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.131437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.132324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:21.132827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:21.134440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ff78a-e8bc-43c1-844d-da9968c7e7e2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:21.143246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:21.144523 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 79/177] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:21.146126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452621e2-436e-48fe-b5d7-7486ba74a701 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.146684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452621e2-436e-48fe-b5d7-7486ba74a701 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.147236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452621e2-436e-48fe-b5d7-7486ba74a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.167947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-452621e2-436e-48fe-b5d7-7486ba74a701 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:21.170102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-452621e2-436e-48fe-b5d7-7486ba74a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:21.255166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 80/178] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:21.256606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.256920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.257179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.257932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce47d5-8e6b-4bb9-ae72-10d91582e6e3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:21.277636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:21.278830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:21.296449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:21.297714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.298190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.298656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.300165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] RBAC: Adding query filter params (role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=81a0409391cd41d29788abb688691db1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:21.300696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:21.302330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:21.309096 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 99/179] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:21 2022] GET /identity/v3/role_assignments?user.id=81a0409391cd41d29788abb688691db1&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:21.310134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:21.378855 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 81/180] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:21.407398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:21.428569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c194a-bfc0-46a1-b2d8-dea5aae3e59f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:21.465382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:21.466036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.466315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.466589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] PATH_INFO: `/v3/users/81a0409391cd41d29788abb688691db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.467810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] RBAC: Authorizing `identity:get_user(user_id=81a0409391cd41d29788abb688691db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:21.469323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:21.470930 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 100/181] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:21 2022] GET /identity/v3/users/81a0409391cd41d29788abb688691db1 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:21.476521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:21.479783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:21.606376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323a627-924f-49e9-aed8-05ba17605a5e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:21.657107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dac017-ecb3-4056-a135-d10d21783fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:21.657741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac017-ecb3-4056-a135-d10d21783fb8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.658029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac017-ecb3-4056-a135-d10d21783fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.658307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dac017-ecb3-4056-a135-d10d21783fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.756727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dac017-ecb3-4056-a135-d10d21783fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:21.758211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dac017-ecb3-4056-a135-d10d21783fb8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:21.760232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:21.817096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:21.898983 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 82/182] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:21.900237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97acfa-a029-41e1-b509-4089cfdd3ba7 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.900530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97acfa-a029-41e1-b509-4089cfdd3ba7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.900831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97acfa-a029-41e1-b509-4089cfdd3ba7 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:21.902080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 83/183] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:21.902774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97acfa-a029-41e1-b509-4089cfdd3ba7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:21.962505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8d6ae-24b4-479b-87e7-864d8accae05 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:21.997412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:21.998044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:21.998328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:21.998611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.008694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:22.013969 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:22.015000 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 101/184] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:22.015832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.021524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97acfa-a029-41e1-b509-4089cfdd3ba7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.023216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.024482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.056456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c00eea-45b9-45a4-8194-1f70859704ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.057389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00eea-45b9-45a4-8194-1f70859704ae None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.057389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00eea-45b9-45a4-8194-1f70859704ae None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.057644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c00eea-45b9-45a4-8194-1f70859704ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.068207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c00eea-45b9-45a4-8194-1f70859704ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-75c00eea-45b9-45a4-8194-1f70859704ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:22.073159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:22.074042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 84/185] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:22.075373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.076283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.076283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.094041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:22.095343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:22.118185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f7b83-bb6c-40b1-9167-246e54203b95 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.153560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff35e15-bbc4-403e-b630-d6d030e5f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.154121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff35e15-bbc4-403e-b630-d6d030e5f213 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.154398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff35e15-bbc4-403e-b630-d6d030e5f213 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.154676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff35e15-bbc4-403e-b630-d6d030e5f213 None admin] PATH_INFO: `/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.155834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff35e15-bbc4-403e-b630-d6d030e5f213 None admin] RBAC: Authorizing `identity:get_project(project_id=9fef1bb13e574fbbaa5907a8fd7af2e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.157275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff35e15-bbc4-403e-b630-d6d030e5f213 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.158890 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 102/186] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/projects/9fef1bb13e574fbbaa5907a8fd7af2e1 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.160036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875ace8-8304-4177-a45b-02ab61a3394d None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.160322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875ace8-8304-4177-a45b-02ab61a3394d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.160594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875ace8-8304-4177-a45b-02ab61a3394d None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.161548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 85/187] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:22.165738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 103/188] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:22.165738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875ace8-8304-4177-a45b-02ab61a3394d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.165967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.254068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.274939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.280954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875ace8-8304-4177-a45b-02ab61a3394d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.285207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e7463-1e0f-407a-bc0b-a699cf51da70 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.319109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.319824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.320113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.320385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.321046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:22.321226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.321345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.321927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.322210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.322557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.322734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.323308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:22.323632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.325549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224ca3d-1a1e-4918-bdf7-724bbafb98c9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.330861 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 104/189] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.331795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.339528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 86/190] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.340633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.340927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.341207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.360449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:22.361639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:22.431562 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 87/191] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:22.432616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.453830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8becd5-dac5-40d7-90ba-0c4025a179c1 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.497023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.497626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.497902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.498170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.498883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=9fef1bb13e574fbbaa5907a8fd7af2e1, user.id=81a0409391cd41d29788abb688691db1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:22.499224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.500689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.503549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.508877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 105/192] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/role_assignments?user.id=81a0409391cd41d29788abb688691db1&scope.project.id=9fef1bb13e574fbbaa5907a8fd7af2e1&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.508877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.531934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.554251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32ab02-1004-48bc-a590-b7178e5f5992 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.602225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.603323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.603715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.604053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] PATH_INFO: `/v3/users/95295f78a73d4cd9bcef219da6d11213` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.620105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eeff0-0499-45e8-ade5-fb9df47f0308 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.621903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] RBAC: Authorizing `identity:get_user(user_id=95295f78a73d4cd9bcef219da6d11213)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.624195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.625948 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 88/193] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/users/95295f78a73d4cd9bcef219da6d11213 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.626755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.663880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.664547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.664881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.665159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] PATH_INFO: `/v3/users/95295f78a73d4cd9bcef219da6d11213` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.666375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] RBAC: Authorizing `identity:get_user(user_id=95295f78a73d4cd9bcef219da6d11213)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.667895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.669627 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 106/194] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/users/95295f78a73d4cd9bcef219da6d11213 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.670419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.747462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.777196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee927d9-8284-4e2f-b228-8e95c54bcdee None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.787398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d926c-f7e0-41c8-aaf0-8fd4bb9ad157 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.818620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.819286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.819616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.819935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.821037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.823097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.824885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 89/195] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:22.825492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:22.826295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:22.826921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:22.827303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:22.827582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:22.887078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:22.913697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:22.915225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:22.972303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14fc4b-cf01-454c-b287-dab146098ec0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:22.978514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.005193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.005729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.006008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.006292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.013431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 107/196] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:23.014320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.074409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.075918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.086531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.112329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527ea9-05f1-4149-a070-5a891ce9b5b8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.147116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.147735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.148019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.148287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.158295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:23.163042 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:23.169644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 108/197] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:23.172979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.178537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 90/198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:23.178537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.197766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.270139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3b7b1-967e-4621-afde-954da47f35fe None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.280202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf00b-5f2d-4aed-ba0b-ec45c0b08a06 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.292658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.303660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.304304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.304551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.304811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.305446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.307454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.316046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.316679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.316961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.317239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.318423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.320274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.322441 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 91/199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:23.323477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.390833 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 109/200] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:23 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:23.391694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.428009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1cef1-ae29-431d-a4de-2691512dd697 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.466970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.467872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.468335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.468844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.469798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:23.470103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.471565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.486538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 92/201] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:23.486538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.492137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.509459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80b60-495b-4d57-b616-c9122b92c21e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.532750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.549091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.549841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.550190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.550469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.551805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.553299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.559801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 110/202] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:23.559801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.619250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641b15-582f-44c9-8884-8ca380813d85 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.668383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.669002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.669286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.669557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.670296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] RBAC: Adding query filter params (role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=95295f78a73d4cd9bcef219da6d11213) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:23.670604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.672169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.679615 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 93/203] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/role_assignments?user.id=95295f78a73d4cd9bcef219da6d11213&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:23.680409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.689230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37ce3e-10f6-491f-aa8e-7a86a3eed743 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.732425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.733350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.733640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.733922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] PATH_INFO: `/v3/users/e5f60dab9dea4895ba08b8a833e36fbb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.735271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] RBAC: Authorizing `identity:get_user(user_id=e5f60dab9dea4895ba08b8a833e36fbb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.736685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.738635 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 111/204] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/users/e5f60dab9dea4895ba08b8a833e36fbb => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:23.744435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:23.769787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.828879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a85ffd-17be-45a8-8bce-66ad67180434 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.831904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:23.861025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb59a-7634-4279-810f-a7e89b872567 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:23.871282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.874626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.874626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.874626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:23.874626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=95295f78a73d4cd9bcef219da6d11213) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:23.874626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:23.876024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:23.886264 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 94/205] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/role_assignments?user.id=95295f78a73d4cd9bcef219da6d11213&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:23.918781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:23.919689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:23.920040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:23.920410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:24.013930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:24.015730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:24.038777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:24.143092 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 112/206] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:24.148853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:24.300556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ddcb8-472f-4778-a9b0-a700a8a223e6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:24.342492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e6ed7-4d6e-496c-883c-f59b1efac008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:24.343172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6ed7-4d6e-496c-883c-f59b1efac008 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:24.343460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6ed7-4d6e-496c-883c-f59b1efac008 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:24.343740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e6ed7-4d6e-496c-883c-f59b1efac008 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:24.344887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6ed7-4d6e-496c-883c-f59b1efac008 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:24.346341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e6ed7-4d6e-496c-883c-f59b1efac008 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:24.353399 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 95/207] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:24 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:24.354281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:24.526780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb359-da59-4d18-8427-e4366dab74da None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:24.555072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:24.575678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:24.576289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:24.576569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:24.576838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:24.577564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] RBAC: Adding query filter params (role.id=9bcc153a83184ffc9c91cf100a6dbab2, scope.project.id=3bef669158b14670adfd7ad3888a7352, user.id=e5f60dab9dea4895ba08b8a833e36fbb) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:24.577918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:24.579384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a2538-08b4-40c9-8bf1-3af33437e424 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:24.585493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 113/208] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:24 2022] GET /identity/v3/role_assignments?user.id=e5f60dab9dea4895ba08b8a833e36fbb&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=9bcc153a83184ffc9c91cf100a6dbab2 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:26.027248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fcc5d-cdd7-451d-8599-81896e07f8e9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.027777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fcc5d-cdd7-451d-8599-81896e07f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.027777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fcc5d-cdd7-451d-8599-81896e07f8e9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.029441 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 96/209] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:26.034649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c319b-ba60-4a52-94d4-bd17abe01ada None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.035079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c319b-ba60-4a52-94d4-bd17abe01ada None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.035262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c319b-ba60-4a52-94d4-bd17abe01ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.053760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7c9c319b-ba60-4a52-94d4-bd17abe01ada None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:26.054958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7c9c319b-ba60-4a52-94d4-bd17abe01ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:26.131879 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 114/210] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:26.137192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba24e6d-87dc-4e9b-ab07-cf283b8b276f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.137482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba24e6d-87dc-4e9b-ab07-cf283b8b276f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.137760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba24e6d-87dc-4e9b-ab07-cf283b8b276f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.139255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 97/211] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:26.144397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c952df-25fd-49df-b793-1043dcaa2c32 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.144906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c952df-25fd-49df-b793-1043dcaa2c32 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.145388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c952df-25fd-49df-b793-1043dcaa2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.165392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-34c952df-25fd-49df-b793-1043dcaa2c32 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:26.167615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-34c952df-25fd-49df-b793-1043dcaa2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:26.245439 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 115/212] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:26.279449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a07f-7ae3-4ac0-882c-e33ff05293e0 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.279773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a07f-7ae3-4ac0-882c-e33ff05293e0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.280019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a07f-7ae3-4ac0-882c-e33ff05293e0 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.281499 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 98/213] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:26.286448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.286743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.287034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.309323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:26.310527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:26.333129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1004-1f91-46d3-a44f-43de41ea9801 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.333735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1004-1f91-46d3-a44f-43de41ea9801 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.334190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1004-1f91-46d3-a44f-43de41ea9801 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.336019 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 99/214] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:26.342158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.342524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.342807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.353193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:26.370054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:26.371870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:26.382816 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 116/215] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:26.407947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:26.448082 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 100/216] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:26.486489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:26.585125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64c681-d46c-4ac5-b7c6-b9e5fa41911c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:26.591894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:26.629336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:26.629972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.630258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.630536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.644059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:26.650997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:26.651841 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:26.652673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:26.655090 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 117/217] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:26.659485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:26.701240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f85a7d-57bf-433d-9d35-2be1b19e864e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:26.706029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:26.739151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:26.739911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.740264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.740615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.741766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:26.743229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:26.749524 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 101/218] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:26.750285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:26.787974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7c99a-479a-425c-943f-84d0ebea1b42 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:26.789864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:26.825212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:26.825816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:26.826090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:26.826366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:26.827103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:26.827413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:26.828781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:26.836672 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 118/219] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:26.837452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:26.978466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139cb46-e9d1-4e0f-8cac-7810d42fd0d7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.007695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.012404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.013013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.013297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.013606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.013874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fda9a-a579-4202-87c3-34bea21086cf None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.014226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.015723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.046577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.047405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.048007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.048604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.058517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:27.063779 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:27.064840 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 119/220] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:27.067903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.113405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 102/221] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:26 2022] POST /identity/v3/users => generated 297 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:28:27.114229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.180900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c46ad-5c74-4a57-83a0-7c7b6ff2d34e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.220305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.220954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.221233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.221510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.223350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.239439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:27.239643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19c02f-9622-4ca7-99e1-0da68189241a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:27.240238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:27.241108 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:27.241897 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 120/222] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:27.242548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.265745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.278198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.279204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.279491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.279940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] PATH_INFO: `/v3/users/c76bfa6a7d994d939bcaae95d4b56a44` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.297102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] RBAC: Authorizing `identity:get_user(user_id=c76bfa6a7d994d939bcaae95d4b56a44)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.298816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.300559 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 103/223] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/users/c76bfa6a7d994d939bcaae95d4b56a44 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:27.301344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.366213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b8d3-5860-4fbb-aee6-1b2340c6bd2c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.411290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.411917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.412222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.412491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.413571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:27.413879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.415377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.425071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 121/224] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:27.425747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.442417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afe72d-aec8-4274-926a-2869ba73479d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.487946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.488691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.489069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.489426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.490234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:27.490573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.492077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.502766 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 104/225] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:27.503761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.517647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.531722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.568963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955abf-8aed-46e4-9fff-1173329c8fe9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.609097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.609906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.610301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.610679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.622393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7545b9-da35-4346-9762-d810b856c521 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.661255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.662174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.662622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.663054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] PATH_INFO: `/v3/users/95295f78a73d4cd9bcef219da6d11213` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.664449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] RBAC: Authorizing `identity:get_user(user_id=95295f78a73d4cd9bcef219da6d11213)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.666306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.668511 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 105/226] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/users/95295f78a73d4cd9bcef219da6d11213 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:27.669485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.693466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.695762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.757630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.786995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a47722-7881-4da3-a66f-ac48cde1dd67 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:27.794304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:27.821287 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 122/227] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:27.823302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.827733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:27.828587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:27.829010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:27.829453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] PATH_INFO: `/v3/users/95295f78a73d4cd9bcef219da6d11213` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:27.830734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] RBAC: Authorizing `identity:get_user(user_id=95295f78a73d4cd9bcef219da6d11213)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:27.832378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:27.834365 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 106/228] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/users/95295f78a73d4cd9bcef219da6d11213 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:27.839592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:27.956879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb215bb-bc24-413b-93bc-346d61ba92c7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:28.002162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:28.002969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:28.003485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:28.004063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:28.005411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:28.007476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:28.016755 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 123/229] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:28.016755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:28.072984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:28.133999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba42f8-2ee2-4377-b0c4-8c0d378131e3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:28.171699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:28.172346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:28.172695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:28.172901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:28.174747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:28.176754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7107eb9-b1f7-48d3-bcf3-db3e10495915 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:28.178373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:28.185333 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 124/230] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:28 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:28.185333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:28.251288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:28.252895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:28.253190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:28.253470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:28.257387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:28.260988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:28.264928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 107/231] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:27 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:28.267665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:28.305782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:28.412376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc452-8347-4386-8afd-271afb05288d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:28.413079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44e39-a4fc-4318-a596-3e05791c4116 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:28.428795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:28.451570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:28.452262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:28.452546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:28.453392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/95295f78a73d4cd9bcef219da6d11213/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:28.453490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831307a-2219-445f-83f2-22e0ccf3adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:28.454571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831307a-2219-445f-83f2-22e0ccf3adcf None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:28.455199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831307a-2219-445f-83f2-22e0ccf3adcf None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:28.455673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831307a-2219-445f-83f2-22e0ccf3adcf None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/95295f78a73d4cd9bcef219da6d11213/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:28.455785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] RBAC: Authorizing `identity:create_grant(project_id=df565644916b4b8fa2875131e5d4e5f8, user_id=95295f78a73d4cd9bcef219da6d11213, role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:28.457562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:28.458164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831307a-2219-445f-83f2-22e0ccf3adcf None admin] RBAC: Authorizing `identity:create_grant(project_id=df565644916b4b8fa2875131e5d4e5f8, user_id=95295f78a73d4cd9bcef219da6d11213, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:28.459836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831307a-2219-445f-83f2-22e0ccf3adcf None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:28.539068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 125/232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:28 2022] PUT /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/95295f78a73d4cd9bcef219da6d11213/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:28.540183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:28.565636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 108/233] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:28 2022] PUT /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/95295f78a73d4cd9bcef219da6d11213/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:28.675072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abbb68-2ba2-4dbe-aba9-1d58ba605976 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:28.715993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:28.716618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:28.716895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:28.717163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:28.717902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=c76bfa6a7d994d939bcaae95d4b56a44) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:28.718205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:28.719782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf9678-853e-4bbd-9da6-003d2b6f7982 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:28.727114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 126/234] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:28 2022] GET /identity/v3/role_assignments?user.id=c76bfa6a7d994d939bcaae95d4b56a44&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:29.883859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba84ed-5b2b-488c-9616-8cd4a5eda1d9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:29.884390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba84ed-5b2b-488c-9616-8cd4a5eda1d9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:29.884496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba84ed-5b2b-488c-9616-8cd4a5eda1d9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:29.886033 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 109/235] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:29.891517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:29.891938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:29.892100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:29.934797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb480e-a2b4-442a-8db6-01ecc01778af None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:29.935118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb480e-a2b4-442a-8db6-01ecc01778af None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:29.935390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb480e-a2b4-442a-8db6-01ecc01778af None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:29.936990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 110/236] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:29.941788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:29.942071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:29.942347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:29.962179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:29.964006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:29.964190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:29.965318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:30.005196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:30.059971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 127/237] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:30.097958 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 111/238] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:30.513035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:30.576162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:30.579360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:30.686805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721f389-800a-4fba-a41a-993c7c3db160 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:30.702478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c938-041e-498c-8247-fb8b70357c84 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:30.739569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:30.740316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:30.740604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:30.740879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:30.741996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:30.743488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:30.746036 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 112/239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:30.751380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:30.770517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:30.771196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:30.771481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:30.771757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:30.807657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:30.812662 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:30.813881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:30.814681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 128/240] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:30.824121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:30.831392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:30.855770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f45e29-63f9-4889-8593-2e8328b852f5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:30.880808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:30.893729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:30.894496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:30.894779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:30.895080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:30.895776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:30.897212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:30.976970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af833107-a660-4c7b-8825-6ba66a10a00c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:31.006826 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 113/241] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:30 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:31.032166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:31.032704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.032986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.033322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.034000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:31.034299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:31.035835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd92b9-4047-4a77-8e01-2e9e907c5417 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:31.046821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 129/242] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:31.053298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:31.193844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234e640-4488-4c8d-bb88-3ee202f755cc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:31.227554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:31.231769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff69791-6879-4a23-917b-7b2e864ed3d8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.232371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff69791-6879-4a23-917b-7b2e864ed3d8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.233107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff69791-6879-4a23-917b-7b2e864ed3d8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.234660 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 130/243] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:31.240886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fae8f-001c-4fb0-8cf9-ca261746febf None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.241179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fae8f-001c-4fb0-8cf9-ca261746febf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.241449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fae8f-001c-4fb0-8cf9-ca261746febf None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.246513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139bbba-cb80-4bed-9b8a-6d72701dcbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:31.246651 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 131/244] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:31.246727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139bbba-cb80-4bed-9b8a-6d72701dcbb6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.246727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139bbba-cb80-4bed-9b8a-6d72701dcbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.246845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.246908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139bbba-cb80-4bed-9b8a-6d72701dcbb6 None admin] PATH_INFO: `/v3/users/faa0b35ee08b4e0a8e1bf921f165688a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.246982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.246982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.260086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139bbba-cb80-4bed-9b8a-6d72701dcbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=faa0b35ee08b4e0a8e1bf921f165688a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:31.261565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139bbba-cb80-4bed-9b8a-6d72701dcbb6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:31.263479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 114/245] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:31 2022] GET /identity/v3/users/faa0b35ee08b4e0a8e1bf921f165688a => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:31.264515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe55a73-ce9d-428b-8e8e-48b3a158122a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.264780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe55a73-ce9d-428b-8e8e-48b3a158122a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.265258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe55a73-ce9d-428b-8e8e-48b3a158122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.281689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:31.287093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:31.287248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9fe55a73-ce9d-428b-8e8e-48b3a158122a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:31.287248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9fe55a73-ce9d-428b-8e8e-48b3a158122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:31.368811 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 132/246] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:31.374850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:31.379502 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 115/247] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:31.395577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:31.478799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9b90-7548-4df2-82e8-b0bf74d7bed9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:31.502440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba9fb-a88f-4084-b1b7-399eddd4a50b None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.502859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba9fb-a88f-4084-b1b7-399eddd4a50b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.503249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba9fb-a88f-4084-b1b7-399eddd4a50b None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.504914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 116/248] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:31.510572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.510859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.511218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.520539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:31.521359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.521807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.522265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.534569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:31.536196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:31.616977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:31.618388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:31.623129 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 117/249] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:31.640497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:31.722105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 133/250] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:31.727496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:31.730094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:31.794143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:31.862703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4379c4-b78a-40f3-a208-92286dd41fe1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:31.912030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:31.912787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.913170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.913648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.915041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:31.916508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:31.918374 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 118/251] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:31 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:31.920217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:31.931917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043adf7-8d4b-4525-bca3-5dbf30a1d782 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:31.961419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:31.978609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:31.979252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:31.979537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:31.979811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:31.993396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:32.000613 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:32.001485 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:32.002245 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:32.005393 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 134/252] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:32.006441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.042514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb017-bd7e-4a22-ba6f-0e21489bcec6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.062393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:32.091358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.092233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.092692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.093103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.105196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:32.110567 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:32.111707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:32.112594 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:32.115069 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 119/253] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:32.116124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.140602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28074c9-c223-4156-92dc-477bdaf900b0 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.185676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.186592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.186951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.187329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.188403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] RBAC: Adding query filter params (role.id=9bcc153a83184ffc9c91cf100a6dbab2, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=faa0b35ee08b4e0a8e1bf921f165688a) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:32.188781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:32.190318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:32.198210 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 135/254] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/role_assignments?user.id=faa0b35ee08b4e0a8e1bf921f165688a&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=9bcc153a83184ffc9c91cf100a6dbab2 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:32.198847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.261717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:32.261945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd09e99-b96a-43df-a6e4-242c04b5bd83 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.337341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.338326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.338755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.339215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.361649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:32.363959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe342a5-42bc-4e74-8684-8f467111925b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:32.377430 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:32.378565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:32.379575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:32.383308 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 120/255] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:32.384337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.420094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.420714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.420985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.421258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.422075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:32.422382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:32.424277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:32.431914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:32.445939 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 136/256] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:32.447186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.551360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ca498-3b23-4a79-be0b-3631732366be None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.617418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36697268-f8b2-4088-9b5d-ff455df4ead0 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.623356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.624802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.625548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.626215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.631305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:32.640168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:32.640281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:32.640281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:32.647698 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 121/257] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:32.648547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.691362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.691974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.692255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.692528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.693190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:32.693496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:32.695111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:32.712880 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 137/258] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:32.713031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.796181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:32.802149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99994ed-420d-4bf8-8369-8ee212c822ef None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.868350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e7d3e-46c2-4f50-8af9-5e530ad57314 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:32.880491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.880491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.880491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.880491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] PATH_INFO: `/v3/users/95295f78a73d4cd9bcef219da6d11213` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.881037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] RBAC: Authorizing `identity:get_user(user_id=95295f78a73d4cd9bcef219da6d11213)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:32.884204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:32.884204 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 122/259] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/users/95295f78a73d4cd9bcef219da6d11213 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:32.884905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:32.941489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:32.942128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:32.942411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:32.942687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] PATH_INFO: `/v3/users/95295f78a73d4cd9bcef219da6d11213` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:32.944454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] RBAC: Authorizing `identity:get_user(user_id=95295f78a73d4cd9bcef219da6d11213)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:32.945908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:32.949690 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 138/260] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/users/95295f78a73d4cd9bcef219da6d11213 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:32.951816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.016535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:33.088181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661091d8-e939-4796-942f-bc5af6bcaa07 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:33.123570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:33.124374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:33.124665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:33.124943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] PATH_INFO: `/v3/users/c76bfa6a7d994d939bcaae95d4b56a44` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:33.126266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] RBAC: Authorizing `identity:get_user(user_id=c76bfa6a7d994d939bcaae95d4b56a44)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:33.127826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:33.129935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 123/261] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/users/c76bfa6a7d994d939bcaae95d4b56a44 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:33.130764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.167379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:33.169261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585b91d-6360-46a0-85ef-ab4e9b09a57e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:33.241519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6424e-071b-48fa-b463-5f1c80dde37a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:33.253153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:33.253818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:33.254098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:33.254368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:33.307036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:33.307565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:33.307845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:33.308111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:33.391385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:33.392909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:33.434955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:33.436468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:33.465479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:33.483392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:33.546949 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 124/262] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:33.548264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.580877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 139/263] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:33.581447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.690145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3db7b-2df3-4d6f-9986-b755cca5263f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:33.724582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983745-c320-4bf3-9950-0334e726b741 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:33.737246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:33.737884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:33.738160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:33.738431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:33.740158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:33.741619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:33.743612 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 140/264] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:33 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:33.744391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.752691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:33.791376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:33.794743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:33.795867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:33.796346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:33.798650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:33.803697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:33.805424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:33.807566 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 125/265] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:33 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:33.808540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.854935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d552-63d2-43a7-a41e-9e3746264d83 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:33.895125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:33.895757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:33.896031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:33.896303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:33.897402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:33.898830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:33.901546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 141/266] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:33 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:33.902294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:33.983428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:34.015061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aafc9-c7c1-438f-bd3e-1a6ea05b3f34 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:34.018772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd414c-72cb-4c7b-b3de-c44ef19fbee7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:34.052848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23623e2-7138-4983-a7a2-b4fa6f042cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:34.056502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23623e2-7138-4983-a7a2-b4fa6f042cf5 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.056502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23623e2-7138-4983-a7a2-b4fa6f042cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.056502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23623e2-7138-4983-a7a2-b4fa6f042cf5 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/c76bfa6a7d994d939bcaae95d4b56a44/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.056751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23623e2-7138-4983-a7a2-b4fa6f042cf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=df565644916b4b8fa2875131e5d4e5f8, user_id=c76bfa6a7d994d939bcaae95d4b56a44, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:34.058132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23623e2-7138-4983-a7a2-b4fa6f042cf5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:34.094271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:34.094963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.095386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.095668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.096432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] RBAC: Adding query filter params (role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=95295f78a73d4cd9bcef219da6d11213) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:34.096745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:34.098470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:34.115373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 126/267] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:33 2022] GET /identity/v3/role_assignments?user.id=95295f78a73d4cd9bcef219da6d11213&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:34.115373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:34.146373 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 142/268] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:33 2022] PUT /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/c76bfa6a7d994d939bcaae95d4b56a44/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:34.219373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:34.250414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4a53-1380-4f3e-a0ae-c374685ac717 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.251148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4a53-1380-4f3e-a0ae-c374685ac717 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.251635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d4a53-1380-4f3e-a0ae-c374685ac717 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.253673 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 143/269] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:34.261898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7038-aa88-4c50-90cb-ae9fec5ce9a3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.262532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7038-aa88-4c50-90cb-ae9fec5ce9a3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.263000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7038-aa88-4c50-90cb-ae9fec5ce9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.264141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e72c2-b3f5-4b93-9294-d2f359c88403 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:34.283542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-02fc7038-aa88-4c50-90cb-ae9fec5ce9a3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:34.285483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-02fc7038-aa88-4c50-90cb-ae9fec5ce9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:34.308064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:34.308749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.309033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.309369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.310103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=95295f78a73d4cd9bcef219da6d11213) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:34.310463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:34.312521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5450da5-6fc6-4ce0-92c5-a6c29502d743 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:34.322184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 127/270] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:34 2022] GET /identity/v3/role_assignments?user.id=95295f78a73d4cd9bcef219da6d11213&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:34.399216 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 144/271] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:34.401274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab29ba-1cca-4402-80c7-1f9abb1cd69a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.401677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab29ba-1cca-4402-80c7-1f9abb1cd69a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.402056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab29ba-1cca-4402-80c7-1f9abb1cd69a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.403874 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 128/272] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:34.409412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f581c3-0dc1-4c5e-825c-31eb0da6a8aa None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.409912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f581c3-0dc1-4c5e-825c-31eb0da6a8aa None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.410329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f581c3-0dc1-4c5e-825c-31eb0da6a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.442614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a8f581c3-0dc1-4c5e-825c-31eb0da6a8aa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:34.444226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8f581c3-0dc1-4c5e-825c-31eb0da6a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:34.524729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:34.537126 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 145/273] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:34.862688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab29ba-1cca-4402-80c7-1f9abb1cd69a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:34.883890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396d83-1262-47b4-86c4-00b73111c2f5 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.884236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396d83-1262-47b4-86c4-00b73111c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.884468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22396d83-1262-47b4-86c4-00b73111c2f5 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.886992 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 146/274] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:34.892266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:34.892553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:34.892834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:34.921415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:34.922608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:35.005480 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 147/275] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:35.006366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.032895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab29ba-1cca-4402-80c7-1f9abb1cd69a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.074344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:35.091211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.092330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.093007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.094418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.110897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:35.118201 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:35.119105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:35.119918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:35.123142 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 129/276] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:35.126028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.133382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79fe3-8493-4bf1-a44e-c14a05591849 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.160485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:35.173786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.174446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.174724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.174992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.176135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:35.177555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:35.179430 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 148/277] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:35.187956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.270604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35bf5f-0db1-498e-8962-81639bf76410 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.314049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.315085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.315376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.315656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.316605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:35.316917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:35.318991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:35.322809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247b74-3e90-440d-8678-b8468e2c10c3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.329947 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 130/278] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:35.339227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.370410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.370942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.371264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.371540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.372199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:35.374080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:35.397251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:35.447000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478861-17f1-451b-9b8e-418944c63674 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.479861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.480598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.480825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.481096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] PATH_INFO: `/v3/users/e828121e56f04d538bc9af11399c5af2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.489387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 149/279] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:28:35 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:35.490422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.499846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] RBAC: Authorizing `identity:get_user(user_id=e828121e56f04d538bc9af11399c5af2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:35.501528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:35.504247 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 131/280] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/users/e828121e56f04d538bc9af11399c5af2 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:35.512721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.562989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:35.640033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4d1cb-b2b0-44b9-9e9c-5d9f2ff9c294 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.666746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7600c3-c214-4f6c-9f51-cb9358a1a0b2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.679881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:35.686241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.688705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.688705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.688705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.700976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:35.706269 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:35.707165 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:35.707937 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 150/281] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:35.714780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:35.725783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.726397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.726672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.726941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.727745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, user.id=e828121e56f04d538bc9af11399c5af2, scope.system=all) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:35.728063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:35.729900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:35.737449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 132/282] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/role_assignments?user.id=e828121e56f04d538bc9af11399c5af2&scope.system=all&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:35.836538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c8283-f5e0-44fd-9d88-094e5938fd97 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:35.844904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:35.878926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:35.882206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:35.882206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:35.882206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:35.882206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] RBAC: Adding query filter params (name=reader) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:35.882206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:35.882562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:35.895859 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 151/283] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:35.906597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:36.019656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b143a-4dd8-4340-96e6-065c1ea89ddf None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:36.058107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:36.058872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:36.059231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:36.059556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] PATH_INFO: `/v3/users/faa0b35ee08b4e0a8e1bf921f165688a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:36.060712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] RBAC: Authorizing `identity:get_user(user_id=faa0b35ee08b4e0a8e1bf921f165688a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:36.062169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:36.063796 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 133/284] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:35 2022] GET /identity/v3/users/faa0b35ee08b4e0a8e1bf921f165688a => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:36.069415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:36.178893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775407a-00d8-4c42-a0c4-9429fcea808a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:36.215093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a0ffa-29ca-4015-ad61-d888bbe663e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:36.215731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a0ffa-29ca-4015-ad61-d888bbe663e0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:36.216013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a0ffa-29ca-4015-ad61-d888bbe663e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:36.216289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a0ffa-29ca-4015-ad61-d888bbe663e0 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:36.217409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a0ffa-29ca-4015-ad61-d888bbe663e0 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:36.218850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a0ffa-29ca-4015-ad61-d888bbe663e0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:36.220840 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 152/285] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:36 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:36.226625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:36.283634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:36.344947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bef1d5-e18c-40d9-8242-577679e25231 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:36.387580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a27b1-790f-48b5-b957-702cf02f3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:36.388370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a27b1-790f-48b5-b957-702cf02f3a61 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:36.388708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a27b1-790f-48b5-b957-702cf02f3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:36.388990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a27b1-790f-48b5-b957-702cf02f3a61 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/faa0b35ee08b4e0a8e1bf921f165688a/roles/9bcc153a83184ffc9c91cf100a6dbab2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:36.390962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a27b1-790f-48b5-b957-702cf02f3a61 None admin] RBAC: Authorizing `identity:create_grant(project_id=df565644916b4b8fa2875131e5d4e5f8, user_id=faa0b35ee08b4e0a8e1bf921f165688a, role_id=9bcc153a83184ffc9c91cf100a6dbab2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:36.393306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a27b1-790f-48b5-b957-702cf02f3a61 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:36.468624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 134/286] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:28:36 2022] PUT /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8/users/faa0b35ee08b4e0a8e1bf921f165688a/roles/9bcc153a83184ffc9c91cf100a6dbab2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:36.854432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14e4b-7a7a-4485-9a27-0db9a57a937d None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:36.854799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14e4b-7a7a-4485-9a27-0db9a57a937d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:36.854995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14e4b-7a7a-4485-9a27-0db9a57a937d None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:36.856648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 153/287] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:36.862292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:36.862593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:36.862955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:36.891049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:36.892248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:36.977287 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 135/288] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:37.502888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14e4b-7a7a-4485-9a27-0db9a57a937d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:37.549560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:37.639045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14e4b-7a7a-4485-9a27-0db9a57a937d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:37.685559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:37.686191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:37.686469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:37.686744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:37.703070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:37.707907 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:37.708782 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:37.709653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:37.713849 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 154/289] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:37.715244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:37.746618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:37.819886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d9bb-f5cd-4281-adc0-a05aa1647456 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:37.856303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:37.856917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:37.857241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:37.857522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:37.858456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:37.858762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:37.860192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:37.868993 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 136/290] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:37.874698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:38.031398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:38.033452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e15ce5-8458-47cb-8178-9de3b3efb56b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:38.068909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47ddd6-f6ff-4e86-90c5-3992d93e2be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:38.069564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ddd6-f6ff-4e86-90c5-3992d93e2be2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.069842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ddd6-f6ff-4e86-90c5-3992d93e2be2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.070169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47ddd6-f6ff-4e86-90c5-3992d93e2be2 None admin] PATH_INFO: `/v3/users/c76bfa6a7d994d939bcaae95d4b56a44` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.071481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47ddd6-f6ff-4e86-90c5-3992d93e2be2 None admin] RBAC: Authorizing `identity:get_user(user_id=c76bfa6a7d994d939bcaae95d4b56a44)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:38.072951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47ddd6-f6ff-4e86-90c5-3992d93e2be2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:38.078691 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 155/291] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:37 2022] GET /identity/v3/users/c76bfa6a7d994d939bcaae95d4b56a44 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:38.080522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:38.211248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:38.220882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bdc8f-93be-4d56-921b-d0cf7a799743 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:38.264921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fdac3-5299-4028-8c4f-e9b9a2ab6823 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.265226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fdac3-5299-4028-8c4f-e9b9a2ab6823 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.265477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fdac3-5299-4028-8c4f-e9b9a2ab6823 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.270692 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 156/292] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:38.272225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.272618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.273012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.273995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2a328-5837-4de1-9c81-96d4d2297784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:38.275191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a328-5837-4de1-9c81-96d4d2297784 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.275475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a328-5837-4de1-9c81-96d4d2297784 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.275748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a328-5837-4de1-9c81-96d4d2297784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.296026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:38.297683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:38.389767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a328-5837-4de1-9c81-96d4d2297784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:38.391187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a328-5837-4de1-9c81-96d4d2297784 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:38.393634 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 157/293] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:38.522426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:38.533203 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 137/294] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:38.544154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:38.667664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:38.682818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4863555-031a-4fcd-a1ce-e48e633f9976 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:38.712288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57add1d-656d-4e23-a3b0-afae362360ec None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.712605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57add1d-656d-4e23-a3b0-afae362360ec None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.712841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57add1d-656d-4e23-a3b0-afae362360ec None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.714450 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 138/295] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:38.719794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.720485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.720485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.734837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:38.735534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.735813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.736085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.739742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:38.740254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:38.741209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:38.741518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:38.743572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 158/296] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:38 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:38.749239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:38.820663 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 139/297] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:38.829200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:38.938137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897a14-e574-452d-ab76-d96c7e153303 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:38.974370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:38.974883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d490-750d-4e3b-b734-69c2250fb7cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:38.975178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.975524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.975858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.976795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=c76bfa6a7d994d939bcaae95d4b56a44) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:38.977170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:38.979358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd59cf3-f6df-48f9-8e27-d783a76d05bb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:38.986184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 159/298] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:38 2022] GET /identity/v3/role_assignments?user.id=c76bfa6a7d994d939bcaae95d4b56a44&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:38.987680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344f68-8b15-481f-88f5-677cfc71915e None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.988047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344f68-8b15-481f-88f5-677cfc71915e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.988384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344f68-8b15-481f-88f5-677cfc71915e None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:38.989952 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 160/299] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:38.996336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:38.996680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:38.997077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.017725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:39.019209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:39.031450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:39.052194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.052862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.053148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.053416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.069220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:39.084817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:39.093188 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:39.094159 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:39.094944 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:39.098397 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 140/300] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:28:39.104987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.177185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 161/301] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:39.240341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1649-34b1-469a-9e7f-77a5117287e2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:39.256094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.291264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.291877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.292157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.292428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.293094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:39.293399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:39.294776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d6fe6-7367-4dda-b4f4-0b83bfed1dff None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:39.303590 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 141/302] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:39.307068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173ff9-e095-4c0d-8d62-997a6e1c7148 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.307068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173ff9-e095-4c0d-8d62-997a6e1c7148 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.307068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61173ff9-e095-4c0d-8d62-997a6e1c7148 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.307068 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 142/303] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:39.310188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173ff9-e095-4c0d-8d62-997a6e1c7148 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.365995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:39.386249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6df7af-55fb-4cf4-b9ee-01d702b54666 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:39.421673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577b600-135c-44a4-96dd-8a4fea36023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.422297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577b600-135c-44a4-96dd-8a4fea36023b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.422568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577b600-135c-44a4-96dd-8a4fea36023b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.422966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577b600-135c-44a4-96dd-8a4fea36023b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.423942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577b600-135c-44a4-96dd-8a4fea36023b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:39.425365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577b600-135c-44a4-96dd-8a4fea36023b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:39.426796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61173ff9-e095-4c0d-8d62-997a6e1c7148 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:39.427206 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 162/304] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:39.428306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.428588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.428857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.446051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:39.447298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:39.465641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:39.467458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.468149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.468433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.469035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] PATH_INFO: `/v3/users/e828121e56f04d538bc9af11399c5af2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.469940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] RBAC: Authorizing `identity:get_user(user_id=e828121e56f04d538bc9af11399c5af2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:39.471507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:39.473263 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 143/305] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:39 2022] GET /identity/v3/users/e828121e56f04d538bc9af11399c5af2 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:39.473949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.527083 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 163/306] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:39.527083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.587392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280066f6-65e2-4e96-8cba-1ed862302a08 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:39.601682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:39.624085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.624734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.625109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.625418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.626044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:39.627512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:39.635581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8bb90-b8f3-40b3-86b5-24bc301968e5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:39.670165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.670808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.671144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.671453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] PATH_INFO: `/v3/system/users/e828121e56f04d538bc9af11399c5af2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.672840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e828121e56f04d538bc9af11399c5af2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:39.674223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:39.706584 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 144/307] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Sep 6 10:28:39 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:28:39.707439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.818877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 164/308] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Sep 6 10:28:39 2022] PUT /identity/v3/system/users/e828121e56f04d538bc9af11399c5af2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:39.831054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3db367-c3b0-4e4f-8f2d-1c0239477218 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:39.863163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.874430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:39.875221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:39.875502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:39.875775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:39.890053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:39.891185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:39.896221 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:39.897200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:39.898032 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 145/309] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:39.905311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:39.942598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:40.030742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc05b-c80d-4e6c-9bff-92fecf61d026 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.036481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54244b02-6da7-43ff-b033-8ba0c344be22 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.076676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.077433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.077818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.078098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.078199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.078764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.079125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.079416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.080355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:40.080665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.082440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.090796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:40.092815 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 146/310] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:40.096499 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:40.097432 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:40.098225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 165/311] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:40.103657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:40.104886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:40.205218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:40.229337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec387c1-1738-4361-acd7-026ed91f7378 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.234749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:40.244416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d0c80-742a-4bd9-99f9-d483b49dbae4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.273983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.275496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.276001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.276465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] PATH_INFO: `/v3/users/ba85f1d557294142a7133cca0761652a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.291674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] RBAC: Authorizing `identity:get_user(user_id=ba85f1d557294142a7133cca0761652a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.291850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.292369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.292653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.292927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.293595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:40.293903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.294678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.295314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.296785 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 166/312] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/users/ba85f1d557294142a7133cca0761652a => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:40.302602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:40.304435 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 147/313] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:40.312414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:40.416167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5c25-175f-4a19-9c18-64201a6cb3ad None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.423515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ea6c-5953-48ad-b4eb-e393f9723759 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.456656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.457717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.458209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.458620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.460163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.460744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] RBAC: Adding query filter params (role.id=9bcc153a83184ffc9c91cf100a6dbab2, user.id=ba85f1d557294142a7133cca0761652a, scope.system=all) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:40.461019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.461362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.461471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.461868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] PATH_INFO: `/v3/users/faa0b35ee08b4e0a8e1bf921f165688a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.463178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] RBAC: Authorizing `identity:get_user(user_id=faa0b35ee08b4e0a8e1bf921f165688a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.463378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.464918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.466289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:40.467050 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 148/314] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/users/faa0b35ee08b4e0a8e1bf921f165688a => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:40.472348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:40.473170 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 167/315] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/role_assignments?user.id=ba85f1d557294142a7133cca0761652a&scope.system=all&role.id=9bcc153a83184ffc9c91cf100a6dbab2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:40.509463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:40.594744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25401a-fc06-4822-a84c-68e220fb75e2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.634075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.635155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.635683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.636172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.708845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.710598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.737583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:40.814663 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 149/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:28:40.820111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:40.934707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d76c-2880-4c39-a0ed-29eb2bd2872f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:40.973844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da5dc-ad84-4b8c-b692-7e2f64b1c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:40.974395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da5dc-ad84-4b8c-b692-7e2f64b1c489 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:40.974676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da5dc-ad84-4b8c-b692-7e2f64b1c489 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:40.974950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da5dc-ad84-4b8c-b692-7e2f64b1c489 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:40.976096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da5dc-ad84-4b8c-b692-7e2f64b1c489 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:40.978091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da5dc-ad84-4b8c-b692-7e2f64b1c489 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:40.979761 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 168/317] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:40.986104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:41.092721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f701f-4e8a-4f12-9374-e3243462b1cf None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:41.123071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:41.127991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:41.128601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:41.128883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:41.129158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:41.129879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] RBAC: Adding query filter params (role.id=9bcc153a83184ffc9c91cf100a6dbab2, scope.project.id=df565644916b4b8fa2875131e5d4e5f8, user.id=faa0b35ee08b4e0a8e1bf921f165688a) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:41.130187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:41.131653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a55443-9e5e-4065-85a8-4eb4eed05ed7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:41.137712 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 150/318] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:28:40 2022] GET /identity/v3/role_assignments?user.id=faa0b35ee08b4e0a8e1bf921f165688a&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=9bcc153a83184ffc9c91cf100a6dbab2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:41.991453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165438-d473-4ec9-a5ed-142f53ad4252 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:41.991955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165438-d473-4ec9-a5ed-142f53ad4252 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:41.992063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a165438-d473-4ec9-a5ed-142f53ad4252 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:41.993970 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 169/319] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:41.999255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f773-9014-4a56-a698-4bec4c1c74bf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:41.999656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f773-9014-4a56-a698-4bec4c1c74bf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:41.999816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f773-9014-4a56-a698-4bec4c1c74bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.018145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9e90f773-9014-4a56-a698-4bec4c1c74bf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:42.019362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9e90f773-9014-4a56-a698-4bec4c1c74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:42.087682 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 151/320] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:42.114684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161d91-3914-43a0-b64f-a708bf32f335 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.114967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161d91-3914-43a0-b64f-a708bf32f335 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.115279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161d91-3914-43a0-b64f-a708bf32f335 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.116748 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 170/321] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:42.122449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.122748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.123091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.141835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:42.143044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:42.208969 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 152/322] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:42.420685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20161d91-3914-43a0-b64f-a708bf32f335 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:42.490900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:42.525511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20161d91-3914-43a0-b64f-a708bf32f335 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:42.545686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:42.561519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:42.562181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.562467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.562743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.563977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:42.565477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:42.571605 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 171/323] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:42.573256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:42.607888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:42.676586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3d671-8605-4e50-ad15-a98f4bf167f8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:42.684867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fcfdc-f227-4a11-a3ba-dfded5081690 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:42.713047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c18384-ef29-4e59-a793-d91055c5b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:42.713676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c18384-ef29-4e59-a793-d91055c5b745 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.713956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c18384-ef29-4e59-a793-d91055c5b745 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.714231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c18384-ef29-4e59-a793-d91055c5b745 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.725339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c18384-ef29-4e59-a793-d91055c5b745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:42.726445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77964f-96da-4e7a-9e3b-7ac04bbb7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:42.727081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77964f-96da-4e7a-9e3b-7ac04bbb7046 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.727396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77964f-96da-4e7a-9e3b-7ac04bbb7046 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.727672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77964f-96da-4e7a-9e3b-7ac04bbb7046 None admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.728300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77964f-96da-4e7a-9e3b-7ac04bbb7046 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:42.729757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77964f-96da-4e7a-9e3b-7ac04bbb7046 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-14c18384-ef29-4e59-a793-d91055c5b745 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:42.730288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:42.731146 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:42.731932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 153/324] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:28:42.734291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9a5af-6f8f-47b9-8ece-df0132e3ca54 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.734578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9a5af-6f8f-47b9-8ece-df0132e3ca54 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.734854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9a5af-6f8f-47b9-8ece-df0132e3ca54 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.736358 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 154/325] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:42.737103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9a5af-6f8f-47b9-8ece-df0132e3ca54 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:42.741092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:42.809230 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 172/326] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Sep 6 10:28:42 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:28:42.810602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.810954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.811316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.832838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:42.834233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:42.846566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9a5af-6f8f-47b9-8ece-df0132e3ca54 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:42.859513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:42.895312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:42.896096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:42.896463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:42.896742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:42.897443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:42.897752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:42.899767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:42.911222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 155/327] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:42.915225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:42.922719 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 173/328] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:43.025356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb8f1-8e21-4334-96c0-61a3e53a7ba7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:43.059899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:43.060529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:43.060815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:43.061089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] PATH_INFO: `/v3/users/e828121e56f04d538bc9af11399c5af2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:43.062221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] RBAC: Authorizing `identity:get_user(user_id=e828121e56f04d538bc9af11399c5af2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:43.063700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:43.065259 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 156/329] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:42 2022] GET /identity/v3/users/e828121e56f04d538bc9af11399c5af2 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:43.071812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:43.182203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068385f-ee82-48c8-bab6-75f6e10e979e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:43.209582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:43.218721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:43.222073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:43.222073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:43.222073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:43.222073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] RBAC: Adding query filter params (role.id=2b2cdc35bd8e4dbca625836e27a9d865, user.id=e828121e56f04d538bc9af11399c5af2, scope.system=all) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:43.222073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:43.222533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:43.235330 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 174/330] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 6 10:28:43 2022] GET /identity/v3/role_assignments?user.id=e828121e56f04d538bc9af11399c5af2&scope.system=all&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:43.258168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:43.309875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:43.386121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab92b0-dc2f-416f-b903-a97fe83ba598 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:43.426298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:43.426946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:43.427269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:43.427623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:43.442695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:43.448484 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:43.449361 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:43.450297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 157/331] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:43.455365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:43.571769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7065a4-f613-4423-aebb-24ee7e119844 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:43.608659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:43.609634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:43.610121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:43.610605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:43.611530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:43.612061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:43.613638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:43.623984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 175/332] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:43.629252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:43.733618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:43.737636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab188-e84a-42f6-a118-87d0ecf17ea4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:43.772613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54620c48-4eb4-4b20-8557-f58022860cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:43.773260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620c48-4eb4-4b20-8557-f58022860cdc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:43.773545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620c48-4eb4-4b20-8557-f58022860cdc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:43.773824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620c48-4eb4-4b20-8557-f58022860cdc None admin] PATH_INFO: `/v3/users/ba85f1d557294142a7133cca0761652a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:43.776627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620c48-4eb4-4b20-8557-f58022860cdc None admin] RBAC: Authorizing `identity:get_user(user_id=ba85f1d557294142a7133cca0761652a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:43.778651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620c48-4eb4-4b20-8557-f58022860cdc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:43.780493 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 158/333] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:43 2022] GET /identity/v3/users/ba85f1d557294142a7133cca0761652a => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:43.787190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:43.839833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:43.905178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862999f2-809c-4840-9075-2b86ff2b95c6 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:43.950210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c79901-d8dc-4ea4-98d5-069e1054dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:43.950904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79901-d8dc-4ea4-98d5-069e1054dae9 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:43.951349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79901-d8dc-4ea4-98d5-069e1054dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:43.951631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79901-d8dc-4ea4-98d5-069e1054dae9 None admin] PATH_INFO: `/v3/system/users/ba85f1d557294142a7133cca0761652a/roles/9bcc153a83184ffc9c91cf100a6dbab2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:43.953066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c79901-d8dc-4ea4-98d5-069e1054dae9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba85f1d557294142a7133cca0761652a, role_id=9bcc153a83184ffc9c91cf100a6dbab2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:43.954517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c79901-d8dc-4ea4-98d5-069e1054dae9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:44.028034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 176/334] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Sep 6 10:28:43 2022] PUT /identity/v3/system/users/ba85f1d557294142a7133cca0761652a/roles/9bcc153a83184ffc9c91cf100a6dbab2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:45.597611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e62d-803a-4960-85cf-38e841c3831c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:45.598650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e62d-803a-4960-85cf-38e841c3831c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:45.599171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e62d-803a-4960-85cf-38e841c3831c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:45.600957 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 159/335] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:45.607332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f586fe-ca0a-4368-9643-ccf77639488a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:45.608358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f586fe-ca0a-4368-9643-ccf77639488a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:45.608802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f586fe-ca0a-4368-9643-ccf77639488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:45.630993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e4f586fe-ca0a-4368-9643-ccf77639488a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:45.632431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e4f586fe-ca0a-4368-9643-ccf77639488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:45.714301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 177/336] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:46.047148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10648f-6e69-454d-ad9f-5dce6004ff8b None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.047512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10648f-6e69-454d-ad9f-5dce6004ff8b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.047708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10648f-6e69-454d-ad9f-5dce6004ff8b None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.049188 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 160/337] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:46.054672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.054963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.055808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.080361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:46.081561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:46.123076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:46.162865 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 178/338] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:46.301894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10648f-6e69-454d-ad9f-5dce6004ff8b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:46.413629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10648f-6e69-454d-ad9f-5dce6004ff8b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:46.450974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:46.451686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.451971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.459219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.466359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:46.472094 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:46.473004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:46.474228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:46.476892 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 161/339] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:46.480692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:46.607926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c92a5-f800-467d-8fec-acd8d44d078f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:46.653029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:46.653943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.654402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.655132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.655972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:46.656451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:46.658124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c658-d662-446b-9488-f9da3f318bb7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:46.671821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 179/340] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:46.677974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:46.694378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d50b1f-9494-4be6-a752-2b916c65abc8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.694937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d50b1f-9494-4be6-a752-2b916c65abc8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.695447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d50b1f-9494-4be6-a752-2b916c65abc8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.697786 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 180/341] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:46.707124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d46d6b-6e09-4303-b515-d4725f485da4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.707668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d46d6b-6e09-4303-b515-d4725f485da4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.708124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d46d6b-6e09-4303-b515-d4725f485da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.734817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-25d46d6b-6e09-4303-b515-d4725f485da4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:46.736679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-25d46d6b-6e09-4303-b515-d4725f485da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:46.737488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:46.790224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:46.896644 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 181/342] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:46.901826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60efc63-00e9-4d13-a1b5-ab95bf807f9a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:46.950487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:46.951043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.951376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.951610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.965505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0b22-f7a8-4fb5-9ab5-f653f5ba979f None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.965830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0b22-f7a8-4fb5-9ab5-f653f5ba979f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.966160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0b22-f7a8-4fb5-9ab5-f653f5ba979f None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:46.967691 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 182/343] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:46.972713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:46.972996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:46.973267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.006099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:47.007324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:47.091973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:47.093455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:47.143125 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 183/344] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:47.144096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.146512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:47.244666 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 162/345] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:47.252586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.326981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:47.337880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fcdf-00a7-40d3-93b9-aacb5fae41ae None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:47.379646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:47.380282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:47.380565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:47.380838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.389947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa18a2-ac53-44cc-a616-c2e6fb4bccc3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:47.393804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:47.398866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:47.399946 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:47.400847 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 184/346] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:47.405915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.427388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:47.444580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:47.447228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:47.447228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:47.447228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.450623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:47.452172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:47.455937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 163/347] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:47.461607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.593519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ce32e-4481-4ab2-bb3a-ef267d7af39a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:47.621912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e961-52a5-41c1-86b8-c3240ecd8eb9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:47.631447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:47.632052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:47.632342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:47.632622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.633345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:47.633655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:47.635334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:47.644766 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 185/348] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:47.650975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.670420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:47.677697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:47.678632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:47.679662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:47.680167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.697224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:47.699241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:47.717859 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 164/349] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:47.717859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.767309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f2b4-bfdd-41a8-b1aa-f2799369aced None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:47.788510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:47.812052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:47.812767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:47.813050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:47.813356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.831885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:47.837960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:47.839091 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:47.840063 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 186/350] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:47.843933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:47.854506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b226c03-5b33-407d-bfcf-7732a06251f6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:47.910742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:47.911407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:47.911696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:47.912040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:47.938186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:47.975374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325866-339e-44b2-ac71-d0f6a0f4289c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.007137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.009359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.027165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.028149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.028436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.028714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.029458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=3bef669158b14670adfd7ad3888a7352) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:48.029770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.032913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c3074-1314-4d85-9c35-b03402be2d00 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.038765 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 187/351] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:48.041014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f84b-fcc9-4130-8101-c2120c136ac5 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.041014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f84b-fcc9-4130-8101-c2120c136ac5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.041014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f84b-fcc9-4130-8101-c2120c136ac5 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.042959 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 188/352] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:48.042959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f84b-fcc9-4130-8101-c2120c136ac5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:48.112533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.176268 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 165/353] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:48.177766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:48.207807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f84b-fcc9-4130-8101-c2120c136ac5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.256577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818126-8d28-46e2-a757-bd912718ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.257781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818126-8d28-46e2-a757-bd912718ca34 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.258783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818126-8d28-46e2-a757-bd912718ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.259273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818126-8d28-46e2-a757-bd912718ca34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.268317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.273414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818126-8d28-46e2-a757-bd912718ca34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-62818126-8d28-46e2-a757-bd912718ca34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:48.279142 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:48.285191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 189/354] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:48.285977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.286703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.286703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.303478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2786dd1-9042-4a95-aca2-52c48d4cd55c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.304566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:48.306333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:48.355703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.356318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.356730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.357013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.357956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:48.358269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.359892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea3154-8f6f-4fa0-b8fb-478c037fe5c6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.370051 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 166/355] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:48.371832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8eb64-15ca-46d0-be44-e6fd21ed0465 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.372345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8eb64-15ca-46d0-be44-e6fd21ed0465 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.372820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8eb64-15ca-46d0-be44-e6fd21ed0465 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.374538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 167/356] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:48.375659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8eb64-15ca-46d0-be44-e6fd21ed0465 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:48.396605 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 190/357] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:48.397552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:48.406331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.508781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8eb64-15ca-46d0-be44-e6fd21ed0465 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.541081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dab6d-eba2-4852-9377-3598fab6cac0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.549667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.550691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.551241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.551730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.553207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.555597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.557959 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 168/358] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:48.559044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:48.573218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.583622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.584245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.584576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.584850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.585517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:48.585868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.588071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055d0d7-c0f1-4382-bac2-6af91252ccad None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.601642 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 191/359] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:48.604936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.604936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.604936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.640036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:48.641745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:48.690294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.702713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060724-3304-4f52-aa24-a78ba50c387a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.728602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 192/360] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:48.729455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:48.752821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.754319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.754608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.754880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.853546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.855037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.922387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70457ff-da19-4568-a33f-eebc5ba2e42d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:48.952712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.972387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:48.973726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:48.974426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:48.974899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:48.979914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:48.982057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:48.984967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:48.986030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 193/361] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:48.987203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.003038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 169/362] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:49.007298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.111517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b1705-8c54-4b9b-8732-d8feb18b9374 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.134877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09161f-f9e2-4d55-8d9c-fc772ba02c1e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.157775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.157775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.159417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.159417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.171416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:49.176516 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:49.177400 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:49.178205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 170/363] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:49.178866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.188732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.189586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.190016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.190428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.235085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:49.264208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:49.281293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.282925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.300675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef23595-da05-49ac-9476-dd5d50fa0859 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.344352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.344973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.345261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.345534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.346395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=3bef669158b14670adfd7ad3888a7352) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:49.346710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.348243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.355464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 171/364] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:49.356528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.410304 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 194/365] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:49.411232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.510493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa8744-fc39-47c0-9d4f-14f9b4af67e3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.521201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:49.532136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:49.535926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e229f-8b45-4e52-9023-5b2632ea658e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.559156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.560151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.560437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.560706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.562413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.564401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.566771 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 172/366] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:49.567964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.580978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.587050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.587050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.587050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.597892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:49.603611 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:49.604500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:49.605288 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 195/367] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:49.606719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.701323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a591d75-6917-46a5-a761-93e96fac3c94 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.720492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872f7a-6e40-464d-99e0-8c42a4c5f8be None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.738533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.739307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.739591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.739914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.740587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:49.740895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.742384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.757066 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 173/368] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:49.757259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.757707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.758524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.758636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.758791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.760006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.761584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.763371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 196/369] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:49.764124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.790150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:49.809333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:49.871034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b6e71-6869-4169-8d7a-57ae96bc2398 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.887050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426232a-cbd3-45b8-b0f0-7b707090314e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:49.919033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.919033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.919033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.919341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.920688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.921119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:49.921800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:49.922127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.922244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:49.922519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:49.923289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:49.923662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:49.925097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:49.927238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 174/370] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:49.927995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:49.939348 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 197/371] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:49.940268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.040241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:50.069259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ebd07-989b-41f1-b397-b545183c98c5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.071208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de227b1-c455-463d-a235-726af4dd40d9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.087291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:50.110602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.111371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.111730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.112078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.113292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.114840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.118467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 198/372] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.120994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.123568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.123568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.123568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] PATH_INFO: `/v3/users/ba85f1d557294142a7133cca0761652a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.123568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] RBAC: Authorizing `identity:get_user(user_id=ba85f1d557294142a7133cca0761652a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.125309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.125905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.128725 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 175/373] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:28:49 2022] GET /identity/v3/users/ba85f1d557294142a7133cca0761652a => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.130766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.247745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c5f1-32fc-48d3-a2e2-459e6b0fe1cb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.250529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b75fe-c800-49a9-8259-acb1c5c01cfb None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.285391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.286037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.286284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.286557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.287674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=df565644916b4b8fa2875131e5d4e5f8) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:50.288098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.290619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.290825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.291437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.291727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.292007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.296926 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 199/374] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.297704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.312255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:50.369661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:50.400927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.402424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.422405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a20d-1e64-441a-b860-7a4677db4d80 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.461838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.462569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.462861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.463181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.463936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=df565644916b4b8fa2875131e5d4e5f8) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:50.464248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.465945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.472503 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 200/375] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.473349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.568885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:50.587320 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 176/376] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:50.601491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.606405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea95d-d5ab-4107-94c8-d5ef0b87a6ac None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.646287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.646906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.647214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.647491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.648237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] RBAC: Adding query filter params (role.id=9bcc153a83184ffc9c91cf100a6dbab2, user.id=ba85f1d557294142a7133cca0761652a, scope.system=all) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:50.649622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.651356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f9ad4-b8b4-45ef-b1e9-1de64346980f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.666112 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 201/377] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/role_assignments?user.id=ba85f1d557294142a7133cca0761652a&scope.system=all&role.id=9bcc153a83184ffc9c91cf100a6dbab2 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.697182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b609e-8bc7-475f-9594-8e08ebb64efb None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.697491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b609e-8bc7-475f-9594-8e08ebb64efb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.697716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b609e-8bc7-475f-9594-8e08ebb64efb None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.699479 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 202/378] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:50.705127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.705469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.705747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.719418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:50.738074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:50.739487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:50.746200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe507d-8c7c-4947-b4a1-580e54202ec3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.786868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.787566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.787851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.788129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] PATH_INFO: `/v3/projects/bd30074e8f6b499db04c6cc2b896adb1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.789946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] RBAC: Authorizing `identity:get_project(project_id=bd30074e8f6b499db04c6cc2b896adb1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.791489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.793595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 177/379] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/projects/bd30074e8f6b499db04c6cc2b896adb1 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.812123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:50.838738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 203/380] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:50.939242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a667a-399e-4713-8338-eced7f30b245 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:50.978287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:50.978925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:50.979239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:50.979517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] PATH_INFO: `/v3/groups/d71dc87112784fff98b2c7c3d46a836e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:50.985461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] RBAC: Authorizing `identity:get_group(group_id=d71dc87112784fff98b2c7c3d46a836e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:50.986928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:50.988947 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 178/381] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/groups/d71dc87112784fff98b2c7c3d46a836e => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:50.994663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:51.087841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:51.142700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072fbcb-6e58-4cdb-9516-d976c83be674 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:51.181923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:51.182537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:51.182819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:51.183114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:51.183846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] RBAC: Adding query filter params (group.id=d71dc87112784fff98b2c7c3d46a836e, role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd30074e8f6b499db04c6cc2b896adb1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:51.184152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:51.185587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:51.195065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 204/382] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:50 2022] GET /identity/v3/role_assignments?group.id=d71dc87112784fff98b2c7c3d46a836e&scope.project.id=bd30074e8f6b499db04c6cc2b896adb1&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:51.309172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:51.323139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:51.443789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08d173-de65-4d81-8280-5033ee07c9c2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:51.479918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:51.480556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:51.480839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:51.481113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:51.492897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:51.497888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:51.499924 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:51.501789 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 179/383] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:51.509589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:51.639515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdfe32-df22-452a-9d47-a2bfa2a32a14 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:51.666505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:51.675901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:51.680784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:51.680784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:51.680784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:51.680784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:51.680784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:51.680784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:51.695449 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 205/384] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:51.701079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:51.783388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:51.820136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814693-32bd-4e17-bc1e-a99211a7a751 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:51.861664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:51.862301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:51.862583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:51.862858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:51.864010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:51.865447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:51.871431 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 180/385] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:51 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:51.873642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:51.984617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8776d-4e74-4a40-aa91-70b7f250d97f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:52.024667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63d605-5efd-44d4-8d37-c2d93d96fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:52.025301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63d605-5efd-44d4-8d37-c2d93d96fb61 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:52.025583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63d605-5efd-44d4-8d37-c2d93d96fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:52.025857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63d605-5efd-44d4-8d37-c2d93d96fb61 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:52.026985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63d605-5efd-44d4-8d37-c2d93d96fb61 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:52.028449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63d605-5efd-44d4-8d37-c2d93d96fb61 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:52.030351 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 206/386] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:51 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:52.036220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:52.155847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7013-c371-4c4b-96b7-5b5c718a846e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:52.191884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1928e-007e-4fa6-aee4-4aadeffbbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:52.192557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1928e-007e-4fa6-aee4-4aadeffbbf86 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:52.192840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1928e-007e-4fa6-aee4-4aadeffbbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:52.193177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1928e-007e-4fa6-aee4-4aadeffbbf86 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352/groups/7d8864c01619424e80b3c07b18fda30a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:52.195218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1928e-007e-4fa6-aee4-4aadeffbbf86 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bef669158b14670adfd7ad3888a7352, group_id=7d8864c01619424e80b3c07b18fda30a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:52.196773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1928e-007e-4fa6-aee4-4aadeffbbf86 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:52.284748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:52.291134 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 181/387] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 6 10:28:52 2022] PUT /identity/v3/projects/3bef669158b14670adfd7ad3888a7352/groups/7d8864c01619424e80b3c07b18fda30a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:52.486114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a95a-0cc1-4ea8-901f-27ab28c8cd3b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:52.486114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a95a-0cc1-4ea8-901f-27ab28c8cd3b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:52.486114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93a95a-0cc1-4ea8-901f-27ab28c8cd3b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:52.486114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 207/388] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:52.494860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:52.494860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:52.494860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:52.520667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:52.522215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:52.613775 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 182/389] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:53.035377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a95a-0cc1-4ea8-901f-27ab28c8cd3b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:53.113170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:53.177032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93a95a-0cc1-4ea8-901f-27ab28c8cd3b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:53.222525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:53.227271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.227643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.227935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.239508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:53.245096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:53.245968 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:53.246753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 208/390] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:53.256099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:53.387034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddab84-4630-4d5d-b9c7-e87bfe959e07 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:53.421701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:53.433904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:53.433904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.433904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.433904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.434296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:53.434296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:53.434422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4bebb-93db-4208-a91f-524141d9d2b3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:53.444020 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 183/391] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:53.450918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:53.599817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa058e7-5764-40bc-94e6-6dc9ba2664e6 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:53.616583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34115-578a-48ea-a0a4-c599dc91bb3a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.616888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34115-578a-48ea-a0a4-c599dc91bb3a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.617688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34115-578a-48ea-a0a4-c599dc91bb3a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.619379 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 184/392] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:53.620272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:53.632435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cc2a2-cc64-45fc-87bf-870a7e8e6584 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.633320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cc2a2-cc64-45fc-87bf-870a7e8e6584 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.633561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cc2a2-cc64-45fc-87bf-870a7e8e6584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.640406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:53.641050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.641338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.641614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.642802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:53.644383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:53.645954 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 209/393] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:53 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:53.652718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:53.670458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-945cc2a2-cc64-45fc-87bf-870a7e8e6584 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:53.672020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-945cc2a2-cc64-45fc-87bf-870a7e8e6584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:53.763133 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 185/394] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:53.764867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee453-3b94-4f95-830b-a11bb08d7d01 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.765346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee453-3b94-4f95-830b-a11bb08d7d01 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.765808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee453-3b94-4f95-830b-a11bb08d7d01 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.767276 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 186/395] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:53.780180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f58e0-36e4-44b9-a7f3-430c942a062d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.780723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f58e0-36e4-44b9-a7f3-430c942a062d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.781201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f58e0-36e4-44b9-a7f3-430c942a062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.797274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e536c8-b3f1-466e-ad26-5604fc2f301e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:53.823733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6a7f58e0-36e4-44b9-a7f3-430c942a062d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:53.825290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a7f58e0-36e4-44b9-a7f3-430c942a062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:53.843716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:53.845770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:53.847731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:53.848204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:53.849567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:53.852170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:53.858098 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 210/396] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:53 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:53.864719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:53.967537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 187/397] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:54.008960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:54.025270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a108-7f60-4f70-b1a5-5406c4778f52 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.093672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:54.094461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.094710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.094988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352/groups/7d8864c01619424e80b3c07b18fda30a/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.097217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bef669158b14670adfd7ad3888a7352, group_id=7d8864c01619424e80b3c07b18fda30a, role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:54.098667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:54.120937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883addd0-0d8c-42fa-9618-330dc43903f9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.121629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883addd0-0d8c-42fa-9618-330dc43903f9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.122134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883addd0-0d8c-42fa-9618-330dc43903f9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.124098 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 188/398] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:54.129913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.130543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.131091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.152005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:54.154730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:54.178432 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 211/399] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 6 10:28:53 2022] PUT /identity/v3/projects/3bef669158b14670adfd7ad3888a7352/groups/7d8864c01619424e80b3c07b18fda30a/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:54.180108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.223675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:54.275918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 189/400] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:54.340546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.376511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d016a7-a032-4952-9c22-f93634225068 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.392325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:54.418998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:54.419662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.419942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.420213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.433671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:54.443500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:54.446651 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:54.447885 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 212/401] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:54.455813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.489028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071528be-89d9-43b1-a2b5-4d04cfd3ec80 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.557656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:54.558231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.558515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.558792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.584068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:54.589886 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:54.590767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:54.591592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:54.594175 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 190/402] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:54.610482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.619304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed63536-f1dc-4b3d-8f00-cdcd94ff564b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.674717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:54.675381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.675654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.675927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.676587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:54.676887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:54.678251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:54.700249 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 213/403] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:54.706577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:54.708264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.752897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:54.787674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12eaf-df46-4b9e-b779-4415605ca2fc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.827294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:54.828354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.828836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.829307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.830173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:54.830778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:54.832645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:54.843457 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 191/404] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:54.844672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.853419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a300-09e9-4e52-ae3f-4544c71d0932 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.897682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:54.898881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:54.899194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:54.899465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:54.900591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:54.902502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:54.909682 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 214/405] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:54.910664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:54.975045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dce59f-bfe2-45e1-ae5b-8635b7c51c97 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:54.977113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:55.015056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.015056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.015056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.015056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.026141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:55.032103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:55.033045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:55.033814 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:55.036382 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 192/406] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:55.037413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.058638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91499d3b-4cf7-4a4f-ba36-178ce767ee3f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.060829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:55.106635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.107671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.107867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.108147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.109271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.111757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.113391 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 215/407] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:54 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:55.114553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.158989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772a818-1d19-47a2-b098-28e801703ef4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.208927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.210372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.211188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.211662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.213955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.215661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.217557 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 193/408] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:55 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:55.218588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.258698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380846bc-6ae2-4f95-89fe-2ba6ecb7437c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.259821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:55.307197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.307846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.308094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.308365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.309322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:55.309626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.311677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.324865 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 216/409] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:55.325373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.358658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b897d0-c0ff-42b2-862b-868946c57f74 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.364535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:55.400379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.401006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.401289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.401564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.402672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.404199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.405829 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 194/410] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:55 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:55.406589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.446718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af2176-f22f-4ed3-bae5-39e4f31e4268 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.483194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.484160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.484749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.485033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8/groups/7d8864c01619424e80b3c07b18fda30a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.487142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] RBAC: Authorizing `identity:create_grant(project_id=df565644916b4b8fa2875131e5d4e5f8, group_id=7d8864c01619424e80b3c07b18fda30a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.488713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.506781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:55.510255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739720a-5697-479c-a3e7-3e18f7fc9be0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.543350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dd1ed-57a2-4c86-8cc4-d46b0655f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.543977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd1ed-57a2-4c86-8cc4-d46b0655f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.544267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd1ed-57a2-4c86-8cc4-d46b0655f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.544550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd1ed-57a2-4c86-8cc4-d46b0655f6d4 None admin] PATH_INFO: `/v3/groups/d71dc87112784fff98b2c7c3d46a836e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.545702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dd1ed-57a2-4c86-8cc4-d46b0655f6d4 None admin] RBAC: Authorizing `identity:get_group(group_id=d71dc87112784fff98b2c7c3d46a836e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.547178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dd1ed-57a2-4c86-8cc4-d46b0655f6d4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.553464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 195/411] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:55 2022] GET /identity/v3/groups/d71dc87112784fff98b2c7c3d46a836e => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:55.553464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5d62-2c1f-4f2c-81ac-131d666f8632 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.553464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5d62-2c1f-4f2c-81ac-131d666f8632 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.553464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5d62-2c1f-4f2c-81ac-131d666f8632 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.553464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 196/412] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:55.553464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed5d62-2c1f-4f2c-81ac-131d666f8632 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.569338 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 217/413] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 6 10:28:55 2022] PUT /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8/groups/7d8864c01619424e80b3c07b18fda30a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:55.570480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.673411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:55.686182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a54dc-dabd-48c6-a82f-79a2d40cec26 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.695848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed5d62-2c1f-4f2c-81ac-131d666f8632 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:55.725313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f2f8-3f97-4db2-9258-3ba24618d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.726846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f2f8-3f97-4db2-9258-3ba24618d744 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.727449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f2f8-3f97-4db2-9258-3ba24618d744 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.728011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f2f8-3f97-4db2-9258-3ba24618d744 None admin] PATH_INFO: `/v3/projects/bd30074e8f6b499db04c6cc2b896adb1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.729377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f2f8-3f97-4db2-9258-3ba24618d744 None admin] RBAC: Authorizing `identity:get_project(project_id=bd30074e8f6b499db04c6cc2b896adb1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.731289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f2f8-3f97-4db2-9258-3ba24618d744 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.733463 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 218/414] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:55 2022] GET /identity/v3/projects/bd30074e8f6b499db04c6cc2b896adb1 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:55.734993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.735565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.736045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.743679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:55.744167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:55.744493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:55.744954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8/groups/7d8864c01619424e80b3c07b18fda30a/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:55.748387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] RBAC: Authorizing `identity:create_grant(project_id=df565644916b4b8fa2875131e5d4e5f8, group_id=7d8864c01619424e80b3c07b18fda30a, role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:55.750042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:55.758753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:55.760349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:55.820786 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 197/415] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 6 10:28:55 2022] PUT /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8/groups/7d8864c01619424e80b3c07b18fda30a/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:55.828279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:55.844660 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 219/416] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:55.870814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:56.007318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f1815-c6aa-4ea7-bfac-d5c214e2c1ca None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:56.060771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:56.061452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:56.061734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:56.062119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] PATH_INFO: `/v3/projects/bd30074e8f6b499db04c6cc2b896adb1/groups/d71dc87112784fff98b2c7c3d46a836e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:56.064102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] RBAC: Authorizing `identity:create_grant(project_id=bd30074e8f6b499db04c6cc2b896adb1, group_id=d71dc87112784fff98b2c7c3d46a836e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:56.065549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:56.153824 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 198/417] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Sep 6 10:28:55 2022] PUT /identity/v3/projects/bd30074e8f6b499db04c6cc2b896adb1/groups/d71dc87112784fff98b2c7c3d46a836e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:28:56.229574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:56.339512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:56.353533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143c63b-b06c-46c9-9e8b-bf1899856a14 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:56.396691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:56.397568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:56.398051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:56.399129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:56.417403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:56.422522 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:56.423708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:56.424682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:56.426683 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 220/418] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:56.433234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:56.548979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:56.565320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fe612-5a72-46cb-ae67-5be987a22e0a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:56.606533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:56.607403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:56.607749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:56.608039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:56.608712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] RBAC: Adding query filter params (name=member) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:56.609020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:56.610403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16035d-bc75-4a5c-a5eb-fe9595fb3523 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:56.619866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 199/419] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:56.626081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:56.653477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970d110-4d2d-498c-acbc-7501d1b3309e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:56.653477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970d110-4d2d-498c-acbc-7501d1b3309e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:56.653477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970d110-4d2d-498c-acbc-7501d1b3309e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:56.653477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 200/420] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:56.662881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:56.662881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:56.662881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:56.691387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:56.694438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:56.820511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d3be3-b1e4-4400-a965-0ed56e5ffe09 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:56.834802 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 201/421] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:56.870750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:56.871326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:56.871609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:56.871884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:56.892542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:56.945157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:56.946627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:57.053471 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 221/422] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:57.059423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:57.159203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:57.186480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358145b-b9ce-46d3-97fe-8f7f0a7826ac None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:57.201767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:57.246987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:57.248022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:57.248504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:57.249034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:57.250584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:57.252235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:57.254752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 202/423] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:57 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:57.261908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:57.294403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:57.390012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb133e-0b91-454c-9541-2a8bcca4912b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:57.426834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:57.427413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:57.427695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:57.427966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:57.438379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:57.443570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:57.444440 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:57.445311 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:57.449670 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 222/424] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:57.450958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:57.453252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7a898-2a3b-4572-9b3a-6830967e80d2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:57.521978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:57.522671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:57.523511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:57.523977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:57.526334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:57.527817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:57.529752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 203/425] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:57 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:57.535846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:57.564168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:57.628171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5cc2-192a-4404-af1a-59dea12a2203 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:57.651822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:57.676437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2f434-b50d-44f5-845c-c24463e4956b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:57.692140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:57.692785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:57.693072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:57.693345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:57.694017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:57.694321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:57.696478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:57.713609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:57.714213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:57.714490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:57.714611 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 223/426] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:57.714772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:57.715511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=3bef669158b14670adfd7ad3888a7352) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:57.715820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:57.717255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:57.720690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:57.723531 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 204/427] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:57 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:57.846776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7f81c-0284-447f-8f1f-81c22f3395c6 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:57.897411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:57.898669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:57.898954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:57.899250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:57.958961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:57.987374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:57.988895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:58.102984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 224/428] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:28:58.108994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:58.213035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:58.237196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f6f0-a712-438b-90ce-7bea6079a27a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:58.278791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0272-80f4-4850-92b4-ad123ead6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:58.279462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0272-80f4-4850-92b4-ad123ead6083 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.279742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0272-80f4-4850-92b4-ad123ead6083 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.280017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0272-80f4-4850-92b4-ad123ead6083 None admin] PATH_INFO: `/v3/projects/3bef669158b14670adfd7ad3888a7352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.281153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0272-80f4-4850-92b4-ad123ead6083 None admin] RBAC: Authorizing `identity:get_project(project_id=3bef669158b14670adfd7ad3888a7352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:58.282603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0272-80f4-4850-92b4-ad123ead6083 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:58.288937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 205/429] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:58 2022] GET /identity/v3/projects/3bef669158b14670adfd7ad3888a7352 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:58.290284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:58.300471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfac9a-e0aa-4d89-9c64-1958ac223c91 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.300770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfac9a-e0aa-4d89-9c64-1958ac223c91 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.301036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfac9a-e0aa-4d89-9c64-1958ac223c91 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.302505 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 206/430] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:58.311040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.311040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.311040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.329808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:58.331144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:58.383392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:58.411741 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 207/431] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:28:58.450691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805208-a761-46e6-9660-cb23fe6890c0 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:58.502971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74037296-945c-48fe-84ff-acc13d1cc4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:58.503579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037296-945c-48fe-84ff-acc13d1cc4d2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.503864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037296-945c-48fe-84ff-acc13d1cc4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.504143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037296-945c-48fe-84ff-acc13d1cc4d2 None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.505441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037296-945c-48fe-84ff-acc13d1cc4d2 None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:58.506911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037296-945c-48fe-84ff-acc13d1cc4d2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:58.508882 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 225/432] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:58 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:58.514885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:58.594415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18331-9c70-4d3f-90b0-eaff1c21318a None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.594798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18331-9c70-4d3f-90b0-eaff1c21318a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.594967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd18331-9c70-4d3f-90b0-eaff1c21318a None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.596878 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 226/433] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:28:58.602712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.603000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.603302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.621417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:58.628834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:58.630343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:58.640001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6dab3-233b-47ad-98e2-1173ffda87df None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:58.693708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:58.694426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.694770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.695701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.696018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=3bef669158b14670adfd7ad3888a7352) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:58.696422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:58.698564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:58.707079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 208/434] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:58 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=3bef669158b14670adfd7ad3888a7352&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:58.718380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 227/435] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:58.802745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:58.918899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea398b-42dc-46dd-a351-2659d8fea5a6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:58.958172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:58.958910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:58.959246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:58.959525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:58.969692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:58.973318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:58.979490 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:58.989499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:58.990275 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 209/436] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:58.990924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.062748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.078087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.098100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316660-a9cc-4142-b5a0-6d7c242ca304 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.145467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.146086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.146372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.146647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.147354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] RBAC: Adding query filter params (name=member) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:59.147664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.150278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365fa8f-4c69-4cbc-9491-0582223c0edd None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.157686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 228/437] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:59.159249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc323eb-cdec-4a67-b6f8-425d31b166f8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.160497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc323eb-cdec-4a67-b6f8-425d31b166f8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.160497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc323eb-cdec-4a67-b6f8-425d31b166f8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.161172 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 229/438] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:28:59.166409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc323eb-cdec-4a67-b6f8-425d31b166f8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.196042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc2638-f1a8-45fc-803f-44c5d72982d4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.239407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc186b8-649b-41e6-bdfb-a9eb44d9fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.240043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc186b8-649b-41e6-bdfb-a9eb44d9fa21 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.240349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc186b8-649b-41e6-bdfb-a9eb44d9fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.240622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc186b8-649b-41e6-bdfb-a9eb44d9fa21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.252694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc186b8-649b-41e6-bdfb-a9eb44d9fa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5fc186b8-649b-41e6-bdfb-a9eb44d9fa21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:59.258934 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:59.259970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:28:59.260784 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 210/439] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:28:59.261423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.262359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.262359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.279341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:28:59.280521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:28:59.288039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc323eb-cdec-4a67-b6f8-425d31b166f8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.317228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.322060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.322658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.322935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.323237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.335408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.346223 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 211/440] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:28:59.347116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.391195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.392671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.463371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815aae8-e9be-4bfd-908e-1d43764dd431 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.499533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.500132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.500460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.500734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.501391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:59.501768 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 230/441] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:28:59.503400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.504788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.506843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.513521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 212/442] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:59.518773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.542975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.572728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.616721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dc1c6-a169-4e99-9394-b340a3396975 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.627018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bbb30-300f-4f42-a185-3e3be3d77966 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.652611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.653234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.653515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.653787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.654892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.656372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.658167 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 231/443] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:59.663292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.663424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.664635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.664916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.665195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.733336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.734786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.762077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.765064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98fafb-95d5-49e2-8978-11317e5107a2 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.785313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:28:59.798698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.799349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.799628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.799900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.800994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.802432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.804015 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 232/444] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:28:59.804894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.838919 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 213/445] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:28:59.840078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.909216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeccf8c-bc4b-49ea-9a8e-8444b6f82b01 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.940205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff490f57-ebc5-4624-aa08-37f5d9fefdac None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:28:59.944207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.945324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.945609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.945876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.956111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:28:59.961417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:28:59.962289 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:28:59.963197 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 233/446] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:28:59.963844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:28:59.976304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:28:59.976912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:28:59.977196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:28:59.977474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:28:59.978201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=2b2cdc35bd8e4dbca625836e27a9d865, scope.project.id=df565644916b4b8fa2875131e5d4e5f8) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:28:59.978518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:28:59.979992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:28:59.986018 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 214/447] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=2b2cdc35bd8e4dbca625836e27a9d865 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:28:59.986646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.006086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.006831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.088298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43904efa-060e-4613-8c8e-646c63384046 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.101853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496b80-3c0c-4b77-926a-45db4c40aebc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.126456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.127144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.127437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.127729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] PATH_INFO: `/v3/projects/df565644916b4b8fa2875131e5d4e5f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.128967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] RBAC: Authorizing `identity:get_project(project_id=df565644916b4b8fa2875131e5d4e5f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.130444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.132202 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 234/448] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/projects/df565644916b4b8fa2875131e5d4e5f8 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:00.138314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.145612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.146236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.146520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.150628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.150628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:00.150628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.150628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.159377 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 215/449] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:00.165007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.258223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.264972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.271125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18321a1c-137a-4b38-8dc6-e1434d7c434a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.293468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f3c2-6a2a-4aa7-a723-04d340d31248 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.313840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.314480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.314764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.315056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] PATH_INFO: `/v3/groups/7d8864c01619424e80b3c07b18fda30a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.316469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] RBAC: Authorizing `identity:get_group(group_id=7d8864c01619424e80b3c07b18fda30a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.318242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.320615 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 235/450] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:29:00 2022] GET /identity/v3/groups/7d8864c01619424e80b3c07b18fda30a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:00.327240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.338423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.339075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.339363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.339638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.415190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.416558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.440357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07cf5e-dfbc-402c-a640-16d178dbb0b6 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.474110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.474704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.474983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.475292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.476002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] RBAC: Adding query filter params (group.id=7d8864c01619424e80b3c07b18fda30a, role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=df565644916b4b8fa2875131e5d4e5f8) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:00.476351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.477764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.483804 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 236/451] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:29:00 2022] GET /identity/v3/role_assignments?group.id=7d8864c01619424e80b3c07b18fda30a&scope.project.id=df565644916b4b8fa2875131e5d4e5f8&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:00.499175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.524446 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 216/452] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:29:00.530549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.561255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.638417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44fc3-ac2d-4a02-86ad-b8b0f0026f5b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.674098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.674649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.674925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.675227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] PATH_INFO: `/v3/projects/bd30074e8f6b499db04c6cc2b896adb1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.676339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] RBAC: Authorizing `identity:get_project(project_id=bd30074e8f6b499db04c6cc2b896adb1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.677752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.679962 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 237/453] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:29:00 2022] GET /identity/v3/projects/bd30074e8f6b499db04c6cc2b896adb1 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:00.685448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.787817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d2073-c198-4b6d-afe0-b10c2ac95461 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.822871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bea9a-66dd-4f9c-bcc0-07abf7d71152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.823612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bea9a-66dd-4f9c-bcc0-07abf7d71152 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.823893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bea9a-66dd-4f9c-bcc0-07abf7d71152 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.824163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bea9a-66dd-4f9c-bcc0-07abf7d71152 None admin] PATH_INFO: `/v3/groups/d71dc87112784fff98b2c7c3d46a836e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.825262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bea9a-66dd-4f9c-bcc0-07abf7d71152 None admin] RBAC: Authorizing `identity:get_group(group_id=d71dc87112784fff98b2c7c3d46a836e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.826686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bea9a-66dd-4f9c-bcc0-07abf7d71152 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.828473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 217/454] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Sep 6 10:29:00 2022] GET /identity/v3/groups/d71dc87112784fff98b2c7c3d46a836e => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:00.834383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:00.930285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:00.935809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bd681-ed6f-4e4e-9e87-8bc81e8937f8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:00.967545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:00.968137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:00.968418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:00.968691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:00.969403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] RBAC: Adding query filter params (group.id=d71dc87112784fff98b2c7c3d46a836e, role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd30074e8f6b499db04c6cc2b896adb1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:00.969711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:00.971163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7369c-4107-45b4-82a8-572e10472f19 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:00.977181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 238/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Sep 6 10:29:00 2022] GET /identity/v3/role_assignments?group.id=d71dc87112784fff98b2c7c3d46a836e&scope.project.id=bd30074e8f6b499db04c6cc2b896adb1&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:03.834073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8904-f547-46a8-9d33-771e1ae990b0 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:03.834962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8904-f547-46a8-9d33-771e1ae990b0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:03.835418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8904-f547-46a8-9d33-771e1ae990b0 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:03.837295 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 218/456] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:03.843681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69062-8be7-4248-b953-2c94b4142a2c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:03.844646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69062-8be7-4248-b953-2c94b4142a2c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:03.845142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69062-8be7-4248-b953-2c94b4142a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:03.850246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6317a-fa37-48c4-878f-5e80f153b780 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:03.850860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6317a-fa37-48c4-878f-5e80f153b780 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:03.851891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6317a-fa37-48c4-878f-5e80f153b780 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:03.853807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 219/457] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:03.866212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7606-07e7-4063-9409-f51952b020c2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:03.866521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7606-07e7-4063-9409-f51952b020c2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:03.866853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7606-07e7-4063-9409-f51952b020c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:03.877309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7cc69062-8be7-4248-b953-2c94b4142a2c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:03.882044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7cc69062-8be7-4248-b953-2c94b4142a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:03.906244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-81eb7606-07e7-4063-9409-f51952b020c2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:03.906244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-81eb7606-07e7-4063-9409-f51952b020c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:03.997738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:04.003055 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 239/458] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:04.032645 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 220/459] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:04.055139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654568-e2f2-43e6-8393-70b48d4459dc None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.055772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654568-e2f2-43e6-8393-70b48d4459dc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.056273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654568-e2f2-43e6-8393-70b48d4459dc None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.058124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 240/460] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:04.063003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.063536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.064004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.092095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:04.093560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:04.181865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 221/461] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:04.414612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654568-e2f2-43e6-8393-70b48d4459dc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:04.509315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:04.534569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:04.545267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654568-e2f2-43e6-8393-70b48d4459dc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:04.580077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:04.581137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.581918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.582197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.593491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:04.595550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-fad80bb9-4fb6-4097-a07d-f0ed02afc101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:04.616109 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:04.617268 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 241/462] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78943dbb-62d5-490d-b338-c394146a8cf0 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78943dbb-62d5-490d-b338-c394146a8cf0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78943dbb-62d5-490d-b338-c394146a8cf0 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 242/463] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:04.624360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78943dbb-62d5-490d-b338-c394146a8cf0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:04.624842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b5de5-8601-4bcb-8171-8c045d6224e7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:04.633810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:04.663218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:04.664323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.665001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.665227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.675832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:04.677435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:04.692842 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:04.693749 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:04.694608 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:04.694608 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:04.694608 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:04.694608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 222/464] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:04.695894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:04.738454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78943dbb-62d5-490d-b338-c394146a8cf0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:04.774517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:04.775177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.775514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.775789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.787852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:04.789333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:04.791239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-409a41ef-7538-4016-b787-53992f6f8dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:04.805708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:04.806631 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:04.808113 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:04.808113 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:04.808113 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:04.808273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b566cc-b529-48ef-ab44-19df2baa0d3d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:04.808353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 243/465] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:04.811924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.812441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.812716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.832841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:04.834076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:04.843456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:04.844083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:04.844343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:04.844624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:04.845306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:04.845608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:04.846967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:04.860467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 223/466] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:04.861298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:04.888535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:04.920190 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 244/467] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:04.932237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:04.974085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bafd5c-58ba-44f1-bc1b-2ae9462d887d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.010978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.011700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.012089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.012456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.013170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:05.013542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.015040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.031086 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 224/468] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:05.031086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:05.058359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09153-43ce-4fa5-aede-3f974932d9d8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.093724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:05.106163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.107185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.108008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.108453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.109268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:05.109842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.111416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.117719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:05.130462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 245/469] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:05.131673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:05.143797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c032f-9497-462c-bcf1-fc42e64baba0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.181592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.182095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.182362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.182637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.183334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.185007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.241264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae501d-c9b2-4960-9382-e5b297e06fa7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.275156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161a7f-4332-4c43-9787-214189ef890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.275754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161a7f-4332-4c43-9787-214189ef890b None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.276035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161a7f-4332-4c43-9787-214189ef890b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.276307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161a7f-4332-4c43-9787-214189ef890b None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.276935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161a7f-4332-4c43-9787-214189ef890b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.278365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a161a7f-4332-4c43-9787-214189ef890b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.295180 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 225/470] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:29:05 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:05.295980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:05.366600 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 246/471] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:29:05 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:05.369065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddde4-fc09-4aae-a9e7-126b1e988c15 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.369607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddde4-fc09-4aae-a9e7-126b1e988c15 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.369894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddde4-fc09-4aae-a9e7-126b1e988c15 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.371589 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 247/472] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:05.376130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fddde4-fc09-4aae-a9e7-126b1e988c15 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:05.421315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59cda-155f-4627-bc3e-fc760e04cc45 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.450708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:05.476841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9af51-59d6-4bc1-825e-8ed9d4a79dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.477762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9af51-59d6-4bc1-825e-8ed9d4a79dd7 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.478148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9af51-59d6-4bc1-825e-8ed9d4a79dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.478556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9af51-59d6-4bc1-825e-8ed9d4a79dd7 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.479566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9af51-59d6-4bc1-825e-8ed9d4a79dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.481584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9af51-59d6-4bc1-825e-8ed9d4a79dd7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.494555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:05.531161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fddde4-fc09-4aae-a9e7-126b1e988c15 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.572871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.573533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.573813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.574086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.587381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 226/473] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:29:05 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:05.588600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.588710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.590676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.590793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.590793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.610470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:05.611004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:05.611963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:05.612800 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:05.612800 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:05.612800 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:05.612975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:05.613046 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 248/474] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:05.620130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:05.708166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 227/475] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:05.748533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:05.755931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5e6a-2a16-49f2-aecb-93689c0e009f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.799546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.800159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.800669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.800953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.801614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:05.801920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.803324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:05.817838 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 249/476] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:05.825226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:05.936018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd85e-524f-4140-adda-ff7c79db3d56 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:05.959955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:05.972088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:05.972720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:05.974363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:05.974363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:05.974363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:05.975591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:06.066261 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 228/477] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:29:05 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:06.100589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:06.230613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025528e6-2990-4dbb-9df4-90c1ea32cdac None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:06.266354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:06.266971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:06.267277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:06.267551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:06.268223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:06.269600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:06.319439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.sql.core [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 10:29:06.319439 ncdv-master-1 devstack@keystone.service[92878]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 10:29:06.319439 ncdv-master-1 devstack@keystone.service[92878]: [parameters: {'id': 'f47685114bd94b09b78182aed91a056f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 10:29:06.319439 ncdv-master-1 devstack@keystone.service[92878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application conn.query(q) Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result.read() Sep 06 10:29:06.340228 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 10:29:06.341667 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application next(self.gen) Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application yield resource Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application next(self.gen) Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise self.value Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application session.commit() Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 10:29:06.342538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.session.flush() Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application compat.raise_( Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 10:29:06.344035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:29:06.344860 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application conn.query(q) Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result.read() Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:29:06.345766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [parameters: {'id': 'f47685114bd94b09b78182aed91a056f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:06.347181 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 10:29:06.349191 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:06.355302 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 250/478] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 6 10:29:06 2022] POST /identity/v3/roles => generated 144 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:06.355458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:06.477794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2181-e69b-4021-80f8-ce0a3e8dc846 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:06.516903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4e791-6449-4061-991b-388223ba3387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:06.517560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e791-6449-4061-991b-388223ba3387 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:06.517842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e791-6449-4061-991b-388223ba3387 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:06.518116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4e791-6449-4061-991b-388223ba3387 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:06.530040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4e791-6449-4061-991b-388223ba3387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-9ad4e791-6449-4061-991b-388223ba3387 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:06.537557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:06.538704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:06.540040 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 229/479] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:06.547330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:06.566104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:06.655817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b810c61-d47c-4c42-9ef5-cff1f8d4a869 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:06.696619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:06.697221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:06.697498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:06.697823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:06.698535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:06.698843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:06.700243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b145704-d333-48b9-8640-17e9da549ccb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:06.710417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 251/480] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:07.952939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cb1e5-3f4a-44c2-b8dc-991be409042b None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:07.953677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cb1e5-3f4a-44c2-b8dc-991be409042b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:07.953677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cb1e5-3f4a-44c2-b8dc-991be409042b None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:07.955225 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 230/481] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:07.961679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf656e-a8a9-43e7-9cb6-f200f1729c2a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:07.962164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf656e-a8a9-43e7-9cb6-f200f1729c2a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:07.962241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf656e-a8a9-43e7-9cb6-f200f1729c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:07.988405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-37bf656e-a8a9-43e7-9cb6-f200f1729c2a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:07.989884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37bf656e-a8a9-43e7-9cb6-f200f1729c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:08.093596 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 252/482] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:08.166789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683b3c-77d3-4fa3-9020-a6f8326bc049 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:08.167097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683b3c-77d3-4fa3-9020-a6f8326bc049 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:08.167284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683b3c-77d3-4fa3-9020-a6f8326bc049 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:08.168751 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 231/483] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:08.174042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6b97c-9dd3-4d0f-98f0-d184639041e8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:08.174333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6b97c-9dd3-4d0f-98f0-d184639041e8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:08.174610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6b97c-9dd3-4d0f-98f0-d184639041e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:08.193537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-43b6b97c-9dd3-4d0f-98f0-d184639041e8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:08.194750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43b6b97c-9dd3-4d0f-98f0-d184639041e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:08.197570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:08.308719 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 253/484] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:08.440763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638423fd-48fa-4490-af04-0f487a0afbdf None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:08.441096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638423fd-48fa-4490-af04-0f487a0afbdf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:08.441272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638423fd-48fa-4490-af04-0f487a0afbdf None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:08.442795 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 232/485] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:08.448530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:08.449084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:08.449566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:08.482570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:08.484380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:08.493083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638423fd-48fa-4490-af04-0f487a0afbdf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:08.575184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:08.600648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 254/486] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:08.676495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638423fd-48fa-4490-af04-0f487a0afbdf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:08.721046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:08.721690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:08.721980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:08.722256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:08.737192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:08.742948 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:08.744006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:08.745139 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 233/487] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:08.752104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:08.784859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:08.866632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:08.940332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344953-0f6f-4e6e-8c7a-6a7ca04ddc17 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:08.991560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.002960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6f54d-b8f1-4d7e-918a-9ece7cbf14b2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.026501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.027153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.027415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.027851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.028395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:09.028793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.030075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.042727 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 255/488] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:09.043618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.059698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.060478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.060863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.061433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.076189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:09.084397 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:09.086247 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 234/489] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:09.088348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.157724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe390b8-aeb2-4646-b9f0-6998cf45a411 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.197844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.205852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.206484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.206766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.206884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828eb1a8-9879-4992-ac54-f362a831a894 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.207067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.221324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:09.228357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:09.229201 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:09.229959 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:09.231167 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 256/490] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:09.232236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.248007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.248559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.248839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.249111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.259689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.261135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a6439491-5d87-4152-be7d-aa4fde6c009a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:09.276332 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:09.277284 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:09.278116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:09.278116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:09.278116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:09.278116 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 235/491] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:09.278740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db69d-951b-4951-b356-10196f16e458 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.278930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db69d-951b-4951-b356-10196f16e458 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.279227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db69d-951b-4951-b356-10196f16e458 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.283287 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 236/492] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:09.284204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db69d-951b-4951-b356-10196f16e458 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.298032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.349710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c72e-11a4-44d0-a962-deb3eaff23be None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.385714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.386322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.386602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.386877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.387558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:09.387863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.389228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.394722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db69d-951b-4951-b356-10196f16e458 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.397710 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 257/493] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:09.398502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.434911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f2074-445e-4413-b499-2a052234b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.435550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2074-445e-4413-b499-2a052234b55b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.435831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2074-445e-4413-b499-2a052234b55b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.436106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2074-445e-4413-b499-2a052234b55b None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.436769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f2074-445e-4413-b499-2a052234b55b None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:09.437076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f2074-445e-4413-b499-2a052234b55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.438439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f2074-445e-4413-b499-2a052234b55b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.446838 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 237/494] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:09.452465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.452988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.453997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.455154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.478552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:09.479823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:09.504363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315cc98-64a2-4ad9-921f-189e8a951052 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.538690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.539986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.540273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.540738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.541396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:09.541667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.543158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.546432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.559212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 238/495] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:09.559212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.567564 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 258/496] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:09.569034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.675456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707ca07-ab76-4f0e-96fa-cf7333dd8329 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.714177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4dce6-a5cf-48d6-a11e-787859222462 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.720784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.721422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.721707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.721984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.735422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.737666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.739166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:09.762702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:09.763760 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:09.764587 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:09.764587 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:09.764587 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:09.764744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.764744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.764744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.764951 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 239/497] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:09.765023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.765088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.771311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.773998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-f9d1a7a2-ce37-46e7-b3da-ba7bf8fc5b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:09.793309 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:09.794180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:09.795103 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:09.795103 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:09.795103 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:09.795103 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 259/498] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:09.796148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30cd7-face-46a8-8e0c-37cda721c8bd None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.796431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30cd7-face-46a8-8e0c-37cda721c8bd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.796701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30cd7-face-46a8-8e0c-37cda721c8bd None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.802186 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 260/499] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:09.802186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30cd7-face-46a8-8e0c-37cda721c8bd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.818611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:09.872051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86932a-2cd0-424a-853b-3d0c88c47db4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.906844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.907729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.908151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.908562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.916806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.918251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.920575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30cd7-face-46a8-8e0c-37cda721c8bd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:09.930693 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:09.931678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:09.932600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 240/500] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:09.933179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:09.955338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:09.955943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.956227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.956499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.957137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:09.957443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:09.958817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4856b58-d70b-4b04-9108-b14750167b93 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:09.971074 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 261/501] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:09.972113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:09.972405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:09.972683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:09.990618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:09.991929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:10.016543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.037160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306297-eb5b-46a7-af72-4779f09bbc69 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.050368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.069481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 262/502] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:10.070803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.072597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.073250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.073540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.073816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.074472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:10.074785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.076214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.088826 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 241/503] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:10.089535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.185520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22005cd-43f9-4e0a-9489-bf24af87af5a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.198020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747338ff-6651-4fe9-8cca-975af759307d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.221552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.222191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.222456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.222734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.233930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:10.235231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.236054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.236485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.236906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.237778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:10.238246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:10.238826 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:10.239904 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 263/504] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:10.243858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.246907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.260387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.288992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 242/505] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:10.288992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.329372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.359159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14926398-6990-4221-bc4f-8d02ed8eb409 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.397224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.397854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.398168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.398446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.405942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.407428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.408790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6b7c-684e-4e34-9f37-1ee834acc020 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:10.420653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:10.421811 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 264/506] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:10.422684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.446719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.447373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.447654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.447923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.454832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.456311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:10.467616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:10.468544 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 243/507] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:10.474049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.510209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.534436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a88a05-889d-4c6d-811e-994a31ef9bb4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.558524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.568196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f28c5-f784-431e-9760-a43888770702 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.570115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.570449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.570737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.571035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.571705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:10.572012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.573402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.581305 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 265/508] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:10.582172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.609020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.609626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.609910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.610181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.677090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.678542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.683124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e3c26-0e15-45e7-9625-6d0070329da2 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.716480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.717114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.717398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.717676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.720342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.729016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.730460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:10.745274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:10.746257 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:10.747116 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:10.747116 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:10.747116 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:10.747116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 266/509] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:10.747563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.767973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.778282 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 244/510] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:10.779112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.845798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b4f6-e138-45c8-983d-4035053b16e8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.880019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8007d-ff0b-4836-8899-2cc91056bf6a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:10.880934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.881534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.881811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.882077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.882827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:10.883163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.884611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.914995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:10.915628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:10.915914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:10.916223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:10.916921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:10.917232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:10.918662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:10.921190 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 267/511] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:10.922022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.936039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 245/512] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:10.936856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:10.972162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:10.985019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.024348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f2fab-192f-4a0c-91ed-c89af55a36ea None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.033934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8264e9-6fbd-4b4b-ad0a-b5adda0937d8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.059166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.059788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.060069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.060338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.066951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.067582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.067868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.068145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.068788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:11.069096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.070052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.070488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.071530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.081408 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 246/513] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:11.082188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:11.086161 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:11.087384 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:11.088710 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:11.088710 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:11.088710 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:11.088710 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 268/514] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:11.088710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.183676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040a2c2-caee-4556-bf40-f78315a7c218 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.186286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.189642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9e284-6ba0-4e40-9591-4cea857759b9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.192279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.218895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.219600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.219891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.220170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.223037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.223651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.223938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.224214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.230351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.231886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:11.246575 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:11.247677 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:11.248704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:11.248704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:11.248704 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:11.250186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 247/515] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:11.251391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.294908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.296460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.349245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b80da-8dbf-4141-9f2c-955ed01ad73d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.383984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.384583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.384867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.385140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.390452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.394880 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 269/516] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:11.395704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.417005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.458739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.460147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.493821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd404-9eab-4006-833c-40f98eff0718 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.528746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.529378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.529660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.529935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.530568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.532114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.558339 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 248/517] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:11.559207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.615252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.635357 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 270/518] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:29:11 2022] POST /identity/v3/users => generated 247 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:11.636188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.657079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14023c00-97d5-4372-88c8-76f6a537340c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.696937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.697576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.697860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.698137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.698882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:11.699235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.700687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.714000 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 249/519] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:11.714803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.722124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.773398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e190e-faa4-44dd-8ef3-c36a0b965e75 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.813141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.814229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.814518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.815107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.815770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:11.816076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.817996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.833421 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 271/520] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:11.834628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:11.835627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1f9b-638e-4e60-bddb-132498acdced None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:11.901229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:11.921804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:11.922450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:11.922737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:11.923455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:11.936749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:11.938555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:11.954071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:12.006398 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:12.007413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:12.007413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:12.007413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:12.007413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 250/521] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:12.007413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.007723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea6ac-7aa5-4c68-a0e7-e17d2579a12a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.007723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.026723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.027713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.028338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.028712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.040812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.042285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:12.058258 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:12.059381 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:12.060230 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:12.060230 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:12.060230 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:12.060230 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 272/522] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:12.060450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.076102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03aa57-032a-468b-9b26-f5edc9d8dc82 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.111830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.112455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.112745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.113022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.121521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.122984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:12.137625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:12.138603 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:12.139637 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 251/523] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:12.146466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.176795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee848a9-b021-4a45-b7b3-3b5052d6c373 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.180519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.213290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.214495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.214900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.215217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.222115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.223734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:12.237378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:12.238251 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 273/524] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:12.239530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.256168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fbefd-e299-47ba-a94c-38bb38e4e01c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.268894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.292646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.293256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.293544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.293814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.294466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:12.294778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.296179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.312087 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 252/525] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:12.312087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.353306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e531-48a2-4f1f-ad1e-0dbbcd5de37a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.387784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.388383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.388666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.388937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.389636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:12.389939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.391361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.403552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 274/526] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:12.404337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.417688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.427298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdefe5-422e-4303-b523-2c571c0fee52 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.464253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.464970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.465293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.465591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.466339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:12.466672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.468133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.486521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 253/527] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:12.487349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.499490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.514488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc9cce-dab5-4270-b892-4b8fdea54e1e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.555352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.555557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.555724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.556002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.556682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:12.556988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.558422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.581571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 275/528] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:12.581571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.601048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7204e4-3c96-4f1d-9a04-0470d8d3e17d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.639523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.640160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.640441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.640716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.648989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.650516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:12.663528 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:12.665015 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:12.665857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 254/529] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:12.666888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.682589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.700732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdcc3d-13c9-4fa8-8221-583d97f6255c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.739568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b8672-996a-499b-904f-9149643bc919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.740620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b8672-996a-499b-904f-9149643bc919 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.740620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b8672-996a-499b-904f-9149643bc919 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.740841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b8672-996a-499b-904f-9149643bc919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.747520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b8672-996a-499b-904f-9149643bc919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.749312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b8672-996a-499b-904f-9149643bc919 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-276b8672-996a-499b-904f-9149643bc919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:12.761143 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:12.761999 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 276/530] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:12.767480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b8672-996a-499b-904f-9149643bc919 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:12.775597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.784259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df5a5c-43c5-41f5-a904-84841ef93c2c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.827183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.827800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.828160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.828438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.874944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b8672-996a-499b-904f-9149643bc919 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:12.904619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.906206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.917850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:12.923021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:12.923665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:12.923947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:12.924223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:12.924952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=6c2ddfc46e6c414085493829459e5ea9) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:12.925261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:12.926692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:12.932458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 277/531] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/role_assignments?user.id=6c2ddfc46e6c414085493829459e5ea9&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:12.967130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.020150 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 255/532] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:13.021316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.044779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:13.076889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d94306-062b-40d6-8e74-eff84c63710f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.115734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.116370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.117251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.117609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.118399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:13.118800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.120625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.135204 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 278/533] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:13.136072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.163150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9610c-5b85-4f70-bf9f-c0a77078e4b1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.180014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:13.204869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.205810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.206276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.206761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.208062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:13.209880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.212164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.235835 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 256/534] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:13.236930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.261845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb086-d931-4d1a-ba05-bd0e714db5b9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.293055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:13.300049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.301018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.301531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.302032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.314257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.316249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:13.333302 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:13.334364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:13.335278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:13.335278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:13.335278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:13.337060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 279/535] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:13.338180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.368025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6208-702b-47ec-a745-6c67fa5c55f3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.404892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.405831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.406307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.406765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.407715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=3a5944ef46aa40078b84b486b24822eb) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:13.408261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.410076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.416986 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 257/536] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/role_assignments?user.id=3a5944ef46aa40078b84b486b24822eb&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:13.418134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.456750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df700cb6-814a-477b-b04b-6d098066888f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.457674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:13.505638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.510277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.510277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.510277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.510277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=c06e2a3faa864da19cef4089e8392702) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:13.510277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.510277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.516342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 280/537] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/role_assignments?user.id=c06e2a3faa864da19cef4089e8392702&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:13.591303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4d39f-1c2f-45bf-87ed-b161d0893529 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.643673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.644661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.645173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.645666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.646556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:13.647132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.648838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.662177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 258/538] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:13.668174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.733346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:13.793681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750fc1-b8d9-4893-9252-31a587fcdffc None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:13.839983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:13.840632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.841017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.841295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.848541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:13.849988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d21f30af-3961-4dfb-b871-fc6718fe97ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:13.865216 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:13.866082 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:13.866960 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:13.871042 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 281/539] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:13.872260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:13.959957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0bf21-b763-4566-b497-e22820ae41ad None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.960244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0bf21-b763-4566-b497-e22820ae41ad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.961061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0bf21-b763-4566-b497-e22820ae41ad None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:13.967160 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 282/540] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:13.972934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:13.973416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:13.973856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:14.003381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:14.008834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:14.010225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:14.011448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a14f1d-31e4-4a06-bddc-c66d8ddc1b84 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:14.053947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:14.054602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:14.054935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:14.055232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:14.055925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:14.056275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:14.057707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:14.079530 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 259/541] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:14.087982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:14.123703 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 283/542] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:14.251829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd306d6-907a-4e2c-9c87-2d534b953ac3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:14.297827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:14.298672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:14.299120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:14.299532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:14.300413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=3720ac834902404a9992a0a6aa43081a) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:14.300862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:14.302496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:14.315157 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 260/543] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:14 2022] GET /identity/v3/role_assignments?user.id=3720ac834902404a9992a0a6aa43081a&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:14.517214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:14.559506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:14.657222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7587f00-99d5-46b5-92a0-1a26feff9a24 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:14.694765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:14.696006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:14.696292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:14.696566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:14.706916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:14.711888 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:14.712764 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:14.713537 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 284/544] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:14.722005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:14.753489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:14.936405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023997-f8cb-452d-9560-0a0a2a36b4e7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:14.987745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:14.988712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:14.989338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:14.989822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:14.995174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:14.995707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:14.997387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:15.006643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 261/545] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:15.012701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:15.149360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:15.155693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9ccdc-dbfb-474f-b602-2926931cb971 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:15.201322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:15.202304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:15.202785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:15.203278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:15.219556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:15.221223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:15.240349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:15.241330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:15.242748 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:15.242748 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:15.242748 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:15.245235 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 285/546] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:15.250965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:15.356553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:15.381134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbdca5-6295-4578-b49e-3ceedd059ed5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:15.417694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:15.418643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:15.419169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:15.419658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:15.420516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:15.421068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:15.422641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:15.435337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 262/547] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:15.441084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:15.574942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e58f9-6280-4138-a8be-1709df9b8d4f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:15.619285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:15.620279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:15.620872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:15.621347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] PATH_INFO: `/v3/users/swift` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:15.630019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:15.631855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-35d4c611-8fd9-4b27-a17f-5ae75e5d730e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:15.649156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:15.650111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:15.651004 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:15.653475 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 286/548] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:15.659278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:15.780847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a150e9-a4e5-4d71-964c-ca512ae19d6d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:15.801155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce806c7-02e2-48af-832c-34e15dc72051 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:15.801706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce806c7-02e2-48af-832c-34e15dc72051 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:15.801981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce806c7-02e2-48af-832c-34e15dc72051 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:15.804138 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 287/549] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:15.810450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64c87-dba7-452a-b552-3c4af8206315 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:15.815165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64c87-dba7-452a-b552-3c4af8206315 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:15.815165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64c87-dba7-452a-b552-3c4af8206315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:15.837340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-12a64c87-dba7-452a-b552-3c4af8206315 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:15.838459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-12a64c87-dba7-452a-b552-3c4af8206315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:15.841394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:15.846625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:15.847269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:15.847549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:15.847822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:15.849390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:15.849705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:15.851327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:15.861174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:15.872147 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 263/550] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 6 10:29:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:15.884843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:15.994422 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 288/551] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:16.069207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f8c20-c6d7-46a2-aeba-649580941452 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:16.110569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:16.111128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.111414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.111689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.177305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:16.181094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:16.182641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:16.208444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85049-eb3c-4f3a-986e-89ca7dfd68c4 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.209062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85049-eb3c-4f3a-986e-89ca7dfd68c4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.209554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85049-eb3c-4f3a-986e-89ca7dfd68c4 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.212180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 289/552] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:16.217145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c5384-21ce-407f-a0b5-88c487bdac23 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.217728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c5384-21ce-407f-a0b5-88c487bdac23 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.218197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c5384-21ce-407f-a0b5-88c487bdac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.236887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a6c5384-21ce-407f-a0b5-88c487bdac23 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:16.238389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a6c5384-21ce-407f-a0b5-88c487bdac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:16.329472 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 264/553] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:16.335608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:16.361181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 290/554] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:16.458137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:16.463525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d0c0b-b029-4c4b-b448-8535ace13b80 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:16.503640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:16.504784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.505267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.505737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.522946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:16.524854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:16.527274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2137-7216-4b28-a10b-fdfffa05aba6 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.527575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2137-7216-4b28-a10b-fdfffa05aba6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.527857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2137-7216-4b28-a10b-fdfffa05aba6 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.530600 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 291/555] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:16.535061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.535061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.535315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:16.547224 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:16.548512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:16.549380 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:16.549380 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:16.549380 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:16.549380 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 265/556] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:16.553860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:16.566165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:16.567411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:16.643494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:16.647118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 292/557] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:16.648032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:16.687143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71f3f0-9f2a-4517-be89-9aeef3b69eb6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:16.759141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:16.760097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.760560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.761039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.761891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:16.762499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:16.764295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:16.782701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 266/558] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:16.788141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:16.801656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:16.812956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa446cf2-7ebe-47b1-910d-69ea7463b6a9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:16.853517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:16.854149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.854429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.854702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.865884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:16.870997 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:16.872362 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:16.873186 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:16.877443 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 293/559] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:16.879048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:16.918798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949007-b3d5-4d9f-9702-8509bc0d6399 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:16.947468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:16.954656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:16.955504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:16.956047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:16.956498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:16.967805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:16.973085 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:16.973984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:16.974788 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:16.978020 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 267/560] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:16.979146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:16.996647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ede47-ca64-463a-a289-3bb3dd289cd5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.033413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.034141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.034499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.034850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.042465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.043987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.053582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:17.055429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:17.056531 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 294/561] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:17.057397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.083906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389c43-a89c-4fe9-b772-0b43f1035f17 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.118643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.119277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.119637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.119914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.120659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.120968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.122352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.130412 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 268/562] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.131221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.159693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24857e-9bfb-476a-a0da-c333bcd4a1e0 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.176724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.192676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.193284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.193571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.203718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.203718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.203718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.203718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421e583-e59f-4af7-afa6-9eb607b8eaf9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.204914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 295/563] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.206151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf677e-e887-46ff-a356-5f5610c019c4 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.206490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf677e-e887-46ff-a356-5f5610c019c4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.206772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf677e-e887-46ff-a356-5f5610c019c4 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.211560 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 296/564] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:17.211560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf677e-e887-46ff-a356-5f5610c019c4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.234973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b798346-4ecc-453a-92de-0cc84ba53ebf None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.263432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.268171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.268801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.269090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.269365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.280206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:17.284990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:17.285895 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:17.286717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 269/565] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:17.287430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.314022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf677e-e887-46ff-a356-5f5610c019c4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.347813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.348416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.348698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.348974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.349661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.349973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.351465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.363127 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 297/566] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.363931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.386502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f56f7-de17-418b-ad7b-9ae4c177a68c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.404331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.419738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.420323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.420604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.420878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.432052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.433534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b7dc6079-bdfd-413a-8e34-281de1e8c056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:17.447768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:17.448729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:17.450325 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:17.450325 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:17.450325 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:17.450325 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 270/567] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:17.450325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.451028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.451028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.464830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e75f-b5af-49a3-abf0-8e59420ef2f5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.474445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:17.475666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:17.498203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.498825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.499123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.499401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.510465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.511939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.515059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:17.526306 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:17.527470 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:17.528992 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:17.528992 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:17.528992 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:17.528992 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 298/568] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:17.528992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.541645 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 271/569] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:17.542481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.621146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.630030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14837f-2a9f-4867-8026-c87d504620b8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.647517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680589e-c52e-4157-92e4-841cb9077da8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.664599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.665204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.665485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.665759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.666413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.666716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.668137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.679120 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 299/570] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.679120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.687375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.688011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.688293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.688567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.689295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=cd53273c297e44518ba1bbe2c838e744) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.689610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.691046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.697077 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 272/571] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/role_assignments?user.id=cd53273c297e44518ba1bbe2c838e744&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.697946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.775464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.825887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd225fce-4b88-44d0-961d-4454215b6f97 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.868761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.869537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.869989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.870362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.871159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.871565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.873053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.892905 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 300/572] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.892905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:17.899452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d8c5-c25d-4ce5-8400-832b63e45693 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:17.909987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:17.940163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:17.940922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:17.941206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:17.941481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:17.942130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:17.942433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:17.943833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:17.955974 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 273/573] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:17.960774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.004525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844221fc-fcc6-4cf0-8ec9-4734690a406c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.037789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.038418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.039278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.039665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.060318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.061781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.071219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:18.076786 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.083495 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:18.084679 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:18.084679 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:18.084679 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:18.084679 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 301/574] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.084679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.085040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d9ba-d84b-41b2-a5af-021b068af752 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.120146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.120806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.121089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.121365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.131659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:18.136504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.137461 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:18.138292 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 274/575] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.141018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.158447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.197999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539691e7-39f9-4412-ada0-30c8f6260ca7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.235401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.236435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.237040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.237509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.246710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.248402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.248918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f8226-42b6-4595-af0c-86b79e0e7517 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:18.260831 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.261937 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:18.263080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:18.264873 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 302/576] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.265776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.291175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.291807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.292089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.292365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.300735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.302186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:18.313826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.314892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:18.315868 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 275/577] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.316437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.338270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.377787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10d476-3d84-4307-aed0-d11b59cf93e8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.405422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.415868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.442140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.442140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.442140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.442140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:18.442140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.442140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.442746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e57ad4-b5c8-4a15-ad9f-112aa83ca724 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.442853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 303/578] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:18.442853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.467401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.467943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.468226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.468506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.469175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:18.469472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.470851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.483180 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 276/579] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:18.483180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.543443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e850a-9661-4078-9ac5-77c997084609 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.562726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.579853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.580657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.581094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aca60-cae2-4ae6-a757-a292f838cd26 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.581263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.581691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.582617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:18.583099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.584740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.611771 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 304/580] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:18.611771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.617492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.618113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.618401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.618680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.619450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:18.619769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.621624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.647300 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 277/581] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:18.648757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.659423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.715428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bebd6d-72af-40d4-9e13-5e18e1ef2483 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.750797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.751388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.751671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.751944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.752238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f66f9-2ce2-4f38-8f07-cf6e37992e54 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.760558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.762016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:18.775984 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.777180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:29:18.778388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:18.781765 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 305/582] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.782579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.794129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.794899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.795299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.795669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.802398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.806187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.807773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:18.824784 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.830836 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:18.832783 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:18.832783 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:18.832783 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:18.832783 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 278/583] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.832783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.903249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e89b2-8290-49e6-9d8f-b122f3b09cf3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.907878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:18.941158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5631-cf2e-4844-9146-0a67d69cd7ea None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:18.941378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.942033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.942436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.942837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.954119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.955891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:18.971274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:18.972189 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:18.973076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:18.973076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:18.973076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:18.973076 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 306/584] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:18.973076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:18.983976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:18.987561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:18.987561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:18.987561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:18.996077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:18.997528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:19.012673 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:19.013598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:19.014459 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:19.014459 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:19.014459 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:19.014459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 279/585] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:19.014459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.062325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.088937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de732241-cd0d-4d99-a7f5-99857fb1210b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.125219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.125821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.126098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.126367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.126987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b75d14-12d8-4770-94ba-cb0bc761620e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.127167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.127487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.128927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.147162 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 307/586] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 6 10:29:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.147803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.162927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.168177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.173206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.173206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.173206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.173206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.173206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.173206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.188328 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 280/587] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.188328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.259807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff69d2-25c4-4523-b343-60a99b9a9ced None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.292400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108eb3f-809d-47bb-b388-b7118d2e3366 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.294226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.294371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.294749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.295051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.295333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.296645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.296645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.297623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.310147 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 308/588] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.310816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.335753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.336643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.337116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.337582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.338222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.338524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.339897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.356524 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 281/589] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.356524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.394195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.419335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ccdf-725b-45c1-aaa4-b98ac1dd6f37 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.453534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.454161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.454442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.454722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.457727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be16e-dd6b-43b8-8bf9-7a770e611a03 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.465387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.466839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:19.481471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:19.482521 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:19.483672 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:19.483672 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:19.483672 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:19.483672 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 309/590] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:19.483672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.495824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.496484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.496851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.497128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.505820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.507429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:19.519625 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:19.520570 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:19.521524 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 282/591] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:19.522150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.548665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.590949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637744c-0c63-4393-954f-ed25a96a7ce9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.618975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.627482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.628179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.628461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.628735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.629698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d63863-1af6-4f95-b1d8-8ce66e423bed None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.635458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.636915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:19.648330 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:19.649444 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:19.650546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 310/592] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:19.651455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.671330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.672187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.672462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.672735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.679930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.681353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:19.692319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:19.693217 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 283/593] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:19.698833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.763436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f578-744d-4e4c-96b4-a762dc15584e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.788518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.808661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.808661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.808661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.808661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.809074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.809074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.809074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.809269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005c05-d3b2-4e8c-96da-1d07f32f92d3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.824956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 311/594] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.824956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.849329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.849942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.850226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.850498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.851825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.852133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.853538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.872911 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 284/595] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.879218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:19.884077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:19.942272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67fe96-7500-4e8a-b05b-595948c41fad None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.975259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:19.975857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:19.976184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:19.976965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:19.977644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:19.977805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78bfe6-1355-4133-8755-6bf1bced0310 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:19.977947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:19.979392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:19.990636 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 312/596] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:19.991550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.016126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.016722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.017001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.017274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.017956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:20.018263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.019711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.029111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.032153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 285/597] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:20.032921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.090278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357186d-7b02-45ba-8714-508ce07956c9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.097064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.123217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.123846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.124128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.124404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.131016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af463c4d-d30c-45a0-9251-8ce5c4077828 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.131888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.133357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-792084c1-ceaf-42b2-9db2-187ce057e140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:20.144878 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:20.145821 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:20.146729 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 313/598] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:20.147379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc18cc-47cc-481d-8a5b-9545dfb08976 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.147451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc18cc-47cc-481d-8a5b-9545dfb08976 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.147807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc18cc-47cc-481d-8a5b-9545dfb08976 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.149503 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 314/599] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:20.150180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc18cc-47cc-481d-8a5b-9545dfb08976 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.170179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.170806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.171116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.171393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.181782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.183249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:20.197620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:20.198566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:20.199518 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:20.199518 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:20.199518 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:20.199518 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 286/600] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:20.199518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.252318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.255150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc18cc-47cc-481d-8a5b-9545dfb08976 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.289071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.289704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.289986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.290271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/6c2ddfc46e6c414085493829459e5ea9/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.299470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64863-17db-419b-9924-75a3d5f0d7f9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.304036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=6c2ddfc46e6c414085493829459e5ea9, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.305669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.333039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1196a-6b1c-4f34-b7ae-a4674046a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.333692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1196a-6b1c-4f34-b7ae-a4674046a409 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.333975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1196a-6b1c-4f34-b7ae-a4674046a409 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.334253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1196a-6b1c-4f34-b7ae-a4674046a409 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/3a5944ef46aa40078b84b486b24822eb/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.348703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1196a-6b1c-4f34-b7ae-a4674046a409 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=3a5944ef46aa40078b84b486b24822eb, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.350074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1196a-6b1c-4f34-b7ae-a4674046a409 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.366050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 315/601] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:20 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/6c2ddfc46e6c414085493829459e5ea9/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:20.366888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.385965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.445450 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 287/602] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:20 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/3a5944ef46aa40078b84b486b24822eb/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:20.447241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.447669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.448218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.469797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:20.471517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:20.492846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea962-761a-4e62-ac6a-2258508e108b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.553533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.555353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.555794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.556225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.557145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:20.557466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.559829 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 288/603] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:20.560544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.560743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.576351 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 316/604] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:20.584149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.606934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.701433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3e5d-1cc5-448f-9e8a-4ca1da1bcf92 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.715729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.746232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.746849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.747319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.747422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce4944-6322-4a77-a81e-3b9160c2c86f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.747596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.748364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:20.748732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.750125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.763903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 289/605] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:20.769402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.807562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.808280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.808562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.808835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/c06e2a3faa864da19cef4089e8392702/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.841925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=c06e2a3faa864da19cef4089e8392702, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.843521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.903127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:20.912757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2053e-0a67-4e96-a2d0-2a9f75ee2744 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:20.949834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:20.950577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:20.950865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:20.951256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:20.960080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:20.961625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:20.973759 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:20.974684 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:20.975617 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 290/606] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:20.982750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:20.984097 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 317/607] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:20 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/c06e2a3faa864da19cef4089e8392702/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:21.006857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:21.137561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6a166-8c7f-47bb-a36b-e5db18aaf6ae None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:21.185703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3d828-61ff-4689-ab10-66295a05eb29 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:21.214542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:21.221975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:21.222721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:21.223042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:21.223364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:21.224191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:21.224495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:21.226049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:21.227155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:21.228079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:21.230804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:21.230804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:21.240523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:21.246420 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:21.247571 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:21.248956 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:21.249631 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 291/608] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:21.252639 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 318/609] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:21.257800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:21.259574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:21.292778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:21.374942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c785c-1ce2-4d5b-a7b5-8b5d449f192b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:21.424950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:21.425581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:21.425866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:21.426147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:21.426816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:21.427153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:21.428624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:21.442733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71269bcc-cf3f-41b1-806b-14b554f2f181 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:21.459540 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 319/610] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:21.467999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:21.487724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:21.488560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:21.488672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:21.488952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/3720ac834902404a9992a0a6aa43081a/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:21.524810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=3720ac834902404a9992a0a6aa43081a, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:21.525289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:21.526277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:21.580895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9909b-d5d1-4805-a740-5540dca01b3b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:21.609606 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 292/611] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:21 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/3720ac834902404a9992a0a6aa43081a/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:21.624880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:21.625553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:21.625840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:21.626117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:21.647923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:21.650546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:21.674689 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:21.675771 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:21.676655 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:21.676655 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:21.676655 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:21.678999 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 320/612] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:21.685514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:21.784917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:21.829324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c60d2-403f-48d7-863b-2fd021db0901 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:21.886496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:21.887157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:21.887443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:21.887716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:21.888387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:21.888690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:21.890084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:21.903257 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 293/613] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:21.914378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:22.024322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:22.028704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3497-4212-4d17-8bff-69651bc86cec None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:22.065527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:22.066491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:22.067075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:22.067548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] PATH_INFO: `/v3/users/swift` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:22.076663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:22.078458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:22.091342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:22.092341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:22.093317 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:22.095898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 321/614] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:22.101861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:22.208240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d5f72-2d69-43d6-83e6-680f14a65fb8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:22.240408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:22.260362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:22.260987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:22.261270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:22.261547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:22.262285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:22.262599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:22.264060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:22.284487 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 294/615] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 6 10:29:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:22.290839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:22.436640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553fb4b-f976-4793-a769-7b9a439d092b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:22.474897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:22.476032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:22.477122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:22.477612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:22.490001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:22.492496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:22.508345 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:22.509343 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:22.510243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:22.510243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:22.510243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:22.512404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 322/616] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:22.518182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:22.640996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96aaa64-07c6-4082-82f8-71407e3b5885 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:22.688750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:22.689720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:22.690200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:22.690681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:22.691558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:22.692063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:22.693789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:22.707769 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 295/617] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:22.713639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:22.730800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:22.828427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9f28-ee27-4879-9914-bdf6e318825c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:22.865889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:22.866903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:22.867411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:22.867994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:22.875446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:22.877253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-88a8899a-2c33-419c-a1a0-fa11b0b527ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:22.889481 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:22.890443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:22.891378 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:22.893738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 323/618] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:22.900526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:22.958512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:23.022715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1d785-7c36-4d47-900c-53beaae9062c None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.024219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1d785-7c36-4d47-900c-53beaae9062c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.024693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1d785-7c36-4d47-900c-53beaae9062c None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.026429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 324/619] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:23.039829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee3061-1a19-4c2c-af67-16b2257162ce None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:23.049156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28b09-870b-42f7-9e57-499837c666da None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.049747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28b09-870b-42f7-9e57-499837c666da None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.050249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28b09-870b-42f7-9e57-499837c666da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.069235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-02e28b09-870b-42f7-9e57-499837c666da None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:23.070823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-02e28b09-870b-42f7-9e57-499837c666da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:23.111738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:23.112363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.112654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.112937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.113643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:23.113959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:23.115441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:23.139461 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 296/620] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:23.146762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:23.151342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 325/621] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:23.254920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:23.263421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b58bf-d714-468e-bbcc-59341d15bd87 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:23.313349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:23.314044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.314329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.314608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/cd53273c297e44518ba1bbe2c838e744/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.337041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=cd53273c297e44518ba1bbe2c838e744, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:23.338524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:23.415271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b213a-8671-4e65-8462-f1918d96f25b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.415626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b213a-8671-4e65-8462-f1918d96f25b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.415840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b213a-8671-4e65-8462-f1918d96f25b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.417496 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 326/622] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:23.423228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.423505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.424000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.424843 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 297/623] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:23 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/cd53273c297e44518ba1bbe2c838e744/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:23.431405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:23.454145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:23.455471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:23.539167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:23.559133 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 327/624] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:23.687860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536d37-9291-4b29-a2c0-3ef34878f90c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:23.728627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871b3f-dca0-49d4-a3c7-3bdeb8b61758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:23.729267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871b3f-dca0-49d4-a3c7-3bdeb8b61758 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.729549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871b3f-dca0-49d4-a3c7-3bdeb8b61758 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.729824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871b3f-dca0-49d4-a3c7-3bdeb8b61758 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.741070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4871b3f-dca0-49d4-a3c7-3bdeb8b61758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b4871b3f-dca0-49d4-a3c7-3bdeb8b61758 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:23.746632 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:23.747610 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:23.748426 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 298/625] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:23.753603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:23.860154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22c8d-8fe7-4726-a682-421f34b09755 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:23.889285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59425-f6dd-4e70-ba60-5225f159f41a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.889285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59425-f6dd-4e70-ba60-5225f159f41a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.889285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59425-f6dd-4e70-ba60-5225f159f41a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.889285 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 299/626] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:23.893563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.893857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.894140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.896822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:23.908777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:23.909183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:23.911201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:23.911201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:23.911201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:23.911201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:23.912442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:23.929915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 328/627] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:23.934072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:23.938428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:23.939665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:23.955209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.039613 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 300/628] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:24.041189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.093949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32763-a4cc-4614-ab7a-e0e3144f6203 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.146222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.146528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.146780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.147102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.158038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:24.159554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:24.174673 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:24.175697 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:24.176583 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:24.176583 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:24.176583 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:24.181065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 329/629] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:24.182253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.236460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.285493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8501225-0e9f-4257-b7d0-8cc413e16c91 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.289470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dae81-fa97-4c15-b91c-3c30c99476c4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.322283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.323180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.323548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.323908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.325015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:24.325408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:24.326877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:24.345500 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 330/630] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:24.346782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.417153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.417722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.418045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.418273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.428913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:24.434157 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:24.435158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:24.436244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.437085 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 301/631] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:24.437403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.462773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2133f9-530f-49e1-91ea-96c52c3db3f5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.473225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.513616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.515559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.516062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.516527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.526442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:24.529407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:24.545924 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:24.546885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:24.547873 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:24.553655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 331/632] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:24.553655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.558395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457a21-f6e1-46b2-9b52-448d58a4307b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.607492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.609104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.609871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.610370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.625685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:24.634168 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:24.635126 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:24.635964 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:24.638642 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 302/633] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:24.639954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.673139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f858-db13-424d-abc8-83e7773f5663 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.705613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.711780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.712395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.712685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.712963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.713626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:24.713932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:24.715341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:24.724525 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 332/634] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:24.724798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.755344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461b0d-a25b-4d23-93ea-ab8f576adf7a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.757952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.796878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.797484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.797769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.798035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.798838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:24.799120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:24.800525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719af242-0f44-41f9-b43a-9e69b3328cbc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:24.823312 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 303/635] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:24.824784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62c6b0-7414-4925-beef-299b14084275 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.825073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62c6b0-7414-4925-beef-299b14084275 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.825346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62c6b0-7414-4925-beef-299b14084275 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.826816 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 304/636] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:24.827579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62c6b0-7414-4925-beef-299b14084275 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:24.846044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e394-c9b1-48ed-88d6-94676e713058 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.886283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.886930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.887244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.887518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.888178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:24.888485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:24.889911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab3e7-16b8-462b-81d3-68094977a5be None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:24.898431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 333/637] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:24.899932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.900455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.900804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.922225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:24.923611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:24.951326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62c6b0-7414-4925-beef-299b14084275 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:24.968521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:24.986872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:24.987559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:24.987840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:24.988115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:24.994964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 334/638] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:24.995866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.009269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.010972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.024464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:25.026906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:25.027871 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:25.028757 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:25.028757 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:25.028757 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:25.034992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 305/639] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:25.044639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.136972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56264f-6d92-480b-8853-5f94b75f85e3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.158689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e491078-145e-41d6-95aa-76adc75096d7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.173231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.174183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.174703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.175217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.194356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.195049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.195333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.195611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.206779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.208299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:25.223495 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:25.224482 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:25.225350 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:25.225350 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:25.225350 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:25.229970 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 306/640] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:25.230833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.249273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.251345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.256515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.284801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.334557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e74eec-d74f-48f9-bcb2-46489423492b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.357919 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 335/641] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:25.359431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.376486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.377188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.377471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.377744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.378392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:25.378695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.380091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.392384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 307/642] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:25.392989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.475147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71555f3-d39c-4ec2-bebe-94ccfb7e3636 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.490877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.498605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.510162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0735-eb80-4b8d-9140-db1f1ba8094d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.512409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.513018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.513297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.513569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.514200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:25.514499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.515894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.528808 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 336/643] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:25.529885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.545915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.546554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.546833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.547134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.558708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:25.565422 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:25.566393 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 308/644] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:25.567893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.640937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c883-1fbe-4580-a93a-8cedaedd5bf7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.682679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.683110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ba255-486b-4a4b-a777-eeb6f24b69d1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.683356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.683634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.683904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.695963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.697400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:25.712812 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:25.713749 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:25.714792 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:25.714792 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:25.714792 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:25.714792 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 337/645] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:25.714792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.726758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.727407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.727849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.727956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.736207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.737709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.746973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:25.749666 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:25.750585 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 309/646] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:25.752815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.758013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.830587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1e051-72f8-4208-90ca-2580fd8d5347 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.865334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891717b-67e3-4f03-a944-06c3ad1cd4b6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:25.868798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.869681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.870179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.870645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.879078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.880653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:25.892584 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:25.893523 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:25.894465 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 338/647] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:25.895733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.915195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:25.915969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:25.916253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:25.916833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:25.917502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:25.917811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:25.919624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:25.932950 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 310/648] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:25.932950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:25.993714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:25.994273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.002600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074a33c-a2dc-4d96-9114-abba8c7716eb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.031082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53eae0-bfbb-47a8-b4e0-2ae5692f0894 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.034929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.035608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.035995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.036268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.036931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:26.037231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.038596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.050085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 339/649] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:26.050870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.064434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.065040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.065321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.065592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.066314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:26.066616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.068065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.085683 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 311/650] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 6 10:29:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:26.086417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.154770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608544e-8eca-42b1-8bfb-61c3bbace09d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.187019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa952e2-0edb-4ba6-b518-5e9d2ad9364a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.187898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.188496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.188772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.189042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.189753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:26.190055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.191499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490076ad-6d1a-46b3-b340-40f60d6a9464 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.207796 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 340/651] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:26.208943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e405-3273-4902-8b10-138648c19d86 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.209224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e405-3273-4902-8b10-138648c19d86 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.209494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e405-3273-4902-8b10-138648c19d86 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.209874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.214941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 341/652] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:26.214941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e405-3273-4902-8b10-138648c19d86 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.223114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.225872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.227704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.227989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.228258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.238974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.240531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:26.255988 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:26.257108 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:26.258337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:26.258337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:26.258337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:26.258337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 312/653] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:26.258337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.314474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e405-3273-4902-8b10-138648c19d86 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.347428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.348068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.348317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.348588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.355490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.356924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.357779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b4c3f-3811-4fbd-8f91-f87eaa9d82d9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:26.369465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:26.370407 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 342/654] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:26.371332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.396331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953b1db-7a95-4b17-b8fb-de3de7669239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.396939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953b1db-7a95-4b17-b8fb-de3de7669239 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.397227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953b1db-7a95-4b17-b8fb-de3de7669239 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.397507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953b1db-7a95-4b17-b8fb-de3de7669239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.438875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.440097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.464335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953b1db-7a95-4b17-b8fb-de3de7669239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.465801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953b1db-7a95-4b17-b8fb-de3de7669239 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.468499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef954-f834-4f28-93db-112d735f2ad5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.502749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.503378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.503660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.503943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.563495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 313/655] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:26.564725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.565012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.565290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.568837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.570316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.587191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:26.588373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:26.636863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.654150 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 314/656] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:26.654984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.658389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.678573 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 343/657] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:26.683820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.761154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98094ac-d696-47a9-b268-27c87f202511 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.791283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3140a88-7cfa-4cdd-9e76-e33df3bf6dc6 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.802314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.802934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.803261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.803577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.804260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:26.804733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.806245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.823333 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 315/658] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:26.823333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.828031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.828641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.828922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.829199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.829891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:26.830203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.831713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:26.845487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 344/659] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:26.846164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:26.883619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.899524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:26.937283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28e88-d9b4-4c53-bf82-c020589b6c5f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.973128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efcbc4-245f-43df-9ce4-9b1ad62c3fd5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:26.974053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:26.974689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:26.974972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:26.975276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:26.987334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:26.989635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:27.003985 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:27.005043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:27.005962 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:27.005962 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:27.005962 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:27.005962 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 316/660] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:27.005962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.015699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.016341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.016624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.016898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.028064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.029527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:27.043462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:27.044536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:27.045406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:27.045406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:27.045406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:27.045406 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 345/661] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:27.045406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.109071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a57872-1c81-4b96-b94f-4a479933d9be None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.124273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.127546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.142543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.143204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.143485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.143758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.145409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c944c-13f9-48b3-b83a-3f088bc1ba1c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.151699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.153134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:27.164319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:27.172326 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 317/662] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:27.173375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.181405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.182011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.182293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.182566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.183318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=6c2ddfc46e6c414085493829459e5ea9) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:27.183627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.185066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.190625 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 346/663] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/role_assignments?user.id=6c2ddfc46e6c414085493829459e5ea9&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:27.191523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.282559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052467f6-fd73-4b03-a55d-0393f11fb12c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.302542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6628-e2ef-4bd9-8255-0aa810783d1a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.321742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.322396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.322682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.322964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.335075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:27.340474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:27.340663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:27.341586 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:27.342434 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:27.343658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.343658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.343658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.343658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:27.343658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.344107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.347173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 318/664] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:27.348145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.358119 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 347/665] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:27.359328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.369524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.395806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.473308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d436-a3e7-4806-8eac-dd6e86556b17 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.478187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b28ff-99c5-4bc5-b017-607e80de457e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.509673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.510279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.510550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.510823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.511576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:27.511880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.513292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.516736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.517348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.517631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.517905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.518549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:27.518856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.520247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.531387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 348/666] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:27.532038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.537603 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 319/667] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:27.538750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.596782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.636056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.638809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e8e2-6419-4a19-b52f-f8086b3e0a2e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.641582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528e0c7-a374-43fa-9765-a04d3fd8fd2e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.675896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.676500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.676780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.676903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.677142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.677500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.677696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:27.677803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.678000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.678099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.679973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.685300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.686721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.688509 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 349/668] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:27.689721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:27.702618 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:27.703750 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:27.704820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:27.708408 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 320/669] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:27.709230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.801300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251af86-6435-4555-8d16-2e23ccbbbd00 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.808784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23d678-6c41-4fdd-b550-b880c5eba91d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:27.832872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.842052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.842906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.843359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.843963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.844963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:27.845590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:27.845869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:27.846141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:27.853544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.854976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:27.866308 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:27.867929 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:27.868824 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 321/670] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:27.869302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:27.892984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:27.929067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:27.931106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:27.984787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928b6ab-9f02-44c5-8363-b4d4a86622ca None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.029105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.030269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.030884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.031366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.035029 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 350/671] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:28.035688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.050950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.052471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.063250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:28.068771 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:28.084631 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:28.086034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:28.086034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:28.086034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:28.086034 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 322/672] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:28.086034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.144048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55274dca-2133-4860-ae12-1dff7ef62bb2 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.154275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:28.184295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.185391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.186004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.186289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.186974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:28.187316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.188760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.190435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a11f-3181-4c48-abff-a2f4cb4c98e8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.205911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 351/673] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:28.205911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.233276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.234175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.234507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.234792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.235507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:28.235815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.237263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.254154 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 323/674] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:28.254154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.304309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:28.322959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04454-d52e-4e89-a618-d5635f32e1b1 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.368590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.369249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.369537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.369811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.374885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2f7a8-8709-4be1-b792-6bfe41d0cf18 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.382080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.383574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:28.403693 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:28.404665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:28.406528 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:28.406528 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:28.406528 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:28.409301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 352/675] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:28.410196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.410589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:28.426981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.428057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.428540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.429036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.429965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:28.430474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.432117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.446887 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 324/676] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:28.448145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.552282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfcd9d-1cc5-4d07-b7db-e03509ed9790 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.557473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abfd61-abfb-4f36-ac80-0ad6ccf24da8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.593097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.594237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.594796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.595306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.595699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.596224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.596504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.596773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.597216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=c06e2a3faa864da19cef4089e8392702) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:28.597610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=3a5944ef46aa40078b84b486b24822eb) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:28.597808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.598304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.599244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.600313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:28.619571 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 325/677] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/role_assignments?user.id=c06e2a3faa864da19cef4089e8392702&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:28.621103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.623485 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 353/678] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/role_assignments?user.id=3a5944ef46aa40078b84b486b24822eb&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:28.624510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:28.639110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:28.808486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:28.928220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e77b6-9d25-420a-bd2a-8333245ebd52 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.951434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90c9ee-3358-4a19-b530-d1380e664eb7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:28.984865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:28.985209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:28.985437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:28.985699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:28.988368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:28.988368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:28.989283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.006457 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 326/679] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:29.012581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:29.017236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.017236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.017236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.017236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.035444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.037468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:29.052598 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:29.053728 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:29.055357 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:29.058235 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 354/680] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:29.063636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:29.129152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2dca4-9ef4-4799-975a-fc26d3de4899 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:29.144553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:29.146996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:29.169787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.170529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.170883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.171268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.178618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.180825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.192279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746224-66a7-4b96-8dd5-6498dd5008c9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:29.192778 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:29.194651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:29.195651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 327/681] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:29.200343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:29.246968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.247608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.247893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.248172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.248909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:29.249219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.250791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.274444 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 355/682] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:29.276209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:29.314982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8efac-973a-434f-9d2f-d72e70ba9674 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:29.350174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.351733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.352217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.352685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.353586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:29.354090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.355761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.369570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 328/683] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:29.375778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:29.391896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4951c-1c8d-4944-8d42-504a35ab6698 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:29.407739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:29.415576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:29.430772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48b90b-a938-472a-8596-ea9d53f943c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.431424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48b90b-a938-472a-8596-ea9d53f943c4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.431705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48b90b-a938-472a-8596-ea9d53f943c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.431979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48b90b-a938-472a-8596-ea9d53f943c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.480956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828beb-b0c7-43e5-bb3b-f8533b1966d5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:29.510789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48b90b-a938-472a-8596-ea9d53f943c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.512170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48b90b-a938-472a-8596-ea9d53f943c4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.579817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.580362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.580651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.580930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.581670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=3720ac834902404a9992a0a6aa43081a) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:29.581987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.583458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.601601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 329/684] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/role_assignments?user.id=3720ac834902404a9992a0a6aa43081a&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:29.627586 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 356/685] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 10:29:29.629434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:29.702573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313da33-6339-472d-a604-9576f7102b64 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.702899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313da33-6339-472d-a604-9576f7102b64 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.703173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313da33-6339-472d-a604-9576f7102b64 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.705037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 357/686] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:29.710629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.710931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.711239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.742574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:29.744800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:29.770085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:29.781150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ad2a8-8d13-4400-ad15-0d2463872bcf None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:29.783121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:29.858438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:29.859711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:29.860223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:29.861262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:29.864060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 358/687] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:29.875292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:29.877058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:29.894776 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:29.895802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:29.896690 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:29.896690 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:29.896690 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:29.899224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 330/688] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:29.904790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.013660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801f4c-8421-49c7-8634-578b57ff93c3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:30.053625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:30.054318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:30.055100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:30.055381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:30.056026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:30.056329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:30.057715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:30.069532 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 359/689] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:30.076059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.220440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.236015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:30.244821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b854b-c31c-4e3e-a6e5-b0139ff9f7ae None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:30.304562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:30.305196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:30.305476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:30.305749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:30.318982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:30.320492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:30.334233 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:30.338093 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:30.338970 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 331/690] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:30.342420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.354983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:30.431260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092261ed-39d8-44e0-addd-51aff792f05d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:30.460211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40857b78-9804-4f05-9927-245af5b1f076 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:30.498950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:30.500437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:30.501716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:30.502654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:30.503450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:30.505916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:30.506403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:30.507124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:30.508636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:30.509315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:30.512714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:30.526461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:30.533682 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:30.534593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:30.535532 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:30.541345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 332/691] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:30.541746 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 360/692] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:30.547168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.557701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.668094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:30.670363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:30.723793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd3820-d12d-48d8-a295-786775e44ff7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:30.733266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094f8e-daba-4408-9789-9f79dcd27ade None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:30.780154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:30.780763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:30.781042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:30.781320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:30.782082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:30.782387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:30.787046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:30.793098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:30.793708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:30.793989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:30.794259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:30.796039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=cd53273c297e44518ba1bbe2c838e744) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:30.796352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:30.797769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:30.801848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 361/693] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:30.807486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:30.817317 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 333/694] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:30 2022] GET /identity/v3/role_assignments?user.id=cd53273c297e44518ba1bbe2c838e744&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:30.986863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b371-3277-45d9-be8d-8989c00f7d0b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:31.031715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:31.037506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:31.038422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.038963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.039424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.055806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:31.057627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:31.075881 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:31.076855 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:31.077730 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:31.077730 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:31.077730 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:31.077730 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 362/695] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:31.084121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:31.228164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5d681-b9b3-4ef0-b58d-ab1e35463346 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:31.270181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:31.276884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:31.282627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.282627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.282627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.282627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:31.282627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:31.282627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fd215-0e2f-4066-bd6e-db5303fbf8b2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:31.300334 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 334/696] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:31.306487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:31.461209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa32f-e114-479e-9557-af78f4031dae None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:31.465417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46fe0-34df-43a0-9921-9722e8e2abeb None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.465706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46fe0-34df-43a0-9921-9722e8e2abeb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.465983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46fe0-34df-43a0-9921-9722e8e2abeb None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.467608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 335/697] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:31.473512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60355600-cbef-4727-8b0b-362a239e5ba4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.473799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60355600-cbef-4727-8b0b-362a239e5ba4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.474077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60355600-cbef-4727-8b0b-362a239e5ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.507134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:31.507805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.508085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.508359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.517703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:31.518699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:31.520173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-60355600-cbef-4727-8b0b-362a239e5ba4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:31.521392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-60355600-cbef-4727-8b0b-362a239e5ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:31.530653 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:31.539430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 363/698] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:29:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:31.540406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:31.632520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:31.660565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 336/699] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:31.684314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93672b-a766-4053-9f32-0543c32acd6d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:31.727098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:31.727711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.727989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.728260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.728981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:31.729281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:31.730705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:31.760463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd338d2-e6f6-4efc-9bf6-7495ad48c746 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.760833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd338d2-e6f6-4efc-9bf6-7495ad48c746 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.761029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd338d2-e6f6-4efc-9bf6-7495ad48c746 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.762732 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 337/700] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:31.768728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:31.769376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:31.769880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:31.812287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:31.813837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:31.927906 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 364/701] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:29:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:31.933581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:31.958263 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 338/702] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:32.121715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac26a71-f6aa-4c6e-aa0b-9f0809e0cc65 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.123683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:32.164671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.165214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.165461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.165732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.166005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.264258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:32.289510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.291000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.325382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d74c7-056d-43e8-a8a5-7586efa94a3b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.362621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.363277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.363563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.364012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.364700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.366149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:32.377795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:32.378930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:32.379815 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 339/703] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:32.381195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.427198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 365/704] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:32.428313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.443367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:32.488839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f20c-e23a-4452-81ec-4522b53c1aff None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.506459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:32.529283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.529923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.530207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.530486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.542503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.543980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.544181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd203d-e656-4f72-a8bc-dc490b08c5bb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:32.558896 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:32.560023 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:32.560921 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:32.560921 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:32.560921 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:32.560921 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 340/705] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:32.560921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.587645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.588254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.588648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.588924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.589662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:32.589966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.591481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1130f-82c9-4b1a-9440-36ac33fad77c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.596255 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 366/706] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:32.597385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284a8d-1564-4dcc-903c-4a07ffcb52f4 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.597673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284a8d-1564-4dcc-903c-4a07ffcb52f4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.597949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284a8d-1564-4dcc-903c-4a07ffcb52f4 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.603095 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 367/707] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:32.603095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284a8d-1564-4dcc-903c-4a07ffcb52f4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.669659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:32.671807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92ca20-95ae-4cb2-8668-cc1a741ad6d5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.708066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284a8d-1564-4dcc-903c-4a07ffcb52f4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.709008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.709634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.709917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.710192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.721620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.723088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:32.738271 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:32.739450 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:32.740507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:32.740507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:32.740507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:32.744376 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 341/708] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:32.745157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.749000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.749519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.749800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.750074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.750776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:32.751110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.752538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb3551-b7f6-4adb-9348-6f6953e0b1c7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.769803 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 368/709] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:32.769803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.769803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.770147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:32.770258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.789119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:32.790332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:32.866194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8be87a-bfa0-4cd6-aea6-4b6efd0a4bfb None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:32.875336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 369/710] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:32.876982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.920107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:32.920653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:32.920939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:32.921219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:32.921855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:32.922164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:32.923990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:32.939036 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 342/711] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:32.939036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:32.972404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:33.038328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:33.059388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17700-3c45-426c-95d0-81ed56912333 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.075848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbb3b4-4b05-4ce1-abe2-a8e14ded481a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.098616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.099275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.099563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.099836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.100491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.102848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.138519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.139179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.139661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.139954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.140604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:33.140967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.142487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.156722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 370/712] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:33.162902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:33.216224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 343/713] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:29:32 2022] POST /identity/v3/users => generated 254 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:33.221287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:33.293167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99320-09a9-44d2-8561-4dee57db8566 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.311715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:33.330765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.331486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.331770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.332093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.339819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.341282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.341937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90452934-c057-42d4-ad2f-1d1811593232 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:33.355156 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:33.356160 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:33.357059 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 371/714] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:33.362497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:33.380239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.380887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.381175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.381453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] PATH_INFO: `/v3/services/network` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.382053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.383541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:33.393128 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:33.395415 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:33.397367 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:33.399951 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 344/715] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:33 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:33.407035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:33.407035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:33.480292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d030e5-f199-4e48-906c-acdb77760901 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.512566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c21a7a-559c-4087-8a85-70fa181b4d65 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.522497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.523780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.524067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.524340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.525040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:33.525346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.526818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.542235 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 372/716] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:33.548279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:33.562914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.563556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.563875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.564122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.564768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] RBAC: Adding query filter params (name=network) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:33.565078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.566451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.577364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 345/717] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:29:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:33.578643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:33.587763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:33.653279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:33.662598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774b23e-05fa-4379-a9fb-1dc2054b0beb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.690291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8df6a-9da7-4a26-9809-7d80b5f98ed5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:33.701436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.702101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.702388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.702663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.703414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=6c2ddfc46e6c414085493829459e5ea9) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:33.703722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.705300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c9c80-69cb-4341-8ff0-e67e75454d8a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.712498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 373/718] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:33 2022] GET /identity/v3/role_assignments?user.id=6c2ddfc46e6c414085493829459e5ea9&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:33.720555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69407-7712-4128-b050-6b0cf036e2ee None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.720879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69407-7712-4128-b050-6b0cf036e2ee None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.721113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69407-7712-4128-b050-6b0cf036e2ee None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.722599 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 374/719] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:33.730802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.731213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.731601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.735043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:33.735963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:33.736401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:33.736847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:33.737711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:33.738241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:33.739855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:33.751189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 346/720] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:29:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:33.754685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:33.756012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:33.852825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 375/721] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 10:29:34.200578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:34.311610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362c0cb-14c3-4418-bf2e-6a2046bbc4b4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:34.465210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:34.471068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:34.472032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:34.472523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:34.473027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:34.484741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:34.490288 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:34.491493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:34.492906 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:34.495524 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 347/722] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:34.501504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:34.540199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:34.637656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c63f-2b45-401d-b453-d2f0fc0eeadc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:34.684829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:34.685438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:34.685723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:34.686000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:34.686667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:34.686974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:34.688434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:34.702281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 376/723] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:34.707776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:34.833313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eab9d5-3757-4fb8-bfa3-37c60ca71eb3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:34.882610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98706883-3898-4b66-bc72-986753749f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:34.883556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98706883-3898-4b66-bc72-986753749f49 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:34.884063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98706883-3898-4b66-bc72-986753749f49 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:34.884489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98706883-3898-4b66-bc72-986753749f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:34.897864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98706883-3898-4b66-bc72-986753749f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:34.900129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98706883-3898-4b66-bc72-986753749f49 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-98706883-3898-4b66-bc72-986753749f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:34.928246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:34.929231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:34.930200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:34.930200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:34.930200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:34.930200 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 348/724] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:34.935039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:35.076151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:35.085193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8648-44f6-4472-96d8-65164fb399c8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:35.120653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:35.121318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:35.121604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:35.122067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:35.122835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:35.123179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:35.124559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:35.144596 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 377/725] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:35.151176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98706883-3898-4b66-bc72-986753749f49 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:35.226676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:35.289962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98706883-3898-4b66-bc72-986753749f49 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:35.334068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:35.334690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:35.334968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:35.335316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:35.343664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:35.345106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:35.362492 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:35.363513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:35.364499 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:35.367108 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 349/726] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:35.369261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:35.530999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4084ad-5ba7-4a95-884b-031831cf3e03 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:35.586216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:35.586746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:35.587048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:35.587332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:35.588061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:35.588368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:35.589810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f969032-7a6f-4181-8c0b-9969b949c2cc None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:35.614736 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 378/727] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 6 10:29:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:35.620560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:35.766297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeca4b-be7e-4cb3-8f0a-ac2f73c735e9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:35.768797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:35.813530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4281-4f93-4fe6-a288-dff53e1e4777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:35.814148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4281-4f93-4fe6-a288-dff53e1e4777 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:35.814433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4281-4f93-4fe6-a288-dff53e1e4777 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:35.814708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4281-4f93-4fe6-a288-dff53e1e4777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:35.877838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655568-9dca-4d64-952b-36b03ee779c5 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:35.878036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655568-9dca-4d64-952b-36b03ee779c5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:35.878302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2655568-9dca-4d64-952b-36b03ee779c5 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:35.879982 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 379/728] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:35.888339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:35.888627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:35.888905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:35.909052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa4281-4f93-4fe6-a288-dff53e1e4777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:35.911096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa4281-4f93-4fe6-a288-dff53e1e4777 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:35.935146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:35.936366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:35.941328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:36.063520 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 380/729] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:36.085920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 350/730] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 10:29:36.091690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:36.233088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745ec80-208d-457f-83ab-3bbfc3a4dcf8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:36.282086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:36.282722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.282998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.283292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.292689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:36.297189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:36.298667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:36.307686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310ff7a-ab29-4307-a484-81dc81468ac7 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.308379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310ff7a-ab29-4307-a484-81dc81468ac7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.308641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310ff7a-ab29-4307-a484-81dc81468ac7 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.310568 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 351/731] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:36.315622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.315911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.316192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:36.319159 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:36.320430 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:36.321315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:36.321315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:36.321315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:36.321315 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 381/732] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:36.327288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:36.331371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:36.342758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:36.343986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:36.446026 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 352/733] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:36.446870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:36.479100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096100e-727e-4a41-801f-330081cbbc07 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:36.537123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:36.537816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.538046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.538300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.539556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:36.541170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:36.541878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:36.561697 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 382/734] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:36.563196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:36.593995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042779-b34d-480e-9fdc-ff7dbeda585c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:36.632480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:36.684224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df714a-adf1-4d21-9725-891bdda04bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:36.684858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df714a-adf1-4d21-9725-891bdda04bb2 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.685142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df714a-adf1-4d21-9725-891bdda04bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.685419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df714a-adf1-4d21-9725-891bdda04bb2 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.686093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df714a-adf1-4d21-9725-891bdda04bb2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:36.687501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df714a-adf1-4d21-9725-891bdda04bb2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:36.691521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:36.694444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce370-d8f2-42f4-b317-c292f1f1c580 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:36.733916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:36.734816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.735157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.735437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.742328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:36.743802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a3d13d5b-8a7a-4169-89d7-8badc64c3448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:36.755180 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:36.756078 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:36.757040 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:36.761487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 383/735] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:36.762766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8483ba-4fb4-463a-a01e-37d79f7c3e6b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.763272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8483ba-4fb4-463a-a01e-37d79f7c3e6b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.763593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8483ba-4fb4-463a-a01e-37d79f7c3e6b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.765008 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 384/736] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:36.765644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8483ba-4fb4-463a-a01e-37d79f7c3e6b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:36.804181 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 353/737] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:29:36 2022] POST /identity/v3/services => generated 251 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:36.805456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b6f0-51b6-4526-bbc2-2462d9e9e5c4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.805751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b6f0-51b6-4526-bbc2-2462d9e9e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.806033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b6f0-51b6-4526-bbc2-2462d9e9e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.850292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b368b6f0-51b6-4526-bbc2-2462d9e9e5c4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:36.851589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b368b6f0-51b6-4526-bbc2-2462d9e9e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:36.939602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8483ba-4fb4-463a-a01e-37d79f7c3e6b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:36.951369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:36.971701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 354/738] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:36.973170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbd30-3ed9-4a6d-a3d6-c9fa8ee44198 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.973465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbd30-3ed9-4a6d-a3d6-c9fa8ee44198 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.973767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbd30-3ed9-4a6d-a3d6-c9fa8ee44198 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.983203 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 355/739] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:36.983203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adbd30-3ed9-4a6d-a3d6-c9fa8ee44198 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:36.989631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:36.990269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:36.990556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:36.990834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:36.991629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:36.991978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:36.993445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25e8e-f472-430e-a3f9-dbb53cca2e22 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.010527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 385/740] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:37.012028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.012320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.012603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.034450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:37.035683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:37.110020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adbd30-3ed9-4a6d-a3d6-c9fa8ee44198 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.119646 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 386/741] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 10:29:37.120857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.136192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:37.147384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.154297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.154297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.154297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.159581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:37.164890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:37.166064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:37.167158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:37.169240 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 356/742] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:37.181604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.235414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:37.246515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f71c0-a8e6-4a73-978e-f347261c20dd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.318097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.318952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.319410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.320487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.321365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=cd53273c297e44518ba1bbe2c838e744) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:37.321850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:37.323460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.329476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdedbd-933f-429b-92ad-f270d0778d82 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.335295 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 387/743] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/role_assignments?user.id=cd53273c297e44518ba1bbe2c838e744&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:37.336491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.370923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.372205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.372662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.373190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.374196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:37.374701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:37.376307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.387122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 357/744] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:37.393739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.454438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:37.524448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380b95-8c98-4b31-9f0f-a97369dc5354 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.525446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e32f-9f4e-4fb5-b09e-0134c811842d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.575444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.576390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.576847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.578095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.597840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.599915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.600531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.602037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:37.602517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.604907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.622959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:37.628127 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:37.629034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:37.629854 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:37.630990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:37.631865 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:37.632786 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:37.632786 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:37.632786 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:37.634863 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 388/745] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:37.639089 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 358/746] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:37.640899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.642724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.670551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:37.755728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a20d3-9394-480a-aab1-70f9fdb75dd2 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.761670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:37.766238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b09931-53bc-4f1f-8d05-254806931f00 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.792845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.793448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.793772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.794526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.795918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:37.796493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:37.799564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.810750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.811666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.812149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.812640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.812746 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 389/747] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:37.813562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.813921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:37.814460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:37.815913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.831093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 359/748] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:37.832170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:37.923968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:37.944753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2897208-2021-47ec-8d77-1fb1b3b06fcb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.952722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a3a3-e0df-49f9-9c94-983a8b227399 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:37.981287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.982022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.982411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.982777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.983638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:37.985597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:37.989815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:37.990476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:37.990759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:37.991055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:37.999738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:38.001172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:38.013174 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:38.014092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:38.015061 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 360/749] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:29:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:38.015659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.038426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:38.066812 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 390/750] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:29:37 2022] POST /identity/v3/services => generated 240 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:38.068117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.182234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f128c2-a913-4617-aef3-fa084ca40193 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:38.230555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:38.231236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:38.231523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:38.231796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:38.255329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:38.256781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:38.273115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf5183-6492-445b-8d28-d45be47670ff None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:38.273385 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:38.274613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:38.275568 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:38.275568 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:38.275568 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:38.275568 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 361/751] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:38.280019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.317495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:38.318102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:38.318381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:38.318667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:38.319835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:38.320148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:38.321866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:38.340341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:38.350696 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 391/752] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:38.356006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.365732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:38.412813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a063c-9244-4cc9-b9c3-8c3d7aa041b8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:38.458885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:38.459585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:38.459963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:38.461413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:38.462215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:38.462602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:38.464101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:38.466971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6578d1-7314-4d4f-ba53-1d071809f918 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:38.480654 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 362/753] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:38.489117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.535141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:38.535752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:38.536029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:38.536301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:38.673141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:38.677164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:38.678663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:38.698479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad8158-70b5-4d1d-82e2-dac483857266 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:38.794325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:38.794325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585ff96-da03-4119-9133-4156473db89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:38.794325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585ff96-da03-4119-9133-4156473db89b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:38.794325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585ff96-da03-4119-9133-4156473db89b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:38.794715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585ff96-da03-4119-9133-4156473db89b None admin] PATH_INFO: `/v3/users/nova` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:38.794715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585ff96-da03-4119-9133-4156473db89b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:38.794715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585ff96-da03-4119-9133-4156473db89b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2585ff96-da03-4119-9133-4156473db89b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:38.802323 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:38.803320 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:38.804318 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:38.804851 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 363/754] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:38.812110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585ff96-da03-4119-9133-4156473db89b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.865425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 392/755] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 10:29:38.871825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:38.985501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f963b2-811b-4734-af51-f661765fe462 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:38.988903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:39.022888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.024672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.025162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.025664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.040026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.041775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.067107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585ff96-da03-4119-9133-4156473db89b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:39.071766 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:39.072806 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:39.073710 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:39.073710 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:39.073710 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:39.079591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 393/756] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:39.085166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.145023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.146021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.146511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.146991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.148518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:39.150733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.152452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.190155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 364/757] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:29:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:39.204234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.252233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b76c6a-ef15-4d58-861a-76870fe2feab None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.292078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.293223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.294422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.295096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.297701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:39.298454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.300679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e9357-efca-4c59-a60c-261453de5f73 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.301230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:39.328381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 394/758] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:39.329951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55cc00-91c0-481c-8b7f-cbb09eae2c3f None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.330450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55cc00-91c0-481c-8b7f-cbb09eae2c3f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.330927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55cc00-91c0-481c-8b7f-cbb09eae2c3f None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.332698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 395/759] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:39.338281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55cc00-91c0-481c-8b7f-cbb09eae2c3f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.355525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:39.380512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29976-bdeb-4f9e-806c-4c1167466de6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.425294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.427235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.427675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.428102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.443344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.446490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.455505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55cc00-91c0-481c-8b7f-cbb09eae2c3f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-10b102d6-c980-46a7-8258-5e8ab830b544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:39.467746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:39.468914 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:39.470024 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:39.470024 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:39.470024 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:39.472252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 365/760] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:39.473808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0631-2059-4662-be15-ec651482e1de None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.474244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0631-2059-4662-be15-ec651482e1de None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.474652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0631-2059-4662-be15-ec651482e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.500517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f1db0631-2059-4662-be15-ec651482e1de None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:39.502158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f1db0631-2059-4662-be15-ec651482e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:39.503919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.505113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.505700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.507128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.515151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.516783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:39.529210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:39.530303 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:39.531429 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:39.537137 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 396/761] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:39.538121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.602997 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 366/762] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:39.602997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0631-2059-4662-be15-ec651482e1de None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.626493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:39.658470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:39.693758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb485a7-b258-446a-8c58-4a0057ead332 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.755753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.756358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.756634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.756901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.757573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:39.757873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.759596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.772787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0631-2059-4662-be15-ec651482e1de None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.789900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 397/763] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:39.796189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.849774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:39.850388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:39.850689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:39.850958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:39.856880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:39.857225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:39.858830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:39.886235 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 367/764] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:39.897306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:39.953968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f36dcd-b88b-40a4-8c05-ba5f75c7acc1 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:39.986352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:39.998545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.000594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.004338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.004338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.014020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.015807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:40.028516 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:40.029509 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:40.030610 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:40.032320 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 398/765] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:40.033283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.048217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:40.060723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c12bc-0719-4d89-9e91-5a3a6926f023 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.097954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.098566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.098851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.099179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.099907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=1866762d940c472abd6e41d57e1d3c4f) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:40.100256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.102241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7593607-39ee-4752-a68f-f2533054a7fa None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.115135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 368/766] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:39 2022] GET /identity/v3/role_assignments?user.id=1866762d940c472abd6e41d57e1d3c4f&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:40.115135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dfd35-6cce-4a79-ade2-e5a52155f5a7 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.115135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dfd35-6cce-4a79-ade2-e5a52155f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.115135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dfd35-6cce-4a79-ade2-e5a52155f5a7 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.115135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 369/767] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:40.115135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dfd35-6cce-4a79-ade2-e5a52155f5a7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.157912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9744d9-2977-4402-8697-197e225d50af None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.203275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.204120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.204404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.205532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.206146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.208943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-175aac18-4ff4-4767-be7c-53389ed6cd6e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:40.227034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:40.228067 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:40.228897 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 399/768] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Sep 6 10:29:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:40.230233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.230332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.230580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.247321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dfd35-6cce-4a79-ade2-e5a52155f5a7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.253270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:40.254556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:40.290714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.291533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.291821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.292439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.293430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:40.293748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.295962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.311475 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 370/769] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:40.312662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.319462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:40.330887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:40.352199 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 400/770] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:40.352199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.497355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ddc02-4b13-478a-aa43-dd37b1b8a4bc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.549191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.549803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.550082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.550354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.550987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:40.551321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.553253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.557204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a365-a5a4-4a08-80e4-df0c36cb5212 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.558263 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 371/771] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 6 10:29:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:40.565272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.622902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b414048-0d42-4f80-9489-717f34263321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.624331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b414048-0d42-4f80-9489-717f34263321 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.624611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b414048-0d42-4f80-9489-717f34263321 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.625521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b414048-0d42-4f80-9489-717f34263321 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/6c2ddfc46e6c414085493829459e5ea9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.627515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b414048-0d42-4f80-9489-717f34263321 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=6c2ddfc46e6c414085493829459e5ea9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.629078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b414048-0d42-4f80-9489-717f34263321 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.674364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:40.697605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f76c8-6ba8-4796-b7a8-b1dd0823885b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.706378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 401/772] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:40 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/6c2ddfc46e6c414085493829459e5ea9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:40.709067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84855799-6b04-456b-956c-8718508dbfc9 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.709978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84855799-6b04-456b-956c-8718508dbfc9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.711150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84855799-6b04-456b-956c-8718508dbfc9 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.715408 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 402/773] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:40.727539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.727539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.727539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.751922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:40.753070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:40.754943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:40.755608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:40.755893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:40.756224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:40.756876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:40.757193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:40.759214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:40.769967 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 372/774] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 6 10:29:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:40.770923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.831392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:40.837096 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 403/775] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:29:40.838024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:40.958813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce090e-576e-4a4b-9147-761164fd9176 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.980211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b093-eeaa-4fde-85c9-05511c0d553b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:40.998703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.004770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.004770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.004770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.009002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:41.012527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:41.017990 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:41.019180 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:41.020050 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:41.020717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 373/776] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:41.024703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.025592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.026083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.026404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.026801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.027840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] RBAC: Adding query filter params (interface=public, service_id=3766cdb2bb134029a5e0aaecda5607d2, region_id=RegionOne) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:41.028482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.030075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.048777 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 404/777] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:29:40 2022] GET /identity/v3/endpoints?service_id=3766cdb2bb134029a5e0aaecda5607d2&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:41.055059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.119406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:41.211677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce2c6-3db7-41ee-8e94-e1d6172207a1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.236173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09524f0-46ec-45ee-99f3-7aadf5c59a3b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.261845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.262465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.262811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.263280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.263953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:41.264262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.265627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.274767 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 374/778] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:41.275741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.278839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.280096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.280559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.281024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.281801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.283365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.290236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 405/779] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/services => generated 772 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:41.291396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.343544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:41.391174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd63f36-0817-43b2-bf13-f6f1c7415fcb None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.445482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434f8a-c847-4cc5-91c2-f904362602ef None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.463402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:41.464561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.465215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.465503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.465790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.466387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.467820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:41.486691 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:41.488034 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:41.489073 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:41.493787 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 375/780] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:41.494720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.524758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.525615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.527459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.527782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.543472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.545361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:41.561605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:41.562794 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:41.563914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:41.563914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:41.563914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:41.564938 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 406/781] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:41.570762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.639090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ad7bf-0d79-4457-88ce-3e84d525a3b8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.666742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:41.677165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.680035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.680035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.680035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.680035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] RBAC: Adding query filter params (name=network) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:41.680343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.681960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.683652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9036-ecd7-4cbb-b7f7-d1eed380900b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.689037 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 376/782] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:41.695966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.741056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.742325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.742754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.743201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.744146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:41.745455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.747706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.776999 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 407/783] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:41.782824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.818545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:41.902582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad2c7-f98d-4d1b-ad64-f0b036f5cc87 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:41.945310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:41.945935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:41.946216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:41.946489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:41.947147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] RBAC: Adding query filter params (type=network) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:41.947988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:41.949353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:41.955216 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 377/784] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:41.961404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:41.982413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab924b3c-d8b4-4812-8b6e-6ddf1dafad12 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:42.048677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:42.050465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.051749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.052202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.065678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:42.067237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:42.067376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:42.090120 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:42.091335 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:42.092500 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:42.094135 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 408/785] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:42.098716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:42.114896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36cc8-8340-41ff-a24a-036e3fd38311 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:42.152531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:42.153247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.153741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.154089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.155109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] RBAC: Adding query filter params (interface=public, service_id=b79ebd7444ea4988bcb867f0c09994ec, region_id=RegionOne) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:42.155489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:42.156922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:42.165481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 378/786] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:29:41 2022] GET /identity/v3/endpoints?service_id=b79ebd7444ea4988bcb867f0c09994ec&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:42.171229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:42.241482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:42.281114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ba10d-0e84-46c5-82ac-2fe92491ab7d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:42.285482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20056218-4f58-4bff-a785-ecb374fbbdfa None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:42.319491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:42.330784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:42.331517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.331802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.332073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.332781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:42.334139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:42.340118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 379/787] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:29:42 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:42.360727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:42.361371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.361657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.361941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.362707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:42.363035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:42.364557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:42.403513 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 409/788] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 6 10:29:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:42.409265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:42.565142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0361d-8dd1-4fce-b4bb-96f1ba75246b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:42.601811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:42.602367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.602650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.602926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.614016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:42.615492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-ccfc104e-3f6c-4c80-9177-72ee200ba323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:42.630606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:42.631678 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:42.633186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:42.633186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:42.633186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:42.633186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 380/789] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:42.639474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:42.653351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852f13-5dd1-409e-b78b-316ec8e6bd25 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.654312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852f13-5dd1-409e-b78b-316ec8e6bd25 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.654814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852f13-5dd1-409e-b78b-316ec8e6bd25 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.656425 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 381/790] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:42.662905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.663224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.663500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.691187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:42.693515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:42.735614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:42.817442 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 382/791] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:42.845088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66c9d-973b-4ba9-9091-5b2c5f89411d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:42.898190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:42.898723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:42.898997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:42.899300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:42.899946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:42.900245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:42.901605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:42.903383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:42.924868 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 410/792] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:42.930929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:43.087340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a9e85-9fbe-4c28-8d3f-931f6fc72f67 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:43.140843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:43.141498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.141782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.142056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.156160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:43.157667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:43.173447 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:43.174371 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:43.175281 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 383/793] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:43.180240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:43.294895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:43.327976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:43.348781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080652-6d9a-4874-9aa4-50c7c33dd87c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:43.386705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:43.387828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.388351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.388835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.389754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:43.390318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:43.392077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d97ec-c365-4055-943b-5fd2a9034016 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:43.406630 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 411/794] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:43.408327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1375af-86da-4119-80bf-2b7b773e01e0 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.414845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1375af-86da-4119-80bf-2b7b773e01e0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.414845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1375af-86da-4119-80bf-2b7b773e01e0 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.414845 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 412/795] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:43.416142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1375af-86da-4119-80bf-2b7b773e01e0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:43.422342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db5a4a-4445-4a57-bff6-7aeffc476561 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:43.473018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991794a-3294-4f86-ad1d-57c6dafa5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:43.473989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991794a-3294-4f86-ad1d-57c6dafa5133 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.474283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991794a-3294-4f86-ad1d-57c6dafa5133 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.474566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991794a-3294-4f86-ad1d-57c6dafa5133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.482964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:43.488322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991794a-3294-4f86-ad1d-57c6dafa5133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3991794a-3294-4f86-ad1d-57c6dafa5133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:43.495047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:43.499387 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:43.500237 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 384/796] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:43.503380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.503674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.504167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.527830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:43.529222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:43.541648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1375af-86da-4119-80bf-2b7b773e01e0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:43.578887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:43.579998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.580507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.581040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/cd53273c297e44518ba1bbe2c838e744/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.583232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=cd53273c297e44518ba1bbe2c838e744, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:43.584984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:43.615113 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 385/797] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:43.615113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:43.626770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:43.677615 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 413/798] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:43 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/cd53273c297e44518ba1bbe2c838e744/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:43.728630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa29ef5-7e98-4ed5-867a-a0585f7c86ea None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:43.775779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:43.776540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:43.776831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:43.777100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:43.777788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:43.778094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:43.779550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:43.789541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 386/799] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:43.795158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.000878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099cb59-907d-4501-9822-276fec47eae4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.017813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.022292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.056337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.058274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.058569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.058844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.087112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:44.091788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:44.121393 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:44.122405 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:44.124028 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:44.124028 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:44.124028 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:44.124028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 414/800] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:44.128720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.164847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.189736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238fb17-f69c-44e7-bd86-757e83f71473 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.245974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603eb2c8-0796-421c-ab62-b104289e8248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.246607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eb2c8-0796-421c-ab62-b104289e8248 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.246886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eb2c8-0796-421c-ab62-b104289e8248 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.247185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eb2c8-0796-421c-ab62-b104289e8248 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.265745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eb2c8-0796-421c-ab62-b104289e8248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-603eb2c8-0796-421c-ab62-b104289e8248 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:44.271228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:44.272200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:44.273066 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 387/801] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:44.274249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee6f6-8d3c-4342-8623-cf7d6a8e4a94 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.274249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee6f6-8d3c-4342-8623-cf7d6a8e4a94 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.274418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee6f6-8d3c-4342-8623-cf7d6a8e4a94 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.280531 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 388/802] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:44.284744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee6f6-8d3c-4342-8623-cf7d6a8e4a94 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.316863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a546be-fd8b-403d-8d6e-8f9bbe5b9b9f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.363837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.364490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.364815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.365087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.365735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:44.366035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:44.368046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b2b8f-cfe8-4070-b148-8b84b0b51ff0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:44.382036 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 415/803] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:44.383743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.384124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.384492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.396415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee6f6-8d3c-4342-8623-cf7d6a8e4a94 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.405004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:44.406428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:44.431892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.433443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.434305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.434728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.435187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.435993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:44.436440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:44.437970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:44.440523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.453352 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 389/804] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:44.453352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.487418 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 416/805] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:44.488706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.606187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f568f0-f1ad-4b4e-ba9c-8bb2bd2afff1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.608353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23920-b663-4017-82e2-e810c26e3a53 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.653788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e792330-198f-444b-91d1-21dda041587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.654790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792330-198f-444b-91d1-21dda041587d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.655326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792330-198f-444b-91d1-21dda041587d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.655859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792330-198f-444b-91d1-21dda041587d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.667885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e792330-198f-444b-91d1-21dda041587d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:44.669045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.669686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.674470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.674575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e792330-198f-444b-91d1-21dda041587d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:44.674654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-4e792330-198f-444b-91d1-21dda041587d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:44.686248 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:44.687241 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:44.688115 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:44.688115 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:44.688115 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:44.690136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 417/806] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:44.694638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:44.694638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:44.695972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e792330-198f-444b-91d1-21dda041587d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.713650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:44.719131 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:44.720058 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:44.720984 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 390/807] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:44.726675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.812372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e792330-198f-444b-91d1-21dda041587d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.851960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:44.852953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:44.853435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:44.853871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:44.854700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:44.855677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:44.857325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:44.875481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 418/808] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:44.877396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:44.906770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.957264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:44.982021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbd6b-e8d6-4d68-9258-83ad42462926 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:44.995685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429b870-ecdf-4d8a-9867-5320b6796f57 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.019633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.020410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.020777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.021272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.021833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:45.022143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.024301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.034404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.036082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.036082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.036082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.043607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.049073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 391/809] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:45.049204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.049283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-badbb1ef-e933-4bcc-9a04-844fecb50839 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:45.060496 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:45.061538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:45.062471 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 419/810] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:29:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:45.063609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c452c3-2ec4-4cfd-ba50-77e962ec98fe None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.063609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c452c3-2ec4-4cfd-ba50-77e962ec98fe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.063609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c452c3-2ec4-4cfd-ba50-77e962ec98fe None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.064693 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 420/811] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:45.065282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c452c3-2ec4-4cfd-ba50-77e962ec98fe None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.166229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cda19c-d9a1-4f20-9967-2d767a72cfde None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.170124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c452c3-2ec4-4cfd-ba50-77e962ec98fe None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.186091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:45.197579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:45.204124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.209678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.209678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.209865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.209965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.209965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.210133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.210133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.210133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.210351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.217209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:45.217641 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:45.218569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 10:29:45.224125 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:45.224854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.224939 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 392/812] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:45.224939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3f16d820-af1d-48e2-9e7b-373cd4ed5e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:45.239604 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:45.240778 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:45.241655 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:45.241655 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:45.241655 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:45.245419 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 421/813] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:45.246629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.246921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.247225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.266225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:45.267452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:45.338258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52cbd-32fb-4054-bb29-a3100f76e868 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.339967 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 422/814] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:45.340652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.377521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.378137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.378419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.378694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.379464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:45.379777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.381325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.405813 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 393/815] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:45.405813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.447916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:45.489056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdde73-65ea-450d-b916-1ea7172f1aab None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.503935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:45.520610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c18e7-0bc1-4266-9c26-4c760046a280 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.538658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.539973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.540459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.540956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.541792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:45.542809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.544964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.551716 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 423/816] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:45.556720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.563576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.564504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.564986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.565530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.566878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:45.567436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.569490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.586799 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 394/817] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:45.587903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.674097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860894f1-7567-412e-8dae-17cbff89df95 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.713346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.714147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.714432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.714884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.718126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:45.722075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0de0-f929-4478-ae72-3a5fa67a9442 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.762174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:45.762684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.763325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.763609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.764169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.764545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:45.764823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.766350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.776180 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 395/818] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:45.776180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.794327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.795815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.892411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181171f-b6fc-4bbd-bc16-f4a9a5bb2dca None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:45.907335 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 424/819] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:29:45.907335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.938292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:45.938930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:45.939246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:45.939524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:45.946727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:45.948465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:45.962974 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:45.970620 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 396/820] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:45.972941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:45.998778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.008379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.033659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1896151-94a1-4fad-82c4-a0169165b517 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.071779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.072455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.073000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.073281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.074027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.075763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.083502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e23a-3af3-4bff-9e65-7d682d3a3317 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:46.084534 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:46.086037 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:46.086918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 425/821] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:45 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:46.087787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.127845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.128458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.128785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.129024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.129692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.131099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.191073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef980-af31-4692-9b86-a0e0fd7739c4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.224528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.225567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.225850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.226693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.234078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.238441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.239972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.243249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 397/822] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:29:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:46.244326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:46.256096 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:46.257158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:46.258097 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:46.258097 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:46.258097 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:46.258097 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 426/823] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:46.259176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.345635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.374895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef352b5-c658-4199-90b4-30814a7b7f1e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.381449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba03bd0-2fe4-4534-a68a-01d8ed2bc8a5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.413278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.414490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.414787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.415091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.416987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:46.416987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.417530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d024-3c2e-4716-8270-332bfe89a8cb None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.424989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.425601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.426351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.426645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.427299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:46.427604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.429491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.431466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 398/824] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:46.432614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149bbfb-37d5-4c22-82eb-5622d535a72c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.432978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149bbfb-37d5-4c22-82eb-5622d535a72c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.433264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149bbfb-37d5-4c22-82eb-5622d535a72c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.434465 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 399/825] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:46.435254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149bbfb-37d5-4c22-82eb-5622d535a72c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.437951 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 427/826] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:29:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:46.438964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.503899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.551314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1970d0-8e03-49cc-98f6-cc349d6e2cb3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.555203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149bbfb-37d5-4c22-82eb-5622d535a72c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.588597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cfe8d-7c64-4dd6-bc15-1bd30ea21a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.589306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cfe8d-7c64-4dd6-bc15-1bd30ea21a50 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.589548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cfe8d-7c64-4dd6-bc15-1bd30ea21a50 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.589826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cfe8d-7c64-4dd6-bc15-1bd30ea21a50 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/1866762d940c472abd6e41d57e1d3c4f/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.592220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.592924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.593263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.593591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.594241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:46.594573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.595958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.597442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.612600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cfe8d-7c64-4dd6-bc15-1bd30ea21a50 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=1866762d940c472abd6e41d57e1d3c4f, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.612821 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 400/827] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:46.612821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.612988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cfe8d-7c64-4dd6-bc15-1bd30ea21a50 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.671233 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 428/828] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:29:46 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/1866762d940c472abd6e41d57e1d3c4f/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:29:46.673272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.673571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.673862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.698825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:46.700360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:46.743657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1672-9a97-466c-a946-bd9df4506dc9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.785756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:46.786826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:46.787246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:46.787574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:46.788572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] RBAC: Adding query filter params (type=network) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:46.788969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:46.790619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:46.798128 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 401/829] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:29:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:46.799315 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 429/830] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:46.799429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.816161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:46.873306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.895678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:46.940449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2c25f-e18f-4c24-9952-1f7538cbad91 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:46.981496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967b5d9-5d2a-49c7-861d-5361cb1efd4b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:47.003793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.004452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.005681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.005681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.024183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:47.025975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:47.044844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.045375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.045656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.045930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.046594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:47.047979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:47.055036 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:47.056105 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:47.057090 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 402/831] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:47.062624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:47.145136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 430/832] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:29:46 2022] POST /identity/v3/endpoints => generated 337 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:47.190626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3933282-3112-48db-993e-5bec8fcce910 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:47.212440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:47.216073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:47.242783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.243462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.244144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.244144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.244747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:47.245066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:47.251038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:47.265153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 403/833] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:47.267895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:47.406440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:47.414998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e8e6-288e-49ea-8ea0-09f3fb3bbf85 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:47.426125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b8dc-eee0-4d89-8ea6-94070f01adc5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:47.468245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.468865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.469249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.469527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.470363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=6c2ddfc46e6c414085493829459e5ea9) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:47.470777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:47.472474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:47.473621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.474542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.474972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.475490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.480440 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 404/834] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:47 2022] GET /identity/v3/role_assignments?user.id=6c2ddfc46e6c414085493829459e5ea9&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:47.495732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:47.501963 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:47.503170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:29:47.504176 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:47.506829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 431/835] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:47.512743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:47.561947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:47.631324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ae965-3507-4f51-9b9b-764443335008 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:47.670171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.670702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.670981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.671291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.671967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:47.672270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:47.673771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:47.683374 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 405/836] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:47.688829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:47.795561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459885aa-1fc8-478c-963b-f3063b64ebbd None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:47.831735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:47.832367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:47.832647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:47.832921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:47.844703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:47.846152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:47.861614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:47.865920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:47.867054 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:47.867054 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:47.867054 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:47.867054 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 432/837] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:47.872285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:47.978693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:47.981742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8da4-6ad5-4c27-9bc7-41cd88f4d8a6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:48.020596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:48.021750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.022416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.023657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.024185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:48.024961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:48.026395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:48.039083 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 406/838] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:48.044665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:48.048159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:48.154020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ad11-f527-469b-a447-808c4ba57b7c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:48.189371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:48.190384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.190869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.191399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.200229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:48.201601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:48.213491 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:48.214457 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:48.215416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 433/839] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:29:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:48.222276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:48.329665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3fc3-14bb-4c63-96b5-b2c1a207b545 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:48.364583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:48.365191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.365474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.365796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.366517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:48.367383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:48.370636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a847f-e8ae-43f3-9abf-0ae2828b095e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:48.387331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 407/840] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Sep 6 10:29:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:48.392951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:48.457813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:48.503474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0da40-3d30-4988-93d0-182f6b923b81 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:48.539711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:48.540344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.540623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.540903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.616233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:48.618185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:48.681718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:48.716253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bfd2-a8fa-4464-8155-972b18c21464 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.716572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bfd2-a8fa-4464-8155-972b18c21464 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.716825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0bfd2-a8fa-4464-8155-972b18c21464 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.722201 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 408/841] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:48.723911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.724207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.724486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.725497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 434/842] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:48 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:29:48.732185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:48.744172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:48.745371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:48.760187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:48.845519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 409/843] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:29:48.862558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80301e-51bc-472c-be0e-62324027d6c9 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:48.899967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:48.900522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:48.900807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:48.901081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:48.912193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:48.914176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:48.930034 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:48.930975 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:48.931942 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:48.931942 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:48.931942 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:48.931942 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 435/844] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:48.938968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.060111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf6a6-dc81-4859-8262-b86f8748c449 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.102326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.103331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.103819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.104323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.105312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:49.105819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.107469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.119936 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 410/845] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:49.125672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.149374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:49.213838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.227453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:49.244155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41dc65-ed36-46b2-ad78-ee661eb2fa50 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.280790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.281419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.281701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.281976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.291219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.293492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-f030612a-685f-4347-9304-c8f99dc9c8c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:49.304837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:49.305950 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 436/846] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d36c7-233a-4cda-b5b5-0600515becff None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.307410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d36c7-233a-4cda-b5b5-0600515becff None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.308058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d36c7-233a-4cda-b5b5-0600515becff None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.312726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 437/847] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:49.313498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d36c7-233a-4cda-b5b5-0600515becff None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.329342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523ab4c-6619-4090-a23e-f08b043fec3a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.365078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.365714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.365996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.366279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.366898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.368306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3ebc1324-9912-4bb4-8e01-0b7a0581b5f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:49.377227 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:49.378295 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:49.379186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 411/848] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:49.380009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.380009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.380143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.399152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:49.400359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:49.400505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:49.429830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d36c7-233a-4cda-b5b5-0600515becff None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.470638 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 412/849] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:49.471852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.474429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:49.481874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.486208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.486208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.486208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.486208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:49.486208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.486740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.503071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 438/850] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:49.509797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.589137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594681a4-b09a-4404-98cf-ddbd41e11ff4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.625888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.626638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.626831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.627115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.627758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:49.628068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.629436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.639176 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 413/851] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:49.640291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.651593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0628d-ed31-4d5f-863a-7e9181027c35 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.698216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.699465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.700378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.701151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.702318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=cd53273c297e44518ba1bbe2c838e744) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:49.702850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.704596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.706556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:49.719394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:49.731162 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 439/852] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/role_assignments?user.id=cd53273c297e44518ba1bbe2c838e744&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:49.758976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dc5b2-66ea-4b43-8596-aa9eaf4c584b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.800722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.801363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.801650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.801929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.802679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:49.802995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:49.805069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7987-ce32-4791-a801-7cd91df882ec None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:49.810971 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 414/853] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:49.815259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:49.945512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5c80-45b1-4268-a345-ecff35f820b2 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:49.978070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b7555-4d94-4cc6-ad34-cd7710ad13f3 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.978659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b7555-4d94-4cc6-ad34-cd7710ad13f3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.979129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b7555-4d94-4cc6-ad34-cd7710ad13f3 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.981005 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 415/854] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:49.993268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:49.993268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.993268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.993268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.993778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:49.993778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:49.993778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:49.998840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:50.004213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:50.005242 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:50.006076 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 440/855] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:50.012013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.012412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:50.013583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:50.083027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:50.111995 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 416/856] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:29:50.131450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e646d-2853-432e-8c0b-0eead2b23745 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.166888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481894-e380-47ab-8d24-003656878bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.167543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481894-e380-47ab-8d24-003656878bcb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.167825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481894-e380-47ab-8d24-003656878bcb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.168103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481894-e380-47ab-8d24-003656878bcb None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.168764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481894-e380-47ab-8d24-003656878bcb None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:50.169071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481894-e380-47ab-8d24-003656878bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.170443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481894-e380-47ab-8d24-003656878bcb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.179877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 441/857] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:50.185492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.251481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:50.289723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bac3c-1a52-49b3-98e0-4066668f45ba None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.326273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.326909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.327223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.327498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.338046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.339559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:50.355261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:50.356262 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:50.357470 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:50.357470 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:50.357470 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:50.357470 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 417/858] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:50.364168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481894-e380-47ab-8d24-003656878bcb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.454301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.475337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481894-e380-47ab-8d24-003656878bcb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.501154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:50.517647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.518739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.519259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.519735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.520564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:50.521454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.524079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.541381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 442/859] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:50.546468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.577109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b5d2-9b43-418c-991d-0cd117b4d79c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.591200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:50.613348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.614420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.615269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.615970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.616781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.618516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:50.630234 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:50.631228 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:29:50.632110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:50.632865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 418/860] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:50.637906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.668055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a496039-fb4e-431f-9955-e5640527f44c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.706866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.707800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.708275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.708824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.716679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.718352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:50.731627 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:50.732680 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:50.733605 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:50.736374 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 443/861] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:50.741936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.753356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dbe42-da9c-41b0-9eee-42ca55fd8d8a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.797408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:50.799292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.799896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.800178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.800461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.801418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:50.801718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.803403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.811087 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 419/862] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:50.814524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:50.871791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:50.879532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dffe7-3978-41e2-a011-4752962f9e4f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.924637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:50.929810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:50.929810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:50.929810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:50.929810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:50.929810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:50.929810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:50.946976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959a158-860a-4ed7-8a94-1aff58c4d365 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:50.951170 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 444/863] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:50.954530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:51.002231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:51.003235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:51.003715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:51.004106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:51.005790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:51.006202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:51.008399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:51.015091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 420/864] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:51.091870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:51.096881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ced1-5665-471d-a00b-abd10a8a69ea None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:51.137864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:51.138821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:51.139427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:51.139859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:51.224353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:51.225799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:51.325760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:51.330841 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 445/865] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 10:29:51.336587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:51.445536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527bbc7-6a26-440b-9420-10a05b341d14 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:51.447863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:51.479778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:51.480417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:51.480696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:51.480975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:51.492456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:51.493926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:51.509602 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:51.510576 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:51.512110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:51.512110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:51.512110 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:51.515132 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 421/866] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:51.516713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:51.622781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5bd8b-39aa-4535-94cf-936286b98de6 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:51.659287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:51.659903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:51.660181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:51.660454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:51.661197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:51.661504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:51.662881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:51.676023 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 446/867] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:51.682104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:51.789218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398895a6-52d1-4481-bfd4-cc955bd85b7e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:51.825170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:51.825798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:51.826077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:51.826348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:51.833268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:51.840635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:51.846150 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:51.847071 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:51.848183 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 422/868] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:51.853786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:51.915323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:51.962421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd5e2-0c3b-444a-a8ca-842f8487d7ba None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:52.002793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:52.003441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.003730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.003988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.004679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:52.004981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:52.006393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10142694-c1f9-44d1-b2cf-b8200172b093 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:52.023735 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 447/869] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:52.025766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:52.045648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:52.111298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842e048-7949-4938-9bd0-def3a7d14619 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.111298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842e048-7949-4938-9bd0-def3a7d14619 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.111298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842e048-7949-4938-9bd0-def3a7d14619 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.111298 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 448/870] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:52.116828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210220-ed17-4041-b029-5a21c659710c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.117113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210220-ed17-4041-b029-5a21c659710c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.117385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c210220-ed17-4041-b029-5a21c659710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.138780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4c210220-ed17-4041-b029-5a21c659710c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:52.140503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c210220-ed17-4041-b029-5a21c659710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:52.142982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173d5f4-583a-43aa-bab5-762457339d0a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:52.179833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:52.180438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.180716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.180987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.181705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=1866762d940c472abd6e41d57e1d3c4f) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:52.182013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:52.183470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27933ab-8b64-4e9d-8390-25e3bea2de3e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:52.189658 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 423/871] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:52 2022] GET /identity/v3/role_assignments?user.id=1866762d940c472abd6e41d57e1d3c4f&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:52.190923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926edace-aaed-4aea-9289-3f89af69501f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.191242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926edace-aaed-4aea-9289-3f89af69501f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.191515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926edace-aaed-4aea-9289-3f89af69501f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.196840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 424/872] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:52.200758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.201044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.201314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.221816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:52.223070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:52.227054 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 449/873] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:52.316398 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 425/874] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:52.560937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210220-ed17-4041-b029-5a21c659710c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:52.611407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:52.667944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c210220-ed17-4041-b029-5a21c659710c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:52.682303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:52.693957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:52.708445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:52.709564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.710050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.710657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.712209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:52.714226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:52.792754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5956c7-333f-44eb-8077-f9d242ab8fc3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:52.800926 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 450/875] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:29:52 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:52.845596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:52.846321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:52.846615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:52.846892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:52.847593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:52.849201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:52.860505 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:52.861616 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:52.862479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 426/876] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:29:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:52.867733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:52.995661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5df49-4f55-4d23-988b-23e7d4d69a07 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:53.005589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:53.032488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:53.033414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:53.033868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:53.034372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:53.036209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:53.036209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:53.037388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d37af9-b3ac-4e92-9ee3-9745d4ee1998 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:53.043097 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 451/877] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:29:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:53.048624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:53.119996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:53.152256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ac979-ad33-4933-b6fb-fd4c192e0f12 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:53.187512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:53.188124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:53.188411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:53.188686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:53.189381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:53.189697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:53.191086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf668af-d3de-45f4-b38d-25b13ec675e1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:53.196469 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 427/878] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:29:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:53.423249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478c79-52a6-4a01-87f2-6c875bf8d707 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:53.423435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478c79-52a6-4a01-87f2-6c875bf8d707 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:53.423798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12478c79-52a6-4a01-87f2-6c875bf8d707 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:53.425260 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 452/879] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:53.430718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9015ec2-f5b1-4f27-b826-5275c8e909fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:53.431044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9015ec2-f5b1-4f27-b826-5275c8e909fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:53.438085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9015ec2-f5b1-4f27-b826-5275c8e909fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:53.453431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b9015ec2-f5b1-4f27-b826-5275c8e909fb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:53.454714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b9015ec2-f5b1-4f27-b826-5275c8e909fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:53.531050 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 428/880] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:53.860615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478c79-52a6-4a01-87f2-6c875bf8d707 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:53.966611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12478c79-52a6-4a01-87f2-6c875bf8d707 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:54.004054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d746-c5af-4750-af3b-89183629e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:54.005032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d746-c5af-4750-af3b-89183629e542 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:54.005512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d746-c5af-4750-af3b-89183629e542 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:54.005981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d746-c5af-4750-af3b-89183629e542 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:54.006841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260d746-c5af-4750-af3b-89183629e542 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:54.008543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260d746-c5af-4750-af3b-89183629e542 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:54.092513 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 453/881] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:29:53 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:54.580450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ea0f-33d4-44a0-9c99-7fc18cd88b3e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:54.581141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ea0f-33d4-44a0-9c99-7fc18cd88b3e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:54.581141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ea0f-33d4-44a0-9c99-7fc18cd88b3e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:54.582721 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 429/882] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:54.588680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:54.589217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:54.589668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:54.612396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:54.613605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:54.642494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:54.692296 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 454/883] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:55.028697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936ea0f-33d4-44a0-9c99-7fc18cd88b3e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.101338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:55.144707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936ea0f-33d4-44a0-9c99-7fc18cd88b3e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:55.180347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382a4b-2090-46c9-9a10-765e028ad3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:55.180893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382a4b-2090-46c9-9a10-765e028ad3f9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.181167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382a4b-2090-46c9-9a10-765e028ad3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.181484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382a4b-2090-46c9-9a10-765e028ad3f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.192084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382a4b-2090-46c9-9a10-765e028ad3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-1b382a4b-2090-46c9-9a10-765e028ad3f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:29:55.197444 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:55.198364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:55.199209 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 430/884] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:55.206250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.252734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436ef4-ae42-4120-b16d-af58b1153666 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.253072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436ef4-ae42-4120-b16d-af58b1153666 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.253299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436ef4-ae42-4120-b16d-af58b1153666 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.255499 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 431/885] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:55.261381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ffc8-a88d-420f-be43-4ee47796440e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.261665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ffc8-a88d-420f-be43-4ee47796440e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.261942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ffc8-a88d-420f-be43-4ee47796440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.280731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8bd0ffc8-a88d-420f-be43-4ee47796440e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:55.281945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8bd0ffc8-a88d-420f-be43-4ee47796440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:55.318072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467bb3-48db-490f-a734-335f6c29dbf5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:55.356315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:55.357407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.357891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.358372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.359332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:55.360110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:55.361737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:55.377035 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 455/887] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:55.378409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.378782 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 432/887] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:55.402822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:55.487199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65073e49-10cc-48f6-a984-4091c12b63b8 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:55.518443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4219b-3f33-4610-9f8c-f5f3b1c5199c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.518783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4219b-3f33-4610-9f8c-f5f3b1c5199c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.519020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4219b-3f33-4610-9f8c-f5f3b1c5199c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.521591 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 433/888] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:29:55.522430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:55.523116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.523400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.523766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.525651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.525945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.526224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.536470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:55.537921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:55.546375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:55.548205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:55.553426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:55.554941 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:55.555883 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:55.555883 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:55.555883 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:55.555883 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 456/889] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:55.561947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.612064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:55.637126 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 434/890] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:55.651367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:55.683895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c88d5-56a6-4b33-9896-3bfd72364ad0 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:55.723077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:55.724031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.724511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.724980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.725811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:55.726900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:55.728529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:55.743473 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 457/891] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:55.752175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.757604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.863671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c5d6-6abb-42b6-97fc-c4aa49d32d9b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:55.866039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fe297-a043-40e2-96b1-2476a3f03b60 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:55.894366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:55.900019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:55.900657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.900941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.901237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.901843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:55.903242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:55.910684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:55.911555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:55.912000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:55.912697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:55.918644 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:55.919708 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:55.920538 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 458/892] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:55.921353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:55.924787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:55.926576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:29:55.940748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:55.941714 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:29:55.942663 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:55.949708 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 435/893] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:55.950884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.003948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.050312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f124e-e0f7-457b-b04f-0acb75024bf7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.069215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2e844-f2dc-4b9e-8d49-72918baf51ca None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.088835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.089444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.089728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.090006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.090982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:56.090982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.092330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.102299 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 459/894] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:56.102977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.107280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.107892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.108180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.108491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.109192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:56.109501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.111288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.135258 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 436/895] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 6 10:29:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:56.135258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.173660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.218356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f4bfd-9725-4614-a579-6b3f7f1a0cdb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.239264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dae2b-0ed5-4379-9d23-f03b0c662c3a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.241017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.254996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.255736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.256029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.256309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.256983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.258953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.280040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.280654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.280938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.281213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.281856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:56.282165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.283569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.288657 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 437/896] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:56.289252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.330814 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 460/897] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:29:56 2022] POST /identity/v3/services => generated 241 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:29:56.331932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.439717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f93a4-68b3-434b-acd4-bb65c15d5b7f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.462455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc705f3-45bb-43d7-bde3-8fcd6dd8f241 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.479658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.482234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.482857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.483177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.483455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.502906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.503578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.503857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.504121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.504901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] RBAC: Adding query filter params (interface=public, service_id=df3b9b6edc8a446c86cdccb1b46ffe6b, region_id=RegionOne) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:56.505266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.506621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936024b-27ff-4b59-9788-9986d9db10aa None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.514129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 461/898] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:29:56 2022] GET /identity/v3/endpoints?service_id=df3b9b6edc8a446c86cdccb1b46ffe6b&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:56.515498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45aac-d1bd-4a97-b555-11a75db4092b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.515784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45aac-d1bd-4a97-b555-11a75db4092b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.516056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45aac-d1bd-4a97-b555-11a75db4092b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.517350 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 462/899] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:56.519727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f45aac-d1bd-4a97-b555-11a75db4092b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.531235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.572228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.574793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.629746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f45aac-d1bd-4a97-b555-11a75db4092b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.670918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f59c90-3e0c-4944-9e0a-2ba4fe60f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.671611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59c90-3e0c-4944-9e0a-2ba4fe60f8eb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.671904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59c90-3e0c-4944-9e0a-2ba4fe60f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.672185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59c90-3e0c-4944-9e0a-2ba4fe60f8eb None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.672798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f59c90-3e0c-4944-9e0a-2ba4fe60f8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.674193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f59c90-3e0c-4944-9e0a-2ba4fe60f8eb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.690031 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 463/900] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:29:56 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:29:56.690031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.690031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.690031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.704510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:56.705749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:56.715463 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 438/901] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:29:56 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:29:56.717210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:56.753283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.784565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 464/902] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:56.801211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:56.841304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2129b-d92e-4176-9daf-886dab5a9072 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:56.886303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:56.886967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:56.887325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:56.887602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:56.899412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:56.901605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:29:56.916930 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:56.917979 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:29:56.918888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:29:56.918888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:29:56.918888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:56.918888 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 439/903] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:56.925638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.039650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f722a7c-257c-4df0-801c-b00ae51e533e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.080727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.081774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.082279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.082762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.083661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:57.084176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.085805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.098372 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 465/904] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:57.108096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.129565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.166131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:57.222456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef059f4-690b-4e22-9ad4-55bb0191ff6a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.243312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:57.244818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09806689-81cb-4b7e-b8c7-063450ec38bf None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.267863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.273367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.273367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.273367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.277227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.278883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.283325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.283955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.284234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.284505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.285080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.286493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:29:57.291953 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:57.292826 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:57.293703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 440/905] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:57.296702 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:57.298323 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:57.299497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 466/906] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:29:57.303602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.308062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.415633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1758-399a-4803-8489-f4ee96992634 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.433479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:57.439373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f637d21-115f-4b79-81a4-4fc6aafab3c5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.452884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.453507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.453790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.454069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.454709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:57.455035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.456452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.467135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 441/907] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:57.468679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.491952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.492990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.493506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.494542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.495782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:57.496337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.499048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.517846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:57.525123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 467/908] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:57.528058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.602607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc13e-287f-4e07-9005-22a140fa845f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.634924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ed58f-de95-4534-8e7f-5334b0515643 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.646522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.647447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.648549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.649173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.650112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:57.650642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.652351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.657955 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 442/909] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:57.664750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.675640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.676256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.676540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.676812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.677536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] RBAC: Adding query filter params (role.id=3f9da8e5d46143dfba040495077f1dc5, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=1866762d940c472abd6e41d57e1d3c4f) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:57.677845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.679515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.685217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 468/910] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/role_assignments?user.id=1866762d940c472abd6e41d57e1d3c4f&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=3f9da8e5d46143dfba040495077f1dc5 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:57.786522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1a44f-0822-41e8-b0ea-55899fc938b1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:57.795430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:57.826846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:57.827916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:57.828446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:57.828955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:57.829986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] RBAC: Adding query filter params (interface=public, service_id=9fe81fc4879b4da9be8b977f50808785, region_id=RegionOne) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:57.830580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:57.832210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c241a32-7a15-4c91-8aa2-6ba5d80b22c4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:57.840402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 443/911] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/endpoints?service_id=9fe81fc4879b4da9be8b977f50808785&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:57.846512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:57.875843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:57.965968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5fdcc-5da0-43f0-a557-c1aff2d91da4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:58.003566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e31968-44cf-45c8-85b0-8c6cd233979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:58.004223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e31968-44cf-45c8-85b0-8c6cd233979d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:58.004505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e31968-44cf-45c8-85b0-8c6cd233979d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:58.004778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e31968-44cf-45c8-85b0-8c6cd233979d None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:58.005383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e31968-44cf-45c8-85b0-8c6cd233979d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:58.006742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e31968-44cf-45c8-85b0-8c6cd233979d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:58.013654 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 469/912] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:29:57 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:29:58.607535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff9802-94d8-48a5-adaa-020f661f1ce0 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:58.607871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff9802-94d8-48a5-adaa-020f661f1ce0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:58.608089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff9802-94d8-48a5-adaa-020f661f1ce0 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:58.609684 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 444/913] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:58.616074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b874566-7498-4888-b206-0cafdde4172c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:58.616626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b874566-7498-4888-b206-0cafdde4172c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:58.617330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b874566-7498-4888-b206-0cafdde4172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:58.635406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8b874566-7498-4888-b206-0cafdde4172c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:58.636593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b874566-7498-4888-b206-0cafdde4172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:58.707725 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 470/914] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:59.024996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9cdce-1c14-4ab6-9c73-eb46a9910555 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.025724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9cdce-1c14-4ab6-9c73-eb46a9910555 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.025724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9cdce-1c14-4ab6-9c73-eb46a9910555 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.027152 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 445/915] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:29:59.032797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.033291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.033779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.039959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9cdce-1c14-4ab6-9c73-eb46a9910555 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.055779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:29:59.057050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:29:59.069187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:59.136349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 471/916] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:29:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:29:59.167087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9cdce-1c14-4ab6-9c73-eb46a9910555 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.202772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.203487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.203817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.204092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.204676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.206030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:59.215707 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:59.216647 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:29:59.217472 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:29:59.221747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 446/917] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:59.223174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.329485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d836f3-187c-4973-8ae2-855953e9f129 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.365755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.366723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.367237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.367740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.368574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:59.369100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.370706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.376003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 472/918] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:59.385570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.418566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:59.479527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.489201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a882a3-5953-4abe-a580-73bdc3695212 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.493046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:59.529117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.529725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.530005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.530276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.531080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:59.531530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.534027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.543091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 447/919] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:29:59.547217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.609224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededaf2f-a981-4c07-b5c5-0f0203b06a0a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.662708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.663437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.663688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.663949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.664944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.666588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.667585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:59.671716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b668-984f-41b4-86dd-038d257ebc3f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:29:59.678316 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:29:59.679890 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:29:59.680731 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 473/920] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:29:59.688068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.720482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.721093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.721372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.721643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.722597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] RBAC: Adding query filter params (interface=public, service_id=155de2d5df044758a15f5fff2b3f6e71, region_id=RegionOne) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:59.722906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.725187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.737361 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 448/921] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/endpoints?service_id=155de2d5df044758a15f5fff2b3f6e71&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:59.739569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.792170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:29:59.825659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c1519-1174-45e1-908a-c80663e848cb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.868175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.869121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.869581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.870097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.870985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:29:59.871540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.873080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.874035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea1598-bcc8-410d-86ae-1114e77f1013 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:29:59.879339 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 474/922] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:29:59.885549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:29:59.918515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcdcdd-0923-4d16-b72d-96187b4bb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:29:59.919282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcdcdd-0923-4d16-b72d-96187b4bb01e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:29:59.919697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcdcdd-0923-4d16-b72d-96187b4bb01e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:29:59.920117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcdcdd-0923-4d16-b72d-96187b4bb01e None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:29:59.920779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcdcdd-0923-4d16-b72d-96187b4bb01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:29:59.922376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcdcdd-0923-4d16-b72d-96187b4bb01e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:29:59.935041 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 449/923] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:30:00.002503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee27b4-3f6f-44b0-979e-2e829a6dbf09 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:00.023594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7653a-cc96-41da-be05-3aff01c4f573 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.023927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7653a-cc96-41da-be05-3aff01c4f573 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.024140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7653a-cc96-41da-be05-3aff01c4f573 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.025737 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 450/924] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:00.031375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06042264-2f91-42a2-aa8a-519ae0146509 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.031671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06042264-2f91-42a2-aa8a-519ae0146509 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.031950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06042264-2f91-42a2-aa8a-519ae0146509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.044415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:00.046087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.046604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.047085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.048224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:00.048716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:00.050330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:00.051694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-06042264-2f91-42a2-aa8a-519ae0146509 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:00.052921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06042264-2f91-42a2-aa8a-519ae0146509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:00.060336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 475/925] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Sep 6 10:29:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:00.066416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:00.069724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:00.078732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:00.140547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 451/926] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:00.189407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8a8bb-d990-40f3-8f93-188353dae735 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:00.223402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:00.224030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.224315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.224587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.225242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:00.230524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:00.281169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abc55-842c-485e-ad93-ea0628656e55 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.281517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abc55-842c-485e-ad93-ea0628656e55 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.281786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582abc55-842c-485e-ad93-ea0628656e55 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.283241 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 452/927] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:00.288154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.288524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.289321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.308789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 476/928] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:30:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:00.315820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:00.318953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:00.406492 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 453/929] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:00.475663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:00.542118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:00.587741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b349-8b82-4a3d-8ed0-bd41c3e519b2 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:00.623700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:00.624275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.624559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.624836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.635766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:00.641479 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:00.642426 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:00.643301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 477/930] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 6 10:30:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:00.650632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:00.742165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:00.746176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:00.767321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4040d4-2ae5-41eb-93c1-1d47242b78f7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:00.805842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:00.806474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.806886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.807233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.807910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:00.808278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:00.809737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:00.822945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 454/931] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:30:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:00.826700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:00.868280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68798b-cc0d-447c-ab0b-b17095cb1cac None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:00.890793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:00.916574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:00.917534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.918058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.918542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:00.919396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:00.921189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:00.931919 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:00.932914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 10:30:00.933822 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:00.936924 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 478/932] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Sep 6 10:30:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:00.941516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83629ab-cd00-43ae-890f-89d1fcbe0220 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:00.942282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:00.983625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:00.984708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:00.985964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:00.986572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.001480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.003432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.007087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:01.024660 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:01.026242 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:01.027156 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:01.027156 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:01.027156 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:01.027156 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 455/933] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:01.036230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.075343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653611fd-bb90-4ce3-a431-c12b0803ddda None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.127405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.128443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.128962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.129452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.130320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:01.130832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.133064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.140658 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 479/934] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:30:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:01.145909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.169732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a541c-7148-4e49-b0db-11005d765e17 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.204382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:01.208270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.209417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.210004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.210619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.211585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:01.212024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.213543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.226038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 456/935] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:01.232476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.274766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ab8c-2a52-4726-a111-dded5f410bc1 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.304827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:01.319062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.319255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.319454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.320250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.321029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:01.321338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.322976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.329518 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 480/936] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:30:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:01.337687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.358801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ed12c-6c38-40a6-8a5c-55d07086ed02 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.394942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.395739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.396129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.396527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.403985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.405539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:30:01.417894 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:01.419064 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:30:01.420246 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:01.423140 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 457/937] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:30:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:01.427482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.449041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009859-21ac-446f-a195-fb5c6b61cd1b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.471471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:01.502251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.502866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.503445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.503780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.504448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.506547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.541964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a2adf-03dc-4347-b45e-8a070cf72a4c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.559750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:01.578362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.578967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.579276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.579554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.580412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:01.580719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.582133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.607462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 481/938] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:30:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:01.609087 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 458/939] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 6 10:30:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:01.616187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.752929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1ef6-0937-4d3a-89c0-d3712d19ec8d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.793089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.793663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.793946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.794221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.805702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.807207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:01.821884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:01.823084 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:01.824221 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:01.824221 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:01.824221 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:01.824221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 482/940] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:01.829456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:01.947279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e2641-badc-4a4a-85ae-c79f60b8fa70 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:01.985534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:01.986151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:01.986434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:01.986709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:01.987453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:01.987762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:01.989263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:02.001848 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 459/941] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:02.008138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:02.027739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:02.121788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60881dc-cd3f-44f9-a19b-0e27d264a91a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:02.164525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:02.165537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.166050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.166589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.174195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:02.175995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-9bf07537-30f5-423b-a5b6-b3f0ac088ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:30:02.188394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:02.189543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:02.190441 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:02.192744 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 483/942] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:02.199465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:02.239193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:02.260315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360837e-5f0c-4ed8-9500-5b23951e21db None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.260608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360837e-5f0c-4ed8-9500-5b23951e21db None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.260874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360837e-5f0c-4ed8-9500-5b23951e21db None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.262453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 484/943] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:02.267543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.267827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.268102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.286828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:02.288059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:02.320464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d891a-18bc-4c3e-a6c1-3c65b2851e74 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:02.359376 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 485/944] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:02.372977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:02.373587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.373872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.374145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.374837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:02.375176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:02.376608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:02.390214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 460/945] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:02.396011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:02.414972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:02.510966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11be76-97b8-4eb9-aa30-59e4b8726a4d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:02.546138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae86416-93d6-4876-8afd-b29fbc2aa4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:02.546887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae86416-93d6-4876-8afd-b29fbc2aa4eb None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.547302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae86416-93d6-4876-8afd-b29fbc2aa4eb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.547648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae86416-93d6-4876-8afd-b29fbc2aa4eb None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/1866762d940c472abd6e41d57e1d3c4f/roles/3f9da8e5d46143dfba040495077f1dc5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.549940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae86416-93d6-4876-8afd-b29fbc2aa4eb None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=1866762d940c472abd6e41d57e1d3c4f, role_id=3f9da8e5d46143dfba040495077f1dc5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:02.551578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae86416-93d6-4876-8afd-b29fbc2aa4eb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:02.626053 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 486/946] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:30:02 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/1866762d940c472abd6e41d57e1d3c4f/roles/3f9da8e5d46143dfba040495077f1dc5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:30:02.725902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:02.782568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed225b-3bfe-4143-96d8-874016a9df48 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.783147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed225b-3bfe-4143-96d8-874016a9df48 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.783229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed225b-3bfe-4143-96d8-874016a9df48 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.785031 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 487/947] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:02.790828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.791245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.791605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.814052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:02.815902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:02.851618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:02.864405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a11dee-0641-4bfd-ba11-8b337e6c4b68 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:02.895639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:02.905546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 488/948] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:02.919673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:02.920316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:02.920601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:02.920881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:02.921478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:02.922895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:02.933127 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:02.934101 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:02.935038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 461/949] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:30:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:02.940417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:03.049514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae9a4c-f3ff-4df0-929d-07c84ce3a635 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:03.092035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:03.092654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:03.092937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:03.093214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:03.093842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:03.094148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:03.095557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:03.101346 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 489/950] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:30:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:03.106839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:03.218691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b5cfb-5f8a-4457-908a-a20421b063ef None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:03.255919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:03.256535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:03.256817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:03.257109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:03.257752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:03.258110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:03.259522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:03.265020 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 462/951] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:30:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:03.270987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:03.300726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:03.341347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:03.359407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:03.389709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1244a-2470-418e-a8a5-9410e8eeb9ec None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:03.432246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:03.433274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:03.433770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:03.434250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:03.435226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:03.436238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b697b0-cd4d-4fba-82cc-7e6e2ad3cca5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:03.437109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:03.474291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:03.474827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:03.475142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:03.475419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:03.476774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:03.478200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:03.480859 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.server.flask.common [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 10:30:03.505562 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 490/952] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:30:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:30:03.535044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.sql.core [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 10:30:03.535044 ncdv-master-1 devstack@keystone.service[92879]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 10:30:03.535044 ncdv-master-1 devstack@keystone.service[92879]: [parameters: {'id': 'cc5711c4a3c749e782610f17bcac1fea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 10:30:03.535044 ncdv-master-1 devstack@keystone.service[92879]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92879) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc5711c4a3c749e782610f17bcac1fea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc5711c4a3c749e782610f17bcac1fea. Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application conn.query(q) Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:30:03.548218 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result.read() Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 10:30:03.549158 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application next(self.gen) Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application yield resource Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application next(self.gen) Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise self.value Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application session.commit() Sep 06 10:30:03.550613 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.session.flush() Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application compat.raise_( Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 10:30:03.551795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 10:30:03.552797 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application conn.query(q) Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result.read() Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:30:03.553592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [parameters: {'id': 'cc5711c4a3c749e782610f17bcac1fea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:03.555266 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:03.556255 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc5711c4a3c749e782610f17bcac1fea. Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:03.557413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 463/953] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Sep 6 10:30:03 2022] POST /identity/v3/projects => generated 262 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:03.561972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:03.687723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194c525-4876-4d26-9a33-33c4264192bd None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:03.703413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:03.740952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:03.740952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:03.740952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:03.740952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:03.741355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:03.741355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-da5761fc-fbda-41af-b7cc-8c55fc19c885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:30:03.747167 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:03.748151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:03.749579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 491/954] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:03.754549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:03.858024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:03.890384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d037c0-3f55-42f0-8188-344ee6a25d82 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:03.931641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:03.932521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:03.932918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:03.933300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:03.934081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:03.934500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:03.936261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dd0f7-7708-426b-a8d2-f7353a6ceef8 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:03.957825 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 464/955] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:04.006025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfae46-eb99-42de-8b4c-7964a03bce95 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.006855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfae46-eb99-42de-8b4c-7964a03bce95 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.007849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfae46-eb99-42de-8b4c-7964a03bce95 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.009610 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 492/956] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:04.015382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.015799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.016178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.041455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:04.043150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:04.122623 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 465/957] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:04.461552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfae46-eb99-42de-8b4c-7964a03bce95 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:04.574009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfae46-eb99-42de-8b4c-7964a03bce95 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:04.609940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:04.610839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.611149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.611429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.612011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:04.613444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:04.623135 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:04.626506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:04.627614 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 493/958] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:04.632422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:04.704391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:04.744488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03625f0c-3e88-4327-9901-be5ce766d054 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:04.781619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:04.782255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.782618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.783139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.784290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] RBAC: Adding query filter params (name=compute) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:04.784678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:04.786188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba98237-a18d-4625-acec-26509636eeec None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:04.792309 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 466/959] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:04.800123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:04.839138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:04.895187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317caa4c-a239-4004-9d78-b7afc0e70b0f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.895541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317caa4c-a239-4004-9d78-b7afc0e70b0f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.895764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317caa4c-a239-4004-9d78-b7afc0e70b0f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.898194 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 467/960] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:04.902667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.903207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.903705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.916211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1829c-daa8-46a4-a235-0d09c18f0d48 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:04.923331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:04.924780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:04.959175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:04.959798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:04.960086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:04.960929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:04.961619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] RBAC: Adding query filter params (type=compute) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:04.962007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:04.963533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:04.969642 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 494/961] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:05.005691 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 468/962] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:05.347354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:05.451521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:05.455565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8d364-2c02-456a-91f9-6565ac51e63c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:05.491147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:05.492323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:05.492610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:05.492886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:05.503343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:05.508151 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:05.509059 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:05.509916 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 495/963] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 6 10:30:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:05.516927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:05.584055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:05.624804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3e7ae-88f5-46c6-9896-b72da6ea39cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:05.660655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:05.661278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:05.661554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:05.661832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:05.662511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:05.662820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:05.664788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:05.678389 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 469/964] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:30:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:05.679878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:05.786179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc24c1-af6c-4dbb-8572-4d8d4791548d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:05.826264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:05.826903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:05.827251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:05.830690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:05.839402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:05.840948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c12d0c3b-bd93-433c-8f35-bed12c7ed3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:05.856243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:05.857238 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:05.858123 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:05.858123 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:05.858123 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:05.862469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 496/965] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:05.867535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:05.962791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f893-3cb4-4bd2-8053-6de09cd38fa1 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:05.963171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f893-3cb4-4bd2-8053-6de09cd38fa1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:05.963428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f893-3cb4-4bd2-8053-6de09cd38fa1 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:05.965552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 497/966] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:05.971314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:05.971717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:05.972102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:05.978212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cc09-6ce8-42cb-8517-1ae35944a489 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:05.995780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:05.999695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:06.001043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.004597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.020797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.021757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.022261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.023374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.024332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:06.024854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.026429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.040491 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 470/967] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:06.046012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.085147 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 498/968] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:06.164119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122581-c057-4f4a-b151-e65ec4db6c8e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.201078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.201722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.202007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.202288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.209561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.211596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-c98616d6-fc61-4ae4-9284-54ed0676b2a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:30:06.223525 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:06.224494 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 10:30:06.225419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:06.229417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 471/969] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:06.232104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.322786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810588-cf84-4491-a08f-93494daf436e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.323263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810588-cf84-4491-a08f-93494daf436e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.323652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84810588-cf84-4491-a08f-93494daf436e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.325397 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 472/970] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:06.330355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.330764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.331178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.335522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedee46-5ee1-48cb-96b1-1a9c6c1cc8b1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.349542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:06.350917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:06.383391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.384104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.384389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.384751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.385590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:06.385900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.387593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.399087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.399962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.411176 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 499/971] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:06.416766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.426109 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 473/972] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:06.428389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.528915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61fc5-5fd8-4842-9111-cf2fb3a43261 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.556259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207248-9c00-405a-aa02-b8770954d984 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.565016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.565758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.566049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.566324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.566906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.568586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:06.578884 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:06.579947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:06.585885 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 500/973] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:06.586695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.610052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.611393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.611877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.612363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.661198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.673973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.705659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.706764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a9fe-3ee5-42d7-91d9-ea4063e36c9f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.707638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.747672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.748632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.749060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.749494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.750266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:06.750743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.752523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.758291 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 501/974] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:06.763374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.831499 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 474/975] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:06.832472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.879807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6427ad9-8880-4be3-8faa-4ac27efb9a28 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.905704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.917524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.931214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.931214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.931214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:06.931214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:06.931214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:06.931214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:06.931825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 502/976] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:06.931913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:06.932002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:06.959667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf618cb-4dad-4a54-ab50-930472b1318e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:06.998420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:06.999056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:06.999350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:06.999629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.000274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.001707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.033096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665b4d-152e-4e7a-9a2f-43627524b99e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.067961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.068606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.069091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.069365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.075976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.sql.core [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 10:30:07.075976 ncdv-master-1 devstack@keystone.service[92879]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 10:30:07.075976 ncdv-master-1 devstack@keystone.service[92879]: [parameters: {'user_id': 'afc70666d3a047cdb0e4f4959fab0894', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 10:30:07.075976 ncdv-master-1 devstack@keystone.service[92879]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92879) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 10:30:07.081657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.087118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application conn.query(q) Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result.read() Sep 06 10:30:07.087270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 10:30:07.088092 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application next(self.gen) Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application yield resource Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application next(self.gen) Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise self.value Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application session.commit() Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 10:30:07.089200 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.session.flush() Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application compat.raise_( Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 10:30:07.090185 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 10:30:07.091752 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application conn.query(q) Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result.read() Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 10:30:07.092762 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [parameters: {'user_id': 'afc70666d3a047cdb0e4f4959fab0894', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:07.093782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 10:30:07.094746 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 475/977] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Sep 6 10:30:06 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:07.095940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:07.118315 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:07.119507 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:07.120421 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:07.120421 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:07.120421 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:07.120421 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 503/978] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:07.120712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.167896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:07.203659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec98e2e-0481-4637-b475-2b0b59887716 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.234446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c725e-1be7-4d9a-8764-35d7a9119b32 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.242773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.243407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.243692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.243963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.244673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] RBAC: Adding query filter params (interface=admin, service_id=155de2d5df044758a15f5fff2b3f6e71, region_id=RegionOne) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:07.244981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.246580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.249118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:07.254774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 476/979] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/endpoints?service_id=155de2d5df044758a15f5fff2b3f6e71&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:07.255671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.271526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.272228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.272512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.273331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.281218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.283003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-05fa335a-cb44-47ea-b484-95d2708359a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:30:07.294597 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:07.295787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 504/980] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:07.296898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034dec7-a1c8-4664-9589-f77ba8ca775e None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.297698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034dec7-a1c8-4664-9589-f77ba8ca775e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.297698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034dec7-a1c8-4664-9589-f77ba8ca775e None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.302425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 505/981] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:07.302425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034dec7-a1c8-4664-9589-f77ba8ca775e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.358898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dc3c4-b3c6-4c99-a9b2-936538271609 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.391919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.392857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.392857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.393102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.393685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:07.393992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.395377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.406335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034dec7-a1c8-4664-9589-f77ba8ca775e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.407857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:07.408291 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 477/982] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:07.409082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.442502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6defb-dacf-4dbc-970b-3e1145fa36ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.443455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6defb-dacf-4dbc-970b-3e1145fa36ae None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.443920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6defb-dacf-4dbc-970b-3e1145fa36ae None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.444355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6defb-dacf-4dbc-970b-3e1145fa36ae None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.445792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6defb-dacf-4dbc-970b-3e1145fa36ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.447218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6defb-dacf-4dbc-970b-3e1145fa36ae None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.453053 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 506/983] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:30:07.454233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.454460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.454732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.470325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:07.485652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:07.486885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:07.517983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9576a4-6a02-4069-97c6-4da50f886fd0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.559085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.559805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.560086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.560413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.561164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:07.561358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.562874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.564492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 507/984] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:07.565126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.619245 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 478/985] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:07.681223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:07.688601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd59f90-37bb-4fd5-bace-6245c2a4accf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.729513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.730081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.730368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.730646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.738853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.740364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:30:07.753213 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:07.754344 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:07.755745 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 508/986] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:07.760855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.877871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a6dc-94bc-422f-ba74-8d44d8a8ebff None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:07.897827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:07.916547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:07.917165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:07.917446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:07.917717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:07.918587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:07.918896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:07.920407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:07.928674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:07.936336 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 479/987] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:07.942806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:08.053619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bae4b6-1835-4b2f-93ad-97a88bdad490 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:08.059956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ea4ac-36c1-40ad-8db6-3a2ad73a963a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:08.090793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65d047-0130-42eb-a755-2604b06598f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:08.091431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d047-0130-42eb-a755-2604b06598f2 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:08.091715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d047-0130-42eb-a755-2604b06598f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:08.091994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d047-0130-42eb-a755-2604b06598f2 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:08.092635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65d047-0130-42eb-a755-2604b06598f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:08.093706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:08.094025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65d047-0130-42eb-a755-2604b06598f2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:08.094310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:08.094592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:08.094865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:08.095611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] RBAC: Adding query filter params (role.id=3f9da8e5d46143dfba040495077f1dc5, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=1866762d940c472abd6e41d57e1d3c4f) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:08.095922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:08.097325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b3de9-4414-4c65-b8b5-65ee11372044 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:08.103299 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 480/988] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:07 2022] GET /identity/v3/role_assignments?user.id=1866762d940c472abd6e41d57e1d3c4f&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=3f9da8e5d46143dfba040495077f1dc5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:08.166571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 509/989] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:30:07 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:30:09.707351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9928-56b3-4299-a549-02827f31c65e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:09.707878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9928-56b3-4299-a549-02827f31c65e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:09.707878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9928-56b3-4299-a549-02827f31c65e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:09.709378 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 481/990] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:09.714391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:09.714780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:09.714942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:09.733392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:09.734566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:09.746366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:09.812281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 510/991] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:10.143878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9928-56b3-4299-a549-02827f31c65e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:10.191044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:10.253955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9928-56b3-4299-a549-02827f31c65e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:10.291991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:10.292626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.292904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.293172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.293750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:10.295135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-8a3f67d8-0de6-40b9-9915-b71abaaf3346 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:10.304004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:10.305012 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 10:30:10.305873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:10.309702 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 482/992] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Sep 6 10:30:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:10.311209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:10.392795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf887a8-790a-4660-b8c9-1838c3404760 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.393124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf887a8-790a-4660-b8c9-1838c3404760 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.393371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf887a8-790a-4660-b8c9-1838c3404760 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.394776 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 483/993] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:10.400357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323224c-775c-4ac3-bdd9-6faf6ef6757e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.400645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323224c-775c-4ac3-bdd9-6faf6ef6757e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.400927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323224c-775c-4ac3-bdd9-6faf6ef6757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.414331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244b513-d439-4c57-91a4-bafd4b2fbf86 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:10.419554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7323224c-775c-4ac3-bdd9-6faf6ef6757e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:10.421130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7323224c-775c-4ac3-bdd9-6faf6ef6757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:10.451188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:10.451797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.452082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.452360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.452984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:10.453293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:10.454664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c1f00-8214-4647-af23-0272825a78e4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:10.459282 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 511/994] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:30:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:10.460995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81e37-ba08-4594-a4d5-488454292fb1 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.461283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81e37-ba08-4594-a4d5-488454292fb1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.461560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81e37-ba08-4594-a4d5-488454292fb1 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.462921 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 512/995] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:10.465457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81e37-ba08-4594-a4d5-488454292fb1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:10.474177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:10.492814 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 484/996] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:10.494124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.494381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.494630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.515578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:10.516782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:10.548094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:10.568849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81e37-ba08-4594-a4d5-488454292fb1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:10.588124 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 485/997] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:10.608594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:10.609192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.609469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.609739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.610361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:10.610967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:10.612356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:10.622087 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 513/998] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Sep 6 10:30:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:10.623138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:10.721139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d7b7-869c-4ca6-a652-78a607a81beb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:10.754345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:10.754949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.755255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.755526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.756186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:10.758093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:10.821628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:10.830459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 486/999] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:30:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:30:10.910852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:10.942764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bbed7-9a27-4bd0-8369-415450c46bd4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:10.956421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:10.986676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:10.989209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:10.990130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:10.990487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:10.990834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] PATH_INFO: `/v3/services/image` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:10.992060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:10.993603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:11.004046 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:11.005365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:11.006349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 514/1000] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Sep 6 10:30:10 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:11.012506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:11.073306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6255a7-e19c-437e-840a-4d8aa7fa45d9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.112489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.113253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.113535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.113815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.114408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.115851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.123436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4e006-c33c-498f-9227-6dedb2bc6b99 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:11.125860 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:11.126839 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:11.128045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 487/1001] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:11.133283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:11.157842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:11.164702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.165416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.165696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.165990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.166579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] RBAC: Adding query filter params (name=image) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:11.166880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.168430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.173660 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 515/1002] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:11.180975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:11.237089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:11.249571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff198b9-2939-4540-8e9b-83db7102d7cc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.283827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.284677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.285149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.285426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.286076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:11.286375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.288143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.288965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913575a3-0eb9-46c6-8fcd-6dae14339a00 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.293773 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 488/1003] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:11.299308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:11.331968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.332571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.332853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.333127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.333751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] RBAC: Adding query filter params (type=image) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:11.334055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.335486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.340217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 516/1004] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:11.408449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd1d53-991a-4a37-8a89-48e55e153372 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.446934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.447540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.447820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.448094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.448736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] RBAC: Adding query filter params (type=compute) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:11.449040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.450530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.461356 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 489/1005] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:11.463172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:11.542836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:11.586723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e91f-3ef0-44b3-b6c7-59e8f5e96835 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.620712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.621443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.621818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.622189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.622975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] RBAC: Adding query filter params (interface=public, service_id=54fb7e4008af4e6a861df5a804db5b0f, region_id=RegionOne) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:11.623421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.624893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d116c-abf3-4435-8cd6-e6eaa9e79bbd None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.630101 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 517/1006] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:30:11 2022] GET /identity/v3/endpoints?service_id=54fb7e4008af4e6a861df5a804db5b0f&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:11.635496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:11.656298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:11.738223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed1d2-3aa5-4702-b327-e6768b559dec None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:11.771338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b07b4-40bc-4730-93d7-8ac6dec71983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:11.771994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b07b4-40bc-4730-93d7-8ac6dec71983 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:11.772280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b07b4-40bc-4730-93d7-8ac6dec71983 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:11.772554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b07b4-40bc-4730-93d7-8ac6dec71983 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:11.773786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b07b4-40bc-4730-93d7-8ac6dec71983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:11.775178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b07b4-40bc-4730-93d7-8ac6dec71983 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:11.787046 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 490/1007] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:30:11 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:30:13.086143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4c41-1558-4562-bec4-cdd2ce0be9b0 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.086683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4c41-1558-4562-bec4-cdd2ce0be9b0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.086683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa4c41-1558-4562-bec4-cdd2ce0be9b0 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.091066 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 518/1008] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:13.093355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6955c-4190-46e2-9aa1-28bbb92b203e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.093760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6955c-4190-46e2-9aa1-28bbb92b203e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.093942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6955c-4190-46e2-9aa1-28bbb92b203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.112907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-22e6955c-4190-46e2-9aa1-28bbb92b203e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:13.114299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-22e6955c-4190-46e2-9aa1-28bbb92b203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:13.183762 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 491/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:13.519733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4c41-1558-4562-bec4-cdd2ce0be9b0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:13.564327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baecdda-41e1-464a-abfa-515b2d473963 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.564755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baecdda-41e1-464a-abfa-515b2d473963 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.565038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baecdda-41e1-464a-abfa-515b2d473963 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.566548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 492/1010] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:13.571888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.572179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.572458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.590965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:13.592218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:13.600220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:13.635496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa4c41-1558-4562-bec4-cdd2ce0be9b0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:13.659139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:13.664300 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 493/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:13.674043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc08a0-297d-47db-92ea-de8361c0a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:13.674678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc08a0-297d-47db-92ea-de8361c0a616 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.674960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc08a0-297d-47db-92ea-de8361c0a616 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.675267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc08a0-297d-47db-92ea-de8361c0a616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.676364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc08a0-297d-47db-92ea-de8361c0a616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:13.677830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc08a0-297d-47db-92ea-de8361c0a616 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:13.683003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 519/1012] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:13.685188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:13.785591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4c7a-5a4c-4147-9e40-2a9eeda9b5ce None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:13.825202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187fa8f-c91a-46de-a2cb-448178061008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:13.830992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187fa8f-c91a-46de-a2cb-448178061008 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.830992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187fa8f-c91a-46de-a2cb-448178061008 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.830992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187fa8f-c91a-46de-a2cb-448178061008 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.830992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187fa8f-c91a-46de-a2cb-448178061008 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:13.830992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187fa8f-c91a-46de-a2cb-448178061008 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:13.845130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:13.919313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 494/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:30:13 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:30:13.970275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e4e7-032c-496b-bc0f-f246b949332c None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.970612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e4e7-032c-496b-bc0f-f246b949332c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.970838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e4e7-032c-496b-bc0f-f246b949332c None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.972442 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 520/1014] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:13.978117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:13.978415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:13.978677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:13.994632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e4e7-032c-496b-bc0f-f246b949332c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:13.999159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:14.000361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:14.079971 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 495/1015] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:14.114380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e4e7-032c-496b-bc0f-f246b949332c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:14.150773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:14.151419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:14.151720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:14.151999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:14.152631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:14.153988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:14.249481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 521/1016] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:30:13 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:14.410172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:14.544441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5978a3-7dff-464e-881c-d571f89a1e98 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:14.571533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:14.597049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:14.603034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:14.603034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:14.603034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:14.603034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:14.603034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:14.610831 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:14.615319 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:14.616419 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 496/1017] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:14.622345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:14.681426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:14.737193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853e7f7-ed56-4170-9e20-50296827f1bd None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:14.773209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:14.773820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:14.774101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:14.774370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:14.776782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:14.776782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:14.776782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:14.788122 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 522/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:14.790268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:14.902971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deda51-7b35-496f-a602-7eab228dcee6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:14.939327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:14.939861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:14.940142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:14.940413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:14.941033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] RBAC: Adding query filter params (type=compute) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:14.941337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:14.942752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb92bc-0b17-4378-a916-7317b8bdedbe None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:14.951104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 497/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Sep 6 10:30:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:14.954460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:15.058990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd1518-976d-4d62-98c3-a1c78255fd3d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:15.077344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:15.098301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01278d-42ac-4e6d-85eb-22fff8ead74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:15.098929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01278d-42ac-4e6d-85eb-22fff8ead74d None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:15.099263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01278d-42ac-4e6d-85eb-22fff8ead74d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:15.099537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01278d-42ac-4e6d-85eb-22fff8ead74d None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:15.100216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01278d-42ac-4e6d-85eb-22fff8ead74d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:15.101837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01278d-42ac-4e6d-85eb-22fff8ead74d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:15.177585 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 523/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:30:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:30:16.184496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13cfe8-9c8b-45b7-92f5-be68c890b5d4 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:16.185000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13cfe8-9c8b-45b7-92f5-be68c890b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:16.185000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13cfe8-9c8b-45b7-92f5-be68c890b5d4 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:16.186443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 498/1021] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:16.191426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a97a-f1e0-445b-af41-db87944ffe7a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:16.191846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a97a-f1e0-445b-af41-db87944ffe7a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:16.192009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a97a-f1e0-445b-af41-db87944ffe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:16.210667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8689a97a-f1e0-445b-af41-db87944ffe7a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:16.211884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8689a97a-f1e0-445b-af41-db87944ffe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:16.310751 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 524/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:16.478295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b29ea-34dc-4482-9360-1e8066941c1c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:16.478638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b29ea-34dc-4482-9360-1e8066941c1c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:16.478816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b29ea-34dc-4482-9360-1e8066941c1c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:16.480173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 499/1023] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:16.485504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:16.486055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:16.486327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:16.504561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:16.505730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:16.573936 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 525/1024] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:16.648325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b29ea-34dc-4482-9360-1e8066941c1c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:16.698799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:16.750788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b29ea-34dc-4482-9360-1e8066941c1c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:16.784978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:16.785617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:16.785902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:16.786185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:16.787326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:16.788818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:16.790522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 500/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:16.796058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:16.825256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:16.906832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb34f3-a2a0-480d-9e1a-9a2201f22295 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:16.908316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:16.946157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:16.947148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:16.947433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:16.947704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:16.948360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:16.949855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:17.012931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905b815-4419-43e7-b3d2-bf98d7a45fe7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:17.029223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:17.051721 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 526/1026] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:30:16 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:17.051933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:17.051933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.051933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.051933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.052297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:17.052297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:17.060282 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:17.061392 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:17.064121 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 501/1027] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Sep 6 10:30:16 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:17.068304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:17.162379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:17.182872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694f5f7-e1c6-4434-bed7-c888d3936441 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:17.220026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:17.221351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.221788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.222219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.223039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] RBAC: Adding query filter params (name=image) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:17.223812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:17.225512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:17.235386 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 527/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:17.242310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:17.355935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f58d3-1b48-47a1-81ff-c154e46192b7 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:17.390851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:17.391495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.391780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.392150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.392782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] RBAC: Adding query filter params (type=image) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:17.393087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:17.394456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dca77-6055-475a-b1c3-c2a5d1388a26 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:17.399777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 502/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:17.406108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:17.469161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af914b-9cae-47df-98f4-18a19c8836a8 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.470131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af914b-9cae-47df-98f4-18a19c8836a8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.470506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af914b-9cae-47df-98f4-18a19c8836a8 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.471935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 503/1030] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:17.477443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.477735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.478017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.497226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:17.498429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:17.518900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f044-13b7-4e48-aa46-2d863cdc03fb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:17.542372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:17.554919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:17.555572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.555862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.556129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.556828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] RBAC: Adding query filter params (interface=public, service_id=dee76ce001124dbd9c8e2a3a7f5e34e9, region_id=RegionOne) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:17.557136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:17.558508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:17.563776 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 528/1031] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:30:17 2022] GET /identity/v3/endpoints?service_id=dee76ce001124dbd9c8e2a3a7f5e34e9&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:17.569205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:17.575045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 504/1032] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:17.582366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:17.677994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74697e-212b-4340-b74f-acdd743ba69a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:17.711135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:17.711736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:17.712020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:17.712285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:17.712871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:17.714225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:17.726358 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 529/1033] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:30:17 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:30:17.924887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:18.028074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066a03-7a42-49b6-a726-20de468eca40 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:18.061944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:18.062578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:18.062861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:18.063169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:18.076249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:18.081042 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:18.081981 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:18.082843 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 505/1034] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 6 10:30:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:18.088743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:18.165462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:18.190337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449921-e949-41ea-ba37-ff050e2653a7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:18.225307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:18.225967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:18.226205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:18.226473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:18.227357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:18.227608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:18.228989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:18.240764 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 530/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:30:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:18.246043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:18.287517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:18.352519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d078511-3269-4ab6-8ebc-8de179def739 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:18.386700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:18.387348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:18.387631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:18.387904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:18.398087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:18.399560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:18.413767 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:18.414832 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:18.420401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:18.420401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:18.420401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:18.420401 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 506/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:18.421100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:18.526226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f0bdc-b610-4aa9-bb88-54a66e3a5771 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:18.561004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:18.561536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:18.561821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:18.562092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:18.562720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:18.563037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:18.564396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:18.566728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:18.582107 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 531/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:18.583246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:18.675908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:18.691395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b39669-d87d-4813-afd4-e9646f2d640b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:18.725486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:18.726695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:18.726978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:18.727277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:18.736217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:18.737707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:30:18.749794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:18.750768 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:18.756885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 507/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:30:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:18.757486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:18.864012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f31882-f460-4b26-bbcd-d021eb902e7d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:18.903681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:18.907064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:18.907064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:18.907064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:18.907064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:18.907064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:18.907064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:18.926258 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 532/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:30:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:18.932982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.033814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cec28b-dcd3-4af3-ae41-80011b3cf440 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:19.066972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad5ac-4a4f-4704-a19f-f8c87d929e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:19.067851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad5ac-4a4f-4704-a19f-f8c87d929e0f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.068310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad5ac-4a4f-4704-a19f-f8c87d929e0f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.068788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad5ac-4a4f-4704-a19f-f8c87d929e0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.083928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:19.135278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad5ac-4a4f-4704-a19f-f8c87d929e0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:19.136886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad5ac-4a4f-4704-a19f-f8c87d929e0f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:19.245113 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 508/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:19.246425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.307856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:19.351664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eec6a2-6d6f-4e86-8b1f-da26b64d8204 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.352187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eec6a2-6d6f-4e86-8b1f-da26b64d8204 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.352187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eec6a2-6d6f-4e86-8b1f-da26b64d8204 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.353258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70373a0-5bd9-426f-b116-01573f538c27 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:19.355196 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 509/1041] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:19.358620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.358917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.359229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.377807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:19.379578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:19.389832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:19.390397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.390674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.390943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.401920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:19.403422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:19.418922 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:19.419910 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:19.420787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:19.420787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:19.420787 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:19.420787 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 533/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:19.426832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.430097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:19.459177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 510/1043] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:19.536930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8eaf3-1f02-4237-a4fc-6e2571e176be None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:19.544565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:19.573020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:19.573634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.573920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.574195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.574840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:19.575185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:19.577801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:19.597412 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 534/1044] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:19.599257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.699096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f6a43-8c41-4d92-9787-21ca6dd8e26a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:19.733035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:19.733668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.733954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.734234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.741117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:19.742595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:30:19.753794 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:19.754655 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:19.755597 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 511/1045] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:19.762678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.809113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.852919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:19.876640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516ac0c-0427-4370-adf7-110e963c0631 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:19.920819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:19.921431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.921782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.921971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.922751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:19.922959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:19.924465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:19.932100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cf7a8-357b-42d1-be89-fdf08d4ee0e0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:19.937593 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 535/1046] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:19.943551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:19.969921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6d5af-8a05-409e-93d3-c6d0acc95935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:19.970471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d5af-8a05-409e-93d3-c6d0acc95935 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.970786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d5af-8a05-409e-93d3-c6d0acc95935 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.971094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d5af-8a05-409e-93d3-c6d0acc95935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.973643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:19.981405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6d5af-8a05-409e-93d3-c6d0acc95935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f5f6d5af-8a05-409e-93d3-c6d0acc95935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:19.986440 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:19.987614 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:19.988935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 512/1047] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:19.992101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94a030-f0db-4010-bdc0-4900dea2143d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:19.992392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94a030-f0db-4010-bdc0-4900dea2143d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:19.992668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94a030-f0db-4010-bdc0-4900dea2143d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:19.994802 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 513/1048] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:19.995585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94a030-f0db-4010-bdc0-4900dea2143d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.045677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9939-7e6e-48a9-9e12-0de571f6a135 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.079508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.097202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.097202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.097202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.097202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] RBAC: Adding query filter params (role.id=3f9da8e5d46143dfba040495077f1dc5, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=6c2ddfc46e6c414085493829459e5ea9) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:20.097202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.097202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b8dd-479e-4e63-8ed9-8d940806acd6 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.097758 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 536/1049] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/role_assignments?user.id=6c2ddfc46e6c414085493829459e5ea9&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=3f9da8e5d46143dfba040495077f1dc5 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:20.097758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.097758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.097758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.098099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94a030-f0db-4010-bdc0-4900dea2143d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.110050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:20.111677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:20.142501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:20.152834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.153738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.154191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.154649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.155391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:20.155707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.157117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.170249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 514/1050] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:20.174367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.215187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 537/1051] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:20.311786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e1c6-34f9-4af4-b3f8-72a6a3718d0d None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.358511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.359905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.360394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.361139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] PATH_INFO: `/v3/users/87a62f7cbfd448e28100e125619e2ec3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.376227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] RBAC: Authorizing `identity:get_user(user_id=87a62f7cbfd448e28100e125619e2ec3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.378020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.380225 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 515/1052] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/users/87a62f7cbfd448e28100e125619e2ec3 => generated 285 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:20.385708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.408284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:20.487807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1242fc-a338-4c48-9b0b-4ddd3e00e05c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.544466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.545020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.545305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.545583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.549320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.571037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:20.648487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.649426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.674798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:20.695354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad9dd3-2fb2-4da7-861d-ad0814547449 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.737710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.738660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.739162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.739605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] PATH_INFO: `/v3/services/image` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.740366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.741922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:20.751702 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:20.753006 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 10:30:20.753889 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:20.756632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 516/1053] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:20.763323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.776579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 538/1054] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:20.778133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.862899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:20.886285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c30ae-c771-4312-be30-b327238dbd39 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.899900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bac58-da69-4c76-8624-9cebfc5d1197 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:20.923049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:20.930940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.936128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.936128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.936128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.936128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] RBAC: Adding query filter params (name=image) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:20.936128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.936128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.938310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:20.939054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:20.943916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:20.943916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:20.944148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 517/1055] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:20.944250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:20.944250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:20.944250 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 539/1056] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:20.945576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:20.950929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:21.057282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0e66b-f6e5-4fe6-b2b4-10ca6dcbef18 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:21.057717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9861-3448-48ee-abc0-b767565bcf19 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:21.094627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:21.095373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:21.095727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:21.096075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:21.096890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9, user.id=87a62f7cbfd448e28100e125619e2ec3) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:21.097270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:21.097674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:21.098284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:21.098567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:21.098839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:21.098985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:21.099532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] RBAC: Adding query filter params (type=image) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:21.099838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:21.101222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f226ba-a9bc-4c8c-839b-96936430430a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:21.105088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 540/1057] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/role_assignments?user.id=87a62f7cbfd448e28100e125619e2ec3&scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:21.106862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 518/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:21.112751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:21.181868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:21.242526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e036ad8-2a06-4db2-a130-e7e027359309 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:21.284697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981caf9-c61a-48c2-ade4-da1e8f32bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:21.285321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981caf9-c61a-48c2-ade4-da1e8f32bdc3 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:21.287200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981caf9-c61a-48c2-ade4-da1e8f32bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:21.287200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981caf9-c61a-48c2-ade4-da1e8f32bdc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:21.287200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981caf9-c61a-48c2-ade4-da1e8f32bdc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:21.288747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981caf9-c61a-48c2-ade4-da1e8f32bdc3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:21.386399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 541/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:30:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:22.284824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08634b8d-0d1a-4ac3-a28d-b7cbf8e30da5 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:22.285367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08634b8d-0d1a-4ac3-a28d-b7cbf8e30da5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:22.285367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08634b8d-0d1a-4ac3-a28d-b7cbf8e30da5 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:22.286750 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 519/1060] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:22.292526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:22.292902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:22.293253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:22.311477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:22.312741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:22.386970 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 542/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:22.716915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08634b8d-0d1a-4ac3-a28d-b7cbf8e30da5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:22.728591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:22.829115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08634b8d-0d1a-4ac3-a28d-b7cbf8e30da5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:22.863660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:22.864294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:22.864575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:22.864846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:22.876273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:22.887068 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:22.888100 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:22.889090 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 520/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 6 10:30:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:22.892006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:22.930951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:22.998853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd92035-5592-437d-b81b-ff1ccd3b43d2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.038141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734811da-b8d8-4975-acff-848db5474329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.038762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734811da-b8d8-4975-acff-848db5474329 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.039062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734811da-b8d8-4975-acff-848db5474329 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.039342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734811da-b8d8-4975-acff-848db5474329 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.039998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734811da-b8d8-4975-acff-848db5474329 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:23.040301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734811da-b8d8-4975-acff-848db5474329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:23.041842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734811da-b8d8-4975-acff-848db5474329 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:23.055304 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 543/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:30:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:23.056486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.127654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:23.167121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d593-73f7-43d0-8b42-b0b125338748 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.204336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.204962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.205240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.205513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.218247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:23.219753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2f9c8bbf-e486-4534-b25d-b4e2f014c649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:23.236453 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:23.237493 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:23.244086 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:23.244086 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:23.244086 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:23.244086 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 521/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:23.252249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734811da-b8d8-4975-acff-848db5474329 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.328060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60207d-9b2b-4ca6-bd4d-4ffc7ddba7e6 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.328615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60207d-9b2b-4ca6-bd4d-4ffc7ddba7e6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.328615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60207d-9b2b-4ca6-bd4d-4ffc7ddba7e6 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.330351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 522/1065] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:23.334894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.335246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.335902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.355240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:23.356435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:23.366934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:23.372926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734811da-b8d8-4975-acff-848db5474329 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.406630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.407309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.407536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.407809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.408447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:23.408751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:23.410111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:23.423066 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 544/1066] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:23.429333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.432439 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 523/1067] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:23.541871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf1d5-eadf-44f7-b8b5-8668bd625c7a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.575881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.576517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.576802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.577079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.585610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:23.587104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-fa6d57e1-4734-4423-8c3d-017231c943ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:30:23.599259 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:23.600214 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:23.601914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 545/1068] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:23.606797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.618381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb60095-9c5c-4adf-a39c-3989f16dcc7c None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.618674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb60095-9c5c-4adf-a39c-3989f16dcc7c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.618957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb60095-9c5c-4adf-a39c-3989f16dcc7c None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.620439 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 546/1069] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:30:23.625165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.625451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.625726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.644503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:23.645785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:23.657508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:23.669687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:23.713722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 547/1070] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:23.726395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a668b7-9ea4-4c59-8717-17d70b69911c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.765186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.765799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.766080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.766355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.767144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:23.767456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:23.769087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.770528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:23.790075 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 524/1071] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:23.795301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.893507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb08458-332e-44bd-8acc-1e198f034620 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.900725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eba9b-8a8a-4681-916d-00ce790a960a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:23.918086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:23.929113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.930065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.930065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.930260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.940202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:23.943778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:23.945371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:23.945553 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:23.946567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:23.947558 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 548/1072] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:23.948748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:23.949368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:23.953300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:23.961939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:23.963425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:23.964352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:23.980112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:23.981296 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:23.982541 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:23.982541 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:23.982541 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:23.986489 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 525/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:23.987468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.066902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b43bc-8eda-4886-8062-8fbf68bead84 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.093290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ddcd6-a9a7-4ca5-97d7-42a8402ec9ee None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.101338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.102007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.102291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.102559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.103236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:24.103537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.104898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.113531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 549/1074] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:24.114309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.128722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.129329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.129614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.129894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.130541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:24.130857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.133016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.145056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 526/1075] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:24.145848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.167513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.181112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.214829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ea6de-5ac2-4df1-a601-b6dc3e7d8514 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.246432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd39b4b-ffde-48b0-b1bf-02a3456fbaca None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.248720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.249316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.249593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.249859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.280840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.281460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.281740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.282014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] PATH_INFO: `/v3/users/87a62f7cbfd448e28100e125619e2ec3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.283168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] RBAC: Authorizing `identity:get_user(user_id=87a62f7cbfd448e28100e125619e2ec3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.284602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.286541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 527/1076] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/users/87a62f7cbfd448e28100e125619e2ec3 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:24.287407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.320623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.322050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.374942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.385992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.388034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b151fd-2dfb-4e0e-bf6d-ffa659e0e64a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.420530 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 550/1077] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:24.421547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.425107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.425833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.426185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.426546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.434098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.435622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:30:24.447337 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:24.448420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 528/1078] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:24.449309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.527489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3af199-8ec6-4789-9a50-4b8883517f83 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.553049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb8e5e-a9b1-4af6-a9f3-7d82407ae7cc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.561488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.562126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.562411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.562694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.563828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.565300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.566918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 551/1079] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:24.567713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.587468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.588035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.588318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.588593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.598573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.600027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.601471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.608801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:24.615339 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:24.616983 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:24.617866 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:24.617866 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:24.617866 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:24.617866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 529/1080] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:24.617866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.672416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f454-9a71-4a97-be80-818c4fe4ca56 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.706268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.706869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.707195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.707470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.708147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:24.708449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.709874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.715398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f21405-0278-47f8-8ed1-de4edca63677 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.721058 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 552/1081] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:24.721847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.751684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.752446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.752733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.753003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9/users/87a62f7cbfd448e28100e125619e2ec3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.754888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9, user_id=87a62f7cbfd448e28100e125619e2ec3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.756339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.815754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.818493 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 530/1082] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:30:24 2022] PUT /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9/users/87a62f7cbfd448e28100e125619e2ec3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:30:24.821774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b443f11-c24f-4b4b-a609-4e66c82e4874 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:24.830412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:24.865512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:24.867410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:24.867702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:24.867978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:24.868684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:24.868995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:24.870554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaf856-21e0-4e97-86b4-45b4d09e06dc None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:24.888750 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 553/1083] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:24.918368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:24.977025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a3df3-ff00-4995-a2ee-ecfd93e45bf1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:25.018787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dee21-81d1-4bda-b500-3acb5b1c6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:25.019503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dee21-81d1-4bda-b500-3acb5b1c6461 None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:25.019785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dee21-81d1-4bda-b500-3acb5b1c6461 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:25.020062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dee21-81d1-4bda-b500-3acb5b1c6461 None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/6c2ddfc46e6c414085493829459e5ea9/roles/3f9da8e5d46143dfba040495077f1dc5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:25.022255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dee21-81d1-4bda-b500-3acb5b1c6461 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=6c2ddfc46e6c414085493829459e5ea9, role_id=3f9da8e5d46143dfba040495077f1dc5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:25.024414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dee21-81d1-4bda-b500-3acb5b1c6461 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:25.100001 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 531/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:30:24 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/6c2ddfc46e6c414085493829459e5ea9/roles/3f9da8e5d46143dfba040495077f1dc5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:30:27.054067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1885e-836a-4e44-8437-597b2450d5b4 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.054587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1885e-836a-4e44-8437-597b2450d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.054701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1885e-836a-4e44-8437-597b2450d5b4 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.055978 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 554/1085] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:27.061235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c50059-2aa9-4f0b-960e-075738322c73 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.061635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c50059-2aa9-4f0b-960e-075738322c73 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.061790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c50059-2aa9-4f0b-960e-075738322c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.080077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b0c50059-2aa9-4f0b-960e-075738322c73 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:27.081247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0c50059-2aa9-4f0b-960e-075738322c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:27.149267 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 532/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:27.316292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b2f73-2f1d-46b0-9447-4a3874d6c6ea None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.316615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b2f73-2f1d-46b0-9447-4a3874d6c6ea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.316897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b2f73-2f1d-46b0-9447-4a3874d6c6ea None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.318247 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 555/1087] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:27.324294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.324583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.324861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.342815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:27.344069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:27.389214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:27.410187 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 533/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:27.479198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b2f73-2f1d-46b0-9447-4a3874d6c6ea None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:27.583276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b2f73-2f1d-46b0-9447-4a3874d6c6ea None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:27.618686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1945015-35a4-4747-8238-896497165c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:27.619347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1945015-35a4-4747-8238-896497165c5e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.619661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1945015-35a4-4747-8238-896497165c5e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.619933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1945015-35a4-4747-8238-896497165c5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.630232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1945015-35a4-4747-8238-896497165c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c1945015-35a4-4747-8238-896497165c5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:27.635541 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:27.636664 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:27.637665 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 556/1089] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:27.642852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:27.739729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b37b-cc6d-4b7f-867e-8391ae9404cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:27.745574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1945015-35a4-4747-8238-896497165c5e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:27.764038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:27.776998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:27.777603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.777884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.778719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.778812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:27.779214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:27.780579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:27.789022 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 534/1090] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:27.795036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:27.837561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:27.847067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1945015-35a4-4747-8238-896497165c5e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:27.887309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:27.887941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.888217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.888494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.896874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b585-5840-4f88-af94-2ba15b940d48 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:27.898495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:27.903278 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:27.904208 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:27.905158 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 557/1091] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Sep 6 10:30:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:27.910233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:27.932461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:27.933088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:27.933375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:27.933660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] PATH_INFO: `/v3/users/87a62f7cbfd448e28100e125619e2ec3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:27.934827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=87a62f7cbfd448e28100e125619e2ec3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:27.936474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:27.938085 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 535/1092] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:27 2022] GET /identity/v3/users/87a62f7cbfd448e28100e125619e2ec3 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:27.943851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:27.993967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.016534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d4dc-cc30-4658-bc38-ca91678846be None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.046046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0c0bf-1cbd-42b4-8cac-54b39fdcb0e1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.051644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.052247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.052528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.052803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.053462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:28.053802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.055297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.056533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.063560 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 558/1093] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:30:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:28.069531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.081310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.081920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.082207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.082478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.151293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.152700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.175685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165556d-930e-4307-91a9-e53c2393a677 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.210762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.211461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.211754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.211996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.218476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.222728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.224315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:28.239630 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:28.240600 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:28.241518 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:28.241518 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:28.241518 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:28.241518 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 559/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:28.246481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.259328 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 536/1095] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:28.260559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.275434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.372797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140e86-c2a1-44c9-8a70-b5e9478f42bf None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.376543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed08008-17cd-44dc-8111-25ef3bfcc8c6 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.410347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.410869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.411179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.411453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.412087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:28.412387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.414385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.418088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.418721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.419026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.419311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.420432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.421956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.429591 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 537/1096] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:28.429762 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 560/1097] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:28.431704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.431820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.484750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.519434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.536874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b62752-947d-4907-a4c8-303780d6201c None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.543978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3005d-13aa-40a8-85cc-b7b2e718a361 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.576988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.577626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.577903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.578189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.581341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.581976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.582367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.582648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.583409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9, user.id=87a62f7cbfd448e28100e125619e2ec3) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:28.583716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.585802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.586453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.587934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.591923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 538/1098] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/role_assignments?user.id=87a62f7cbfd448e28100e125619e2ec3&scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:30:28.601560 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:28.604462 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:28.605596 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 561/1099] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:30:28.608985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.732536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594155-8868-41c5-8c6d-976ce3ffb3ad None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.769828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.770442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.770728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.771004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:28.771760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:28.772069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:28.774073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:28.789246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.793413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 539/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:28.799334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:28.905257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef760-9ba6-4310-add7-7e7704efff90 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:28.916344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:28.940591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:28.941298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:28.941854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:28.942207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:29.013597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:29.014942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:29.133490 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 562/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:29.139308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:29.247311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1e43-c454-4afd-bfb9-74ac3e30af2e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:29.288422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:29.295025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:29.295025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:29.295025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:29.300377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:29.301886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:30:29.316963 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:29.317951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:30:29.323939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:30:29.323939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:30:29.323939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:29.323939 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 540/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:29.324408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:29.336788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:29.430590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c62ef-d6ba-4ffd-a257-c6d2f0c75a30 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:29.463773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:29.464363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:29.464641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:29.464910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:29.465535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:29.465836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:29.468233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:29.478743 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 563/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:29.484131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:29.535974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:29.584262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8a169-6ff3-4519-a88a-16edc284222e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:29.617134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:29.617749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:29.618027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:29.618297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:29.624820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:29.626246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:30:29.637206 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:29.638244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:30:29.639458 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:29.640146 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 541/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:29.644035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:29.713456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:29.744199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fb0a5-9365-468d-820f-89b00e3e47fd None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:29.779681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:29.780294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:29.780586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:29.780849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:29.781538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:29.781844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:29.783333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c249c9a-551a-4e87-97ac-aa78443aeda0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:29.796907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 564/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:29.802941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:29.902682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cfa77-308c-4576-a052-63dddca14fc0 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:29.916089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:29.936076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:29.936672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:29.936951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:29.937220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:29.937936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] RBAC: Adding query filter params (role.id=3f9da8e5d46143dfba040495077f1dc5, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=6c2ddfc46e6c414085493829459e5ea9) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:29.938244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:29.939705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000012-7739-4cb7-b885-ca6f4596e817 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:29.945867 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 542/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:29 2022] GET /identity/v3/role_assignments?user.id=6c2ddfc46e6c414085493829459e5ea9&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=3f9da8e5d46143dfba040495077f1dc5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:30.859616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af172bc-c123-485a-877a-07793a189be1 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:30.860157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af172bc-c123-485a-877a-07793a189be1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:30.860157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af172bc-c123-485a-877a-07793a189be1 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:30.861749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 565/1107] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:30.867805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:30.868209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:30.868360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:30.886320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:30.887546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:30.953276 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 543/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:31.284277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af172bc-c123-485a-877a-07793a189be1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:31.383796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af172bc-c123-485a-877a-07793a189be1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:31.411898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:31.418374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a77b7-7d8f-41e7-b28e-a9cc572bf34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:31.419070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a77b7-7d8f-41e7-b28e-a9cc572bf34b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:31.419360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a77b7-7d8f-41e7-b28e-a9cc572bf34b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:31.419641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a77b7-7d8f-41e7-b28e-a9cc572bf34b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:31.420749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a77b7-7d8f-41e7-b28e-a9cc572bf34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:31.422229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a77b7-7d8f-41e7-b28e-a9cc572bf34b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:31.423864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 566/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:31.429734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:31.528636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b75b2-37f1-49cf-afd3-98a67c353678 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:31.535932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:31.561278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c40178-22d7-4894-8f20-4976ab32929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:31.561879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c40178-22d7-4894-8f20-4976ab32929a None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:31.562159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c40178-22d7-4894-8f20-4976ab32929a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:31.562431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c40178-22d7-4894-8f20-4976ab32929a None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:31.563112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c40178-22d7-4894-8f20-4976ab32929a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:31.564624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c40178-22d7-4894-8f20-4976ab32929a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:31.639313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 544/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:30:31 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:33.848173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370285e-f151-43d2-b04f-4faf49316221 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:33.848712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370285e-f151-43d2-b04f-4faf49316221 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:33.848712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370285e-f151-43d2-b04f-4faf49316221 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:33.850078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 567/1111] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:33.855302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:33.855700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:33.855855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:33.874115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:33.875341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:33.942096 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 545/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:34.278090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370285e-f151-43d2-b04f-4faf49316221 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:34.376424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370285e-f151-43d2-b04f-4faf49316221 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:34.408957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:34.409572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:34.409852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:34.410126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] PATH_INFO: `/v3/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:34.411517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] RBAC: Authorizing `identity:get_role(role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:34.412872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:34.414667 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 568/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:34 2022] GET /identity/v3/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:34.420408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:34.507154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:34.515395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45211e70-17d3-4866-bc9f-984554509c72 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:34.547663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:34.548221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:34.548500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:34.548771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] PATH_INFO: `/v3/users/161699fe31e54510a324922bc0d76fa1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:34.562628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] RBAC: Authorizing `identity:get_user(user_id=161699fe31e54510a324922bc0d76fa1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:34.564106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:34.565788 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 546/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:34 2022] GET /identity/v3/users/161699fe31e54510a324922bc0d76fa1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:34.574385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:34.635919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:34.669629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf90d14-fde9-4f08-a668-002ffb94267b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:34.703290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:34.703967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:34.704253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:34.704522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:34.769531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:34.770967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:34.831219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:34.865749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 569/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:34.871929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:34.968966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bb262-2e0e-47e3-80dd-e53249f54343 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:35.012874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55e78-bded-4d6d-a70e-6040ed6e08dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:35.013496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55e78-bded-4d6d-a70e-6040ed6e08dd None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:35.013773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55e78-bded-4d6d-a70e-6040ed6e08dd None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:35.014098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55e78-bded-4d6d-a70e-6040ed6e08dd None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:35.015226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55e78-bded-4d6d-a70e-6040ed6e08dd None admin] RBAC: Authorizing `identity:get_project(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:35.020629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55e78-bded-4d6d-a70e-6040ed6e08dd None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:35.020629 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 547/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:34 2022] GET /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:35.025012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:35.120840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bb1a7-dd4c-4eb1-80cb-953e09ef994f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:35.153431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:35.154018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:35.154293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:35.154564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:35.155296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] RBAC: Adding query filter params (role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9, user.id=161699fe31e54510a324922bc0d76fa1) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:35.155599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:35.157016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348731cf-5aea-493e-849e-f81683710a44 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:35.162150 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 570/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:35 2022] GET /identity/v3/role_assignments?user.id=161699fe31e54510a324922bc0d76fa1&scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:37.310998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb46f07-8b18-45e6-9faf-f2c1aedc1195 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:37.311527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb46f07-8b18-45e6-9faf-f2c1aedc1195 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:37.311618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb46f07-8b18-45e6-9faf-f2c1aedc1195 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:37.312965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 548/1118] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:37.318370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:37.318813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:37.318907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:37.342926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:37.344154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:37.373030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:37.416105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 571/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:37.750404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb46f07-8b18-45e6-9faf-f2c1aedc1195 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:37.769018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:37.850309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb46f07-8b18-45e6-9faf-f2c1aedc1195 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:37.884489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:37.885114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:37.885399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:37.885675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] PATH_INFO: `/v3/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:37.887104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] RBAC: Authorizing `identity:get_role(role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:37.888470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:37.889786 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 549/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:37 2022] GET /identity/v3/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:37.895598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:37.992857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be134aa0-1bb0-49e9-b115-eeed37eed780 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:38.025143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:38.025761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:38.026037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:38.026308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] PATH_INFO: `/v3/users/161699fe31e54510a324922bc0d76fa1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:38.027454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] RBAC: Authorizing `identity:get_user(user_id=161699fe31e54510a324922bc0d76fa1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:38.028867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:38.030405 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 572/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:37 2022] GET /identity/v3/users/161699fe31e54510a324922bc0d76fa1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:38.036164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:38.119985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:38.134172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3002-a6f4-42c6-9f2c-3e95eecb2252 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:38.168389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32347e-733c-4e46-9a03-5c576f13f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:38.169013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32347e-733c-4e46-9a03-5c576f13f49e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:38.169295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32347e-733c-4e46-9a03-5c576f13f49e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:38.169568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32347e-733c-4e46-9a03-5c576f13f49e None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:38.170663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32347e-733c-4e46-9a03-5c576f13f49e None admin] RBAC: Authorizing `identity:get_project(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:38.172187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32347e-733c-4e46-9a03-5c576f13f49e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:38.173801 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 550/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:38 2022] GET /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:38.179881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:38.207700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:38.278844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9807c4d-d7e6-4467-91f5-2adc5b51431d None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:38.311558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9b08-6faa-40f8-9157-bf3b805c2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:38.312232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9b08-6faa-40f8-9157-bf3b805c2297 None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:38.312514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9b08-6faa-40f8-9157-bf3b805c2297 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:38.312791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9b08-6faa-40f8-9157-bf3b805c2297 None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9/users/161699fe31e54510a324922bc0d76fa1/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:38.314897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d9b08-6faa-40f8-9157-bf3b805c2297 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9, user_id=161699fe31e54510a324922bc0d76fa1, role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:38.316367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d9b08-6faa-40f8-9157-bf3b805c2297 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:38.378807 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 573/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:30:38 2022] PUT /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9/users/161699fe31e54510a324922bc0d76fa1/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:30:40.524500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384eebf-2a95-4028-9962-223eaad76bff None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:40.525024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384eebf-2a95-4028-9962-223eaad76bff None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:40.525156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384eebf-2a95-4028-9962-223eaad76bff None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:40.526387 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 551/1124] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:40.531625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:40.532002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:40.532180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:40.550495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:40.551712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:40.626880 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 574/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:40.956125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384eebf-2a95-4028-9962-223eaad76bff None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:41.056151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384eebf-2a95-4028-9962-223eaad76bff None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:41.089043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:41.089661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:41.089946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:41.090222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] PATH_INFO: `/v3/roles/28d5c4c6bbbf4e6e82a01663600185ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:41.091649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] RBAC: Authorizing `identity:get_role(role_id=28d5c4c6bbbf4e6e82a01663600185ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:41.093010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:41.094313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 552/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:40 2022] GET /identity/v3/roles/28d5c4c6bbbf4e6e82a01663600185ce => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:30:41.100121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:41.118529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:41.197325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599db5-06c8-4144-81b3-613611e5f973 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:41.232758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:41.233384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:41.233662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:41.233932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] PATH_INFO: `/v3/users/161699fe31e54510a324922bc0d76fa1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:41.235117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] RBAC: Authorizing `identity:get_user(user_id=161699fe31e54510a324922bc0d76fa1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:41.236805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:41.238371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 575/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:41 2022] GET /identity/v3/users/161699fe31e54510a324922bc0d76fa1 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:41.244639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:41.269096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:41.343764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c3fd-f923-4fcd-bf5c-fb070f080292 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:41.387133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:41.387753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:41.388035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:41.388307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:41.455683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:41.457070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:41.487780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:41.563418 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 553/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:41.570297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:41.657063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:41.672024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9fe8f-299c-46ab-9b10-35777e7f0a85 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:41.707211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520466-376f-416b-a3da-9167b378c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:41.707759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520466-376f-416b-a3da-9167b378c996 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:41.708036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520466-376f-416b-a3da-9167b378c996 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:41.708305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520466-376f-416b-a3da-9167b378c996 None admin] PATH_INFO: `/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:41.709404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01520466-376f-416b-a3da-9167b378c996 None admin] RBAC: Authorizing `identity:get_project(project_id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:41.710948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01520466-376f-416b-a3da-9167b378c996 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:41.712588 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 576/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:41 2022] GET /identity/v3/projects/bc6ef97b0e3e4f9b9ac5a1479d79c5f9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:41.718975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:41.821049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf013fde-03c9-46eb-a34b-16d6ebf3c7e5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:41.844205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:41.855931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:41.856611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:41.856880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:41.857158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:41.857886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] RBAC: Adding query filter params (role.id=28d5c4c6bbbf4e6e82a01663600185ce, scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9, user.id=161699fe31e54510a324922bc0d76fa1) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:41.858198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:41.859680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f086686-db67-4462-a29e-6ceed12fb9b3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:41.865705 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 554/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:41 2022] GET /identity/v3/role_assignments?user.id=161699fe31e54510a324922bc0d76fa1&scope.project.id=bc6ef97b0e3e4f9b9ac5a1479d79c5f9&role.id=28d5c4c6bbbf4e6e82a01663600185ce => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:44.080509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97271ee5-036a-4ded-846d-b45d28f31f81 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:44.081016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97271ee5-036a-4ded-846d-b45d28f31f81 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:44.081133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97271ee5-036a-4ded-846d-b45d28f31f81 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:44.082396 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 577/1131] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:44.088408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:44.088841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:44.088935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:44.107901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:44.109085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:44.177074 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 555/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:44.503253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97271ee5-036a-4ded-846d-b45d28f31f81 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:44.612902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97271ee5-036a-4ded-846d-b45d28f31f81 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:44.648022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0364f-b5dd-45b8-85be-379899ee68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:44.648654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0364f-b5dd-45b8-85be-379899ee68e1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:44.648934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0364f-b5dd-45b8-85be-379899ee68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:44.649208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0364f-b5dd-45b8-85be-379899ee68e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:44.650391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0364f-b5dd-45b8-85be-379899ee68e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:44.651910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0364f-b5dd-45b8-85be-379899ee68e1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:44.653462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 578/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:44.659533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:44.766021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4103-04ed-41bd-b66d-e34c1b5112e8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:44.782727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:44.800138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81efff-77e0-430f-b19d-9ed13a2b5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:44.800762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81efff-77e0-430f-b19d-9ed13a2b5915 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:44.801043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81efff-77e0-430f-b19d-9ed13a2b5915 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:44.801868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81efff-77e0-430f-b19d-9ed13a2b5915 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:44.801956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81efff-77e0-430f-b19d-9ed13a2b5915 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:44.803928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81efff-77e0-430f-b19d-9ed13a2b5915 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:44.952462 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 556/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:30:44 2022] POST /identity/v3/projects => generated 311 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:30:47.177806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207ed9-9cde-4213-9dbc-cd10f1c57a4b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:47.178321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207ed9-9cde-4213-9dbc-cd10f1c57a4b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:47.178413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207ed9-9cde-4213-9dbc-cd10f1c57a4b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:47.179713 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 579/1135] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:47.185028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:47.185436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:47.185582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:47.204508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:47.205691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:47.274028 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 557/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:47.607573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e207ed9-9cde-4213-9dbc-cd10f1c57a4b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:47.633501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:47.725223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e207ed9-9cde-4213-9dbc-cd10f1c57a4b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:47.760068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d65c-bf66-4d5d-a178-fe330716ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:47.760689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d65c-bf66-4d5d-a178-fe330716ca1f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:47.760967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d65c-bf66-4d5d-a178-fe330716ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:47.761244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d65c-bf66-4d5d-a178-fe330716ca1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:47.762334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153d65c-bf66-4d5d-a178-fe330716ca1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:47.763793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153d65c-bf66-4d5d-a178-fe330716ca1f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:47.765327 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 580/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:30:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:47.771039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:47.867601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:47.871234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1c0d5-bba2-4041-a7c7-85cbd92aed2e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:47.908755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76b442-d7b9-4af2-8f53-386d99e5790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:47.908893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76b442-d7b9-4af2-8f53-386d99e5790a None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:47.909094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76b442-d7b9-4af2-8f53-386d99e5790a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:47.909368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76b442-d7b9-4af2-8f53-386d99e5790a None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:47.910024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76b442-d7b9-4af2-8f53-386d99e5790a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:47.911478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76b442-d7b9-4af2-8f53-386d99e5790a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:47.994159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 558/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:30:47 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:30:50.203544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d43d-d4bb-4bd0-a0f1-6605a3275966 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:50.204030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d43d-d4bb-4bd0-a0f1-6605a3275966 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:50.204122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d43d-d4bb-4bd0-a0f1-6605a3275966 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:50.205399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 581/1139] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:50.211181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c989-404e-4778-bb01-8c1107808198 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:50.211550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c989-404e-4778-bb01-8c1107808198 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:50.211736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c989-404e-4778-bb01-8c1107808198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:50.229462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d940c989-404e-4778-bb01-8c1107808198 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:50.230635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d940c989-404e-4778-bb01-8c1107808198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:50.294698 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 559/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:30:50.623697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d43d-d4bb-4bd0-a0f1-6605a3275966 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:50.713919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:50.724016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d43d-d4bb-4bd0-a0f1-6605a3275966 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:50.757318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:50.757925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:50.758201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:50.758467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:50.768136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:50.773274 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:50.774443 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:50.775468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 582/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:30:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:50.780941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c989-404e-4778-bb01-8c1107808198 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:50.863207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:50.879242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c989-404e-4778-bb01-8c1107808198 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:50.964162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:50.964763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:50.965047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:50.965322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:50.965978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:50.966284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:50.967680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:50.976107 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 560/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:50.982226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:51.080687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252aa9-71c6-4538-8936-ea505a87cf10 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:51.112980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:51.113635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:51.113915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:51.114182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] PATH_INFO: `/v3/users/1e5a2c97d5e64464a776776a9bfb15ae` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:51.127342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] RBAC: Authorizing `identity:get_user(user_id=1e5a2c97d5e64464a776776a9bfb15ae)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:51.128763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:51.130394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 583/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:50 2022] GET /identity/v3/users/1e5a2c97d5e64464a776776a9bfb15ae => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:51.136478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:51.233383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846464-a4dc-4efd-85a7-8da70d26a62b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:51.266041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:51.266629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:51.266907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:51.267204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:51.282119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:51.332853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:51.334282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:51.431541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 561/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:51.437567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:51.448213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:51.534886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc44baf-27bd-4d6a-a9b8-b0ebdf25697a None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:51.567506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da33ce-0bc4-4c51-b7dd-41eddf7bb704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:51.568120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da33ce-0bc4-4c51-b7dd-41eddf7bb704 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:51.568402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da33ce-0bc4-4c51-b7dd-41eddf7bb704 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:51.568673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da33ce-0bc4-4c51-b7dd-41eddf7bb704 None admin] PATH_INFO: `/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:51.569793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da33ce-0bc4-4c51-b7dd-41eddf7bb704 None admin] RBAC: Authorizing `identity:get_project(project_id=0fdbd0dcef9d4e7aae8b16962a6b3ba8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:51.571238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da33ce-0bc4-4c51-b7dd-41eddf7bb704 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:51.572824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 584/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:51 2022] GET /identity/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:51.578898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:51.624181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:51.675717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c7789-8cfa-42c3-aa1f-a79ba41beb2f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:51.708848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:51.709414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:51.710243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:51.710518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:51.711261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=0fdbd0dcef9d4e7aae8b16962a6b3ba8, user.id=1e5a2c97d5e64464a776776a9bfb15ae) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:51.711573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:51.712986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12781328-7a2b-4ae0-b379-e4a2017113ae None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:51.718233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 562/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:51 2022] GET /identity/v3/role_assignments?user.id=1e5a2c97d5e64464a776776a9bfb15ae&scope.project.id=0fdbd0dcef9d4e7aae8b16962a6b3ba8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:53.872979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561f161-941c-4fe5-a0a2-31a724ddbd8d None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:53.873551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561f161-941c-4fe5-a0a2-31a724ddbd8d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:53.873551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561f161-941c-4fe5-a0a2-31a724ddbd8d None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:53.874914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 585/1147] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:53.880121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:53.880538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:53.880680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:53.898952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:53.900181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:53.965235 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 563/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:54.307819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561f161-941c-4fe5-a0a2-31a724ddbd8d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:54.384383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:54.406830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561f161-941c-4fe5-a0a2-31a724ddbd8d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:54.440012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:54.440629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:54.440913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:54.441190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:54.451538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:54.456282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:54.457365 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:30:54.458417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 586/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:30:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:54.463437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:54.503020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:54.558091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d21b1-cad0-4bb2-b4d6-59352d67fa49 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:54.590470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:54.591116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:54.591396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:54.591668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:54.592697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:54.593003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:54.594389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:54.603190 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 564/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:54.609145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:54.706763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe8c8a-29da-4e9e-86f2-16b4a17d6727 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:54.738822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:54.739460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:54.739740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:54.740035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] PATH_INFO: `/v3/users/1e5a2c97d5e64464a776776a9bfb15ae` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:54.741687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=1e5a2c97d5e64464a776776a9bfb15ae)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:54.743135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:54.744667 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 587/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:54 2022] GET /identity/v3/users/1e5a2c97d5e64464a776776a9bfb15ae => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:54.750401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:54.847047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82831b1e-6921-4f32-bf12-dc024396edad None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:54.848478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:54.880555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0330a37-b8f5-490c-b284-e152898f3ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:54.881196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330a37-b8f5-490c-b284-e152898f3ed9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:54.881476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330a37-b8f5-490c-b284-e152898f3ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:54.881763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330a37-b8f5-490c-b284-e152898f3ed9 None admin] PATH_INFO: `/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:54.882871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0330a37-b8f5-490c-b284-e152898f3ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=0fdbd0dcef9d4e7aae8b16962a6b3ba8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:54.884361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0330a37-b8f5-490c-b284-e152898f3ed9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:54.885989 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 565/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:54 2022] GET /identity/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:54.892044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:54.895896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:54.989372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24d824-1d67-48ec-b24e-2e85d55e1dd1 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:55.021531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02cfa9-96d4-48dd-84c8-19e45ad71d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:55.022719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02cfa9-96d4-48dd-84c8-19e45ad71d5b None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:55.022995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02cfa9-96d4-48dd-84c8-19e45ad71d5b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:55.023291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02cfa9-96d4-48dd-84c8-19e45ad71d5b None admin] PATH_INFO: `/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8/users/1e5a2c97d5e64464a776776a9bfb15ae/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:55.025154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02cfa9-96d4-48dd-84c8-19e45ad71d5b None admin] RBAC: Authorizing `identity:create_grant(project_id=0fdbd0dcef9d4e7aae8b16962a6b3ba8, user_id=1e5a2c97d5e64464a776776a9bfb15ae, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:55.026581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02cfa9-96d4-48dd-84c8-19e45ad71d5b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:55.130154 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 588/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:30:54 2022] PUT /identity/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8/users/1e5a2c97d5e64464a776776a9bfb15ae/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:30:57.274989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e9577-3efc-4d39-9907-98ba95dcadcd None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:57.275551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e9577-3efc-4d39-9907-98ba95dcadcd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:57.275679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e9577-3efc-4d39-9907-98ba95dcadcd None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:57.276922 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 566/1154] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:30:57.282236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:57.282633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:57.282788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:57.300611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:30:57.301799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:30:57.359832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:57.368715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 589/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:30:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:30:57.696039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e9577-3efc-4d39-9907-98ba95dcadcd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:57.794223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e9577-3efc-4d39-9907-98ba95dcadcd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:57.826635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:57.827286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:57.827572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:57.827849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:57.838293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:30:57.843278 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:30:57.844377 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:30:57.845573 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 567/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:30:57.850791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:57.955613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff86de-6043-4ccb-bd6e-be5a12394950 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:57.988563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:57.989218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:57.989502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:57.989778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:57.990424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:57.991363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:57.992716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:58.000440 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 590/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:58.006397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:58.036792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:58.105165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aab34-ea18-466f-9c47-9aecb76e55f8 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:58.137726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:58.138343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:58.138629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:58.138906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] PATH_INFO: `/v3/users/1e5a2c97d5e64464a776776a9bfb15ae` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:58.140046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] RBAC: Authorizing `identity:get_user(user_id=1e5a2c97d5e64464a776776a9bfb15ae)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:58.141476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:58.143132 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 568/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:30:58 2022] GET /identity/v3/users/1e5a2c97d5e64464a776776a9bfb15ae => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:58.149234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:58.215096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:58.266771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec0c24-a2a2-455a-a044-5139f4997e13 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:58.300057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:58.300664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:58.300940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:58.301213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:58.366786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:58.368262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:58.420619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:58.463844 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 591/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:30:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:30:58.469747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:58.564772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:30:58.568615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908bdf7-2084-4ae6-90e5-3a2cc3585f6c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:58.602626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4379-9662-4464-ac27-159887f86f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:58.603279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4379-9662-4464-ac27-159887f86f7a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:58.603565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4379-9662-4464-ac27-159887f86f7a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:58.603843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4379-9662-4464-ac27-159887f86f7a None admin] PATH_INFO: `/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:58.604957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c4379-9662-4464-ac27-159887f86f7a None admin] RBAC: Authorizing `identity:get_project(project_id=0fdbd0dcef9d4e7aae8b16962a6b3ba8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:58.606387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c4379-9662-4464-ac27-159887f86f7a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:58.608043 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 569/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:30:58 2022] GET /identity/v3/projects/0fdbd0dcef9d4e7aae8b16962a6b3ba8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:30:58.614616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:30:58.711203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb70ec-5b9a-48dd-b62d-cdc64e2f534b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:30:58.744795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:30:58.745324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:30:58.745602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:30:58.745873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:30:58.746582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=0fdbd0dcef9d4e7aae8b16962a6b3ba8, user.id=1e5a2c97d5e64464a776776a9bfb15ae) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:30:58.746887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:30:58.748342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb946c-1df7-44b6-ab0e-07516c5947ca None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:30:58.753990 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 592/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:30:58 2022] GET /identity/v3/role_assignments?user.id=1e5a2c97d5e64464a776776a9bfb15ae&scope.project.id=0fdbd0dcef9d4e7aae8b16962a6b3ba8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:00.937474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fed25-94b3-4b5e-bcb3-d0b24517b7f4 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:00.937909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fed25-94b3-4b5e-bcb3-d0b24517b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:00.938019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fed25-94b3-4b5e-bcb3-d0b24517b7f4 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:00.939526 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 570/1162] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:00.945228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:00.945644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:00.945778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:00.964156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:00.965334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:00.979090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:01.030350 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 593/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:01.363817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fed25-94b3-4b5e-bcb3-d0b24517b7f4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:01.471972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fed25-94b3-4b5e-bcb3-d0b24517b7f4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:01.505171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:01.505770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:01.506053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:01.506353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:01.538443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:01.571341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:01.572764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:01.669635 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 571/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:31:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:31:01.675531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:01.771052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6047-498b-4846-b3a0-67263240059f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:01.804947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:01.805604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:01.805878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:01.806147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:01.812747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:01.814176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-0ed80933-869a-49d7-8618-d65b8d7b2e63 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:31:01.825231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:31:01.826494 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:31:01.827424 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 594/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:31:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:31:01.832313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:01.896617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:01.931767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ee3d3-9d0b-47eb-b133-008615630414 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:01.963989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:01.964589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:01.964871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:01.965142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:01.965777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:31:01.966082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:01.967479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d594d-f877-4e31-a02d-a464febd1af7 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:01.974337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 572/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Sep 6 10:31:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:04.121216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770767-38c6-482b-a054-34def6e1abc3 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:04.121735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770767-38c6-482b-a054-34def6e1abc3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:04.121735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770767-38c6-482b-a054-34def6e1abc3 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:04.123093 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 595/1167] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:04.128447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d6a0-4fb2-4a47-a493-5eeaeec7a23b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:04.128882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d6a0-4fb2-4a47-a493-5eeaeec7a23b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:04.129027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686d6a0-4fb2-4a47-a493-5eeaeec7a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:04.147364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b686d6a0-4fb2-4a47-a493-5eeaeec7a23b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:04.148528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b686d6a0-4fb2-4a47-a493-5eeaeec7a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:04.212178 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 573/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:04.545695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2770767-38c6-482b-a054-34def6e1abc3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:04.557915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:04.643553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2770767-38c6-482b-a054-34def6e1abc3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:04.675782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b4c34-1477-4389-a5ad-c98b108461e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:04.676363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b4c34-1477-4389-a5ad-c98b108461e5 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:04.676642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b4c34-1477-4389-a5ad-c98b108461e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:04.676910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b4c34-1477-4389-a5ad-c98b108461e5 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:04.677564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b4c34-1477-4389-a5ad-c98b108461e5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:04.678951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b4c34-1477-4389-a5ad-c98b108461e5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:04.749203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 596/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Sep 6 10:31:04 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:31:06.953936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48266efd-3e90-41fd-8aab-861d45a72fbd None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:06.954457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48266efd-3e90-41fd-8aab-861d45a72fbd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:06.954561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48266efd-3e90-41fd-8aab-861d45a72fbd None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:06.955870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 574/1170] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:06.961735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:06.962128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:06.962276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:06.979904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:06.981072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:07.041064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:07.045452 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 597/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:07.376961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48266efd-3e90-41fd-8aab-861d45a72fbd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:07.437145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:07.477253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48266efd-3e90-41fd-8aab-861d45a72fbd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:07.516163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d039f-8497-44ef-9402-3c1bcbfb8375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:07.516787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d039f-8497-44ef-9402-3c1bcbfb8375 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:07.517071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d039f-8497-44ef-9402-3c1bcbfb8375 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:07.517349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d039f-8497-44ef-9402-3c1bcbfb8375 None admin] PATH_INFO: `/v3/domains/cf943cc407674f05b7006587a15aa7c4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:07.527905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d039f-8497-44ef-9402-3c1bcbfb8375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cf943cc407674f05b7006587a15aa7c4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:07.529357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d039f-8497-44ef-9402-3c1bcbfb8375 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:07.530952 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 575/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Sep 6 10:31:07 2022] GET /identity/v3/domains/cf943cc407674f05b7006587a15aa7c4 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:07.536852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:07.633553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2a6ce-975a-46f9-a017-f295eee5055b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:07.666105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca59ac9-1a66-4932-b586-80b5b9cd2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:07.666701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59ac9-1a66-4932-b586-80b5b9cd2b83 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:07.666981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59ac9-1a66-4932-b586-80b5b9cd2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:07.667288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca59ac9-1a66-4932-b586-80b5b9cd2b83 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:07.667918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca59ac9-1a66-4932-b586-80b5b9cd2b83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:07.669327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca59ac9-1a66-4932-b586-80b5b9cd2b83 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:07.756194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 598/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:31:07 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:31:09.957866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468b00-db0c-451d-b401-e8d81e7553ea None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:09.958358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468b00-db0c-451d-b401-e8d81e7553ea None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:09.958451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468b00-db0c-451d-b401-e8d81e7553ea None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:09.959797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 576/1174] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:09.964977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:09.965406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:09.965533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:09.984216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:09.985411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:10.031189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:10.050249 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 599/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:10.378597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468b00-db0c-451d-b401-e8d81e7553ea None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:10.476091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468b00-db0c-451d-b401-e8d81e7553ea None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:10.494811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:10.508691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0516-be62-4960-a700-0e4bdb18ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:10.509329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0516-be62-4960-a700-0e4bdb18ab8f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:10.509609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0516-be62-4960-a700-0e4bdb18ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:10.509880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0516-be62-4960-a700-0e4bdb18ab8f None admin] PATH_INFO: `/v3/domains/cf943cc407674f05b7006587a15aa7c4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:10.510964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0516-be62-4960-a700-0e4bdb18ab8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=cf943cc407674f05b7006587a15aa7c4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:10.512447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0516-be62-4960-a700-0e4bdb18ab8f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:10.513974 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 577/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Sep 6 10:31:10 2022] GET /identity/v3/domains/cf943cc407674f05b7006587a15aa7c4 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:10.519661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:10.615485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb7c77-f912-41b5-8237-a4c28a00ecf6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:10.648577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3848-3765-49e2-aa59-80cea4e842e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:10.649119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3848-3765-49e2-aa59-80cea4e842e2 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:10.649400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3848-3765-49e2-aa59-80cea4e842e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:10.649672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3848-3765-49e2-aa59-80cea4e842e2 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:10.650312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a3848-3765-49e2-aa59-80cea4e842e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:10.651757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a3848-3765-49e2-aa59-80cea4e842e2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:10.764733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 600/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:31:10 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:31:12.975842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0782-6c24-4530-b079-93427edb9dbf None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:12.976316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0782-6c24-4530-b079-93427edb9dbf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:12.976406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b0782-6c24-4530-b079-93427edb9dbf None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:12.977734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 578/1178] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:12.982937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:12.983370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:12.983534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:13.002962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:13.004250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:13.032990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:13.068501 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 601/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:13.402065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0782-6c24-4530-b079-93427edb9dbf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:13.500077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b0782-6c24-4530-b079-93427edb9dbf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:13.536958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:13.537599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:13.537880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:13.538285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:13.552035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:31:13.556815 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:31:13.557899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:31:13.558764 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 579/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:31:13.563980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:13.659138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e823f-9ab4-4077-8980-b1ce3a63e983 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:13.713782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:13.714389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:13.714668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:13.714940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:13.715635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:31:13.715940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:13.717313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:13.725390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 602/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:13.731418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:13.780945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:13.831656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f8a27-d107-47bd-b85c-49651b6f048c None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:13.863907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:13.864529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:13.864814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:13.865090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] PATH_INFO: `/v3/users/302cb774481c43d3ae047bf1cb095c54` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:13.880332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] RBAC: Authorizing `identity:get_user(user_id=302cb774481c43d3ae047bf1cb095c54)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:13.882383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:13.884040 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 580/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:31:13 2022] GET /identity/v3/users/302cb774481c43d3ae047bf1cb095c54 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:13.889732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:13.919705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:13.985929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271a40-0f75-404c-be7c-38811267cfc3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:14.019103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:14.019750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:14.020031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:14.020304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:14.085783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:14.087257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:14.114689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:14.182843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 603/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:31:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:31:14.188930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:14.284752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428b8e-fcb1-457f-b97b-7c6df5d9b8ea None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:14.293376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:14.319338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a543d3-48e1-4030-a483-54a37971943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:14.319956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a543d3-48e1-4030-a483-54a37971943e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:14.320249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a543d3-48e1-4030-a483-54a37971943e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:14.320716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a543d3-48e1-4030-a483-54a37971943e None admin] PATH_INFO: `/v3/projects/13102e5eaf5043b29f66c69c428d3310` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:14.322172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a543d3-48e1-4030-a483-54a37971943e None admin] RBAC: Authorizing `identity:get_project(project_id=13102e5eaf5043b29f66c69c428d3310)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:14.323764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a543d3-48e1-4030-a483-54a37971943e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:14.325376 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 581/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:31:14 2022] GET /identity/v3/projects/13102e5eaf5043b29f66c69c428d3310 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:14.331429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:14.426808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37ab73-4e64-4124-bddb-2cd26ca6eccc None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:14.454397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:14.459713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:14.460305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:14.460585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:14.460857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:14.461566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=13102e5eaf5043b29f66c69c428d3310, user.id=302cb774481c43d3ae047bf1cb095c54) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:31:14.461872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:14.463312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5647035-f9cb-4f2a-8388-b1b2ec4c7d43 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:14.468424 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 604/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:31:14 2022] GET /identity/v3/role_assignments?user.id=302cb774481c43d3ae047bf1cb095c54&scope.project.id=13102e5eaf5043b29f66c69c428d3310&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:16.619255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d3f4b-a448-4dcc-b0d9-ab25ea441b84 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:16.619780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d3f4b-a448-4dcc-b0d9-ab25ea441b84 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:16.619780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d3f4b-a448-4dcc-b0d9-ab25ea441b84 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:16.621228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 582/1186] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:16.626508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:16.626910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:16.627083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:16.645362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:16.647213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:16.712260 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 605/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:17.042587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d3f4b-a448-4dcc-b0d9-ab25ea441b84 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:17.141902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d3f4b-a448-4dcc-b0d9-ab25ea441b84 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:17.174513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:17.175093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:17.175379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:17.175654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:17.186001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:31:17.190728 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:31:17.191820 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:31:17.192837 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 583/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:31:17.198076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:17.294063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c12fd-8748-48c0-b61e-5d79115db79f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:17.316875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:17.327151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:17.327748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:17.331678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:17.331678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:17.331678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:31:17.331678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:17.331678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:17.338300 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 606/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:31:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:17.344087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:17.378356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:17.442297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea590-e9d5-48ab-9ac6-492279c1cd18 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:17.475056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:17.475665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:17.475945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:17.476218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] PATH_INFO: `/v3/users/302cb774481c43d3ae047bf1cb095c54` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:17.477313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=302cb774481c43d3ae047bf1cb095c54)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:17.478724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:17.480289 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 584/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:31:17 2022] GET /identity/v3/users/302cb774481c43d3ae047bf1cb095c54 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:17.485950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:17.589455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a2ad-62cd-47a2-b4ea-38009f45e7e4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:17.622864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218389ef-9ca9-4156-8114-cc405b12a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:17.623516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218389ef-9ca9-4156-8114-cc405b12a4b7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:17.623802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218389ef-9ca9-4156-8114-cc405b12a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:17.624078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218389ef-9ca9-4156-8114-cc405b12a4b7 None admin] PATH_INFO: `/v3/projects/13102e5eaf5043b29f66c69c428d3310` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:17.625182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218389ef-9ca9-4156-8114-cc405b12a4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=13102e5eaf5043b29f66c69c428d3310)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:17.626616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218389ef-9ca9-4156-8114-cc405b12a4b7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:17.628261 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 607/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:31:17 2022] GET /identity/v3/projects/13102e5eaf5043b29f66c69c428d3310 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:17.634370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:17.730246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e226e3-688b-416a-b08a-8f71b8ccb8e4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:17.731704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:17.762900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ed2f0-6000-4618-8f5b-2f1f227a763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:17.763563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed2f0-6000-4618-8f5b-2f1f227a763c None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:17.763845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed2f0-6000-4618-8f5b-2f1f227a763c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:17.764119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed2f0-6000-4618-8f5b-2f1f227a763c None admin] PATH_INFO: `/v3/projects/13102e5eaf5043b29f66c69c428d3310/users/302cb774481c43d3ae047bf1cb095c54/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:17.765981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed2f0-6000-4618-8f5b-2f1f227a763c None admin] RBAC: Authorizing `identity:create_grant(project_id=13102e5eaf5043b29f66c69c428d3310, user_id=302cb774481c43d3ae047bf1cb095c54, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:17.767512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed2f0-6000-4618-8f5b-2f1f227a763c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:17.869624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 585/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:31:17 2022] PUT /identity/v3/projects/13102e5eaf5043b29f66c69c428d3310/users/302cb774481c43d3ae047bf1cb095c54/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:31:20.024621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2394d-eef2-4999-821d-79000c94ed9f None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:20.025119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2394d-eef2-4999-821d-79000c94ed9f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:20.025211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2394d-eef2-4999-821d-79000c94ed9f None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:20.026488 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 608/1193] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:31:20.031605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:20.031977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:20.032154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:20.050423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:31:20.051609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:31:20.116665 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 586/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:31:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:31:20.454301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2394d-eef2-4999-821d-79000c94ed9f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:20.510201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:20.554288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2394d-eef2-4999-821d-79000c94ed9f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:20.586368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:20.586976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:20.587294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:20.587569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:20.597878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:31:20.603187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:31:20.604307 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:31:20.605355 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 609/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:31:20.610334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:20.696676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:20.704914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb736-3523-4007-867d-33bc5237260d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:20.741510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:20.742111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:20.742388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:20.742704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:20.743390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:31:20.747817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:20.747817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:20.752765 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 587/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:20.758849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:20.854700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde01081-bc8a-486b-8fc5-99ce1b6797dc None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:20.868054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:20.887371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:20.887993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:20.888274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:20.888547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] PATH_INFO: `/v3/users/302cb774481c43d3ae047bf1cb095c54` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:20.889640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] RBAC: Authorizing `identity:get_user(user_id=302cb774481c43d3ae047bf1cb095c54)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:20.891085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:20.892682 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 610/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Sep 6 10:31:20 2022] GET /identity/v3/users/302cb774481c43d3ae047bf1cb095c54 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:20.899081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:20.995967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4481666-77ad-4caf-8251-9f37028a6357 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:21.028422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:21.029014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:21.029294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:21.029566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:21.052017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:21.094765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:21.096227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:21.189550 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 588/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:31:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:31:21.196093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:21.292921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80134766-a244-4b5c-9535-dc358dcd6017 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:21.329681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bdc12-981d-408d-b2ad-df0d73fbadaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:21.330295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bdc12-981d-408d-b2ad-df0d73fbadaa None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:21.330578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bdc12-981d-408d-b2ad-df0d73fbadaa None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:21.330851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bdc12-981d-408d-b2ad-df0d73fbadaa None admin] PATH_INFO: `/v3/projects/13102e5eaf5043b29f66c69c428d3310` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:21.332054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bdc12-981d-408d-b2ad-df0d73fbadaa None admin] RBAC: Authorizing `identity:get_project(project_id=13102e5eaf5043b29f66c69c428d3310)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:21.333550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bdc12-981d-408d-b2ad-df0d73fbadaa None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:21.335238 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 611/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Sep 6 10:31:21 2022] GET /identity/v3/projects/13102e5eaf5043b29f66c69c428d3310 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:21.341886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:31:21.395672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:21.437736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9360bd-e20e-4d84-a6d7-a72ce8b4552e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:31:21.470050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:31:21.470633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:31:21.470910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:31:21.471215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:31:21.471924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=13102e5eaf5043b29f66c69c428d3310, user.id=302cb774481c43d3ae047bf1cb095c54) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:31:21.472231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:31:21.473637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e924b80-13d2-4d99-93f3-0c7d6861c3b1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:31:21.479285 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 589/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:31:21 2022] GET /identity/v3/role_assignments?user.id=302cb774481c43d3ae047bf1cb095c54&scope.project.id=13102e5eaf5043b29f66c69c428d3310&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:31:31.325194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=75 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:31:31.476734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=41 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:41.112826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ce44-ee46-4f25-b75e-46d299a87640 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:41.113403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ce44-ee46-4f25-b75e-46d299a87640 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:41.113403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0ce44-ee46-4f25-b75e-46d299a87640 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:41.114947 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 612/1201] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:32:41.120727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:41.121137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:41.121268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:41.139369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:32:41.140542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:32:41.206670 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 590/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:32:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:32:41.544844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0ce44-ee46-4f25-b75e-46d299a87640 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:41.644979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0ce44-ee46-4f25-b75e-46d299a87640 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:41.677788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:41.678405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:41.679121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:41.679121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:41.689079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:41.690510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:41.704170 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:41.705351 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:41.706358 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:41.706358 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:41.706358 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:41.706358 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 613/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:41.711985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:41.807326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4556e-938b-498b-9048-58b4883c6a0d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:41.834667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:41.840322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:41.840918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:41.841194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:41.841463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:41.842096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:41.842397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:41.843805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791e6ca-76ac-4db8-83de-a86e85b07678 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:41.855205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 591/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:41.861314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:41.915630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:41.966407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5923eb-71d4-42c3-9eb0-9384823504b4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:42.004134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a13a66-db92-4fbb-9765-a6700950b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:42.004740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13a66-db92-4fbb-9765-a6700950b866 None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:42.005020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13a66-db92-4fbb-9765-a6700950b866 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:42.005292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13a66-db92-4fbb-9765-a6700950b866 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:42.006455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a13a66-db92-4fbb-9765-a6700950b866 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:42.007906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a13a66-db92-4fbb-9765-a6700950b866 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:42.063615 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 614/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Sep 6 10:32:41 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:32:44.280439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda841e-ceef-483b-b85b-cf01520245a0 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:44.280957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda841e-ceef-483b-b85b-cf01520245a0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:44.285682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda841e-ceef-483b-b85b-cf01520245a0 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:44.285682 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 592/1206] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:32:44.288199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:44.288641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:44.288753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:44.307371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:32:44.314376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:32:44.377655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 615/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:32:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:32:44.707038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda841e-ceef-483b-b85b-cf01520245a0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:44.808743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda841e-ceef-483b-b85b-cf01520245a0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:44.841632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:44.842246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:44.842529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:44.842804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:44.853890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:32:44.858650 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:44.859818 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:44.860867 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 593/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:32:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:44.866187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:44.905856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:44.964941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136a7cb-9c79-4d45-8a0a-f1a9b04ec1db None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:44.997070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:44.997664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:44.997947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:44.998221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:44.998869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:44.999203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:45.000571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:45.008849 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 616/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:32:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:45.014725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:45.065310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:45.114472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3428b3-0a44-4f19-8d4c-eafacf151d80 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:45.147408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:45.148026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:45.148308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:45.148581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:45.158627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:45.160181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:45.173862 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:45.174899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:45.175891 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:45.175891 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:45.175891 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:45.175891 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 594/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:45.180694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:45.277247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:45.280306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb645302-01e9-4488-b5ed-6e9f38824a60 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:45.312840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:45.313435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:45.313758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:45.314031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:45.314666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:45.314969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:45.316395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:45.328349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 617/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:45.334059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:45.434229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25826ece-acc3-4740-ae9d-4df423a586cc None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:45.435809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:45.467849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:45.468469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:45.468748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:45.469022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:45.476292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:45.477704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:32:45.488782 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:45.490667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:45.497010 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 595/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:45.497788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:45.598944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f955a-f2b5-4572-91ac-3ecfced201a5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:45.633207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:45.633789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:45.634178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:45.634457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:45.635207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:45.635514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:45.636937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:45.653627 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 618/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 6 10:32:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:45.659711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:45.758712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f874c66-1063-44d2-bb76-2ac676000111 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:45.791396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:45.792019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:45.792297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:45.792564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:45.821438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:45.860549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:45.861926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:45.964453 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 596/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:32:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:32:45.970390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:45.990110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:46.072053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da667f94-feb3-457c-a80b-711933d33cf5 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:46.105949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:46.106559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:46.106836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:46.107138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:46.117253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:46.118627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:46.134147 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:46.136998 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:46.138022 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:46.138022 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:46.138022 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:46.138022 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 619/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:46.142478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:46.202301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:46.250688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd890b-ed71-431b-903d-e64c9dd084a5 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:46.284519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:46.285121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:46.285400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:46.285673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:46.286313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:46.286618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:46.288569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:46.299552 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 597/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:46.305425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:46.372697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:46.402810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23ab3-d809-4819-ba30-8b5dcb272db1 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:46.435992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:46.436607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:46.436888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:46.437190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:46.444645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:46.446073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:32:46.457121 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:46.458069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:46.459988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 620/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:46.464723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:46.562479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de444c5-c4d9-4ab7-8bcb-c3864c5da253 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:46.585643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:46.597111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:46.597719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:46.597998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:46.598270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:46.598958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:46.599325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:46.600751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eab2d-d5ab-4217-b3f7-e6e179e68bc5 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:46.612312 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 598/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:46.618873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:46.717253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca244b-b356-4fab-be62-031eb13e1e52 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:46.745231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:46.750893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:46.751619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:46.751901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:46.752173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:46.752882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=d7fac79d1cad45f7b67ba2f8117899db) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:46.753232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:46.754643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f892-37c5-4807-89f4-a3ee94cf6903 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:46.760470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 621/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:32:46 2022] GET /identity/v3/role_assignments?user.id=d7fac79d1cad45f7b67ba2f8117899db&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:48.909752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7862-2267-4963-a10f-e10e6ded5ed7 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:48.910160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7862-2267-4963-a10f-e10e6ded5ed7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:48.910307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d7862-2267-4963-a10f-e10e6ded5ed7 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:48.912239 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 599/1220] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:32:48.917516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:48.917889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:48.918076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:48.936741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:32:48.937940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:32:49.006072 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 622/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:32:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:32:49.342809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7862-2267-4963-a10f-e10e6ded5ed7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:49.443637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d7862-2267-4963-a10f-e10e6ded5ed7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:49.478016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:49.478645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:49.478930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:49.479239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:49.489599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:32:49.494428 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:49.495552 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:49.496667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 600/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:32:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:49.501672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:49.599067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf2eda-c78f-4231-80df-cf7f099da3aa None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:49.621585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:49.632438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:49.633038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:49.633323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:49.633592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:49.634239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] RBAC: Adding query filter params (name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:49.634542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:49.635943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:49.643571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 623/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:32:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:49.649817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:49.694444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:49.749881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a6e7-915f-4240-be0b-6905a580bbe4 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:49.782098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:49.782705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:49.783033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:49.783308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:49.793316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:49.794743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:49.808811 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:49.809966 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:49.810874 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:49.810874 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:49.810874 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:49.810874 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 601/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:49.815686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:49.915353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db96f-1e65-4e93-ad75-5bad94fb2045 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:49.948925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:49.949527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:49.949807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:49.950086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:49.950717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:49.951046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:49.952458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:49.965051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 624/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:49.970682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:50.068640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:50.075141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bf95d-0009-46cf-babb-4a119d409ae1 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:50.108514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:50.109136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:50.109418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:50.109691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] PATH_INFO: `/v3/users/placement` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:50.118402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:50.119871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:32:50.130857 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:50.132005 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:50.133181 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 602/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:50.137911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:50.185531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:50.237158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4703f-213e-4e3e-b9fd-0fad83395d79 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:50.272023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:50.272624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:50.272899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:50.273168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:50.273878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:50.274181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:50.275634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:50.292436 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 625/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 6 10:32:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:32:50.298079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:50.396344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574404e-2783-41cf-9857-fb7c1909543b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:50.429554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:50.430165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:50.430445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:50.430717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:50.440939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:50.442335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:50.457047 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:50.460675 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:50.461802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:50.461802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:50.461802 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:50.461802 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 603/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:50.464394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:50.562170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23b754-5dc6-44bb-b23f-7412d4ff6ecb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:50.564474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:50.595333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:50.595941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:50.596225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:50.596501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:50.597137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:50.597517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:50.598821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:50.610830 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 626/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:50.617238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:50.627182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:50.715725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d552-e7bd-435b-a3e4-362b8f94c67f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:50.752388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:50.753020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:50.753304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:50.753579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:50.760257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:50.761702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:32:50.773192 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:50.774277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:50.775566 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 604/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:32:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:50.780191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:50.880035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c878ef3-1bb5-4b78-ad82-2433bca6d035 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:50.914134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:50.914733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:50.915030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:50.915309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:50.915978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:50.916282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:50.917744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff54528-2174-4c32-aa3c-8bf86e7f6b78 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:50.929799 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 627/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:50.943987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:51.011616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:51.044753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa151cc-4778-44f0-9b29-4ce97b088243 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:51.077507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e4999-241b-4c5b-9c55-1b7177d156cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:51.078150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e4999-241b-4c5b-9c55-1b7177d156cd None admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:51.078429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e4999-241b-4c5b-9c55-1b7177d156cd None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:51.078699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e4999-241b-4c5b-9c55-1b7177d156cd None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/d7fac79d1cad45f7b67ba2f8117899db/roles/50817f77002e4408861aa5a2837d4c46` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:51.092660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e4999-241b-4c5b-9c55-1b7177d156cd None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=d7fac79d1cad45f7b67ba2f8117899db, role_id=50817f77002e4408861aa5a2837d4c46)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:51.094098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e4999-241b-4c5b-9c55-1b7177d156cd None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:51.320585 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 605/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:32:50 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/d7fac79d1cad45f7b67ba2f8117899db/roles/50817f77002e4408861aa5a2837d4c46 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:32:53.467129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec3f9-ada4-41c9-8550-ef28fa6e657d None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:53.467679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec3f9-ada4-41c9-8550-ef28fa6e657d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:53.467679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec3f9-ada4-41c9-8550-ef28fa6e657d None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:53.501868 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 628/1233] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:32:53.501963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:53.501963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:53.501963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:53.501963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:32:53.501963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:32:53.564495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 606/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:32:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:32:53.894401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ec3f9-ada4-41c9-8550-ef28fa6e657d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:53.920873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:53.997074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ec3f9-ada4-41c9-8550-ef28fa6e657d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.029053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.029667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.029945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.030218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:54.040618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:32:54.045285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:54.046326 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:54.047612 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 629/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Sep 6 10:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:54.053134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:54.098298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:54.148549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d3ef-9be0-4eed-bfb4-c53cad90d396 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.183587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.184188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.184466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.184736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:54.185401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] RBAC: Adding query filter params (name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:54.185736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:54.187120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:54.194695 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 607/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Sep 6 10:32:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:54.200741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:54.285749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:54.301772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841084e4-b700-4f81-b8eb-685a54ae1624 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.334466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.335110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.335396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.335670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:54.345330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:54.346877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:54.361529 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:54.362536 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:54.363576 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:54.363576 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:54.363576 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:54.363576 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 630/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:54.368843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:54.467864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94238c7c-40eb-48a9-8a05-06615715c80b None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.476955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:54.502781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.503471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.503688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.503970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:54.504607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:54.504918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:54.506311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:54.517671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 608/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:54.524005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:54.624054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07071c-333c-4c7e-a14b-9df5ac4e9fe0 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.658512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.659168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.659446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.659716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] PATH_INFO: `/v3/users/placement` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:54.662374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:54.667842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:54.669298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:32:54.680313 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:54.681815 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:54.682900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 631/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:54.687356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:54.785810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0717c6-b91c-4370-8c83-182f5d4bac4f None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.819210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.819813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.820093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.820367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:54.821088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:54.821396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:54.822853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:54.841211 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 609/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 6 10:32:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:54.846930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:54.947299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d2daf-54c7-4a11-bcce-96d772c87abb None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:54.979875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:54.980472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:54.980757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:54.981030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:55.041964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:55.048127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:55.049643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:55.146682 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 632/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:32:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:32:55.152486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:55.179967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:55.250623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117cca9-0b0f-4aa5-b673-63bb40abea96 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:55.284399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:55.285064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:55.285346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:55.285618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:55.297289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:55.298685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:55.313501 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:55.314592 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:55.315611 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:55.315611 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:55.315611 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:55.315611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 610/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:55.321051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:55.412160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:55.417681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9878ae-c41c-412e-956a-c9b96aa5063f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:55.450189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:55.450788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:55.451100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:55.451379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:55.452022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:55.452326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:55.453690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:55.464539 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 633/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:55.470172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:55.548208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:55.569070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bd530-b349-4531-a759-2a2e505ca368 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:55.601368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:55.601987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:55.602278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:55.602553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:55.609174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:55.610604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:32:55.622509 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:55.623532 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:32:55.624854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 611/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:32:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:55.629487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:55.729326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52e175-99da-4be4-bfb5-793257ad80e4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:55.762238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:55.762867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:55.763183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:55.763462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:55.764142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:55.764452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:55.765884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa751d-92d7-4775-8e0c-be00411d5a77 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:55.778146 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 634/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:32:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:55.784200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:55.883443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d7b2-ec79-40f9-ac79-1e30de1df358 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:55.917898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:55.918501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:55.918782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:55.919153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:55.919878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] RBAC: Adding query filter params (role.id=50817f77002e4408861aa5a2837d4c46, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=d7fac79d1cad45f7b67ba2f8117899db) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:55.920189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:55.921772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d65e6a-9984-4003-a259-2f034151b0e4 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:55.927557 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 612/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:32:55 2022] GET /identity/v3/role_assignments?user.id=d7fac79d1cad45f7b67ba2f8117899db&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=50817f77002e4408861aa5a2837d4c46 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:58.166618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606275-aeca-4f4f-b3d4-ef0025662957 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:58.167495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606275-aeca-4f4f-b3d4-ef0025662957 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:58.167495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606275-aeca-4f4f-b3d4-ef0025662957 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:58.169002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 635/1247] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:32:58.174153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:58.174667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:58.174771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:58.181614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:58.194177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:32:58.195423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:32:58.261218 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 613/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:32:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:32:58.592341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606275-aeca-4f4f-b3d4-ef0025662957 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:58.610953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:58.694629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606275-aeca-4f4f-b3d4-ef0025662957 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:58.728489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:58.729108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:58.729389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:58.729659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:58.739947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:32:58.744783 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:58.745872 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:58.746772 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 636/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:32:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:58.751932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:58.848062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a501c-bd38-4479-a7f3-e453da9ebe2f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:58.877890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:58.882961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:58.883601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:58.883888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:58.884168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:58.884835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:58.885146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:58.886542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:58.894674 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 614/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:32:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:58.901174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:58.979615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:59.002935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c49331-bfca-42cd-a58a-9075f4053b15 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:59.036881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:59.037521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:59.037833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:59.038134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:59.050430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:59.052078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:32:59.066461 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:59.067636 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:32:59.068920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:32:59.068920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:32:59.068920 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:59.068920 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 637/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:59.073503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:59.172474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5953-8cbd-4492-8a4d-e55f3b2fdc2a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:59.206031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:59.206684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:59.206908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:59.207217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:59.207857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:59.208793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:59.210157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:59.221648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 615/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:59.227533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:59.353899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece51dd-703e-4bd8-a618-11284188bc63 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:59.386484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:59.396424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:59.397056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:59.397339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:59.397613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:59.405225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:59.406665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:32:59.417683 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:32:59.418833 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:32:59.419813 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 638/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:32:59.424790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:59.481456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:59.525892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0f052-31f0-4f14-8a7c-e16fd6a58dd3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:59.559160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:59.559763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:59.560047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:59.560324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:59.561111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:32:59.561427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:59.562847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:59.581742 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 616/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 6 10:32:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:32:59.587924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:32:59.695078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4ed7-326c-4b13-90e8-0f2a8fd840e3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:32:59.727696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:32:59.728339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:32:59.728616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:32:59.728888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:32:59.783613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:32:59.795825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:32:59.797271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:32:59.894138 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 639/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:32:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:32:59.900012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:00.001638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9891-5559-4eee-a528-3c2979af5573 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:00.014477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:00.035377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:00.036000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:00.036784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:00.037050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:00.047123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:00.050629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:33:00.063488 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:00.064598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:33:00.065538 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:33:00.065538 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:00.065538 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:00.065538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 617/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:33:00.070357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:00.156092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:00.168291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d61c-b074-4718-b822-6abef4667f96 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:00.202732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:00.203350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:00.203628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:00.203897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:00.204523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:00.204875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:00.206556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:00.218817 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 640/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:00.225209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:00.322762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1582-a07b-4147-aa3c-983ebe997c1a None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:00.355722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:00.356338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:00.356622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:00.356897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:00.363329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:00.365023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:33:00.376809 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:00.387244 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:00.388322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 618/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:00.388918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:00.482961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bb9a1-d90e-4ab5-a194-687997ef2e73 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:00.516228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:00.516882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:00.517171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:00.517448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:00.518188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:00.518496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:00.519962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86815-c76a-4479-b263-369d0a692411 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:00.534203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 641/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:00.540836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:00.565786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:00.639941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993b80f-6189-49b8-99ce-46cc8d0b7e79 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:00.673338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:00.673936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:00.674211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:00.674485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:00.675228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=d7fac79d1cad45f7b67ba2f8117899db) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:00.675540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:00.676984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccd8cc-7eef-4c52-aa0c-f05e6c04720b None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:00.682186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 619/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:33:00 2022] GET /identity/v3/role_assignments?user.id=d7fac79d1cad45f7b67ba2f8117899db&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:02.865950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52712a5-5153-4cb6-a8a6-4a1cf56b78be None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:02.866476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52712a5-5153-4cb6-a8a6-4a1cf56b78be None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:02.866476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52712a5-5153-4cb6-a8a6-4a1cf56b78be None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:02.867897 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 642/1261] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:33:02.872995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:02.873395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:02.873543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:02.892247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:33:02.893436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:33:02.959638 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 620/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:33:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 10:33:03.292830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52712a5-5153-4cb6-a8a6-4a1cf56b78be None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:03.304190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:03.391484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52712a5-5153-4cb6-a8a6-4a1cf56b78be None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:03.423830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:03.424454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:03.424737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:03.425011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:03.435733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:33:03.440472 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:03.441573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:03.443342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 643/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:33:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:03.448355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:03.466588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:03.546501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef37dc-b73d-4ef9-b106-fa133fbac617 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:03.581897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:03.582493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:03.582775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:03.583076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:03.583740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:03.584044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:03.585402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:03.593260 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 621/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:03.599733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:03.665914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:03.700690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a88e-0ac4-4d32-948d-52c8c84cc997 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:03.733526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:03.734149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:03.734431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:03.734735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:03.745806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:03.748953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:33:03.761282 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:03.762261 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:33:03.763187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:33:03.763187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:03.763187 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:03.763187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 644/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:03.768516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:03.847760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:03.867508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1653d-ddd1-48b9-99a1-335750ebd004 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:03.900298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:03.900912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:03.901202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:03.901477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:03.902161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:03.902420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:03.903833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:03.919990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 622/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:03.926043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.025030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ce85-9811-4e7c-bf62-f0a4a16bfcb4 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:04.044536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:04.058481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:04.059141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:04.059425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:04.059698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:04.067031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:04.068491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:33:04.079285 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:04.080394 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:04.081380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 645/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:33:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:04.086672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.182923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ef827-9071-4b45-874f-33d56880b2ea None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:04.216718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:04.217319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:04.217607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:04.217880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:04.218605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:04.218913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:04.220362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:04.229474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:04.238340 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 623/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 6 10:33:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:04.244329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.344692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f03562-0b52-4720-9c67-0aa48ef0efd3 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:04.378146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:04.378767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:04.379078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:04.379354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:04.390113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:04.391591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:33:04.406013 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:04.407106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:33:04.408008 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:33:04.408008 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:04.408008 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:04.408008 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 646/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:04.412889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.512224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911850d-27b5-4fe2-be82-910d17bf0fda None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:04.545218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:04.545817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:04.546095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:04.546363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:04.546994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:04.547333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:04.548690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:04.559960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 624/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:04.565685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.597769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:04.665615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ed536-8664-4ac9-93e2-cd7fc75ed33b None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:04.698341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:04.698967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:04.699327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:04.699606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:04.706083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:04.707563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:33:04.719396 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:04.720469 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:04.721590 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 647/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:04.726335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.784334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:04.825548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e58be-60de-455b-98cc-2e54a72335a2 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:04.857847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:04.858446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:04.858730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:04.859028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:04.859726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:04.860127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:04.861512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802b08c-d7b0-4c92-95c8-cc898bc10b00 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:04.874434 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 625/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:04.881182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:04.972845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:04.981347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c24e1-65df-4c54-a952-fb7c7d2df432 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:05.014384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4ec1-0dee-4695-8516-ef0e83bdc13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:05.015055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4ec1-0dee-4695-8516-ef0e83bdc13d None admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:05.015341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4ec1-0dee-4695-8516-ef0e83bdc13d None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:05.015615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4ec1-0dee-4695-8516-ef0e83bdc13d None admin] PATH_INFO: `/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/d7fac79d1cad45f7b67ba2f8117899db/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:05.017507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a4ec1-0dee-4695-8516-ef0e83bdc13d None admin] RBAC: Authorizing `identity:create_grant(project_id=bd4e815d95a246d5ab51c3c2719e5df8, user_id=d7fac79d1cad45f7b67ba2f8117899db, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:05.018944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a4ec1-0dee-4695-8516-ef0e83bdc13d None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:05.188110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 648/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Sep 6 10:33:04 2022] PUT /identity/v3/projects/bd4e815d95a246d5ab51c3c2719e5df8/users/d7fac79d1cad45f7b67ba2f8117899db/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:33:07.380864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf63cb-d34c-47c9-b0d0-3629e3a35420 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:07.381409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf63cb-d34c-47c9-b0d0-3629e3a35420 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:07.381409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf63cb-d34c-47c9-b0d0-3629e3a35420 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:07.382785 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 626/1274] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:33:07.388064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:07.388516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:07.388636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:07.407579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:33:07.408907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:33:07.475226 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 649/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:33:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:33:07.811234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf63cb-d34c-47c9-b0d0-3629e3a35420 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:07.913179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf63cb-d34c-47c9-b0d0-3629e3a35420 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:07.930780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:07.947688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:07.948300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:07.948580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:07.948854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:07.958591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 10:33:07.963324 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:07.969520 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:07.970364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 627/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Sep 6 10:33:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:07.971085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:08.056785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:08.089448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56423e-2ae6-4a9e-adf5-71dc017e83a2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:08.138005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:08.138610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:08.138894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:08.139196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:08.139848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:08.140276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:08.141649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:08.149551 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 650/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Sep 6 10:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:08.155559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:08.255537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceea85-5661-47b2-974d-3dbce659028e None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:08.289981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:08.290599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:08.290904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:08.291212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:08.301209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:08.303345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:33:08.326181 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:08.332277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:33:08.333549 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:33:08.333549 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:08.333549 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:08.333549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 628/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:08.333839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:08.437035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0acb-1ee1-4ad4-8664-badf1db2a58e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:08.472297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:08.472919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:08.473199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:08.474073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:08.474724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:08.475050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:08.476409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:08.487686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 651/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:08.493749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:08.525954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:08.594596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05745ff-76cb-4470-83ba-de0296750832 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:08.627490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:08.628100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:08.628378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:08.628645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:08.636062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:08.637474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 10:33:08.649004 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:08.650136 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:08.651141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 629/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:33:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:08.656105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:08.659987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:08.763124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d12e3-22f5-438a-91ae-5522afdd05b7 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:08.800671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:08.801292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:08.801651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:08.801927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:08.802672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:08.803057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:08.804495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:08.824055 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 652/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Sep 6 10:33:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:08.829794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:08.934836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:08.946080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670779-cd98-4d87-81b6-c84cfdf4d421 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:08.981675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:08.982292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:08.982571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:08.982841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:09.055184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:09.056748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:09.148548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:09.160469 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 630/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Sep 6 10:33:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 10:33:09.166670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:09.229072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:09.267094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa715b-ba39-407b-ae89-9b290c04345e None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:09.300110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:09.300734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:09.301018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:09.301295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:09.315636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:09.315636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 10:33:09.327918 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:09.329036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 10:33:09.329973 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:33:09.329973 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 10:33:09.329973 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:09.329973 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 653/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:09.334859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:09.431990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad156be1-8f82-4db0-8e21-65ea5a364512 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:09.465385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:09.465988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:09.466271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:09.466544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:09.467211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:09.467519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:09.468884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:09.479841 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 631/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Sep 6 10:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:09.485813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:09.585047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b625f8-45a6-40bf-8893-0a7aeb4a1c8f None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:09.599758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:09.619748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:09.620370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:09.620652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:09.620926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:09.627382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:09.628855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 10:33:09.639838 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:09.641009 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:33:09.642083 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 654/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Sep 6 10:33:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 10:33:09.647067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:09.697085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:09.746869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e08e52-cd9c-4bd6-b7dc-e739f5d8cbc9 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:09.780139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:09.780733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:09.781015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:09.781293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:09.781997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:09.782307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:09.783763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53de4-8b06-471d-9c33-1722a4d15b48 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:09.796656 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 632/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Sep 6 10:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:09.803501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:09.903162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb795b2-8b6c-468d-84bb-ec2b09abcc10 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:09.939372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:09.939977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:09.940302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:09.940580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:09.941298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] RBAC: Adding query filter params (role.id=46571a7e08c246cc9af7ce6c064eecdb, scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8, user.id=d7fac79d1cad45f7b67ba2f8117899db) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:09.941610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:09.943085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26608-73fc-4764-ad76-88599b981d20 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:09.948671 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 655/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Sep 6 10:33:09 2022] GET /identity/v3/role_assignments?user.id=d7fac79d1cad45f7b67ba2f8117899db&scope.project.id=bd4e815d95a246d5ab51c3c2719e5df8&role.id=46571a7e08c246cc9af7ce6c064eecdb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:12.157066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445d28-bc59-426d-ad66-aa8543649823 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:12.157687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445d28-bc59-426d-ad66-aa8543649823 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:12.157687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445d28-bc59-426d-ad66-aa8543649823 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:12.158996 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 633/1288] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:33:12.164109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:12.164597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:12.164707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:12.182273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:33:12.183481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:33:12.212603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:12.253744 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 656/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:33:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:33:12.584281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c445d28-bc59-426d-ad66-aa8543649823 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:12.684016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c445d28-bc59-426d-ad66-aa8543649823 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:12.694354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:12.717120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:12.717858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:12.718137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:12.718407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:12.718977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:12.720352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:12.730027 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:12.734037 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:12.735118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 634/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:33:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:12.737196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:12.841155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11b315-da7f-4b5f-a7e0-2d0b17861340 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:12.874785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:12.875410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:12.875690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:12.875959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:12.876667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:12.876968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:12.878333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a1077-736c-40b8-bb71-8b0b8daa8037 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:12.883202 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 657/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 6 10:33:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:12.888996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:12.988355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fb96d-c5a3-477c-b267-619597ce2312 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:13.020903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:13.021533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:13.022305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:13.022577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:13.023232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:13.023540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:13.024901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed41bf1-29b1-4135-b7e3-3228471292a6 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:13.029209 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 635/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 6 10:33:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:15.197775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128eecf-f852-4cfc-b369-260cfef959df None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:15.198320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128eecf-f852-4cfc-b369-260cfef959df None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:15.198320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128eecf-f852-4cfc-b369-260cfef959df None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:15.199618 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 658/1293] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:33:15.204638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327199-34a9-40f1-8504-a15cf9c36d01 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:15.205019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327199-34a9-40f1-8504-a15cf9c36d01 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:15.205192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327199-34a9-40f1-8504-a15cf9c36d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:15.223357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-69327199-34a9-40f1-8504-a15cf9c36d01 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:33:15.224585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-69327199-34a9-40f1-8504-a15cf9c36d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:33:15.255038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:15.291271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 636/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:33:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:33:15.622022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128eecf-f852-4cfc-b369-260cfef959df None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:15.652584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:15.720684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128eecf-f852-4cfc-b369-260cfef959df None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:15.755456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f200b-8107-4af8-95ff-b605eef7a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:15.756079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f200b-8107-4af8-95ff-b605eef7a30b None admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:15.756364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f200b-8107-4af8-95ff-b605eef7a30b None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:15.756641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f200b-8107-4af8-95ff-b605eef7a30b None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:15.757294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f200b-8107-4af8-95ff-b605eef7a30b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:15.758683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f200b-8107-4af8-95ff-b605eef7a30b None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:15.845702 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 659/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Sep 6 10:33:15 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:33:18.053579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9a8b1-adcf-4218-ab32-ff23724cb0cc None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:18.054099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9a8b1-adcf-4218-ab32-ff23724cb0cc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:18.054195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9a8b1-adcf-4218-ab32-ff23724cb0cc None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:18.055538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 637/1296] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:33:18.060570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:18.067814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:18.067814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:18.079790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:33:18.080972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:33:18.157229 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 660/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:33:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:33:18.491321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9a8b1-adcf-4218-ab32-ff23724cb0cc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:18.590584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9a8b1-adcf-4218-ab32-ff23724cb0cc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:18.624497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:18.625118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:18.625399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:18.625669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] PATH_INFO: `/v3/services/placement` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:18.626247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:18.627648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:18.636425 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:18.637612 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:18.638654 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 638/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:33:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:18.643791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:18.663045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:18.742803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b566-f285-4670-a7a7-7c9fca283c33 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:18.775398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:18.775997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:18.776272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:18.776541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:18.777159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:18.777458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:18.778845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:18.783952 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 661/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 6 10:33:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:18.790172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:18.821538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:18.887708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914e748-6880-43d2-a3ab-be865f725faf None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:18.922105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:18.922744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:18.923099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:18.928322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:18.928322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] RBAC: Adding query filter params (interface=public, service_id=1f5805abcb1f405e84327598494ef163, region_id=RegionOne) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:18.928322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:18.928322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801195d0-26ce-488a-a481-1169e1d22e0c None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:18.931227 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 639/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Sep 6 10:33:18 2022] GET /identity/v3/endpoints?service_id=1f5805abcb1f405e84327598494ef163&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:18.937181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:19.018098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:19.035996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3909a-bec3-481f-9d8c-c623daa80305 None admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:19.068819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0c28f-a13f-4e98-9008-13e9419fabe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:19.069418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0c28f-a13f-4e98-9008-13e9419fabe2 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:19.069701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0c28f-a13f-4e98-9008-13e9419fabe2 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:19.069975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0c28f-a13f-4e98-9008-13e9419fabe2 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:19.070572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0c28f-a13f-4e98-9008-13e9419fabe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:19.072004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0c28f-a13f-4e98-9008-13e9419fabe2 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:19.078481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 662/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Sep 6 10:33:18 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:33:21.262756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167be322-ca79-4676-be37-f8f27cf3379d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:21.263301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167be322-ca79-4676-be37-f8f27cf3379d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:21.263301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167be322-ca79-4676-be37-f8f27cf3379d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:21.264659 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 640/1302] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:33:21.270126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:21.273477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:21.273477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:21.288556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:33:21.289762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:33:21.355190 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 663/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:33:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 10:33:21.687845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167be322-ca79-4676-be37-f8f27cf3379d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:21.803727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:21.810178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167be322-ca79-4676-be37-f8f27cf3379d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:21.841819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:21.842433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:21.842711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:21.842980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:21.843580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:21.844970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:33:21.853926 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:33:21.855163 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:33:21.856116 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 641/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Sep 6 10:33:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 10:33:21.861101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:21.937745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:21.960289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701eb2-4afb-4195-8f57-4f2c36e68bb1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:21.993779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:21.994381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:21.994663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:21.994938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:21.995632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:33:21.995934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:21.997445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08bef8-c2cf-4ba3-b736-a4835ac88ad3 None admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:22.002378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 664/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Sep 6 10:33:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:33:22.008338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:33:22.106713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7b036-49c7-49ed-84de-232b8c07c9b3 None admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:33:22.139890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eacf5-d153-4a23-aa7e-859982113583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:33:22.140493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eacf5-d153-4a23-aa7e-859982113583 None admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:33:22.140777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eacf5-d153-4a23-aa7e-859982113583 None admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:33:22.141053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eacf5-d153-4a23-aa7e-859982113583 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:33:22.141759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eacf5-d153-4a23-aa7e-859982113583 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:33:22.143145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eacf5-d153-4a23-aa7e-859982113583 None admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:33:22.228189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 642/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:33:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:33:31.999475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=30 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:33:32.222914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:37.102625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ab39-d01d-427e-81e7-a8a6018d3e38 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:37.103699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ab39-d01d-427e-81e7-a8a6018d3e38 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:37.104202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ab39-d01d-427e-81e7-a8a6018d3e38 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:37.107503 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 665/1307] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:37.112334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917cbb5-6613-40bd-93fa-2dcfd2df5c3e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:37.112793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917cbb5-6613-40bd-93fa-2dcfd2df5c3e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:37.113134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917cbb5-6613-40bd-93fa-2dcfd2df5c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:37.200513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4917cbb5-6613-40bd-93fa-2dcfd2df5c3e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:37.201652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4917cbb5-6613-40bd-93fa-2dcfd2df5c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:37.339560 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 643/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:37.701978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11cb5-c03f-4f76-9f21-a806968afcc3 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:37.702702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11cb5-c03f-4f76-9f21-a806968afcc3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:37.703455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11cb5-c03f-4f76-9f21-a806968afcc3 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:37.705999 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 666/1309] 10.222.0.20 () {54 vars in 965 bytes} [Tue Sep 6 10:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:37.712749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7a72-1940-4356-81bd-a584a23b253b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:37.713411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7a72-1940-4356-81bd-a584a23b253b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:37.714007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f7a72-1940-4356-81bd-a584a23b253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:37.854068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b5f7a72-1940-4356-81bd-a584a23b253b None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:37.855639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b5f7a72-1940-4356-81bd-a584a23b253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:37.895195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:37.997201 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 644/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 6 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:37.998111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b11cb5-c03f-4f76-9f21-a806968afcc3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:37.999970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-59b11cb5-c03f-4f76-9f21-a806968afcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:38.124816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b11cb5-c03f-4f76-9f21-a806968afcc3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:38.214433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:38.215450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:38.215914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:38.216384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:38.218150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:38.282415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:38.343060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:38.344693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094a809-8aa8-491e-94d2-c89fcc93138a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:38.365035 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 667/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:39:40.914490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb235-ec3f-463b-82e2-4b18db51fca0 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:40.914903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb235-ec3f-463b-82e2-4b18db51fca0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:40.915077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb235-ec3f-463b-82e2-4b18db51fca0 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:40.916452 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 645/1312] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:40.921812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6498-a368-40a5-9553-5dd32fbe4eb4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:40.922225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6498-a368-40a5-9553-5dd32fbe4eb4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:40.922386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6498-a368-40a5-9553-5dd32fbe4eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:40.993340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6faf6498-a368-40a5-9553-5dd32fbe4eb4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:40.994456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6faf6498-a368-40a5-9553-5dd32fbe4eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:41.091290 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 668/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:41.448625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb235-ec3f-463b-82e2-4b18db51fca0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:41.450204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01bcb235-ec3f-463b-82e2-4b18db51fca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:41.556186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb235-ec3f-463b-82e2-4b18db51fca0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:41.630346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:41.633333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:41.634327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:41.634611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:41.635057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:41.636670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:41.749334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:41.750720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04b96-a08d-4ce5-b505-177bc86e606b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:41.769718 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 646/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:39:44.398784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cc21-0a8f-4206-94a8-e76068971550 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:44.399363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cc21-0a8f-4206-94a8-e76068971550 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:44.399363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cc21-0a8f-4206-94a8-e76068971550 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:44.400748 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 669/1315] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:44.406041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd037a7-6cb0-4193-9ab3-39c840e19b91 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:44.406471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd037a7-6cb0-4193-9ab3-39c840e19b91 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:44.406602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd037a7-6cb0-4193-9ab3-39c840e19b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:44.471948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4fd037a7-6cb0-4193-9ab3-39c840e19b91 None None] MFA Rules not processed for user `81a0409391cd41d29788abb688691db1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:44.473165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4fd037a7-6cb0-4193-9ab3-39c840e19b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:44.523985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:44.568611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 647/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:44.914625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cc21-0a8f-4206-94a8-e76068971550 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:44.916214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ce38cc21-0a8f-4206-94a8-e76068971550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:44.926516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:45.019100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cc21-0a8f-4206-94a8-e76068971550 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:45.090586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:45.091212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:45.091497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:45.091772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:45.093380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:45.155091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:45.201926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:45.203334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff2b0d-fc86-4026-a50e-2cda22d8d752 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:45.223060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 670/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:39:48.145353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf704be0-e7f8-446e-b4b7-0e42f03a419a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:48.145881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf704be0-e7f8-446e-b4b7-0e42f03a419a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:48.145978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf704be0-e7f8-446e-b4b7-0e42f03a419a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:48.147342 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 648/1318] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:48.152612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b184-9c95-4a41-9f71-e00c6dbe6e31 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:48.153053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b184-9c95-4a41-9f71-e00c6dbe6e31 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:48.153151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b184-9c95-4a41-9f71-e00c6dbe6e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:48.217366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1317b184-9c95-4a41-9f71-e00c6dbe6e31 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:48.218498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1317b184-9c95-4a41-9f71-e00c6dbe6e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:48.311927 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 671/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:48.671926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c43396-a60b-4d6c-9a32-353df920cb20 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:48.672267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c43396-a60b-4d6c-9a32-353df920cb20 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:48.672549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c43396-a60b-4d6c-9a32-353df920cb20 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:48.673898 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 649/1320] 10.222.0.20 () {54 vars in 965 bytes} [Tue Sep 6 10:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:48.679832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751d9d-7b1b-406c-9c70-bcb8ac4c02a7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:48.684535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751d9d-7b1b-406c-9c70-bcb8ac4c02a7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:48.684535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751d9d-7b1b-406c-9c70-bcb8ac4c02a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:48.701824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:48.755747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f6751d9d-7b1b-406c-9c70-bcb8ac4c02a7 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:48.756955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f6751d9d-7b1b-406c-9c70-bcb8ac4c02a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:48.832497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 672/1321] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 6 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:39:48.841471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c43396-a60b-4d6c-9a32-353df920cb20 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:48.843046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-47c43396-a60b-4d6c-9a32-353df920cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:48.958811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c43396-a60b-4d6c-9a32-353df920cb20 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:49.031799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:49.032399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:49.032678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:49.032955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:49.034539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:49.041810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:49.141552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:49.142997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d80c1-30ac-416a-9bd2-8b6753910a87 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:49.165385 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 650/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:39:52.721211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89acc-d77c-41a2-af21-f4b091f57d53 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:52.721779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89acc-d77c-41a2-af21-f4b091f57d53 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:52.721779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a89acc-d77c-41a2-af21-f4b091f57d53 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:52.723130 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 673/1323] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:39:52.728492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3066-d8a9-48dd-9323-8a53792637d5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:52.728898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3066-d8a9-48dd-9323-8a53792637d5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:52.729181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3066-d8a9-48dd-9323-8a53792637d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:52.796506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ba4b3066-d8a9-48dd-9323-8a53792637d5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:52.798368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba4b3066-d8a9-48dd-9323-8a53792637d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:52.858853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:52.899158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 651/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:53.257600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a89acc-d77c-41a2-af21-f4b091f57d53 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:53.259156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28a89acc-d77c-41a2-af21-f4b091f57d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:53.361788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a89acc-d77c-41a2-af21-f4b091f57d53 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:53.374117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:53.436886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:53.438015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:53.438298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:53.438572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:53.440297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:53.557432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:53.558893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0df3e-494d-4c11-901a-bc5a37eca371 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:53.581462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 674/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:39:55.825387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af5193-2c94-40d8-bcb0-ed2dceb76c7b None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:55.825978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af5193-2c94-40d8-bcb0-ed2dceb76c7b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:55.825978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af5193-2c94-40d8-bcb0-ed2dceb76c7b None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:55.827331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 652/1326] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:55.832608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac26af-5fad-4425-b80f-3ccb0ff811f8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:55.833068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac26af-5fad-4425-b80f-3ccb0ff811f8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:55.833182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac26af-5fad-4425-b80f-3ccb0ff811f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:55.886704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:55.905325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5aac26af-5fad-4425-b80f-3ccb0ff811f8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:55.907227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5aac26af-5fad-4425-b80f-3ccb0ff811f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:56.007635 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 675/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:56.351734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af5193-2c94-40d8-bcb0-ed2dceb76c7b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:56.353366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a2af5193-2c94-40d8-bcb0-ed2dceb76c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:56.456644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af5193-2c94-40d8-bcb0-ed2dceb76c7b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:56.530594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:56.531234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:56.531524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:56.531794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:56.533402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:56.550601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:56.642775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:56.644206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea5be9-e27c-4230-a912-ffb9fe94a7f7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:56.662401 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 653/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:39:58.900108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4e06-b5b3-470d-952b-0d0dccd81af6 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:58.900666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4e06-b5b3-470d-952b-0d0dccd81af6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:58.900775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae4e06-b5b3-470d-952b-0d0dccd81af6 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:58.902156 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 676/1329] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:39:58.907968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151fc6-fdd7-4cfe-b457-a50ce7aaaea8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:58.908391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151fc6-fdd7-4cfe-b457-a50ce7aaaea8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:58.908534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151fc6-fdd7-4cfe-b457-a50ce7aaaea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:58.975298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-08151fc6-fdd7-4cfe-b457-a50ce7aaaea8 None None] MFA Rules not processed for user `81a0409391cd41d29788abb688691db1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:39:58.976520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-08151fc6-fdd7-4cfe-b457-a50ce7aaaea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:59.042088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:59.073129 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 654/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:39:59.420224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae4e06-b5b3-470d-952b-0d0dccd81af6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:39:59.421762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d4ae4e06-b5b3-470d-952b-0d0dccd81af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:59.529059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae4e06-b5b3-470d-952b-0d0dccd81af6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:39:59.548618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:39:59.602506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:39:59.603053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:39:59.603339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:39:59.603612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:39:59.605200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:39:59.714967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:39:59.716430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a343bb4-09a0-41f4-8242-a750f6d0233c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:39:59.735252 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 677/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:02.337652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22fc9-78e9-43c0-90dc-c3551da9b5f2 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:02.338217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22fc9-78e9-43c0-90dc-c3551da9b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:02.338217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22fc9-78e9-43c0-90dc-c3551da9b5f2 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:02.340607 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 655/1332] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:02.346494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c8442-5aff-4eb9-9044-8be3339b2d5a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:02.347055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c8442-5aff-4eb9-9044-8be3339b2d5a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:02.347152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c8442-5aff-4eb9-9044-8be3339b2d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:02.420928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:02.423583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-462c8442-5aff-4eb9-9044-8be3339b2d5a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:02.424828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-462c8442-5aff-4eb9-9044-8be3339b2d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:02.523421 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 678/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:02.877792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd22fc9-78e9-43c0-90dc-c3551da9b5f2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:02.879610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9fd22fc9-78e9-43c0-90dc-c3551da9b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:02.983622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd22fc9-78e9-43c0-90dc-c3551da9b5f2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:03.056436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a328b-2743-418f-965a-820660573e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:03.057038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a328b-2743-418f-965a-820660573e82 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:03.057319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a328b-2743-418f-965a-820660573e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:03.057591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a328b-2743-418f-965a-820660573e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:03.059207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-074a328b-2743-418f-965a-820660573e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:03.086993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:03.169192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a328b-2743-418f-965a-820660573e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:03.170560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a328b-2743-418f-965a-820660573e82 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:03.189079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 656/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:05.436126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05532658-0275-409f-bc21-9ea192f420b8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:05.437208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05532658-0275-409f-bc21-9ea192f420b8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:05.437208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05532658-0275-409f-bc21-9ea192f420b8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:05.438526 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 679/1335] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:05.443984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9409-d9c7-4ba8-b75a-2a2b2a02630a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:05.444445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9409-d9c7-4ba8-b75a-2a2b2a02630a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:05.444554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9409-d9c7-4ba8-b75a-2a2b2a02630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:05.511719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5a0e9409-d9c7-4ba8-b75a-2a2b2a02630a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:05.512971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5a0e9409-d9c7-4ba8-b75a-2a2b2a02630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:05.594179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:05.617081 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 657/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:05.959937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05532658-0275-409f-bc21-9ea192f420b8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:05.961497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-05532658-0275-409f-bc21-9ea192f420b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:06.064069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05532658-0275-409f-bc21-9ea192f420b8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:06.091629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:06.136953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:06.137548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:06.137824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:06.138154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:06.139756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:06.247496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:06.250947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d16434-575b-43a0-8b3c-4d897a43143c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:06.268092 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 680/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:08.991945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd950bd-ec54-41f5-b1be-4303f6e156fc None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:08.992488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd950bd-ec54-41f5-b1be-4303f6e156fc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:08.992488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd950bd-ec54-41f5-b1be-4303f6e156fc None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:08.993861 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 658/1338] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:08.998966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faadb65-4ca2-4bac-87d0-c58f453f23cb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:08.999469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faadb65-4ca2-4bac-87d0-c58f453f23cb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:08.999566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faadb65-4ca2-4bac-87d0-c58f453f23cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:09.064183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3faadb65-4ca2-4bac-87d0-c58f453f23cb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:09.065376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3faadb65-4ca2-4bac-87d0-c58f453f23cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:09.073512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:09.160374 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 681/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:09.506062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd950bd-ec54-41f5-b1be-4303f6e156fc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:09.507655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5fd950bd-ec54-41f5-b1be-4303f6e156fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:09.618911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd950bd-ec54-41f5-b1be-4303f6e156fc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:09.691677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:09.692311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:09.692659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:09.692965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:09.694668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:09.731451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:09.807512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:09.808968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a4040-1b7c-44be-bd92-a80163b0cc0a service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:09.830335 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 659/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:14.151173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b08f6-666d-4e6a-a83e-f04f7dcc3710 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:14.151748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b08f6-666d-4e6a-a83e-f04f7dcc3710 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:14.151748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b08f6-666d-4e6a-a83e-f04f7dcc3710 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:14.153100 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 682/1341] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:14.158448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418e583-a9ce-4ed0-8dd2-bf4cbdc0ab35 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:14.158858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418e583-a9ce-4ed0-8dd2-bf4cbdc0ab35 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:14.159041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418e583-a9ce-4ed0-8dd2-bf4cbdc0ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:14.224941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a418e583-a9ce-4ed0-8dd2-bf4cbdc0ab35 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:14.226163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a418e583-a9ce-4ed0-8dd2-bf4cbdc0ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:14.311119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:14.321940 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 660/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:14.670070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b08f6-666d-4e6a-a83e-f04f7dcc3710 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:14.671792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f17b08f6-666d-4e6a-a83e-f04f7dcc3710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:14.778206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b08f6-666d-4e6a-a83e-f04f7dcc3710 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:14.818524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:14.855939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:14.856548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:14.856826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:14.857097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:14.858726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:14.969614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:14.970984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc527b-c069-40f0-ba2f-2a85dd0e6d73 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:14.990225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 683/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:18.080307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18426-e30b-4ff6-b5c6-71ef7def92c0 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:18.080859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18426-e30b-4ff6-b5c6-71ef7def92c0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:18.080944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18426-e30b-4ff6-b5c6-71ef7def92c0 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:18.082402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 661/1344] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:18.087869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e93c-66be-4027-9097-0a57ba1b105e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:18.088320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e93c-66be-4027-9097-0a57ba1b105e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:18.088545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e93c-66be-4027-9097-0a57ba1b105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:18.157564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c803e93c-66be-4027-9097-0a57ba1b105e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:18.158815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c803e93c-66be-4027-9097-0a57ba1b105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:18.179862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:18.259339 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 684/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:18.598572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab18426-e30b-4ff6-b5c6-71ef7def92c0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:18.600222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ab18426-e30b-4ff6-b5c6-71ef7def92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:18.703828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab18426-e30b-4ff6-b5c6-71ef7def92c0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:18.776615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:18.777227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:18.777511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:18.777789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:18.779427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:18.823022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:18.893245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:18.894601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef766c-71d5-4fb1-aafd-d53676fd731d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:18.915878 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 662/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:23.382413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6a504-9690-432a-8f8c-5ac2e386df7b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:23.382966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6a504-9690-432a-8f8c-5ac2e386df7b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:23.382966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6a504-9690-432a-8f8c-5ac2e386df7b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:23.387051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 685/1347] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:23.390759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d13c-0f50-43a6-85a8-be5ebbb4a240 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:23.391235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d13c-0f50-43a6-85a8-be5ebbb4a240 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:23.391418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d13c-0f50-43a6-85a8-be5ebbb4a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:23.461762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ae87d13c-0f50-43a6-85a8-be5ebbb4a240 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:23.462981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae87d13c-0f50-43a6-85a8-be5ebbb4a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:23.567978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:23.570573 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 663/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:23.926683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6a504-9690-432a-8f8c-5ac2e386df7b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:23.928352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28d6a504-9690-432a-8f8c-5ac2e386df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:24.037502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6a504-9690-432a-8f8c-5ac2e386df7b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:24.089820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:24.116093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:24.116753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:24.117230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:24.117684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:24.119850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:24.229439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:24.230889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da16898-35e8-4a3c-9101-bc9d20f3d53b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:24.250743 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 686/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:29.757390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f2c7-cf72-4046-a109-2ecb49d37f74 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:29.757949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f2c7-cf72-4046-a109-2ecb49d37f74 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:29.758083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f2c7-cf72-4046-a109-2ecb49d37f74 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:29.760118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 664/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:29.771901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bfeac-7f7c-4ef4-a821-327d12bc99cf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:29.772397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bfeac-7f7c-4ef4-a821-327d12bc99cf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:29.772476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bfeac-7f7c-4ef4-a821-327d12bc99cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:29.890130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-956bfeac-7f7c-4ef4-a821-327d12bc99cf None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:29.891420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-956bfeac-7f7c-4ef4-a821-327d12bc99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:29.923340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:30.070160 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 687/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:34.617351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44356d5-f3c8-4098-87ac-b86889369797 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:34.617351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44356d5-f3c8-4098-87ac-b86889369797 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:34.617351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44356d5-f3c8-4098-87ac-b86889369797 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:34.617351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 665/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:40:34.625224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e912-d1f2-4d75-b172-ba0d12984056 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:34.625889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e912-d1f2-4d75-b172-ba0d12984056 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:34.625889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e912-d1f2-4d75-b172-ba0d12984056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:34.722123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2ad5e912-d1f2-4d75-b172-ba0d12984056 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:34.723920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2ad5e912-d1f2-4d75-b172-ba0d12984056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:34.802242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:34.844545 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 688/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:36.152315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4480e-ce1c-4160-bf61-0388af769d4d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:36.152947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4480e-ce1c-4160-bf61-0388af769d4d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:36.153044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4480e-ce1c-4160-bf61-0388af769d4d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:36.154938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 666/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:36.160350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4070e-c392-4cdd-824f-5af6d2d9eab1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:36.160834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4070e-c392-4cdd-824f-5af6d2d9eab1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:36.160953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4070e-c392-4cdd-824f-5af6d2d9eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:36.267927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9bf4070e-c392-4cdd-824f-5af6d2d9eab1 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:36.269217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9bf4070e-c392-4cdd-824f-5af6d2d9eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:36.393914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 689/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:40.181340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35629508-a263-4f14-9d78-afae0be91853 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:40.181867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35629508-a263-4f14-9d78-afae0be91853 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:40.181867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35629508-a263-4f14-9d78-afae0be91853 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:40.184080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 667/1356] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:40.190462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e0b29-59fa-4c45-b24e-dc01f9502fcb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:40.190462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e0b29-59fa-4c45-b24e-dc01f9502fcb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:40.190462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e0b29-59fa-4c45-b24e-dc01f9502fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:40.233600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:40.275272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5b3e0b29-59fa-4c45-b24e-dc01f9502fcb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:40.276470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5b3e0b29-59fa-4c45-b24e-dc01f9502fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:40.394738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 690/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:40.750822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5525fd-f459-434c-83c1-b86177226804 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:40.751432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5525fd-f459-434c-83c1-b86177226804 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:40.751946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5525fd-f459-434c-83c1-b86177226804 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:40.754344 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 668/1358] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 6 10:40:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:40.766001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e6616-38b7-4004-ae6f-15acb8c1766a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:40.767144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e6616-38b7-4004-ae6f-15acb8c1766a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:40.767682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e6616-38b7-4004-ae6f-15acb8c1766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:40.862539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-da0e6616-38b7-4004-ae6f-15acb8c1766a None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:40.863780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da0e6616-38b7-4004-ae6f-15acb8c1766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:40.926928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:41.004679 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 691/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 6 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:41.017599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5525fd-f459-434c-83c1-b86177226804 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:41.019297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee5525fd-f459-434c-83c1-b86177226804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:41.179224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5525fd-f459-434c-83c1-b86177226804 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:41.255075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:41.296589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:41.297232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:41.297521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:41.297795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:41.299427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:41.392363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:41.394042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a9e50-1589-4a89-aee0-5f4ec245a77a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:41.412478 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 669/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:43.813345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c686e4-a89f-4d8f-b4df-e04a9597673f None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:43.813345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c686e4-a89f-4d8f-b4df-e04a9597673f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:43.813345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c686e4-a89f-4d8f-b4df-e04a9597673f None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:43.813345 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 692/1361] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:43.817467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201b1f-399a-4f63-be33-ef5732d1d608 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:43.817884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201b1f-399a-4f63-be33-ef5732d1d608 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:43.818062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201b1f-399a-4f63-be33-ef5732d1d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:43.892175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-88201b1f-399a-4f63-be33-ef5732d1d608 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:43.893330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88201b1f-399a-4f63-be33-ef5732d1d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:43.935912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:44.000997 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 670/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:44.352500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c686e4-a89f-4d8f-b4df-e04a9597673f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:44.353940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-25c686e4-a89f-4d8f-b4df-e04a9597673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:44.502855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c686e4-a89f-4d8f-b4df-e04a9597673f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:44.512727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:44.624673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:44.625351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:44.625707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:44.626085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:44.627992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:44.722577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:44.724327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fface5-4eac-4022-9701-b1d669b58035 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:44.743722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 693/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:47.371823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba20a4-581f-4634-8745-90103f850b86 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:47.376440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba20a4-581f-4634-8745-90103f850b86 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:47.376743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba20a4-581f-4634-8745-90103f850b86 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:47.378134 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 671/1364] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:47.388952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262d0c-39f0-41c1-b836-c32bdce5d83e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:47.389728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262d0c-39f0-41c1-b836-c32bdce5d83e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:47.390466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262d0c-39f0-41c1-b836-c32bdce5d83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:47.418152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:47.475781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f9262d0c-39f0-41c1-b836-c32bdce5d83e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:47.476989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f9262d0c-39f0-41c1-b836-c32bdce5d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:47.581886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 694/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:47.955968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523efe-a25e-4cb7-b438-3cec3df541ae None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:47.957010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523efe-a25e-4cb7-b438-3cec3df541ae None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:47.957400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523efe-a25e-4cb7-b438-3cec3df541ae None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:47.958896 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 672/1366] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 6 10:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:47.964334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15e02-dc53-4be3-8465-b365b63fcb5a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:47.964622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15e02-dc53-4be3-8465-b365b63fcb5a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:47.964895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d15e02-dc53-4be3-8465-b365b63fcb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:48.045916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-14d15e02-dc53-4be3-8465-b365b63fcb5a None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:48.047325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14d15e02-dc53-4be3-8465-b365b63fcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:48.085751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:48.178227 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 695/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 6 10:40:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:48.186851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523efe-a25e-4cb7-b438-3cec3df541ae None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:48.188524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-80523efe-a25e-4cb7-b438-3cec3df541ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:48.412605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523efe-a25e-4cb7-b438-3cec3df541ae None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:48.439369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:48.577759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:48.578675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:48.579176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:48.579608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:48.582752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:48.715043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:48.715043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387d232-8ca1-4026-b609-be2b41df0b28 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:48.732565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 673/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:40:51.447422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310a761-c072-417f-87b2-cdfb54bc8674 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:51.450684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310a761-c072-417f-87b2-cdfb54bc8674 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:51.451358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310a761-c072-417f-87b2-cdfb54bc8674 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:51.458369 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 696/1369] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:51.459747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60308-56e9-4c69-8b63-6906b044f53d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:51.468875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60308-56e9-4c69-8b63-6906b044f53d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:51.468875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c60308-56e9-4c69-8b63-6906b044f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:51.503177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:51.554544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-51c60308-56e9-4c69-8b63-6906b044f53d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:51.556733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-51c60308-56e9-4c69-8b63-6906b044f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:51.683955 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 674/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:40:52.101307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310a761-c072-417f-87b2-cdfb54bc8674 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:52.102980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d310a761-c072-417f-87b2-cdfb54bc8674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:52.254685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:52.260440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310a761-c072-417f-87b2-cdfb54bc8674 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:52.384442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:52.385105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:52.385450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:52.385787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:52.387539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:52.486474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:52.488548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e3518-6c00-46d3-b6a0-05e8eeb08e4c service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:52.509349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:52.516149 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 697/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:53.107002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bfdd8-5086-47ca-8511-16c7c4fd733f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:53.107002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bfdd8-5086-47ca-8511-16c7c4fd733f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:53.107002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bfdd8-5086-47ca-8511-16c7c4fd733f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:53.107002 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 675/1372] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:53.107715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ac2c0-742e-404a-b34d-10a308f1f85e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:53.107715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ac2c0-742e-404a-b34d-10a308f1f85e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:53.107715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ac2c0-742e-404a-b34d-10a308f1f85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:53.189659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-da8ac2c0-742e-404a-b34d-10a308f1f85e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:53.192381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da8ac2c0-742e-404a-b34d-10a308f1f85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:53.304195 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 698/1373] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:40:53.932841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664829e-51ad-4262-bd85-605a81bc1189 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:53.932841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664829e-51ad-4262-bd85-605a81bc1189 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:53.933576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664829e-51ad-4262-bd85-605a81bc1189 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:53.936903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 676/1374] 10.222.0.20 () {54 vars in 964 bytes} [Tue Sep 6 10:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:53.946611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797627e9-5fa2-499f-837d-27bcd14ab874 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:53.947238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797627e9-5fa2-499f-837d-27bcd14ab874 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:53.947573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797627e9-5fa2-499f-837d-27bcd14ab874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:54.034967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-797627e9-5fa2-499f-837d-27bcd14ab874 None None] MFA Rules not processed for user `c06e2a3faa864da19cef4089e8392702`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:54.036486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-797627e9-5fa2-499f-837d-27bcd14ab874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:54.059407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:54.123206 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 699/1375] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Sep 6 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:54.131868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664829e-51ad-4262-bd85-605a81bc1189 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:54.133397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3664829e-51ad-4262-bd85-605a81bc1189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:54.243988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664829e-51ad-4262-bd85-605a81bc1189 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:54.248044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:54.333104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:54.333756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:54.334104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:54.334481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:54.336725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:54.473312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:54.474971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9aa78-8dcf-4d08-a1aa-4a9a503653f3 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:54.495790 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 677/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:55.091582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671009e-8e16-4a28-8147-b688a2def6f2 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:55.091582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671009e-8e16-4a28-8147-b688a2def6f2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:55.091582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671009e-8e16-4a28-8147-b688a2def6f2 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:55.095175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 700/1377] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:55.096498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb946c9-f976-46f6-ae7b-7f9cec321627 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:55.096790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb946c9-f976-46f6-ae7b-7f9cec321627 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:55.097068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb946c9-f976-46f6-ae7b-7f9cec321627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:55.157997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:55.186446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-edb946c9-f976-46f6-ae7b-7f9cec321627 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:55.188030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-edb946c9-f976-46f6-ae7b-7f9cec321627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:55.314351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 678/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:55.848163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671009e-8e16-4a28-8147-b688a2def6f2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:55.849712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0671009e-8e16-4a28-8147-b688a2def6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:56.001985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671009e-8e16-4a28-8147-b688a2def6f2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:56.032306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:56.126215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:56.126959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:56.127108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:56.127298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:56.128902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:56.219856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:56.221484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a2afd-4160-4da3-b48e-994676af9b0e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:56.240583 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 701/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:40:58.732994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2bae2-7b5e-4f99-b503-e18f8a7122e3 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:58.732994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2bae2-7b5e-4f99-b503-e18f8a7122e3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:58.732994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2bae2-7b5e-4f99-b503-e18f8a7122e3 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:58.732994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 679/1380] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:40:58.736275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9d69-1d49-4e56-8d95-168af84926c0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:58.737307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9d69-1d49-4e56-8d95-168af84926c0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:58.738628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a9d69-1d49-4e56-8d95-168af84926c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:58.792032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:58.823917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f43a9d69-1d49-4e56-8d95-168af84926c0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:40:58.825864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f43a9d69-1d49-4e56-8d95-168af84926c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:58.939474 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 702/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:40:59.295480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2bae2-7b5e-4f99-b503-e18f8a7122e3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:40:59.297229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-53e2bae2-7b5e-4f99-b503-e18f8a7122e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:59.431679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:59.474269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2bae2-7b5e-4f99-b503-e18f8a7122e3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:40:59.598183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:40:59.598712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:40:59.599157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:40:59.599442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:40:59.601118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:40:59.684353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:40:59.700941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:40:59.702626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3c4a5-624d-4752-b94d-6f15bdb8c22b service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:40:59.725911 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 680/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:02.096781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5776d0-4c03-45d9-a7e3-78f771ea3f0d None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:02.097345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5776d0-4c03-45d9-a7e3-78f771ea3f0d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:02.097345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5776d0-4c03-45d9-a7e3-78f771ea3f0d None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:02.098827 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 703/1383] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:02.104078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cddb12-9671-478d-b85b-495645676d3b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:02.108139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cddb12-9671-478d-b85b-495645676d3b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:02.108139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cddb12-9671-478d-b85b-495645676d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:02.180188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-37cddb12-9671-478d-b85b-495645676d3b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:02.181416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-37cddb12-9671-478d-b85b-495645676d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:02.289099 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 681/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:02.655078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5776d0-4c03-45d9-a7e3-78f771ea3f0d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:02.657007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ff5776d0-4c03-45d9-a7e3-78f771ea3f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:02.779286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:02.821013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5776d0-4c03-45d9-a7e3-78f771ea3f0d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:02.954104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:02.954719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:02.955002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:02.955378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:02.957000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:03.031188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:03.047402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:03.048994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b162ff-efb3-4a29-8316-0f880e8dd965 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:03.067630 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 704/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:05.466750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a03bd-3348-43e7-b156-263e6f2fb3ef None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:05.467514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a03bd-3348-43e7-b156-263e6f2fb3ef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:05.467514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a03bd-3348-43e7-b156-263e6f2fb3ef None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:05.468697 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 682/1386] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:05.475532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452df3a-41af-4b02-81ed-d2773b4d595d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:05.476740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452df3a-41af-4b02-81ed-d2773b4d595d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:05.476740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452df3a-41af-4b02-81ed-d2773b4d595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:05.559889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2452df3a-41af-4b02-81ed-d2773b4d595d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:05.561392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2452df3a-41af-4b02-81ed-d2773b4d595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:05.690877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 705/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:06.139167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a03bd-3348-43e7-b156-263e6f2fb3ef None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:06.140765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6b8a03bd-3348-43e7-b156-263e6f2fb3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:06.204089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:06.309158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a03bd-3348-43e7-b156-263e6f2fb3ef None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:06.431195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:06.431957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:06.432309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:06.432671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:06.434907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:06.534372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:06.536048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32071bcb-5dc6-4f69-8e6e-b5b0208bb448 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:06.554393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 683/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:06.648275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:09.277786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73f99c-18fc-483e-a222-63af0bebf46b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:09.278462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73f99c-18fc-483e-a222-63af0bebf46b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:09.278462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73f99c-18fc-483e-a222-63af0bebf46b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:09.279739 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 706/1389] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:09.285322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5ab9f-3c5f-4b55-85f2-dfbe0686d2fc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:09.285827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5ab9f-3c5f-4b55-85f2-dfbe0686d2fc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:09.285934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5ab9f-3c5f-4b55-85f2-dfbe0686d2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:09.362740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a0f5ab9f-3c5f-4b55-85f2-dfbe0686d2fc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:09.364003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a0f5ab9f-3c5f-4b55-85f2-dfbe0686d2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:09.458429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:09.470879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 684/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:09.833430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73f99c-18fc-483e-a222-63af0bebf46b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:09.834928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0c73f99c-18fc-483e-a222-63af0bebf46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:09.888285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:09.983693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73f99c-18fc-483e-a222-63af0bebf46b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:10.097725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:10.098225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:10.098508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:10.098783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:10.100396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:10.112755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:10.193723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:10.195517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29129ec3-3934-4627-abbb-2d513a580711 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:10.213713 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 707/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:11.363086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6907b7-b3a1-4872-a79d-8fc15a52cef5 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:11.363719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6907b7-b3a1-4872-a79d-8fc15a52cef5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:11.363719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6907b7-b3a1-4872-a79d-8fc15a52cef5 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:11.365027 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 685/1392] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:11.370746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb3ce-bdab-4499-9fe6-e1c3f0f766b2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:11.371273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb3ce-bdab-4499-9fe6-e1c3f0f766b2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:11.371364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb3ce-bdab-4499-9fe6-e1c3f0f766b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:11.442557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ff0cb3ce-bdab-4499-9fe6-e1c3f0f766b2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:11.443880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ff0cb3ce-bdab-4499-9fe6-e1c3f0f766b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:11.530464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:11.542915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 708/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:11.899623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b8bf1-a7be-4cc9-84e3-2989eb832f21 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:11.900020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b8bf1-a7be-4cc9-84e3-2989eb832f21 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:11.900333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b8bf1-a7be-4cc9-84e3-2989eb832f21 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:11.901903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 686/1394] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 6 10:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:11.906914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606b115-7747-4a69-a8e9-b785164419fe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:11.907149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606b115-7747-4a69-a8e9-b785164419fe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:11.907416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606b115-7747-4a69-a8e9-b785164419fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:11.984021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4606b115-7747-4a69-a8e9-b785164419fe None None] MFA Rules not processed for user `3a5944ef46aa40078b84b486b24822eb`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:11.985221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4606b115-7747-4a69-a8e9-b785164419fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:12.065017 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 709/1395] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:12.072614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b8bf1-a7be-4cc9-84e3-2989eb832f21 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:12.074129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b35b8bf1-a7be-4cc9-84e3-2989eb832f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:12.187873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b8bf1-a7be-4cc9-84e3-2989eb832f21 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:12.266313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:12.266948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:12.267259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:12.267531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:12.269118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:12.312364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:12.382729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:12.384211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca94e2f-c5e6-4563-9c76-ce085c997861 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:12.403792 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 687/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:12.577918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa489d-07bc-4cf0-892d-ff68f888f774 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:12.578515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa489d-07bc-4cf0-892d-ff68f888f774 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:12.578515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa489d-07bc-4cf0-892d-ff68f888f774 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:12.579862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 710/1397] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:12.585582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f1c2-a2ed-479e-87a5-78e1d891ba28 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:12.585873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f1c2-a2ed-479e-87a5-78e1d891ba28 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:12.586150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f1c2-a2ed-479e-87a5-78e1d891ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:12.653971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9f93f1c2-a2ed-479e-87a5-78e1d891ba28 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:12.655302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9f93f1c2-a2ed-479e-87a5-78e1d891ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:12.755516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:12.758141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 688/1398] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:13.114317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa489d-07bc-4cf0-892d-ff68f888f774 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:13.116059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eaaa489d-07bc-4cf0-892d-ff68f888f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:13.132377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc26dd-6e4b-4564-b51a-c25112a8274f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:13.132665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc26dd-6e4b-4564-b51a-c25112a8274f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:13.132939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc26dd-6e4b-4564-b51a-c25112a8274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:13.202561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:13.204056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5edc26dd-6e4b-4564-b51a-c25112a8274f None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:13.205302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5edc26dd-6e4b-4564-b51a-c25112a8274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:13.270841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa489d-07bc-4cf0-892d-ff68f888f774 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:13.296176 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 689/1399] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:41:13.352836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be569-c285-4cf3-95dd-e9e151fea3fc None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:13.353156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be569-c285-4cf3-95dd-e9e151fea3fc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:13.353460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be569-c285-4cf3-95dd-e9e151fea3fc None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:13.355484 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 690/1400] 10.222.0.20 () {54 vars in 943 bytes} [Tue Sep 6 10:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:41:13.364970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326b5f1-6ac0-44cc-b563-044fe80df588 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:13.365285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326b5f1-6ac0-44cc-b563-044fe80df588 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:13.366054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326b5f1-6ac0-44cc-b563-044fe80df588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:13.414615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:13.415357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:13.415640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:13.415915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:13.418049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:13.444982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0326b5f1-6ac0-44cc-b563-044fe80df588 None None] MFA Rules not processed for user `cd53273c297e44518ba1bbe2c838e744`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:13.446430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0326b5f1-6ac0-44cc-b563-044fe80df588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:13.463232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:13.481023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:13.511688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:13.513299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:13.532316 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 711/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:13.557076 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 691/1402] 10.222.0.20 () {58 vars in 1040 bytes} [Tue Sep 6 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:41:13.566435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:13.567693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:13.657901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5980-0c8f-409d-b5ff-b7d74f6a18db service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:13.740223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:13.771193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:13.771825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:13.772611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:13.772611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:13.774323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:13.872962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:13.874637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e98a7-2187-4680-b75e-74ee193dca5a service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:13.884344 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 712/1403] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:41:15.988695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9234e-489b-44b5-badb-8253f89a94a8 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:15.989336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9234e-489b-44b5-badb-8253f89a94a8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:15.989336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9234e-489b-44b5-badb-8253f89a94a8 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:15.990834 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 692/1404] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:15.997999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a261-fd4a-4645-aff3-d59514398bbf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:15.998622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a261-fd4a-4645-aff3-d59514398bbf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:15.998622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924a261-fd4a-4645-aff3-d59514398bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:16.068851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e924a261-fd4a-4645-aff3-d59514398bbf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:16.070210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e924a261-fd4a-4645-aff3-d59514398bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:16.137488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:16.175613 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 713/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:16.558384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9234e-489b-44b5-badb-8253f89a94a8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:16.558384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-98e9234e-489b-44b5-badb-8253f89a94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:16.727659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9234e-489b-44b5-badb-8253f89a94a8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:16.732489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:16.855264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:16.855797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:16.856084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:16.856363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:16.858012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:16.951998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:16.953605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68f86e-6f53-4810-bf85-cae070f02e9a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:16.973432 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 693/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:19.428287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f878f9-b9fe-4b1a-a00e-47185b4fbd16 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:19.485721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f878f9-b9fe-4b1a-a00e-47185b4fbd16 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:19.485721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f878f9-b9fe-4b1a-a00e-47185b4fbd16 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:19.485721 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 714/1407] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:41:19 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:19.486092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882750-4a36-42d1-8249-a511a4003136 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:19.486092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882750-4a36-42d1-8249-a511a4003136 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:19.486092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882750-4a36-42d1-8249-a511a4003136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:19.486092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:19.537827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7d882750-4a36-42d1-8249-a511a4003136 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:19.539223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7d882750-4a36-42d1-8249-a511a4003136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:19.655914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 694/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:20.008815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f878f9-b9fe-4b1a-a00e-47185b4fbd16 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:20.010899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0f878f9-b9fe-4b1a-a00e-47185b4fbd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:20.171907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f878f9-b9fe-4b1a-a00e-47185b4fbd16 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:20.226481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:20.302651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:20.303296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:20.303579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:20.303854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:20.305474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:20.410792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:20.412462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3f3c0-e15b-409d-87e4-1724cbe48ef4 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:20.432829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 715/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:29.648297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=61 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:30.428990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=76 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:37.624342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440f37-5225-4a3d-b9dd-5ad00801ee32 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:37.624900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440f37-5225-4a3d-b9dd-5ad00801ee32 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:37.624900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440f37-5225-4a3d-b9dd-5ad00801ee32 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:37.626254 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 695/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Sep 6 10:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:37.631578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7124a-76bd-4833-ac54-62bddf4b6603 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:37.631989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7124a-76bd-4833-ac54-62bddf4b6603 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:37.632149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7124a-76bd-4833-ac54-62bddf4b6603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:37.713511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-add7124a-76bd-4833-ac54-62bddf4b6603 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:37.714660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-add7124a-76bd-4833-ac54-62bddf4b6603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:37.826804 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 716/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Sep 6 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:37.842451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e172ea8-3076-4a16-99d1-253ae480f4e9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:37.842734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e172ea8-3076-4a16-99d1-253ae480f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:37.843039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e172ea8-3076-4a16-99d1-253ae480f4e9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:37.844736 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 696/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Sep 6 10:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:37.849708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf467ad-de44-41a4-8fa9-53a66491dfde None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:37.850000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf467ad-de44-41a4-8fa9-53a66491dfde None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:37.850282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf467ad-de44-41a4-8fa9-53a66491dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:37.932392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:37.935595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-aaf467ad-de44-41a4-8fa9-53a66491dfde None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:37.936828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aaf467ad-de44-41a4-8fa9-53a66491dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:38.060266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 717/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Sep 6 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:40.762204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bcbd-b491-4d4f-8433-4c73def4256e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:40.762752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bcbd-b491-4d4f-8433-4c73def4256e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:40.762752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bcbd-b491-4d4f-8433-4c73def4256e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:40.764130 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:40.769409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b9e6-7c68-4089-b8c6-493f776d7797 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:40.769836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b9e6-7c68-4089-b8c6-493f776d7797 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:40.769948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b9e6-7c68-4089-b8c6-493f776d7797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:40.835054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dfa5b9e6-7c68-4089-b8c6-493f776d7797 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:40.836263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dfa5b9e6-7c68-4089-b8c6-493f776d7797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:40.890904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:40.934437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:41.283929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bcbd-b491-4d4f-8433-4c73def4256e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:41.285480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-87e4bcbd-b491-4d4f-8433-4c73def4256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:41.431915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bcbd-b491-4d4f-8433-4c73def4256e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:41.502911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:41.544592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:41.545127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:41.545408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:41.545682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:41.547324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:41.635023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:41.636631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800e578-af0f-4261-a3fe-8b39565223d3 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:41.654821 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 698/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:42.624061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98700d60-e7f8-41ce-837a-815cc90ab9fd None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:42.624612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98700d60-e7f8-41ce-837a-815cc90ab9fd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:42.624612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98700d60-e7f8-41ce-837a-815cc90ab9fd None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:42.625938 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:42.630727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869590ff-0d77-4582-871d-eb6f14c9f87c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:42.631160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869590ff-0d77-4582-871d-eb6f14c9f87c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:42.631302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869590ff-0d77-4582-871d-eb6f14c9f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:42.705898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-869590ff-0d77-4582-871d-eb6f14c9f87c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:42.707142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-869590ff-0d77-4582-871d-eb6f14c9f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:42.734885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:42.813942 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:43.024292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98700d60-e7f8-41ce-837a-815cc90ab9fd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:43.026363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98700d60-e7f8-41ce-837a-815cc90ab9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:43.173939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98700d60-e7f8-41ce-837a-815cc90ab9fd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:43.214864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:43.289850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:43.290454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:43.290741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:43.291032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:43.292616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:43.380252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:43.381898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d321827-92e2-40c8-9294-d73dac2c991a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:43.400911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 720/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:44.306396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d221-56b2-4424-bcde-03014ea492dd None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:44.307605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d221-56b2-4424-bcde-03014ea492dd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:44.307605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4d221-56b2-4424-bcde-03014ea492dd None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:44.308341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:44.313423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a460-a668-4470-aceb-cb3a6f004b12 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:44.313853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a460-a668-4470-aceb-cb3a6f004b12 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:44.313965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a460-a668-4470-aceb-cb3a6f004b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:44.368896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:44.390442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c0b3a460-a668-4470-aceb-cb3a6f004b12 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:44.391721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c0b3a460-a668-4470-aceb-cb3a6f004b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:44.495343 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:44.656240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d221-56b2-4424-bcde-03014ea492dd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:44.657688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ded4d221-56b2-4424-bcde-03014ea492dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:44.809030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4d221-56b2-4424-bcde-03014ea492dd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:44.820904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:44.924359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:44.925001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:44.925285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:44.925559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:44.927195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:45.016269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:45.017995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce607-086b-4653-ac1d-b9916c0b15cc service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:45.035835 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 701/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:45.905196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628335c-7e6d-480b-a015-5ca2183a5c33 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:45.905716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628335c-7e6d-480b-a015-5ca2183a5c33 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:45.905826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628335c-7e6d-480b-a015-5ca2183a5c33 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:45.907144 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:45.912338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897a3c-0680-4788-9e8f-c142f51b8a74 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:45.912794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897a3c-0680-4788-9e8f-c142f51b8a74 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:45.912895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897a3c-0680-4788-9e8f-c142f51b8a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:45.932886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:45.990037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a9897a3c-0680-4788-9e8f-c142f51b8a74 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:45.991199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a9897a3c-0680-4788-9e8f-c142f51b8a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:46.084790 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:41:46.243184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628335c-7e6d-480b-a015-5ca2183a5c33 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:46.244626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8628335c-7e6d-480b-a015-5ca2183a5c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:46.353107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:46.388240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628335c-7e6d-480b-a015-5ca2183a5c33 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:46.501354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:46.501879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:46.502179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:46.502434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:46.504213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:46.579388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:46.592683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:46.594274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd319-ebb5-4393-a8bf-78a00c6a4b1f service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:46.613086 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 723/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:47.483193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d72b8-2027-4529-9393-1a2c33c8d701 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:47.483738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d72b8-2027-4529-9393-1a2c33c8d701 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:47.483852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d72b8-2027-4529-9393-1a2c33c8d701 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:47.485177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:47.490399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184d2c-5821-47ca-a712-2ffee7eefac0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:47.490820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184d2c-5821-47ca-a712-2ffee7eefac0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:47.490933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75184d2c-5821-47ca-a712-2ffee7eefac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:47.565808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-75184d2c-5821-47ca-a712-2ffee7eefac0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:47.567032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-75184d2c-5821-47ca-a712-2ffee7eefac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:47.661513 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:47.826362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d72b8-2027-4529-9393-1a2c33c8d701 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:47.827946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b53d72b8-2027-4529-9393-1a2c33c8d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:47.913457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:47.975553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d72b8-2027-4529-9393-1a2c33c8d701 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:48.090110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:48.090714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:48.090991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:48.091288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:48.092881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:48.140751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:48.179445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:48.181504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9ab7a-a896-4881-8ebd-d267a30aafb8 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:48.199883 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 704/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:49.071788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aae1eb-4484-4948-b366-dac541ba8972 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:49.072345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aae1eb-4484-4948-b366-dac541ba8972 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:49.072345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aae1eb-4484-4948-b366-dac541ba8972 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:49.073660 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:49.079539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33637a4a-426d-457a-b875-91460fc0c540 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:49.085185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33637a4a-426d-457a-b875-91460fc0c540 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:49.085185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33637a4a-426d-457a-b875-91460fc0c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:49.158688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-33637a4a-426d-457a-b875-91460fc0c540 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:49.160117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33637a4a-426d-457a-b875-91460fc0c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:49.253859 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:49.414007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aae1eb-4484-4948-b366-dac541ba8972 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:49.415511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68aae1eb-4484-4948-b366-dac541ba8972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:49.465566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:49.561600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aae1eb-4484-4948-b366-dac541ba8972 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:49.672135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:49.672653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:49.672929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:49.673194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:49.674777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:49.682124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:49.763519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:49.765133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa607a-888c-4ebc-a6f4-ccbbbc943c1a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:49.782779 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 726/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:50.670467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd86a-775a-4c35-865e-63ab9cf9ef9b None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:50.671038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd86a-775a-4c35-865e-63ab9cf9ef9b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:50.671038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd86a-775a-4c35-865e-63ab9cf9ef9b None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:50.672359 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:50.677425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f20f9-d3f2-44dd-8e69-c7d15af0ff5a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:50.677899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f20f9-d3f2-44dd-8e69-c7d15af0ff5a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:50.678009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f20f9-d3f2-44dd-8e69-c7d15af0ff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:50.756324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f98f20f9-d3f2-44dd-8e69-c7d15af0ff5a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:50.757558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f98f20f9-d3f2-44dd-8e69-c7d15af0ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:50.825415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:50.854471 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:51.012869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd86a-775a-4c35-865e-63ab9cf9ef9b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:51.014572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df8cd86a-775a-4c35-865e-63ab9cf9ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:51.032741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:51.159071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd86a-775a-4c35-865e-63ab9cf9ef9b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:51.244345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:51.269095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:51.269696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:51.269975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:51.270247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:51.271929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:51.360462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:51.362308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f17810-e828-4553-bed6-7ef0959cdfe7 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:51.380252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 707/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:52.256700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe431-78e3-437e-95f0-c792db7fbcc2 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:52.257232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe431-78e3-437e-95f0-c792db7fbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:52.257232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe431-78e3-437e-95f0-c792db7fbcc2 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:52.258505 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:52.263329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d733b-c4ce-4670-8936-ad76e84912e1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:52.263724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d733b-c4ce-4670-8936-ad76e84912e1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:52.263882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d733b-c4ce-4670-8936-ad76e84912e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:52.337716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1e3d733b-c4ce-4670-8936-ad76e84912e1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:52.338906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1e3d733b-c4ce-4670-8936-ad76e84912e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:52.380150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:52.437217 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:52.601628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe431-78e3-437e-95f0-c792db7fbcc2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:52.603206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-614fe431-78e3-437e-95f0-c792db7fbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:52.747427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe431-78e3-437e-95f0-c792db7fbcc2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:52.801483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:52.860079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:52.860611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:52.860891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:52.861410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:52.863036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:52.951330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:52.952933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742f25e-0d7e-4f9f-a532-12f0cff327ef service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:52.970470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 729/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:53.849675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81b96-b33a-4e9f-a9bc-efe907b08f3c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:53.850246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81b96-b33a-4e9f-a9bc-efe907b08f3c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:53.850246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81b96-b33a-4e9f-a9bc-efe907b08f3c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:53.851632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:53.856424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393bf26-eee1-4564-a0c7-8ba9d6e8e2d9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:53.856802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393bf26-eee1-4564-a0c7-8ba9d6e8e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:53.856974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393bf26-eee1-4564-a0c7-8ba9d6e8e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:53.932653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c393bf26-eee1-4564-a0c7-8ba9d6e8e2d9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:53.933863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c393bf26-eee1-4564-a0c7-8ba9d6e8e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:53.935889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:54.029837 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:54.188146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81b96-b33a-4e9f-a9bc-efe907b08f3c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:54.189581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-44b81b96-b33a-4e9f-a9bc-efe907b08f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:54.334129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81b96-b33a-4e9f-a9bc-efe907b08f3c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:54.360606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:54.447747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:54.448300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:54.448564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:54.448838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:54.450443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:54.538745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:54.540910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dae39-e026-4053-a845-372d4a3fc5a0 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:54.559153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 710/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:56.643834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c63735-a177-4a43-a7de-1bd73464b984 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:56.644397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c63735-a177-4a43-a7de-1bd73464b984 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:56.644397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c63735-a177-4a43-a7de-1bd73464b984 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:56.645747 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:41:56.651730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78e9f-ee9c-41c0-9702-dc4375231c2e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:56.652160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78e9f-ee9c-41c0-9702-dc4375231c2e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:56.652287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78e9f-ee9c-41c0-9702-dc4375231c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:56.692184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:56.717530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-03b78e9f-ee9c-41c0-9702-dc4375231c2e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:56.718752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03b78e9f-ee9c-41c0-9702-dc4375231c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:56.814347 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:41:57.164253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c63735-a177-4a43-a7de-1bd73464b984 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:41:57.165765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-35c63735-a177-4a43-a7de-1bd73464b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:57.269087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c63735-a177-4a43-a7de-1bd73464b984 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:41:57.300815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:41:57.344457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:41:57.345063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:57.345347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:57.345624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:57.347256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:57.455067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:41:57.456481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1c91a-4785-41c3-a9a4-968b1d9ec69b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:41:57.474574 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 732/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:41:59.860231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb538-709f-4110-84d8-e9edeff36a37 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:59.860803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb538-709f-4110-84d8-e9edeff36a37 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:59.860803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb538-709f-4110-84d8-e9edeff36a37 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:59.862437 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:41:59.868412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88979833-a7bb-4155-9e66-ea3b47e71f94 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:41:59.868845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88979833-a7bb-4155-9e66-ea3b47e71f94 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:41:59.868955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88979833-a7bb-4155-9e66-ea3b47e71f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:41:59.935820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-88979833-a7bb-4155-9e66-ea3b47e71f94 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:41:59.937048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-88979833-a7bb-4155-9e66-ea3b47e71f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:41:59.950240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:00.035325 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:00.381010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb538-709f-4110-84d8-e9edeff36a37 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:00.382599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d1bfb538-709f-4110-84d8-e9edeff36a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:00.486737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb538-709f-4110-84d8-e9edeff36a37 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:00.499368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:00.562384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:00.562990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:00.563293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:00.563565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:00.565156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:00.674453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:00.675835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd20a50-afa8-40e2-9f19-e5fecf04e884 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:00.694159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 713/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:03.282655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278ebc-ab30-4697-9e5f-120d0c2937dc None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:03.283245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278ebc-ab30-4697-9e5f-120d0c2937dc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:03.283245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278ebc-ab30-4697-9e5f-120d0c2937dc None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:03.284616 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:03.289871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8746c-3c11-48e2-a72b-5c594c0f0a99 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:03.290315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8746c-3c11-48e2-a72b-5c594c0f0a99 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:03.290417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8746c-3c11-48e2-a72b-5c594c0f0a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:03.337789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:03.356420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e9e8746c-3c11-48e2-a72b-5c594c0f0a99 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:03.357625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e9e8746c-3c11-48e2-a72b-5c594c0f0a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:03.457505 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:03.803484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278ebc-ab30-4697-9e5f-120d0c2937dc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:03.805077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10278ebc-ab30-4697-9e5f-120d0c2937dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:03.908517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278ebc-ab30-4697-9e5f-120d0c2937dc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:03.948403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:03.983414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:03.984025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:03.984315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:03.984590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:03.986491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:04.219107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:04.220445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1de62-2a15-4809-9555-e7772ccaad3e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:04.238676 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 735/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:06.554616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eadaf3-a075-439a-980b-46fa7a89761a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:06.555216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eadaf3-a075-439a-980b-46fa7a89761a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:06.555216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eadaf3-a075-439a-980b-46fa7a89761a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:06.556601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:06.561728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fa130-c607-42f7-be73-c7086c35e19a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:06.562137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fa130-c607-42f7-be73-c7086c35e19a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:06.562277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fa130-c607-42f7-be73-c7086c35e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:06.627169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-082fa130-c607-42f7-be73-c7086c35e19a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:06.628367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-082fa130-c607-42f7-be73-c7086c35e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:06.649187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:06.722416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:07.072121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eadaf3-a075-439a-980b-46fa7a89761a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:07.073718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c8eadaf3-a075-439a-980b-46fa7a89761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:07.176936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eadaf3-a075-439a-980b-46fa7a89761a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:07.198896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:07.253699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:07.254302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:07.254586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:07.254858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:07.256493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:07.362827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:07.364326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8646f-5edb-4359-ba1b-2210035508a5 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:07.382671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 716/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:09.630674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c877-1e57-41a8-bcf7-050f3b5c095a None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:09.631180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c877-1e57-41a8-bcf7-050f3b5c095a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:09.631180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429c877-1e57-41a8-bcf7-050f3b5c095a None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:09.633055 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:09.638267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eabc08-1f44-471d-8842-78233a48ff91 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:09.638697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eabc08-1f44-471d-8842-78233a48ff91 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:09.638880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eabc08-1f44-471d-8842-78233a48ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:09.702112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:09.704662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-85eabc08-1f44-471d-8842-78233a48ff91 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:09.705859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-85eabc08-1f44-471d-8842-78233a48ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:09.927219 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:10.281457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c877-1e57-41a8-bcf7-050f3b5c095a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:10.282984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f429c877-1e57-41a8-bcf7-050f3b5c095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:10.386134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429c877-1e57-41a8-bcf7-050f3b5c095a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:10.435487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:10.458621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:10.459247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:10.459527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:10.459797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:10.462601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:10.574810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:10.576310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d5e1b-3aa9-4591-9916-c34fe4e6ec49 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:10.597016 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 738/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:12.922733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196ff6-fc5c-4097-b41d-808c25646544 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:12.923230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196ff6-fc5c-4097-b41d-808c25646544 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:12.923329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196ff6-fc5c-4097-b41d-808c25646544 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:12.924724 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:12.929948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359b77-3e2b-491a-9c05-f31a92579ed3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:12.930331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359b77-3e2b-491a-9c05-f31a92579ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:12.930498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359b77-3e2b-491a-9c05-f31a92579ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:12.996358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a359b77-3e2b-491a-9c05-f31a92579ed3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:12.997574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a359b77-3e2b-491a-9c05-f31a92579ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:13.026097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:13.091986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:13.441881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196ff6-fc5c-4097-b41d-808c25646544 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:13.443471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45196ff6-fc5c-4097-b41d-808c25646544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:13.551323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196ff6-fc5c-4097-b41d-808c25646544 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:13.579794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:13.624982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:13.625587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:13.625869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:13.626141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:13.627782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:13.734131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:13.735547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8a110-855f-4656-8be0-7cd70075d585 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:13.753763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 719/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:16.013829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784bee-3a5e-4704-bdd8-4cffa792c4f7 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:16.014387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784bee-3a5e-4704-bdd8-4cffa792c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:16.014387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9784bee-3a5e-4704-bdd8-4cffa792c4f7 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:16.015813 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:16.021093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f3b99-61d3-4df1-abbf-00a0a68e4fe4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:16.021538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f3b99-61d3-4df1-abbf-00a0a68e4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:16.021656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f3b99-61d3-4df1-abbf-00a0a68e4fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:16.088429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0d5f3b99-61d3-4df1-abbf-00a0a68e4fe4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:16.089628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0d5f3b99-61d3-4df1-abbf-00a0a68e4fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:16.097825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:16.185804 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:16.528072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784bee-3a5e-4704-bdd8-4cffa792c4f7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:16.529632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c9784bee-3a5e-4704-bdd8-4cffa792c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:16.632737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9784bee-3a5e-4704-bdd8-4cffa792c4f7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:16.685831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:16.704369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:16.704970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:16.705249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:16.705522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:16.707171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:16.813205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:16.814567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd870a-325c-4d84-85a4-8bd02839d604 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:16.833248 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 741/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:19.077838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2cfc-2df1-45d3-b7f9-480e9fae1a1a None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:19.078420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2cfc-2df1-45d3-b7f9-480e9fae1a1a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:19.078420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2cfc-2df1-45d3-b7f9-480e9fae1a1a None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:19.079769 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:19.085763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb909c-e161-46f6-89db-ae9811bd3f58 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:19.086208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb909c-e161-46f6-89db-ae9811bd3f58 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:19.086305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb909c-e161-46f6-89db-ae9811bd3f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:19.153133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4dcb909c-e161-46f6-89db-ae9811bd3f58 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:19.154325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4dcb909c-e161-46f6-89db-ae9811bd3f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:19.191047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:19.248331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:19.599778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2cfc-2df1-45d3-b7f9-480e9fae1a1a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:19.601439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f29a2cfc-2df1-45d3-b7f9-480e9fae1a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:19.703580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2cfc-2df1-45d3-b7f9-480e9fae1a1a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:19.739969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:19.776035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:19.776636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:19.777095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:19.777665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:19.779284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:19.886809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:19.888174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d38c4-e9a6-4d5e-9689-1277844944ce service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:19.906388 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 722/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:22.155643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ee7c-80fc-4955-b588-0419ea962888 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:22.156173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ee7c-80fc-4955-b588-0419ea962888 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:22.156173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ee7c-80fc-4955-b588-0419ea962888 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:22.157476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:22.162820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b518-36b8-47b8-8db7-3bba6b985c42 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:22.163241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b518-36b8-47b8-8db7-3bba6b985c42 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:22.163412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b518-36b8-47b8-8db7-3bba6b985c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:22.228374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a141b518-36b8-47b8-8db7-3bba6b985c42 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:22.229573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a141b518-36b8-47b8-8db7-3bba6b985c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:22.247200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:22.324833 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:22.675441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ee7c-80fc-4955-b588-0419ea962888 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:22.676955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2706ee7c-80fc-4955-b588-0419ea962888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:22.779516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ee7c-80fc-4955-b588-0419ea962888 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:22.862523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:22.870604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:22.871235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:22.871514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:22.871827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:22.873416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:22.980653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:22.982017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fc623-9f85-4412-8196-802dc662709f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:23.000579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 744/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:25.207102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21c1c-47e6-4aa0-a941-42ca96bd2d31 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:25.207608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21c1c-47e6-4aa0-a941-42ca96bd2d31 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:25.207608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21c1c-47e6-4aa0-a941-42ca96bd2d31 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:25.208944 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:25.214948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e13eb-4425-4fae-bd43-48a1359c31ef None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:25.215399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e13eb-4425-4fae-bd43-48a1359c31ef None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:25.215518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e13eb-4425-4fae-bd43-48a1359c31ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:25.281909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cb8e13eb-4425-4fae-bd43-48a1359c31ef None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:25.283190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb8e13eb-4425-4fae-bd43-48a1359c31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:25.331203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:25.378302 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:25.725244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21c1c-47e6-4aa0-a941-42ca96bd2d31 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:25.726859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84a21c1c-47e6-4aa0-a941-42ca96bd2d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:25.829545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21c1c-47e6-4aa0-a941-42ca96bd2d31 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:25.881059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:25.907872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:25.908484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:25.908796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:25.909436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:25.910674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:26.018813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:26.020293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75683516-fc7e-40d7-acd8-af1f0db056d9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:26.038600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 725/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:35.376611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=22 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:36.035869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=66 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:50.296498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca1b2e-3ecd-4221-9663-5e65b3eff0b4 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:50.297040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca1b2e-3ecd-4221-9663-5e65b3eff0b4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:50.297040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca1b2e-3ecd-4221-9663-5e65b3eff0b4 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:50.298423 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 746/1471] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:50.304444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f92c6-587d-4ad8-86a9-167a5c04e91f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:50.304868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f92c6-587d-4ad8-86a9-167a5c04e91f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:50.304999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f92c6-587d-4ad8-86a9-167a5c04e91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:50.370148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ce2f92c6-587d-4ad8-86a9-167a5c04e91f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:50.371383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ce2f92c6-587d-4ad8-86a9-167a5c04e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:50.467879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 726/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:50.856664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddce5f-ece0-4b45-a4dc-808f54010a5c None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:50.856949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddce5f-ece0-4b45-a4dc-808f54010a5c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:50.857224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddce5f-ece0-4b45-a4dc-808f54010a5c None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:50.858535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 747/1473] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 6 10:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:50.863874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e47d84-486b-467e-bc7e-48b54ff61588 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:50.864757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e47d84-486b-467e-bc7e-48b54ff61588 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:50.865070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e47d84-486b-467e-bc7e-48b54ff61588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:50.941603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-12e47d84-486b-467e-bc7e-48b54ff61588 None None] MFA Rules not processed for user `3a5944ef46aa40078b84b486b24822eb`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:50.942865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12e47d84-486b-467e-bc7e-48b54ff61588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:50.963729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:51.019224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 727/1474] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:51.027435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddce5f-ece0-4b45-a4dc-808f54010a5c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:51.028969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2dddce5f-ece0-4b45-a4dc-808f54010a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:51.130986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddce5f-ece0-4b45-a4dc-808f54010a5c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:51.202552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:51.203185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:51.203471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:51.203749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:51.205332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:51.260418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:51.315831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:51.317319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2530a4-2184-48d9-a909-5ff8c5228c84 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:51.336527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 748/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:53.652578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb476-2320-4ea4-99c3-dba52e5a6d30 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:53.653213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb476-2320-4ea4-99c3-dba52e5a6d30 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:53.653213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb476-2320-4ea4-99c3-dba52e5a6d30 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:53.654543 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 728/1476] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:53.659748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39554eb6-03c6-4347-9ae7-af852930ed55 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:53.660175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39554eb6-03c6-4347-9ae7-af852930ed55 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:53.660287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39554eb6-03c6-4347-9ae7-af852930ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:53.725895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-39554eb6-03c6-4347-9ae7-af852930ed55 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:53.727042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-39554eb6-03c6-4347-9ae7-af852930ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:53.823233 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 749/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:54.157880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadb476-2320-4ea4-99c3-dba52e5a6d30 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:54.159452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fdadb476-2320-4ea4-99c3-dba52e5a6d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:54.281473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadb476-2320-4ea4-99c3-dba52e5a6d30 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:54.329427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:54.374092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:54.374700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:54.374976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:54.375276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:54.375910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:54.377687 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:42:54.377687 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:42:54.377687 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:42:54.378851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe53340-8ce1-4a23-860b-a7a3487c62f5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:54.397559 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 729/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Sep 6 10:42:54 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:42:56.618615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8e27-6fcc-4ac3-89ab-b8241cfaf7b3 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:56.619222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8e27-6fcc-4ac3-89ab-b8241cfaf7b3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:56.619222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a8e27-6fcc-4ac3-89ab-b8241cfaf7b3 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:56.620524 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 750/1479] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:56.625763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17521253-4d36-4043-a32f-7681ee79fd6a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:56.626199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17521253-4d36-4043-a32f-7681ee79fd6a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:56.626321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17521253-4d36-4043-a32f-7681ee79fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:56.692533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-17521253-4d36-4043-a32f-7681ee79fd6a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:56.693745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-17521253-4d36-4043-a32f-7681ee79fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:56.788335 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 730/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:42:57.151781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8e27-6fcc-4ac3-89ab-b8241cfaf7b3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:42:57.153346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1e4a8e27-6fcc-4ac3-89ab-b8241cfaf7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:57.163092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:57.300545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a8e27-6fcc-4ac3-89ab-b8241cfaf7b3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:42:57.379712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:42:57.411837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:42:57.412439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:57.412719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:57.412991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:57.414635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:42:57.502041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:42:57.503679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651f1e7-4912-4ae5-9022-9eeee8051543 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:42:57.521522 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 751/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:42:59.891392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb51b2-58ce-4ff4-97bb-804632f7b34e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:59.892039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb51b2-58ce-4ff4-97bb-804632f7b34e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:59.892039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb51b2-58ce-4ff4-97bb-804632f7b34e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:59.893388 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 731/1482] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:42:59.898910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7384a-2a18-4f28-b0a6-f50762665391 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:42:59.899412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7384a-2a18-4f28-b0a6-f50762665391 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:42:59.899531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7384a-2a18-4f28-b0a6-f50762665391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:42:59.966219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-50f7384a-2a18-4f28-b0a6-f50762665391 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:42:59.967457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-50f7384a-2a18-4f28-b0a6-f50762665391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:00.013229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:00.064434 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 752/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:43:00.407763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb51b2-58ce-4ff4-97bb-804632f7b34e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:43:00.409420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27fb51b2-58ce-4ff4-97bb-804632f7b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:00.433249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:00.513134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb51b2-58ce-4ff4-97bb-804632f7b34e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:43:00.587325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:43:00.587932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:00.588214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:00.588482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:00.590083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:00.664066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:00.698403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:43:00.699909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b91dd-f6d1-44e0-9f88-15a3fdf40b39 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:43:00.719163 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 732/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:43:02.955191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8a44d-3978-40c9-af62-546f18820d93 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:02.955752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8a44d-3978-40c9-af62-546f18820d93 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:02.955752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8a44d-3978-40c9-af62-546f18820d93 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:02.957622 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 753/1485] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:43:02.962765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b104ad-6346-4d05-b864-37e74c972586 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:02.963200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b104ad-6346-4d05-b864-37e74c972586 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:02.963366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b104ad-6346-4d05-b864-37e74c972586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:03.028656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c3b104ad-6346-4d05-b864-37e74c972586 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:43:03.029866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c3b104ad-6346-4d05-b864-37e74c972586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:03.125753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 733/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:43:03.475441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8a44d-3978-40c9-af62-546f18820d93 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:43:03.476973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-24a8a44d-3978-40c9-af62-546f18820d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:03.579230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8a44d-3978-40c9-af62-546f18820d93 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:43:03.654329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:03.656292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:43:03.656894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:03.657171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:03.657439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:03.659374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:03.773621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:43:03.775146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18067c0a-1082-4fea-b0d7-7b91fe5fee2b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:43:03.794001 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 754/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:43:06.124697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1041c-23bc-445d-a22d-04497ddd079f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:06.125243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1041c-23bc-445d-a22d-04497ddd079f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:06.125243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1041c-23bc-445d-a22d-04497ddd079f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:06.126583 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 734/1488] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:43:06.131935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c2bea-9e85-45a1-8fdc-ffaabfdb1bd0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:06.132355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c2bea-9e85-45a1-8fdc-ffaabfdb1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:06.132528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c2bea-9e85-45a1-8fdc-ffaabfdb1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:06.207724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-545c2bea-9e85-45a1-8fdc-ffaabfdb1bd0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:43:06.207724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-545c2bea-9e85-45a1-8fdc-ffaabfdb1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:06.253915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:06.300237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 755/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:43:06.651824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1041c-23bc-445d-a22d-04497ddd079f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:43:06.653367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b2b1041c-23bc-445d-a22d-04497ddd079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:06.688278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:06.757015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1041c-23bc-445d-a22d-04497ddd079f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:43:06.829331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:43:06.829931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:06.830252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:06.830529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:06.832339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:06.912733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:06.942261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:43:06.943732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cdcad-79e1-410f-96c0-0c851e790a17 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:43:06.962065 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 735/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:43:09.522920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323608f-2ec3-42a2-b3ae-1b9712f800d2 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:09.523504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323608f-2ec3-42a2-b3ae-1b9712f800d2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:09.523504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323608f-2ec3-42a2-b3ae-1b9712f800d2 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:09.524803 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 756/1491] 10.222.0.20 () {54 vars in 927 bytes} [Tue Sep 6 10:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:43:09.529926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd4c75-3870-41f9-8e81-c603c1a0d921 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:09.530323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd4c75-3870-41f9-8e81-c603c1a0d921 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:09.530512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd4c75-3870-41f9-8e81-c603c1a0d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:09.597030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-63bd4c75-3870-41f9-8e81-c603c1a0d921 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:43:09.598312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63bd4c75-3870-41f9-8e81-c603c1a0d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:09.695042 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 736/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Tue Sep 6 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:43:10.042853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323608f-2ec3-42a2-b3ae-1b9712f800d2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:43:10.044433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f323608f-2ec3-42a2-b3ae-1b9712f800d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:10.148449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323608f-2ec3-42a2-b3ae-1b9712f800d2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:43:10.221097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:43:10.221626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:43:10.221907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:43:10.222205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:43:10.223831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:43:10.232757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:10.332593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:43:10.334225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b34cd9-ac75-4787-b8d7-1609c396bb2b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:43:10.352974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 757/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:43:19.693202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=82 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:43:20.350526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=50 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:44:40.672928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:40.675433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:40.675433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:40.756942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:44:40.758151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:40.860859 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 737/1494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:44:40.869417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:40.869932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:40.870042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:40.890024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:44:40.891250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:40.899754 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 758/1495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:44:40.904258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:40.914451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95526a56-7662-44f8-92d5-7f327c0eafad None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:40.920353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:40.920959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:40.921242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:40.921707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:40.922891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:44:40.923508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:40.925673 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:40.925673 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:44:40.925673 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:44:40.927408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:40.940028 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 738/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:44:40.948623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:40.957919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144d2ea-4bbf-4b59-9ab3-aac6c33d6270 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:40.962436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:40.963062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:40.963344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:40.963635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:40.964264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:40.965998 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:40.965998 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:44:40.965998 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:44:40.967204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:41.075208 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 759/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:44:40 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:44:41.079646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:41.090060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a71e31-75c6-424c-9936-c1191808ed33 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:41.139293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:44:41.146451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:41.147667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.147667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.147667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.148290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:41.149306 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:41.149306 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:44:41.149306 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:44:41.150501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:41.249798 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 739/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:44:41 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:44:41.253993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:41.264591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd27924-c5ff-4d5b-ab1d-9a77c389e40c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:41.269959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:41.271223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.271223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.271223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.271749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:41.272769 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:41.272769 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:44:41.272769 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:44:41.273657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:41.290467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 760/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:44:41.294576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:41.304667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c8f66-bf05-461b-8e71-96921bdc2306 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:41.309264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:41.309858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.310140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.310416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.311097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:41.312107 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:41.312107 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:44:41.312107 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:44:41.312989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a47ed-800a-4da7-b4bb-9d894df10105 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:41.326212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 740/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:44:41.330415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:41.341329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23698dc2-5bf6-4256-93cf-fd5f5ac8004a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:41.346280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:41.347579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.347860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.348138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] PATH_INFO: `/v3/projects/65c3565f9a8f444fabb8066c2d236dce/users/d3a7070b895d4732a20f613bd7a7d4b1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.363066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c3565f9a8f444fabb8066c2d236dce, user_id=d3a7070b895d4732a20f613bd7a7d4b1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:41.364093 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:41.364093 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:44:41.364093 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:44:41.366013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2279-d6ae-4a24-a6e0-d04e51621022 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:41.457021 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 761/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:44:41 2022] PUT /identity/v3/projects/65c3565f9a8f444fabb8066c2d236dce/users/d3a7070b895d4732a20f613bd7a7d4b1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:44:41.469262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7267f-35d6-4984-9f6c-edd76793f52d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.469556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7267f-35d6-4984-9f6c-edd76793f52d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.469831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7267f-35d6-4984-9f6c-edd76793f52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.497845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6dd7267f-35d6-4984-9f6c-edd76793f52d None None] MFA Rules not processed for user `d3a7070b895d4732a20f613bd7a7d4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:44:41.499083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6dd7267f-35d6-4984-9f6c-edd76793f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:41.563547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 741/1502] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:44:41.577237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061c98-5fae-4d01-9652-914d2da38230 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.577526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061c98-5fae-4d01-9652-914d2da38230 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.577799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061c98-5fae-4d01-9652-914d2da38230 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.579174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 762/1503] 10.222.0.20 () {54 vars in 964 bytes} [Tue Sep 6 10:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:44:41.584396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e74746-4027-419d-9f45-1e4e9fe6dde7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.584691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e74746-4027-419d-9f45-1e4e9fe6dde7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.584974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e74746-4027-419d-9f45-1e4e9fe6dde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.642361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-16e74746-4027-419d-9f45-1e4e9fe6dde7 None None] MFA Rules not processed for user `c06e2a3faa864da19cef4089e8392702`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:44:41.644203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-16e74746-4027-419d-9f45-1e4e9fe6dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:41.718337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 742/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Sep 6 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:44:41.725913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061c98-5fae-4d01-9652-914d2da38230 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:41.736552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061c98-5fae-4d01-9652-914d2da38230 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:41.740098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:41.740680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.740959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.741230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.749333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:41.750767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:41.760153 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 763/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:44:41.804804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b52e-bc43-4c2e-9c77-08387f272fa1 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.805100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b52e-bc43-4c2e-9c77-08387f272fa1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.805381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b52e-bc43-4c2e-9c77-08387f272fa1 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.806673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 743/1506] 10.222.0.20 () {52 vars in 830 bytes} [Tue Sep 6 10:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:44:41.810429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:41.873368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134613f-4731-481f-b721-2de20f38ae44 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:41.878712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] PATH_INFO: `/v3/users/d3a7070b895d4732a20f613bd7a7d4b1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a7070b895d4732a20f613bd7a7d4b1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:44:41.887398 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:44:41.888022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:42.122904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a7070b895d4732a20f613bd7a7d4b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:42.137858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a7070b895d4732a20f613bd7a7d4b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:42.138598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a7070b895d4732a20f613bd7a7d4b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:42.139223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a7070b895d4732a20f613bd7a7d4b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:42.161357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a7070b895d4732a20f613bd7a7d4b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:42.165222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:44:42.256271 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 764/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:44:41 2022] DELETE /identity/v3/users/d3a7070b895d4732a20f613bd7a7d4b1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:44:42.260645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:42.260935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:42.261276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:42.281476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:44:42.282683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:42.292739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:44:42.341093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 744/1508] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:44:42.351270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:42.352727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:42.430581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958e33-3034-4187-b932-5852b9d4a049 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:42.434181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535e54-63ed-452e-b219-e7fa2a680388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:42.434791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535e54-63ed-452e-b219-e7fa2a680388 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:42.435104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535e54-63ed-452e-b219-e7fa2a680388 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:42.435386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535e54-63ed-452e-b219-e7fa2a680388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:42.444290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535e54-63ed-452e-b219-e7fa2a680388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:42.445722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97535e54-63ed-452e-b219-e7fa2a680388 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:42.455209 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 765/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:44:42.864134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:44:42.865649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:44:42.881896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53ff65-3c79-43ed-a1b6-e10046c9b846 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:44:42.890855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:44:42.891567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:44:42.892021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:44:42.892443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] PATH_INFO: `/v3/projects/65c3565f9a8f444fabb8066c2d236dce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:44:42.893989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c3565f9a8f444fabb8066c2d236dce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:44:42.895455 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:44:42.895455 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:44:42.895455 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:44:42.896745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:44:43.007479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c3565f9a8f444fabb8066c2d236dce', 'request_id': 'req-562122d6-177e-4f5c-b525-cc587c716dab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:43.021147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c3565f9a8f444fabb8066c2d236dce', 'request_id': 'req-562122d6-177e-4f5c-b525-cc587c716dab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:43.027555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c3565f9a8f444fabb8066c2d236dce', 'request_id': 'req-562122d6-177e-4f5c-b525-cc587c716dab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:43.090304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] The token cache is being invalidate because project 65c3565f9a8f444fabb8066c2d236dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:44:43.090599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:43.091369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-562122d6-177e-4f5c-b525-cc587c716dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:44:43.092962 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 745/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:44:42 2022] DELETE /identity/v3/projects/65c3565f9a8f444fabb8066c2d236dce => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:44:52.451074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:44:53.086748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:47:54.634433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594c48-67fa-44c0-8bdd-3d791177d413 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:47:54.635133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594c48-67fa-44c0-8bdd-3d791177d413 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:47:54.635133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594c48-67fa-44c0-8bdd-3d791177d413 None None] PATH_INFO: `/v3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:47:54.636490 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 766/1511] 10.222.0.44 () {54 vars in 925 bytes} [Tue Sep 6 10:47:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:47:54.671537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f368-d386-42d2-8c64-b461c64e6466 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:47:54.671959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f368-d386-42d2-8c64-b461c64e6466 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:47:54.672091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f368-d386-42d2-8c64-b461c64e6466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:47:54.720638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7bd9f368-d386-42d2-8c64-b461c64e6466 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:47:54.721860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7bd9f368-d386-42d2-8c64-b461c64e6466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:47:54.792443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 746/1512] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Sep 6 10:47:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:47:59.075304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73c49-ed1a-471c-84e7-f2bc658e74cb None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:47:59.075874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73c49-ed1a-471c-84e7-f2bc658e74cb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:47:59.075874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73c49-ed1a-471c-84e7-f2bc658e74cb None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:47:59.077194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 767/1513] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 6 10:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:47:59.082317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1624a14-a2d3-4f3e-8c59-86f1b3fcc394 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:47:59.082750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1624a14-a2d3-4f3e-8c59-86f1b3fcc394 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:47:59.082867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1624a14-a2d3-4f3e-8c59-86f1b3fcc394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:47:59.102265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d1624a14-a2d3-4f3e-8c59-86f1b3fcc394 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:47:59.103495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d1624a14-a2d3-4f3e-8c59-86f1b3fcc394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:47:59.112008 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 747/1514] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:47:59.120124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73c49-ed1a-471c-84e7-f2bc658e74cb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:47:59.133869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73c49-ed1a-471c-84e7-f2bc658e74cb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:47:59.138783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469de86-cea4-493f-babe-941357849f72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:47:59.139402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469de86-cea4-493f-babe-941357849f72 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:47:59.139680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469de86-cea4-493f-babe-941357849f72 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:47:59.139954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469de86-cea4-493f-babe-941357849f72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:47:59.148114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469de86-cea4-493f-babe-941357849f72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:47:59.149733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469de86-cea4-493f-babe-941357849f72 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:47:59.164379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 768/1515] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:47:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:48:09.096892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=47 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:48:09.155625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:48:10.567035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6f374-e99c-4756-a775-1121ef5e644f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:10.567504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6f374-e99c-4756-a775-1121ef5e644f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:10.567617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6f374-e99c-4756-a775-1121ef5e644f None None] PATH_INFO: `/v3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:10.568882 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 748/1516] 10.222.0.17 () {54 vars in 925 bytes} [Tue Sep 6 10:48:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:48:10.575202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33045af2-965b-45db-b2b0-b110c36e5a2a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:10.575676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33045af2-965b-45db-b2b0-b110c36e5a2a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:10.575833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33045af2-965b-45db-b2b0-b110c36e5a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:10.595511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-33045af2-965b-45db-b2b0-b110c36e5a2a None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:48:10.596708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-33045af2-965b-45db-b2b0-b110c36e5a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:10.606995 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 769/1517] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Sep 6 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:48:19.615652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4889fd0-cd24-4964-8d0b-8e0d7c9a1435 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:19.616075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4889fd0-cd24-4964-8d0b-8e0d7c9a1435 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:19.617087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4889fd0-cd24-4964-8d0b-8e0d7c9a1435 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:19.617721 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 749/1518] 10.222.0.20 () {54 vars in 961 bytes} [Tue Sep 6 10:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:48:19.623212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8145-3126-4727-bd19-12fade9c128a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:19.623609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8145-3126-4727-bd19-12fade9c128a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:19.623804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8145-3126-4727-bd19-12fade9c128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:19.642961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f86a8145-3126-4727-bd19-12fade9c128a None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:48:19.644185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f86a8145-3126-4727-bd19-12fade9c128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:19.652780 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 770/1519] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:48:19.660150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4889fd0-cd24-4964-8d0b-8e0d7c9a1435 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:48:19.673961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4889fd0-cd24-4964-8d0b-8e0d7c9a1435 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:48:19.678889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6da2-c300-482d-8536-b1c06613d774 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:48:19.679516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6da2-c300-482d-8536-b1c06613d774 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:19.679800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6da2-c300-482d-8536-b1c06613d774 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:19.680075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6da2-c300-482d-8536-b1c06613d774 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:19.688874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f6da2-c300-482d-8536-b1c06613d774 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:48:19.690453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f6da2-c300-482d-8536-b1c06613d774 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:48:19.700795 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 750/1520] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:48:29.637722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:48:29.695959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:48:36.645218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c288-20af-482a-ab78-fecd735daaa5 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:36.645851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c288-20af-482a-ab78-fecd735daaa5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:36.645851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c288-20af-482a-ab78-fecd735daaa5 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:36.647184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 771/1521] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:48:36.652188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a28f-93e9-4b17-981f-61a2842381db None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:36.652642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a28f-93e9-4b17-981f-61a2842381db None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:36.653377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0a28f-93e9-4b17-981f-61a2842381db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:36.672929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-05a0a28f-93e9-4b17-981f-61a2842381db None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:48:36.674133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-05a0a28f-93e9-4b17-981f-61a2842381db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:36.732611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 751/1522] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:48:36.894810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c288-20af-482a-ab78-fecd735daaa5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:48:36.896590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd49c288-20af-482a-ab78-fecd735daaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:37.007469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c288-20af-482a-ab78-fecd735daaa5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:48:37.013207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e54b5d-0515-4877-a433-56df84c9cf7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:48:37.013819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54b5d-0515-4877-a433-56df84c9cf7c service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:37.014104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54b5d-0515-4877-a433-56df84c9cf7c service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:37.014384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54b5d-0515-4877-a433-56df84c9cf7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:37.022539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e54b5d-0515-4877-a433-56df84c9cf7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:48:37.024162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e54b5d-0515-4877-a433-56df84c9cf7c service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:48:37.033967 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 772/1523] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:48:37.883899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2889-ca1a-479b-af9a-e89ba45630af None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:37.884414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2889-ca1a-479b-af9a-e89ba45630af None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:37.884414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2889-ca1a-479b-af9a-e89ba45630af None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:37.885771 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 752/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 10:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:48:37.890723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dc872-8d1d-4e13-9bf0-d6db214e7c77 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:37.891189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dc872-8d1d-4e13-9bf0-d6db214e7c77 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:37.891310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dc872-8d1d-4e13-9bf0-d6db214e7c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:37.911231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8d9dc872-8d1d-4e13-9bf0-d6db214e7c77 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:48:37.912542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8d9dc872-8d1d-4e13-9bf0-d6db214e7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:37.921002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 773/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 10:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:48:38.081284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2889-ca1a-479b-af9a-e89ba45630af None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:48:38.095971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2889-ca1a-479b-af9a-e89ba45630af None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:48:38.101451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591697-4d24-45ae-806c-e02a737fa476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:48:38.102044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591697-4d24-45ae-806c-e02a737fa476 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:38.102329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591697-4d24-45ae-806c-e02a737fa476 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:38.102601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591697-4d24-45ae-806c-e02a737fa476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:38.111222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591697-4d24-45ae-806c-e02a737fa476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:48:38.112838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591697-4d24-45ae-806c-e02a737fa476 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:48:38.122460 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 753/1526] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:48:42.296194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563bb7-0d76-44d9-84f7-1d5ed42d08ee None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:42.296942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563bb7-0d76-44d9-84f7-1d5ed42d08ee None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:42.296942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563bb7-0d76-44d9-84f7-1d5ed42d08ee None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:42.298465 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 774/1527] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:48:42.304321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0588-3d9b-43a1-bf51-d9eb35276041 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:42.304893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0588-3d9b-43a1-bf51-d9eb35276041 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:42.304893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0588-3d9b-43a1-bf51-d9eb35276041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:42.328948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-890f0588-3d9b-43a1-bf51-d9eb35276041 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:48:42.330185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-890f0588-3d9b-43a1-bf51-d9eb35276041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:42.338284 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 754/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:48:42.689761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8563bb7-0d76-44d9-84f7-1d5ed42d08ee None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:48:42.691496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c8563bb7-0d76-44d9-84f7-1d5ed42d08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:42.747568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8563bb7-0d76-44d9-84f7-1d5ed42d08ee None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:48:42.751053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f214c-49ab-4b19-8a97-5febcf1a6ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:48:42.751649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f214c-49ab-4b19-8a97-5febcf1a6ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:42.751930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f214c-49ab-4b19-8a97-5febcf1a6ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:42.752204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f214c-49ab-4b19-8a97-5febcf1a6ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:42.761016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f214c-49ab-4b19-8a97-5febcf1a6ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:48:42.763036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f214c-49ab-4b19-8a97-5febcf1a6ba2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:48:42.772762 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 775/1529] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:48:45.007129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e683c-adb1-4685-8692-5e4da5931737 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:45.007703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e683c-adb1-4685-8692-5e4da5931737 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:45.007703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e683c-adb1-4685-8692-5e4da5931737 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:45.009015 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 755/1530] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 10:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:48:45.014646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7236c-2a68-4121-96f7-e447309aefa2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:45.015131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7236c-2a68-4121-96f7-e447309aefa2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:45.015246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7236c-2a68-4121-96f7-e447309aefa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:45.035191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d2a7236c-2a68-4121-96f7-e447309aefa2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:48:45.036397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d2a7236c-2a68-4121-96f7-e447309aefa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:48:45.044211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 776/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:48:45.390078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e683c-adb1-4685-8692-5e4da5931737 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:48:45.400989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e683c-adb1-4685-8692-5e4da5931737 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:48:45.405531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb278-4af2-4641-9376-ea28c1a15885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:48:45.406160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb278-4af2-4641-9376-ea28c1a15885 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:48:45.406442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb278-4af2-4641-9376-ea28c1a15885 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:48:45.406712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb278-4af2-4641-9376-ea28c1a15885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:48:45.415975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb278-4af2-4641-9376-ea28c1a15885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:48:45.417394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb278-4af2-4641-9376-ea28c1a15885 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:48:45.427465 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 756/1532] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:48:55.030184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=78 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:48:55.423253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=42 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:49:38.927122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a60c-c45b-423b-b4b1-87ffe5c8ee2f None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:49:38.927660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a60c-c45b-423b-b4b1-87ffe5c8ee2f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:49:38.927831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a60c-c45b-423b-b4b1-87ffe5c8ee2f None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:49:38.929175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 777/1533] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:49:38.934390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076dc05-afca-4d98-95e5-94d752b5cfae None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:49:38.934829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076dc05-afca-4d98-95e5-94d752b5cfae None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:49:38.934964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076dc05-afca-4d98-95e5-94d752b5cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:49:38.955617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0076dc05-afca-4d98-95e5-94d752b5cfae None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:49:38.956817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0076dc05-afca-4d98-95e5-94d752b5cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:49:38.966649 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 757/1534] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:49:48.949993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:12.859566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:12.860641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:12.861142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:12.908539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:12.910190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:12.923298 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 778/1535] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:12.937349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee7fe9-70dd-40f0-a553-1dee9a545cd6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:12.937935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee7fe9-70dd-40f0-a553-1dee9a545cd6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:12.937935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee7fe9-70dd-40f0-a553-1dee9a545cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:12.984992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-74ee7fe9-70dd-40f0-a553-1dee9a545cd6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:12.986224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-74ee7fe9-70dd-40f0-a553-1dee9a545cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.005999 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 758/1536] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.011076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.026447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888577a-49bb-4e30-991d-e7bb67ec1e69 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.039393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.043813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.043813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.043813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.043813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.043813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.047305 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:50:13.047305 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:50:13.047305 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:50:13.048256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.062700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f013fd4-e375-48fc-ba4e-9de27aae32c3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.063075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f013fd4-e375-48fc-ba4e-9de27aae32c3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.063269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f013fd4-e375-48fc-ba4e-9de27aae32c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.063866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 779/1537] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.075305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.090292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee499a5-db1e-43cc-be43-2759bf816b1b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.097783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff70795-3c06-4855-ab1d-93e7c3a7d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.098565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70795-3c06-4855-ab1d-93e7c3a7d90f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.098854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70795-3c06-4855-ab1d-93e7c3a7d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.099175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff70795-3c06-4855-ab1d-93e7c3a7d90f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.099812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70795-3c06-4855-ab1d-93e7c3a7d90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.103811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff70795-3c06-4855-ab1d-93e7c3a7d90f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.118814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8f013fd4-e375-48fc-ba4e-9de27aae32c3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.119996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f013fd4-e375-48fc-ba4e-9de27aae32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.144441 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 759/1538] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.145876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd44c3-81a9-4565-b457-d3f98cf0c79d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.146061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd44c3-81a9-4565-b457-d3f98cf0c79d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.146283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd44c3-81a9-4565-b457-d3f98cf0c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.168957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b2dd44c3-81a9-4565-b457-d3f98cf0c79d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.170179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b2dd44c3-81a9-4565-b457-d3f98cf0c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.190697 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 760/1539] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.192117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f744ec-67a0-47e1-b40d-9275a37fe838 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.192510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f744ec-67a0-47e1-b40d-9275a37fe838 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.192762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f744ec-67a0-47e1-b40d-9275a37fe838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.214897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e8f744ec-67a0-47e1-b40d-9275a37fe838 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.218630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8f744ec-67a0-47e1-b40d-9275a37fe838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.225532 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 761/1540] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.226820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ee482-69a6-44ac-bcc4-61428112d5f2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.227155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ee482-69a6-44ac-bcc4-61428112d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.227440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ee482-69a6-44ac-bcc4-61428112d5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.245498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 780/1541] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:13.246986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b82c-1593-4b8d-bfdf-22b9432eb8e8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.247381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b82c-1593-4b8d-bfdf-22b9432eb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.247737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b82c-1593-4b8d-bfdf-22b9432eb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.248067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-305ee482-69a6-44ac-bcc4-61428112d5f2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.250102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-305ee482-69a6-44ac-bcc4-61428112d5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.270408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4c49b82c-1593-4b8d-bfdf-22b9432eb8e8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.271952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c49b82c-1593-4b8d-bfdf-22b9432eb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.317992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 762/1542] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.319843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32392a8-981b-47c9-be6e-65077369ff76 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.320190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32392a8-981b-47c9-be6e-65077369ff76 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.320629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32392a8-981b-47c9-be6e-65077369ff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.341140 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 781/1543] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.343422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fe4a-a680-4f0c-9ea9-51f43738bbc5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.343988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fe4a-a680-4f0c-9ea9-51f43738bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.344472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fe4a-a680-4f0c-9ea9-51f43738bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.347928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c32392a8-981b-47c9-be6e-65077369ff76 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.349208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c32392a8-981b-47c9-be6e-65077369ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.359186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 763/1544] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.360382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083179e-5507-40e3-b47a-b589057cd6d0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.360901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083179e-5507-40e3-b47a-b589057cd6d0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.361182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083179e-5507-40e3-b47a-b589057cd6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.368089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8199fe4a-a680-4f0c-9ea9-51f43738bbc5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.369400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8199fe4a-a680-4f0c-9ea9-51f43738bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.381448 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 782/1545] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.382954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.383282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.383795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.388977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c083179e-5507-40e3-b47a-b589057cd6d0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.390840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c083179e-5507-40e3-b47a-b589057cd6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.402175 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 764/1546] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.403362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.403650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.404040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.410439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.411669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.422801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 783/1547] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.423709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.424480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.425685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.433739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311602f-4005-482f-94fa-8def6d014ce3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.437799 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 765/1548] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.438858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.439240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.439837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.440149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.440423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.441042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.442123 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:50:13.442123 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:50:13.442123 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:50:13.443358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84693b2-192c-499e-a633-930d0d0edad2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.451031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bafa7d-ea34-46a4-9a2a-43d387e240d0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.457125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.457741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.458021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.458295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.458956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.459293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.460901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babb663-0402-46b7-a517-efd877c55018 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.473005 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 766/1549] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.474176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b740-6a55-4247-b0a9-627e378d65c2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.474469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b740-6a55-4247-b0a9-627e378d65c2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.474761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635b740-6a55-4247-b0a9-627e378d65c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.501239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e635b740-6a55-4247-b0a9-627e378d65c2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.502471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e635b740-6a55-4247-b0a9-627e378d65c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.510421 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 767/1550] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.511618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.511901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.512177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.532539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.535707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.541513 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 768/1551] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.542296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.551504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66e283-1166-46b2-b29e-7f8d8213d080 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.556251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.556824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.557103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.557374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.557997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.558298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.559932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753368a-f501-4b74-bc06-48d0c12b9a2a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.564335 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 784/1552] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:13.564335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.564335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.564335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.582970 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 769/1553] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.582970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.582970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.582970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.583395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.584082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.592257 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 785/1554] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.593695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.598117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:13.599330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:13.606034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70481cc-16c9-41c7-b2f2-4ad4c2787d03 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.607271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 770/1555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:13.608014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.611481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.612190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.612473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.612857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.613499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.613797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.615418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.617955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc77e3-cf90-415d-bb89-efcbc2f570c7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.622801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.623351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.623623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.624488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.628279 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 786/1556] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.628889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.629299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.630322 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:50:13.630322 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:50:13.630322 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:50:13.631540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.640542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440251f-e335-47b4-8fc0-413f74b8d997 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.645112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.645697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.645976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.646246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.646880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.647204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.648897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.660742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 787/1557] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.661526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.671855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33903c48-b177-4090-b724-50638ee04353 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.676572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.677145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.677417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.677687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.678352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.678753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.680288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.692301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 788/1558] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.693410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.706716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cacfa-038c-42f7-abbc-c7ff6533ff97 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.711570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.712150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.712432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.712706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.713330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.714895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.725553 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 789/1559] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:13.727718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.735956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32c48-c363-4fd5-8da0-dfd810b7585a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.740502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.741043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.741322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.741594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.742180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.744041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.763789 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 771/1560] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:13.763789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.810232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:13.824861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9251a1-3257-49c1-840d-2404884f552b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.830110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.830714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.830992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.831296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.831942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.832251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.833854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.838712 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 790/1561] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:13.840078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.847522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 772/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.851536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:13.852422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.862828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eea45-8b99-46bf-aa6c-077a596d14a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.903949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f008f-e2a2-4ad7-8ed8-3591a275a3c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.912778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.913470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.913741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.914017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.914689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:13.915075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.916695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.919417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.920110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.920396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.920709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.921344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.923262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:13.929078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 791/1563] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:13.930023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:13.941837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600f9d7-2118-4bc6-a107-4f29ff04fd8b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:13.946436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:13.947036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:13.949692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:13.949692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:13.949692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:13.950073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.003858 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 773/1564] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.004696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.029461 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 792/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:13 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.029461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.071828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8e51f-bb6a-4202-8098-8167b903eebc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.091682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e0e9-5635-4844-9a04-d47b29357f14 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.096336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.096967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.097249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.097523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.098165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.099803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.109932 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 793/1566] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:14.110709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.123288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe5b05-551d-43b0-9699-b52763063cab admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.128707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.130934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.130934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.130934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.130934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.132474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.132659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.133221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.133594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.133958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.134678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.136777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.235711 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 794/1567] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.236448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.246134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e6df8-ace1-45d6-889d-5d2cd914ac0d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.247262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:14.251570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.252135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.252411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.252682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.253301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.255232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.259208 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 774/1568] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.260095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.324403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2657b0a-17e2-4142-8a9a-7c9130e88532 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.329056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.329653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.329930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.330203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.330857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.332833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.344380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 795/1569] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.345293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.355323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc658e-4e25-428a-87ee-68484d48c450 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.360440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.361022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.361302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.361572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.362186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.364129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.413292 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 775/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.414141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.459394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 796/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.460538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.477398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39fce7-6761-4acf-9d00-3ef30135dc29 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.482620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:14.524464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae723e-9d9b-47d6-adbd-ab8df55da4ff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.529212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.529818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.530598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.530873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.531517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.533416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.535967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.537081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.537081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.537236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.537822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.539904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.617797 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 797/1572] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.618609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.628066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d3f0-00ef-4ee4-ae04-ac975a5d11e6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.632530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.633136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.633412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.633682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] PATH_INFO: `/v3/projects/b549b14bedce4fb3a8418a9c63e5ded1/users/a0290aa1534d42b291a40c2301d5df0c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.647785 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 776/1573] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.647785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.651865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b549b14bedce4fb3a8418a9c63e5ded1, user_id=a0290aa1534d42b291a40c2301d5df0c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.651865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.658037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57ff6-3cfe-4262-b6d1-0ab07d889dc2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.662804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.663442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.663724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.663996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.664637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.666258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.677069 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 777/1574] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:14.678527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.688550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f20a05-748e-4a5e-84f0-17d56d12ac15 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.693008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.693572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.693853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.694125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.694725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.696611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.705326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:14.726962 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 798/1575] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:14 2022] PUT /identity/v3/projects/b549b14bedce4fb3a8418a9c63e5ded1/users/a0290aa1534d42b291a40c2301d5df0c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:14.727748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.791502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82451-ec6a-46bf-8691-6d258fe24b03 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.796060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.796699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.796978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.797248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.797908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.799580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.809091 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 799/1576] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:14.809091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.819733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8504b9-0537-4bc6-9205-88278aa93cba admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.823056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 778/1577] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.823056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.824575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.825238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.825511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.825778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.826464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.829044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.831537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068261f-ab40-42f3-843d-ab59d9de141c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.836145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.837015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.837584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.838206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.838866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.840878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.930115 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 800/1578] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.937822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.941440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c7f7-ead3-429d-8b72-907422ecb1c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.946009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.946576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.946858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.947163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.947782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.949357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.959488 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 801/1579] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:14.960258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.963414 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 779/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:14.964253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:14.972366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6238-cd4a-421a-8a3d-7b9f66b5638b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.975929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070163c-c32a-49cf-8358-1868d9f1d482 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:14.976684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc1828-9b1f-4b02-9639-9039236405c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.977284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc1828-9b1f-4b02-9639-9039236405c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.977545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc1828-9b1f-4b02-9639-9039236405c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.977812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc1828-9b1f-4b02-9639-9039236405c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.978423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc1828-9b1f-4b02-9639-9039236405c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.980075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc1828-9b1f-4b02-9639-9039236405c5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.980769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:14.981413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.981703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.982023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.982657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:14.984941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:14.990784 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 802/1581] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:14.992233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:14.992639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:14.992917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:14.997332 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 780/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:14.998428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.008698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c5a8-c1a5-462b-a9b4-9a7c84eea704 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.013476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.014087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.014377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.014641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.015318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.016895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.023701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] MFA Rules not processed for user `a0290aa1534d42b291a40c2301d5df0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:15.024927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:15.027214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 781/1583] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.031127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.040548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98020aa5-a335-4165-8863-1ade7788ec5e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.045176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.046182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.046464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.046735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.047379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.048933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.054855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:15.058708 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 782/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.059576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.069899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3be94-f6ed-409f-80f1-f87ba86a4613 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.074562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.075175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.075460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.075735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.076366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.078111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.088247 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 783/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.089104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.091873 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 803/1586] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:15.100016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.100145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176231f-26a1-42c3-89ab-317bb1ff34cf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.103125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aea82f-cec7-49a0-82af-dc34dbb72637 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.103548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.104130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.104411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.104683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.105365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.106932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.108705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.109125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.109435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.109712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.110340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.111954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.117920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 784/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.118721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.125584 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 804/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.125584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.131599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0658bf-fa18-4933-af0b-baf7a24a63e3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.135337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad43d6-f7ca-40f9-a808-5aead0947654 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.136192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.136778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.137059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.137331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.137954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.139600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.140380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.141015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.141323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.141603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] PATH_INFO: `/v3/projects/1f68e80660194823bad80a559ccb7d54/users/09891dc24cb14e9597c7d84d64f93e3e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.149284 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 785/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.150048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.156940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f68e80660194823bad80a559ccb7d54, user_id=09891dc24cb14e9597c7d84d64f93e3e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.159456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6596-fddc-4bb2-958e-5c0d8e6df6e8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.159619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.164057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.164683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.164964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.165236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] PATH_INFO: `/v3/projects/69fc984175e248af87dad4c67fb7345c/users/5b041179959d46a2a93d4cc9d3b339c5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.180255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fc984175e248af87dad4c67fb7345c, user_id=5b041179959d46a2a93d4cc9d3b339c5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.181269 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:50:15.181269 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:50:15.181269 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:50:15.183211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.255358 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 805/1590] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:15 2022] PUT /identity/v3/projects/1f68e80660194823bad80a559ccb7d54/users/09891dc24cb14e9597c7d84d64f93e3e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:15.256223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.277752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 786/1591] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:15 2022] PUT /identity/v3/projects/69fc984175e248af87dad4c67fb7345c/users/5b041179959d46a2a93d4cc9d3b339c5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:15.278710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.319757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89456c-d0a1-4e8f-aea3-6e8f0cec05b6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.354374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665f20-a1e7-47b9-b14a-b4c14fec0a17 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.359043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.359661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.359957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.360210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.360844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.362425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.375052 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 787/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.377367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.381277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.381889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.382318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.382444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.383113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.384747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.387031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df8c5-c4b8-422c-a123-bed7c969ae9b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.392288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.392876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.393156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.393432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.394053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.395379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 806/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.395957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.396065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.405306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039db62-f0c2-451f-9623-6914ed45474a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.410239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.410883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.411201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.411480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] PATH_INFO: `/v3/projects/7b2e7b2d14094531848de75f6fe7690d/users/2fe4e82e6fcb40a38fb11a4c65d5d73f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.426390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2e7b2d14094531848de75f6fe7690d, user_id=2fe4e82e6fcb40a38fb11a4c65d5d73f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.429095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.484443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 788/1594] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:15 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:15.485327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.504593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:15.520733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 807/1595] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:15 2022] PUT /identity/v3/projects/7b2e7b2d14094531848de75f6fe7690d/users/2fe4e82e6fcb40a38fb11a4c65d5d73f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:15.522293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.540991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:15.554357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913bf0-2dc6-441c-a84a-43b98c2e605e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.592110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4be91-9dcb-4755-b521-06e6386e3b11 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.596913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de213f-e254-4511-be87-1c32dec3959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.597598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de213f-e254-4511-be87-1c32dec3959b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.597879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de213f-e254-4511-be87-1c32dec3959b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.598159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de213f-e254-4511-be87-1c32dec3959b admin admin] PATH_INFO: `/v3/projects/2c708f857b3f445985133945eb88d6d3/users/b4effbac6059440f9105f21183de9b23/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.614518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de213f-e254-4511-be87-1c32dec3959b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c708f857b3f445985133945eb88d6d3, user_id=b4effbac6059440f9105f21183de9b23, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.615393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2cab9-62a6-4c5e-97ab-874f3c63594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.616005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cab9-62a6-4c5e-97ab-874f3c63594a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.616289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cab9-62a6-4c5e-97ab-874f3c63594a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.616565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2cab9-62a6-4c5e-97ab-874f3c63594a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.617246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de213f-e254-4511-be87-1c32dec3959b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.617354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cab9-62a6-4c5e-97ab-874f3c63594a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.618829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2cab9-62a6-4c5e-97ab-874f3c63594a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.629648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 789/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:15.630845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.631162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.631442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.659080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] MFA Rules not processed for user `09891dc24cb14e9597c7d84d64f93e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:15.660335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:15.715193 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 808/1597] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:15 2022] PUT /identity/v3/projects/2c708f857b3f445985133945eb88d6d3/users/b4effbac6059440f9105f21183de9b23/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:15.716584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.716869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.717142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.737371 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 790/1598] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:15.738418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.749580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] MFA Rules not processed for user `5b041179959d46a2a93d4cc9d3b339c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:15.750923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729b055-6a02-4e6c-9fbd-c732d3347524 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.751198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:15.797763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:15.807167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.807829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.808113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.808391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] PATH_INFO: `/v3/projects/8f141429ddf044e1812ea5e3dbecd995/users/3ff6ad8e78ca4b6dbea50007a5737f5e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.816100 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 809/1599] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:15.817368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.823535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f141429ddf044e1812ea5e3dbecd995, user_id=3ff6ad8e78ca4b6dbea50007a5737f5e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.826226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.827219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfd675-706f-4a94-a506-ea6c3acac941 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:15.832075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641946b-e7da-4e89-9e3d-9353da6f38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:15.832894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641946b-e7da-4e89-9e3d-9353da6f38ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.833182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641946b-e7da-4e89-9e3d-9353da6f38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.833498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641946b-e7da-4e89-9e3d-9353da6f38ef admin admin] PATH_INFO: `/v3/projects/2ee1411eee0a4ae88a3530c4cb88dfb5/users/5ebcb796fc134c0cadbce30ce9051ec8/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.848189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641946b-e7da-4e89-9e3d-9353da6f38ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee1411eee0a4ae88a3530c4cb88dfb5, user_id=5ebcb796fc134c0cadbce30ce9051ec8, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:15.850770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641946b-e7da-4e89-9e3d-9353da6f38ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:15.918568 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 791/1600] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:15 2022] PUT /identity/v3/projects/8f141429ddf044e1812ea5e3dbecd995/users/3ff6ad8e78ca4b6dbea50007a5737f5e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:15.919683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:15.966940 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 810/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:15 2022] PUT /identity/v3/projects/2ee1411eee0a4ae88a3530c4cb88dfb5/users/5ebcb796fc134c0cadbce30ce9051ec8/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:15.969661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:15.970170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:15.970604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:15.987238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73e2ec-bac1-4def-bd4f-031c1baa08a0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.008368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] MFA Rules not processed for user `2fe4e82e6fcb40a38fb11a4c65d5d73f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:16.009610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:16.043495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9781a7-0f6a-46dc-bc10-cc75aa408795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.044100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9781a7-0f6a-46dc-bc10-cc75aa408795 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.044416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9781a7-0f6a-46dc-bc10-cc75aa408795 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.044654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9781a7-0f6a-46dc-bc10-cc75aa408795 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.045282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9781a7-0f6a-46dc-bc10-cc75aa408795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.047773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9781a7-0f6a-46dc-bc10-cc75aa408795 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.064300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:16.074327 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 811/1602] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:16.075255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.085218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39ca26-a309-4f33-bd83-d27873f9ae38 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.089704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.090330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.090609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.090886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] PATH_INFO: `/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2/users/78161f23888f4b3bb35f9cdbb6462730/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.105502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa3489a9bbe41a29a10cb3da1128ca2, user_id=78161f23888f4b3bb35f9cdbb6462730, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.108819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.157947 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 792/1603] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:15 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.159238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.159527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.159804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.187347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] MFA Rules not processed for user `b4effbac6059440f9105f21183de9b23`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:16.191897 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 812/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:16 2022] PUT /identity/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2/users/78161f23888f4b3bb35f9cdbb6462730/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:16.191897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.192101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:16.245940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01042ea7-0353-44c7-a90b-a40f4c1a1f1b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.250169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712b6dc-559b-40c2-b1e6-267f285dd1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.250783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b6dc-559b-40c2-b1e6-267f285dd1cc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.251091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b6dc-559b-40c2-b1e6-267f285dd1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.251370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b6dc-559b-40c2-b1e6-267f285dd1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.252536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:16.256311 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 793/1605] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:16.257393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.314176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712b6dc-559b-40c2-b1e6-267f285dd1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.315675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712b6dc-559b-40c2-b1e6-267f285dd1cc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.324956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 813/1606] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:16.326214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.326489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78fd32-4f79-44a8-91c1-b7fa39a9ed09 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.326609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.326764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.332007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8723-f09d-40a6-ab4f-4147f517ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.332616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8723-f09d-40a6-ab4f-4147f517ee12 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.332900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8723-f09d-40a6-ab4f-4147f517ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.333180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8723-f09d-40a6-ab4f-4147f517ee12 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.333819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8723-f09d-40a6-ab4f-4147f517ee12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.335769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8723-f09d-40a6-ab4f-4147f517ee12 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.355596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] MFA Rules not processed for user `3ff6ad8e78ca4b6dbea50007a5737f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:16.356865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:16.431259 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 794/1607] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.431470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 814/1608] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:16.431470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.432089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.432310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.432673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.446334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589652-2f89-473c-ac4c-d211eb41d5c5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.456133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:16.462863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] MFA Rules not processed for user `5ebcb796fc134c0cadbce30ce9051ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:16.464161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:16.507798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.508537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.508823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.509100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.509731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.511719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.535935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 795/1609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:16.536873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.550457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7992d-fba3-4ce3-a675-e4a78e1acfb6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.555331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8b11-a626-43c2-acc8-0003d1f887c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.556130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8b11-a626-43c2-acc8-0003d1f887c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.556417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8b11-a626-43c2-acc8-0003d1f887c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.556710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8b11-a626-43c2-acc8-0003d1f887c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.557361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8b11-a626-43c2-acc8-0003d1f887c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.559050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8b11-a626-43c2-acc8-0003d1f887c6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.569789 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 796/1610] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:16.571115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.571339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.571619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.594319 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 815/1611] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.596884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.604361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] MFA Rules not processed for user `78161f23888f4b3bb35f9cdbb6462730`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:16.605563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:16.666605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:16.669271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2709-0119-4c61-98ae-79ade8698d35 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.674698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.680943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.680943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.680943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.680943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.680943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.681286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 797/1612] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:16.681286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.694155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2167-3b11-4a1e-aaaf-0c9e8965d61d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.698865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.700011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.700304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.700627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.701670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.703717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.804557 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 816/1613] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.805755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.816476 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 798/1614] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.817258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.828047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5874c0-6a28-4aa6-8161-6772a641fc47 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.869290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ae49-30f9-4534-90ff-463709c60879 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:16.874867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.875512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.875801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.876099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.876723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.878625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.886319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:16.886960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:16.887271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:16.887549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:16.888616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:16.891754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:16.981562 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 817/1615] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.982373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:16.991989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:16.996625 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 799/1616] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:16.996625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.046052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ee3e0-a3c8-41b7-b2ee-8767f5453371 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.060708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c024b6-134c-483d-92d8-f2e2bfc92abc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.066606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.067299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.067585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.067890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.068541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.070444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.102339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.102989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.103297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.103567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] PATH_INFO: `/v3/projects/84361292e17e482db5ca24c7a85b490b/users/40617844ed874bfb8a64be2fdd09fa22/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.117976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84361292e17e482db5ca24c7a85b490b, user_id=40617844ed874bfb8a64be2fdd09fa22, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.120896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.192907 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 800/1617] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:16 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:17.193721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.203243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5dbb-1237-43c4-a666-a4e5033e36d3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.207790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.209066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.209066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.209066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.209561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.211513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.229498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 818/1618] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:16 2022] PUT /identity/v3/projects/84361292e17e482db5ca24c7a85b490b/users/40617844ed874bfb8a64be2fdd09fa22/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:17.230342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.289342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97715358-2851-4a29-8583-f7436a1ee86b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.293373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 801/1619] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:17 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:17.293373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.324550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:17.337254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:17.349946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.350583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.350863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.355161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] PATH_INFO: `/v3/users/09891dc24cb14e9597c7d84d64f93e3e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.355161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=09891dc24cb14e9597c7d84d64f93e3e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.355161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.355861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f949-98fb-4529-994c-b44166652bae admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.361289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.361894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.362170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.362442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.363176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.365118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.481049 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 802/1620] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:17 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:17.481829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.491698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada966be-9917-4871-87d8-5f2aec96848d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.496490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.501004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.501004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.501004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.501004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.501004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.509798 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 803/1621] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:17.510542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.519582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588a6d-e99c-47b3-a57a-65431543ea42 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.524028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.524600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.524878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.525154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.525736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.527616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.562864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09891dc24cb14e9597c7d84d64f93e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:17.569610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09891dc24cb14e9597c7d84d64f93e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:17.570258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09891dc24cb14e9597c7d84d64f93e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:17.570879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09891dc24cb14e9597c7d84d64f93e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:17.582662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09891dc24cb14e9597c7d84d64f93e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:17.635712 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 804/1622] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:17 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:17.636668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.638294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.650025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20c35-b5bc-40b4-b0ed-fd59b9556b36 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.654518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.655646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.655915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.656188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.656816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.658685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.663580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 819/1623] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:17 2022] DELETE /identity/v3/users/09891dc24cb14e9597c7d84d64f93e3e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:17.664601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.666044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.729827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd69229-9d3e-420f-9a1f-3c533c35f3cf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.735187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.735737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.736020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.736295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.736922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.738509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.750754 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 820/1624] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:17.751712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.753320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.756271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 805/1625] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:17 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:17.757252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.758981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.766898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb3ba-5123-4f29-b9c3-55478d3e6667 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.771720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.772117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2f7c2-326c-43b0-9929-2749cac5f29b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.772312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.772597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.772875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.773509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.775131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.776645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.777226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.777504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.777772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.778389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.780345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.785486 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 821/1626] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:17.786289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.787992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.800563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bdcdc-e0c3-4444-ab38-21268fbb5b17 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.805287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.805862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.806147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.806425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.807161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.808746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.819426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 822/1627] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:17.820166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.821729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.834507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80f0f-3748-405c-9e75-20dd680494e0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.839153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9fa5-ebac-4310-b6c0-57bfbb6228ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.839769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9fa5-ebac-4310-b6c0-57bfbb6228ac admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.840051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9fa5-ebac-4310-b6c0-57bfbb6228ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.840333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9fa5-ebac-4310-b6c0-57bfbb6228ac admin admin] PATH_INFO: `/v3/projects/0c357f7b38c84c40bf47211a0acae2d7/users/bfce6a0bfb9a4c8ab68fbd3ae48e8d8c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.854469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af9fa5-ebac-4310-b6c0-57bfbb6228ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c357f7b38c84c40bf47211a0acae2d7, user_id=bfce6a0bfb9a4c8ab68fbd3ae48e8d8c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:17.857164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af9fa5-ebac-4310-b6c0-57bfbb6228ac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:17.926963 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 806/1628] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:17 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:17.927905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:17.929502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.942122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35c01-e186-45c6-a410-f6f02e93b988 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:17.949726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 823/1629] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:17 2022] PUT /identity/v3/projects/0c357f7b38c84c40bf47211a0acae2d7/users/bfce6a0bfb9a4c8ab68fbd3ae48e8d8c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:17.951156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:17.951445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:17.951851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:17.970305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:17.971548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:17.980849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:17.998712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:17.999809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.000093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.000401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.001039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.002635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.012331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 807/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.013181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.022687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee5c9-0c3d-4cb8-bffe-27da294e2a89 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.027561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.028197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.028480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.028758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] PATH_INFO: `/v3/projects/c115c3ce2b104b71849aef9802fbba58/users/011b3766208c4f1f99a4d4f4e0ec5e67/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.034376 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 824/1631] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:18.035275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.043960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c115c3ce2b104b71849aef9802fbba58, user_id=011b3766208c4f1f99a4d4f4e0ec5e67, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.045207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683abd55-1921-4766-abc3-64e2ff105088 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.047228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.051049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.051653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.051935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.052209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.052855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.054429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.065062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 825/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.065825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.075198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d85e30-01b5-49b0-bbe7-1792b067a5f0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.080128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.080917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.081617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.081893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] PATH_INFO: `/v3/projects/84361292e17e482db5ca24c7a85b490b/users/40617844ed874bfb8a64be2fdd09fa22/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.083819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84361292e17e482db5ca24c7a85b490b, user_id=40617844ed874bfb8a64be2fdd09fa22, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.086508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.096691 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 826/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/84361292e17e482db5ca24c7a85b490b/users/40617844ed874bfb8a64be2fdd09fa22/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.097429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.115689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 808/1634] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/c115c3ce2b104b71849aef9802fbba58/users/011b3766208c4f1f99a4d4f4e0ec5e67/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.116620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.147382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.159228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df252c-d0bc-442c-befe-80934745d1c8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.179523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96199882-1b73-4d4e-9bcc-6fd291f45097 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.185394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.186153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.187272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.187528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.188171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.189800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.199886 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 809/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.203236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.210628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365694a-2e5a-4102-98f4-249dbdb8620c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.215030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.215234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.215716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.215828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.215994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.216090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.216262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] PATH_INFO: `/v3/projects/d764a01fa6ba47db9efe3b70401f2089/users/722e850b74954dbdb49d0feb4e59bdf4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.216363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.216959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.219122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.228865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 810/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.229642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.236061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d764a01fa6ba47db9efe3b70401f2089, user_id=722e850b74954dbdb49d0feb4e59bdf4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.238777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.239532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8699-7d91-4950-a413-c1f6e57f5813 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.244049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.244678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.244954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.245224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] PATH_INFO: `/v3/projects/9af44e9347ef4fbf8bac035e9c494411/users/2be10b88d4d64e29b2c590ac7a413d34/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.262479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af44e9347ef4fbf8bac035e9c494411, user_id=2be10b88d4d64e29b2c590ac7a413d34, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.263828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.344586 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 827/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/d764a01fa6ba47db9efe3b70401f2089/users/722e850b74954dbdb49d0feb4e59bdf4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.345483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.347100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:18.372692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.376479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 811/1638] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/9af44e9347ef4fbf8bac035e9c494411/users/2be10b88d4d64e29b2c590ac7a413d34/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.377879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.404148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefb9d2-3fc7-4911-8d8d-a5765e7f1d41 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.442229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756ddd-8960-4be8-ab0f-464bd1de5579 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.447282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.447945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.448291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.448567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] PATH_INFO: `/v3/projects/2fd859a4932d4791ab74f31ca6669a1e/users/ee08cf2807e54157824cde8e9d4b6201/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.453608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731aa59-37d4-4a4c-bfd5-d29a8b5bf263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.454214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731aa59-37d4-4a4c-bfd5-d29a8b5bf263 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.454904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731aa59-37d4-4a4c-bfd5-d29a8b5bf263 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.454904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731aa59-37d4-4a4c-bfd5-d29a8b5bf263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.463899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd859a4932d4791ab74f31ca6669a1e, user_id=ee08cf2807e54157824cde8e9d4b6201, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.464048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731aa59-37d4-4a4c-bfd5-d29a8b5bf263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.465460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731aa59-37d4-4a4c-bfd5-d29a8b5bf263 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.466620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.475754 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 828/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:18.476928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.477418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.477875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.507263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] MFA Rules not processed for user `40617844ed874bfb8a64be2fdd09fa22`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:18.508467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:18.547467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 812/1640] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/2fd859a4932d4791ab74f31ca6669a1e/users/ee08cf2807e54157824cde8e9d4b6201/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.548321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.582654 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 829/1641] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:18.586925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.595029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33377-cd02-4b61-b5aa-04e921cb44ba None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.616431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212accfe-8c67-46b0-b182-bd03593d5c73 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.622240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.623770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.623770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.623770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.624982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.626576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.640009 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 813/1642] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.640009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.647862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00ab8f-c3c5-41fe-8641-2f66b788f358 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.652498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.653131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.653458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.653735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] PATH_INFO: `/v3/projects/0c357f7b38c84c40bf47211a0acae2d7/users/bfce6a0bfb9a4c8ab68fbd3ae48e8d8c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.655663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c357f7b38c84c40bf47211a0acae2d7, user_id=bfce6a0bfb9a4c8ab68fbd3ae48e8d8c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.658276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.660586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.665276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f0da6-aa60-432e-9e71-fd598aed2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.666172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f0da6-aa60-432e-9e71-fd598aed2094 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.666697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f0da6-aa60-432e-9e71-fd598aed2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.666980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f0da6-aa60-432e-9e71-fd598aed2094 admin admin] PATH_INFO: `/v3/projects/c222b7c95f984cff91408ba03070a207/users/f9acf67bba9b4971b79bf08f86bead61/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.671749 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 814/1643] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/0c357f7b38c84c40bf47211a0acae2d7/users/bfce6a0bfb9a4c8ab68fbd3ae48e8d8c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.672778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.683971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:18.688936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f0da6-aa60-432e-9e71-fd598aed2094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c222b7c95f984cff91408ba03070a207, user_id=f9acf67bba9b4971b79bf08f86bead61, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.692367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f0da6-aa60-432e-9e71-fd598aed2094 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.744795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754837f-2a01-4d16-91e4-f5ea75c35e7f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.750454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.752612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.752612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.752612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.752612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.753963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.767771 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 815/1644] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.767771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.776428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d2c7d-9536-4b81-9f3e-dd92cc171332 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.781215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.785893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.785893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.785893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.785893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.785893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.795205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 816/1645] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.796753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.809033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad060-034d-4f69-b5c2-fc36d37ba102 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.813766 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 830/1646] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/c222b7c95f984cff91408ba03070a207/users/f9acf67bba9b4971b79bf08f86bead61/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.817982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385da6bc-569f-4ee9-9192-ed9c850015bb None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.818272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385da6bc-569f-4ee9-9192-ed9c850015bb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.818553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385da6bc-569f-4ee9-9192-ed9c850015bb None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.821145 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 831/1647] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 6 10:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:18.826431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385da6bc-569f-4ee9-9192-ed9c850015bb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:18.880286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed7e8-65da-4a4d-9eb0-73e671d324f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.880908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed7e8-65da-4a4d-9eb0-73e671d324f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.881251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed7e8-65da-4a4d-9eb0-73e671d324f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.881467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed7e8-65da-4a4d-9eb0-73e671d324f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.882252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed7e8-65da-4a4d-9eb0-73e671d324f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.883909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed7e8-65da-4a4d-9eb0-73e671d324f7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.897361 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 817/1648] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:18.897361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.897361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.897361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.918710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385da6bc-569f-4ee9-9192-ed9c850015bb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:18.924486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:18.925555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:18.925662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:18.925962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] PATH_INFO: `/v3/projects/c115c3ce2b104b71849aef9802fbba58/users/011b3766208c4f1f99a4d4f4e0ec5e67/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:18.928114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c115c3ce2b104b71849aef9802fbba58, user_id=011b3766208c4f1f99a4d4f4e0ec5e67, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:18.930992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:18.933742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] MFA Rules not processed for user `bfce6a0bfb9a4c8ab68fbd3ae48e8d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:18.934959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:18.943353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 832/1649] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/c115c3ce2b104b71849aef9802fbba58/users/011b3766208c4f1f99a4d4f4e0ec5e67/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:18.944649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.011515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aed32e-cb3a-4b34-b86d-9dde43babe15 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.013291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.016432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.017072 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 818/1650] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.017212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.017459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.017740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] PATH_INFO: `/v3/projects/d764a01fa6ba47db9efe3b70401f2089/users/722e850b74954dbdb49d0feb4e59bdf4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.018081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.019912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d764a01fa6ba47db9efe3b70401f2089, user_id=722e850b74954dbdb49d0feb4e59bdf4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.022404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.028639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0371bd-014b-4071-a435-1ededc7bb419 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.044896 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 833/1651] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:18 2022] PUT /identity/v3/projects/d764a01fa6ba47db9efe3b70401f2089/users/722e850b74954dbdb49d0feb4e59bdf4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:19.044896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.097258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288620ff-0bfa-4a00-821e-817597d75824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.098004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288620ff-0bfa-4a00-821e-817597d75824 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.098213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288620ff-0bfa-4a00-821e-817597d75824 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.098491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288620ff-0bfa-4a00-821e-817597d75824 admin admin] PATH_INFO: `/v3/projects/9af44e9347ef4fbf8bac035e9c494411/users/2be10b88d4d64e29b2c590ac7a413d34/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.100474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288620ff-0bfa-4a00-821e-817597d75824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af44e9347ef4fbf8bac035e9c494411, user_id=2be10b88d4d64e29b2c590ac7a413d34, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.107237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288620ff-0bfa-4a00-821e-817597d75824 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.114873 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 819/1652] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:19 2022] PUT /identity/v3/projects/9af44e9347ef4fbf8bac035e9c494411/users/2be10b88d4d64e29b2c590ac7a413d34/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:19.116297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c201b2-4adb-4774-9a32-4efa6299c041 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.116877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c201b2-4adb-4774-9a32-4efa6299c041 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.116988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c201b2-4adb-4774-9a32-4efa6299c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.132589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48e91-7fa2-4583-a340-aa0049eb9d76 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.151873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.155482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-63c201b2-4adb-4774-9a32-4efa6299c041 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.156727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63c201b2-4adb-4774-9a32-4efa6299c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.188589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.189503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.189787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.190114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.190691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.192316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.202028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 834/1653] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:19.202808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.212145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce496a0-1285-414e-b2de-e486487c7008 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.216634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc4b1-d111-4735-9534-e010e4d96ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.217256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc4b1-d111-4735-9534-e010e4d96ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.218071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc4b1-d111-4735-9534-e010e4d96ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.218341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc4b1-d111-4735-9534-e010e4d96ed6 admin admin] PATH_INFO: `/v3/projects/2fd859a4932d4791ab74f31ca6669a1e/users/ee08cf2807e54157824cde8e9d4b6201/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.220168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc4b1-d111-4735-9534-e010e4d96ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd859a4932d4791ab74f31ca6669a1e, user_id=ee08cf2807e54157824cde8e9d4b6201, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.222850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc4b1-d111-4735-9534-e010e4d96ed6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.225597 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 820/1654] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.226991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.227314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.227588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.235424 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 835/1655] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:19 2022] PUT /identity/v3/projects/2fd859a4932d4791ab74f31ca6669a1e/users/ee08cf2807e54157824cde8e9d4b6201/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:19.236891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696620a3-a6ba-4d71-a31f-7ae2ca809c79 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.237177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696620a3-a6ba-4d71-a31f-7ae2ca809c79 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.237452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696620a3-a6ba-4d71-a31f-7ae2ca809c79 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.243219 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 836/1656] 10.222.0.20 () {54 vars in 962 bytes} [Tue Sep 6 10:50:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:19.247266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbcd98-dd20-4479-a296-36c7a54a6e72 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.247569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbcd98-dd20-4479-a296-36c7a54a6e72 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.247848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbcd98-dd20-4479-a296-36c7a54a6e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.258489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] MFA Rules not processed for user `011b3766208c4f1f99a4d4f4e0ec5e67`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.259729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.279571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e2dbcd98-dd20-4479-a296-36c7a54a6e72 None None] MFA Rules not processed for user `722e850b74954dbdb49d0feb4e59bdf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.280817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e2dbcd98-dd20-4479-a296-36c7a54a6e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.326357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.331808 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 821/1657] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.332635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.333941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.352285 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 837/1658] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.353608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.353897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.354174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.383840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] MFA Rules not processed for user `2be10b88d4d64e29b2c590ac7a413d34`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.385051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.400557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc825e-88b8-437e-8359-9d4a568c22ca None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.405304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.405931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.406212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.406487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] PATH_INFO: `/v3/projects/1f68e80660194823bad80a559ccb7d54` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.407621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f68e80660194823bad80a559ccb7d54)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.409537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.453148 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 838/1659] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.453973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.464457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2e34d-d3e1-4c11-9f91-d72423035d0d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.469042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.469679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.469956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.470228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] PATH_INFO: `/v3/projects/c222b7c95f984cff91408ba03070a207/users/f9acf67bba9b4971b79bf08f86bead61/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.472092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c222b7c95f984cff91408ba03070a207, user_id=f9acf67bba9b4971b79bf08f86bead61, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.474802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.485403 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 839/1660] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:19 2022] PUT /identity/v3/projects/c222b7c95f984cff91408ba03070a207/users/f9acf67bba9b4971b79bf08f86bead61/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:19.486167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.491090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.516498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f68e80660194823bad80a559ccb7d54', 'request_id': 'req-91db826b-dcaf-4289-be7e-88104a95db43'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:19.522951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f68e80660194823bad80a559ccb7d54', 'request_id': 'req-91db826b-dcaf-4289-be7e-88104a95db43'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:19.529147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f68e80660194823bad80a559ccb7d54', 'request_id': 'req-91db826b-dcaf-4289-be7e-88104a95db43'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:19.555726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab86c1-8ea7-40ec-9db6-3e97d1a8b614 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.609605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] The token cache is being invalidate because project 1f68e80660194823bad80a559ccb7d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:19.609931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:19.610481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91db826b-dcaf-4289-be7e-88104a95db43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:19.616909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.617400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 822/1661] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:19 2022] DELETE /identity/v3/projects/1f68e80660194823bad80a559ccb7d54 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:19.617535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.617813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.618087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.619431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717b80b-ec42-424a-ae41-7e842628d871 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.619734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717b80b-ec42-424a-ae41-7e842628d871 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.619889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.620013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717b80b-ec42-424a-ae41-7e842628d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.640509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8717b80b-ec42-424a-ae41-7e842628d871 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.641716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8717b80b-ec42-424a-ae41-7e842628d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.651248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 823/1662] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.652239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5085ba-35cd-40b0-be23-45d2615040eb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.652519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5085ba-35cd-40b0-be23-45d2615040eb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.652796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5085ba-35cd-40b0-be23-45d2615040eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.681965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fa5085ba-35cd-40b0-be23-45d2615040eb None None] MFA Rules not processed for user `ee08cf2807e54157824cde8e9d4b6201`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.683092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fa5085ba-35cd-40b0-be23-45d2615040eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.683468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.685070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6427e9-709d-4934-9909-aaddb1e9421c service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.695252 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 840/1663] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:19.696476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492864a-0662-47e4-906e-cec243f3d258 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.696766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492864a-0662-47e4-906e-cec243f3d258 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.697178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492864a-0662-47e4-906e-cec243f3d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.716802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7492864a-0662-47e4-906e-cec243f3d258 None None] MFA Rules not processed for user `3ff6ad8e78ca4b6dbea50007a5737f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.718517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7492864a-0662-47e4-906e-cec243f3d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.754838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.763565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 824/1664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.763565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.763565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.763565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.775767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:19.791161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] MFA Rules not processed for user `f9acf67bba9b4971b79bf08f86bead61`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.797108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.797234 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 841/1665] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.797234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb183-140b-42c1-b432-b67a0a45443e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.797234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb183-140b-42c1-b432-b67a0a45443e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.797234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb183-140b-42c1-b432-b67a0a45443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.818686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0d8bb183-140b-42c1-b432-b67a0a45443e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.819952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0d8bb183-140b-42c1-b432-b67a0a45443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.867205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 825/1666] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.867758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.883120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b67ad-7ec9-4342-9c4a-50ac82dceaee None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.888861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.889496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.889783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.890174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.898182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 842/1667] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.898334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.900067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.900381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.900705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.924439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:19.925633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.933924 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 843/1668] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:19.938619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.948174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aa460-c78e-4e6f-8bb9-64fbb6a2e321 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:19.953461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:19.954131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:19.954526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:19.954815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:19.955771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:19.955902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.957579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.979724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:19.983724 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 844/1669] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:19.983842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:19.983935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:19.983935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:19.991469 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 826/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:19.992249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.000946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43259cc6-8c59-4dc5-857b-a527928850fe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.002917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0135c-8ffe-4096-b3b1-4a8b46812382 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.006590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.007246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.007537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.007748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.007864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.008329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.008758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.008981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.009599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.009690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.011509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.072386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.073991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.084148 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 845/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:20.109719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 827/1672] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:19 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:20.114042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.129232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef957b-a7ed-4fe5-b084-86e334badd13 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.141844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.183808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:20.192213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.192821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.198581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.198581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.198581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.198581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.218772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:20.224813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95f264-961c-4451-899e-670010be0154 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.230313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.230950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.231273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.231551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.233898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.295306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.297673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.306067 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 846/1673] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:20 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:50:20.307594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 828/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:50:20.316103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.327283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a48066-bc4b-4e4c-a745-9964d7b3b103 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.332223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.332815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.333117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.333356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.333988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.335620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.347116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 847/1675] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:20.350126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.360030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.362689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac7a44-ed06-4f3c-a282-5d81e3ab8d25 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.367967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.368587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.368871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.369219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.369793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.372393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.376591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582581-c989-41fc-9ab0-6f873bcc0aec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.382240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.382872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.383198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.383502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.385894 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 829/1676] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:20.386491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.386771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.400880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255577-79af-4cdf-90e3-2ec83c050da0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.406438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.407090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.407542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.408096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.410453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.449276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.450885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.460448 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 848/1677] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:20.461388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.471961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.472130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106fe9a-bfb9-4d15-8c88-40f5e65188f1 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.475668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.482265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.482970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.483846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.484120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a/users/9771badb71674d49a2bfc93cbfca1b79/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.485332 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 830/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:20.488266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.488266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.503380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaf917565724ee4a7c411f950b6aa9a, user_id=9771badb71674d49a2bfc93cbfca1b79, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.503874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192ef7-a5ca-408f-82cf-2d3c694540c1 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.507659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.509111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.509739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.510026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.510307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] PATH_INFO: `/v3/users/5ebcb796fc134c0cadbce30ce9051ec8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.511517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebcb796fc134c0cadbce30ce9051ec8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.512533 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:50:20.512533 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:50:20.512533 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:50:20.518748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.572706 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 849/1679] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:20 2022] PUT /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a/users/9771badb71674d49a2bfc93cbfca1b79/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:20.573558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.647077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66a880-12bf-4bfc-b9aa-1e974efe2cb0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.652808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa1e84-2d74-405c-9cf8-25ff7dfe56b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.653427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa1e84-2d74-405c-9cf8-25ff7dfe56b1 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.656144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa1e84-2d74-405c-9cf8-25ff7dfe56b1 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.656144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa1e84-2d74-405c-9cf8-25ff7dfe56b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.698173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:20.713593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa1e84-2d74-405c-9cf8-25ff7dfe56b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:20.715216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa1e84-2d74-405c-9cf8-25ff7dfe56b1 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:20.720677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebcb796fc134c0cadbce30ce9051ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:20.725737 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 850/1680] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:20.727157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36abe-8e35-47c6-814f-c4958a314895 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.727447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36abe-8e35-47c6-814f-c4958a314895 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.727720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f36abe-8e35-47c6-814f-c4958a314895 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.730429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 851/1681] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:20.731368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebcb796fc134c0cadbce30ce9051ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:20.732286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebcb796fc134c0cadbce30ce9051ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:20.732411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f35103-9367-413d-abaa-3e54d8f3edfb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.732601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f35103-9367-413d-abaa-3e54d8f3edfb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.732880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f35103-9367-413d-abaa-3e54d8f3edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.754855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebcb796fc134c0cadbce30ce9051ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:20.755808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebcb796fc134c0cadbce30ce9051ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:20.759811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:20.767523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-79f35103-9367-413d-abaa-3e54d8f3edfb None None] MFA Rules not processed for user `9771badb71674d49a2bfc93cbfca1b79`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:20.768774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79f35103-9367-413d-abaa-3e54d8f3edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.831813 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 852/1682] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:20.833040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.833325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.833597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:20.851819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:20.852992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.863185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 853/1683] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:50:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:20.863933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.865193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.883545 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 831/1684] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:20 2022] DELETE /identity/v3/users/5ebcb796fc134c0cadbce30ce9051ec8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:20.884824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:20.887491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:20.961314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6c608-f876-48c4-b67c-9dbfc0ed723a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.977268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494f60-4401-4b0f-aa9f-db622b0d08a9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:20.980926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebebe4f-ade9-49fd-b451-0a8c1c96f4b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:20.981539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebebe4f-ade9-49fd-b451-0a8c1c96f4b1 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:20.981816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebebe4f-ade9-49fd-b451-0a8c1c96f4b1 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:20.982087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebebe4f-ade9-49fd-b451-0a8c1c96f4b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.017299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.017908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.018189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.018464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.019113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.021013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.035878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:21.056061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebebe4f-ade9-49fd-b451-0a8c1c96f4b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.057801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebebe4f-ade9-49fd-b451-0a8c1c96f4b1 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.070667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 832/1685] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:21.071959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.072253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.072537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.093149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:21.103594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.112630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 833/1686] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:21.113539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.114903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.121631 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 854/1687] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:20 2022] POST /identity/v3/projects => generated 393 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:21.126284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.126848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.135269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5da8a-70b1-44c7-a6f7-aff7543e4419 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.199440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da25364-dfe7-435a-b675-a67785d5b324 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.204123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.204757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.205038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.205146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.205625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] PATH_INFO: `/v3/users/2fe4e82e6fcb40a38fb11a4c65d5d73f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.205718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.206046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.206394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.206542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe4e82e6fcb40a38fb11a4c65d5d73f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.208315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.208500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.214592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:21.270430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.272073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.281191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 834/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:21.282019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.283459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.350395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9402a0e-d588-4f5c-9434-13189e500d1e service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.354192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.354803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.355128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.355409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.365677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.367132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.378178 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 835/1689] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:21.378346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.387549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479b57-1eef-4d61-aa25-b210e434de57 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.393323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864a2a3-0e03-4be6-81f5-df86c30f674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.393924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a2a3-0e03-4be6-81f5-df86c30f674c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.394206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a2a3-0e03-4be6-81f5-df86c30f674c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.394504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a2a3-0e03-4be6-81f5-df86c30f674c admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.395234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864a2a3-0e03-4be6-81f5-df86c30f674c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.397632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864a2a3-0e03-4be6-81f5-df86c30f674c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.417439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe4e82e6fcb40a38fb11a4c65d5d73f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:21.425204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe4e82e6fcb40a38fb11a4c65d5d73f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:21.426186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe4e82e6fcb40a38fb11a4c65d5d73f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:21.426902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe4e82e6fcb40a38fb11a4c65d5d73f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:21.441633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe4e82e6fcb40a38fb11a4c65d5d73f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:21.500248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 836/1690] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:21 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:21.500248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4f71-3efc-46bb-9e6e-196491af978d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.500248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4f71-3efc-46bb-9e6e-196491af978d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.500248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4f71-3efc-46bb-9e6e-196491af978d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.500793 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 837/1691] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:21.501506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd4f71-3efc-46bb-9e6e-196491af978d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.503151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-76cd4f71-3efc-46bb-9e6e-196491af978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.519756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd4f71-3efc-46bb-9e6e-196491af978d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.524441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914277bc-4cfb-4a13-a6f7-3a56fb524211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.527030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914277bc-4cfb-4a13-a6f7-3a56fb524211 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.527030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914277bc-4cfb-4a13-a6f7-3a56fb524211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.527030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914277bc-4cfb-4a13-a6f7-3a56fb524211 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.527030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914277bc-4cfb-4a13-a6f7-3a56fb524211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.530609 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 855/1692] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:21 2022] DELETE /identity/v3/users/2fe4e82e6fcb40a38fb11a4c65d5d73f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:21.530760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914277bc-4cfb-4a13-a6f7-3a56fb524211 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.530838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:21.530838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.538552 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 838/1693] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:21.539829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.540118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.540383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.559418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:21.560614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.621182 ncdv-master-1 devstack@keystone.service[92878]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 06 10:50:21.621887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.628247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.651281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:21.655582 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 839/1694] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:21.657134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.673189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf560ab-376a-4579-98f8-81ca12784886 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.680238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.681413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.681839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.682273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] PATH_INFO: `/v3/projects/ceb93b73593f43e78f646cf45490c716/users/d359c31a7b8145ea947a51adda2ef9ce/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.702966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb93b73593f43e78f646cf45490c716, user_id=d359c31a7b8145ea947a51adda2ef9ce, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.706533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.734871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28b47-677d-4932-a37f-cdee1c5edd31 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.742328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9acf67bba9b4971b79bf08f86bead61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c222b7c95f984cff91408ba03070a207', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.742328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.742328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.742596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] PATH_INFO: `/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.743046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] RBAC: Authorizing `identity:get_project(project_id=3fa3489a9bbe41a29a10cb3da1128ca2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.745302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.747717 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 856/1695] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2 => generated 379 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:21.748372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.750798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.813351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:21.819496 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 840/1696] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:21 2022] PUT /identity/v3/projects/ceb93b73593f43e78f646cf45490c716/users/d359c31a7b8145ea947a51adda2ef9ce/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:21.823742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:21.828699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.858544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd29da-7794-418b-9f6b-53371dd833f1 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.912271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34165fce-f5df-4a68-8a41-6d335f1c3d00 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:21.917566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.918195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.918477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.918752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.920016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:21.920592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:21.920830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:21.921182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:21.921622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:21.937814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:21.937814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:21.945915 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 841/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:21.946702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.022157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.025325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.040319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07475a1e-ca16-4d81-a8db-987cceb1e77e service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.045291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.046033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.046319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.046586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.047256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.049153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.053747 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 857/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:22.054894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.064829 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 842/1699] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:22.065017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.065111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.095203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e284d-9ae1-4971-94b3-3820f0d65b30 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.107568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.110819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.111159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.111448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] PATH_INFO: `/v3/projects/2ee1411eee0a4ae88a3530c4cb88dfb5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.114026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee1411eee0a4ae88a3530c4cb88dfb5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.136342 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:50:22.136342 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:50:22.136342 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:50:22.136342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.164305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:22.173534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f319be7-4ec1-4c48-a079-a2eb10021744 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.180264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.180891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.181173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.181494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.183634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.211328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:22.266756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.268512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.278385 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 843/1700] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:22.279688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.292548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0f5da-5d18-494e-8dac-f6ce702f0447 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.303308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee1411eee0a4ae88a3530c4cb88dfb5', 'request_id': 'req-6fc32f59-678b-49fc-93e2-5495824e6f55'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.310813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee1411eee0a4ae88a3530c4cb88dfb5', 'request_id': 'req-6fc32f59-678b-49fc-93e2-5495824e6f55'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.343889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee1411eee0a4ae88a3530c4cb88dfb5', 'request_id': 'req-6fc32f59-678b-49fc-93e2-5495824e6f55'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.394520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289efbe6-452d-4ddd-8b21-c7ac312b7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.395350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efbe6-452d-4ddd-8b21-c7ac312b7eab admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.395633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efbe6-452d-4ddd-8b21-c7ac312b7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.395910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efbe6-452d-4ddd-8b21-c7ac312b7eab admin admin] PATH_INFO: `/v3/projects/ceb93b73593f43e78f646cf45490c716/users/d359c31a7b8145ea947a51adda2ef9ce/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.398112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efbe6-452d-4ddd-8b21-c7ac312b7eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb93b73593f43e78f646cf45490c716, user_id=d359c31a7b8145ea947a51adda2ef9ce, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.400871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289efbe6-452d-4ddd-8b21-c7ac312b7eab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.423930 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 844/1701] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:22 2022] PUT /identity/v3/projects/ceb93b73593f43e78f646cf45490c716/users/d359c31a7b8145ea947a51adda2ef9ce/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:22.423930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762c2b-d3cb-4866-8768-d30b642dc425 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.423930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762c2b-d3cb-4866-8768-d30b642dc425 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.423930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762c2b-d3cb-4866-8768-d30b642dc425 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.423930 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 845/1702] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:22.423930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.424352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.425554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.425772 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 846/1703] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:50:22.426800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:22.440764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] The token cache is being invalidate because project 2ee1411eee0a4ae88a3530c4cb88dfb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:22.445798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.445798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6fc32f59-678b-49fc-93e2-5495824e6f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.445798 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 858/1704] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:22 2022] DELETE /identity/v3/projects/2ee1411eee0a4ae88a3530c4cb88dfb5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:22.445798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3c1a-05b5-49d2-b21d-b5edcb920f42 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.445798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3c1a-05b5-49d2-b21d-b5edcb920f42 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.446185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3c1a-05b5-49d2-b21d-b5edcb920f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.479772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9f1c3c1a-05b5-49d2-b21d-b5edcb920f42 None None] MFA Rules not processed for user `d359c31a7b8145ea947a51adda2ef9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:22.481044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9f1c3c1a-05b5-49d2-b21d-b5edcb920f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.520000 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 06 10:50:22.520319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.564037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 859/1705] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:22.565408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.565740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.566007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.575153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:22.586532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:22.587879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.589972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273b62-a9d6-406f-8757-1c19eae5c8b4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.598148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9acf67bba9b4971b79bf08f86bead61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c222b7c95f984cff91408ba03070a207', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.599115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.599445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.599697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] PATH_INFO: `/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.600873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] RBAC: Authorizing `identity:get_project(project_id=3fa3489a9bbe41a29a10cb3da1128ca2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.603948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.610948 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 847/1706] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:22 2022] GET /identity/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2 => generated 379 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:22.621977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.621977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.679047 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 860/1707] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:50:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:22.680147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.681451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.697427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e71cb2-da95-4f3f-8c97-e2e121c42af3 tempest-FlavorsAccessTestJSON-221955649 tempest-FlavorsAccessTestJSON-221955649-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.703198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.703832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.704113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.704386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] PATH_INFO: `/v3/users/ee08cf2807e54157824cde8e9d4b6201` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.705522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee08cf2807e54157824cde8e9d4b6201)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.707612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.711755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:22.765586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01e9f-dc74-40c5-b987-2aaa24eb8930 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:22.771402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:22.772026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:22.772310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:22.772640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:22.773278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:22.775340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:22.916285 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 861/1708] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:22 2022] POST /identity/v3/projects => generated 395 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:22.916285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:22.918145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:22.926281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee08cf2807e54157824cde8e9d4b6201'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.946465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee08cf2807e54157824cde8e9d4b6201'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.951907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee08cf2807e54157824cde8e9d4b6201'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.964600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee08cf2807e54157824cde8e9d4b6201'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:22.965393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee08cf2807e54157824cde8e9d4b6201'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.003422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ebf23-3667-43fb-a17d-fd69fb22dc68 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:23.008042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:23.008678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.008985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.009261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] PATH_INFO: `/v3/projects/7b2e7b2d14094531848de75f6fe7690d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.010383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2e7b2d14094531848de75f6fe7690d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:23.012321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:23.063140 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 848/1709] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:22 2022] DELETE /identity/v3/users/ee08cf2807e54157824cde8e9d4b6201 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:23.064561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:23.073003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.155097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2e7b2d14094531848de75f6fe7690d', 'request_id': 'req-caa4373f-9a68-44ea-869a-ac0229bef858'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.164309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2e7b2d14094531848de75f6fe7690d', 'request_id': 'req-caa4373f-9a68-44ea-869a-ac0229bef858'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.172660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2e7b2d14094531848de75f6fe7690d', 'request_id': 'req-caa4373f-9a68-44ea-869a-ac0229bef858'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.187079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a900792-553c-4f8d-afc1-3d5ed6dbc450 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:23.197301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:23.253420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:23.254077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.254298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.254572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.256316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.267036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:23.268604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:23.278610 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 849/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:23.279465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:23.280843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.281121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] The token cache is being invalidate because project 7b2e7b2d14094531848de75f6fe7690d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:23.281484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.285909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.285909 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 862/1711] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:22 2022] DELETE /identity/v3/projects/7b2e7b2d14094531848de75f6fe7690d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:23.285909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:23.287647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.349461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:23.382999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4373f-9a68-44ea-869a-ac0229bef858 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:23.384713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059989-95a1-43b4-b8b2-1356688c9128 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:23.389648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:23.390504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.390889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.391214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daa82-7cd5-4a56-ba27-557f0b9cb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:23.391495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] PATH_INFO: `/v3/users/5b041179959d46a2a93d4cc9d3b339c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.392523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daa82-7cd5-4a56-ba27-557f0b9cb464 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.392965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b041179959d46a2a93d4cc9d3b339c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:23.393072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daa82-7cd5-4a56-ba27-557f0b9cb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.393613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daa82-7cd5-4a56-ba27-557f0b9cb464 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.394543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3daa82-7cd5-4a56-ba27-557f0b9cb464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:23.395954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:23.398478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3daa82-7cd5-4a56-ba27-557f0b9cb464 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:23.503554 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 850/1712] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:23 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:23.504761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c48996-b222-4e9b-beae-516ad7835210 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.505085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c48996-b222-4e9b-beae-516ad7835210 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.505473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c48996-b222-4e9b-beae-516ad7835210 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.506700 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 851/1713] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:23.507530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c48996-b222-4e9b-beae-516ad7835210 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:23.509218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-67c48996-b222-4e9b-beae-516ad7835210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.525810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c48996-b222-4e9b-beae-516ad7835210 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:23.530409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:23.531155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.531343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.531624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] PATH_INFO: `/v3/users/011b3766208c4f1f99a4d4f4e0ec5e67` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.532767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011b3766208c4f1f99a4d4f4e0ec5e67)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:23.534685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:23.604170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b041179959d46a2a93d4cc9d3b339c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.612826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b041179959d46a2a93d4cc9d3b339c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.613690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b041179959d46a2a93d4cc9d3b339c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.614595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b041179959d46a2a93d4cc9d3b339c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.630721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b041179959d46a2a93d4cc9d3b339c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.793540 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 863/1714] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:23 2022] DELETE /identity/v3/users/5b041179959d46a2a93d4cc9d3b339c5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:23.794705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:23.796101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.802930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011b3766208c4f1f99a4d4f4e0ec5e67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.811998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011b3766208c4f1f99a4d4f4e0ec5e67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.813541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011b3766208c4f1f99a4d4f4e0ec5e67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.829154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011b3766208c4f1f99a4d4f4e0ec5e67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.830291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011b3766208c4f1f99a4d4f4e0ec5e67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:23.864657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7d8c-cb61-488e-8b3c-c605fa9b6a49 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:23.869245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa33c-9d3d-4d66-bafc-64a78985963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:23.869844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa33c-9d3d-4d66-bafc-64a78985963a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.870128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa33c-9d3d-4d66-bafc-64a78985963a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.870397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa33c-9d3d-4d66-bafc-64a78985963a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.871364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa33c-9d3d-4d66-bafc-64a78985963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:23.872947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa33c-9d3d-4d66-bafc-64a78985963a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:23.891788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 864/1715] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:23.893120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f655-dd83-4aa9-a18c-9d11f8516e94 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:23.893405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f655-dd83-4aa9-a18c-9d11f8516e94 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:23.893678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994f655-dd83-4aa9-a18c-9d11f8516e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:23.910976 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 852/1716] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:23 2022] DELETE /identity/v3/users/011b3766208c4f1f99a4d4f4e0ec5e67 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:23.912986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:23.915492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.915598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2994f655-dd83-4aa9-a18c-9d11f8516e94 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:23.916365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2994f655-dd83-4aa9-a18c-9d11f8516e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:23.998444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d88adb-e8f7-47a2-b352-3c4903a89fe3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.001085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 865/1717] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:24.003140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.003576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.008604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.009223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.009223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.009223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.009223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] PATH_INFO: `/v3/projects/2fd859a4932d4791ab74f31ca6669a1e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.009546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd859a4932d4791ab74f31ca6669a1e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.012302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.029536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:24.031075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.043581 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 866/1718] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:24.044909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:24.047335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.066364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a468746-6617-4825-9914-8f90aa32c83f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.072004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.072612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.072898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.073172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.073814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.075528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.085671 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 867/1719] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:24.086478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:24.088185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.145351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:24.149157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d90bb1-16b2-4bab-a648-10557b840379 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.155868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.155868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.155868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.155868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.169854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.172288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.180367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd859a4932d4791ab74f31ca6669a1e', 'request_id': 'req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.187921 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 868/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:24.188963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:24.190318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd859a4932d4791ab74f31ca6669a1e', 'request_id': 'req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.190967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.197907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd859a4932d4791ab74f31ca6669a1e', 'request_id': 'req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.211797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cba1a-7518-4f0a-adeb-d956eed1996c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.346664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.347363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.347648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.347920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.354660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] The token cache is being invalidate because project 2fd859a4932d4791ab74f31ca6669a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:24.355243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.355933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.359661 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 853/1721] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:23 2022] DELETE /identity/v3/projects/2fd859a4932d4791ab74f31ca6669a1e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:24.360734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:24.363094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.472125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.473572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.486454 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 869/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:24.487349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:24.489039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.491101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca04e40-093d-4f5e-801c-9b23ebc20dc1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.503711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.504007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3bb6d-1aae-4e08-9a27-d3dcaec9b748 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.504395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.504716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.505305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] PATH_INFO: `/v3/projects/233ccb254c784281864e757a9b9a3a84/users/b5a47c8524d04224bcda58e1545a65b1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.508888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.509958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.509958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.510275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] PATH_INFO: `/v3/users/a0290aa1534d42b291a40c2301d5df0c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.511441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0290aa1534d42b291a40c2301d5df0c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.513336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.528846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233ccb254c784281864e757a9b9a3a84, user_id=b5a47c8524d04224bcda58e1545a65b1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.532197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:24.532373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.617755 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 854/1723] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:24 2022] PUT /identity/v3/projects/233ccb254c784281864e757a9b9a3a84/users/b5a47c8524d04224bcda58e1545a65b1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:24.618959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:24.628694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.709615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeceadd-ee62-4787-b3e2-2287813476f8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:24.715461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:24.716343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.716682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.717028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] PATH_INFO: `/v3/users/78161f23888f4b3bb35f9cdbb6462730` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.719241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78161f23888f4b3bb35f9cdbb6462730)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:24.721404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:24.765607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0290aa1534d42b291a40c2301d5df0c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.775192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0290aa1534d42b291a40c2301d5df0c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.775904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0290aa1534d42b291a40c2301d5df0c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.776651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0290aa1534d42b291a40c2301d5df0c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.791693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688ea97a-67f4-4d62-b8c3-836e3f9116dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0290aa1534d42b291a40c2301d5df0c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:24.911242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 870/1724] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:24 2022] DELETE /identity/v3/users/a0290aa1534d42b291a40c2301d5df0c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:24.912561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:24.912848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:24.913122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:24.934108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:24.935358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:24.982479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78161f23888f4b3bb35f9cdbb6462730'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.001413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78161f23888f4b3bb35f9cdbb6462730'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.002200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78161f23888f4b3bb35f9cdbb6462730'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.010499 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 871/1725] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.011401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.012708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.014946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78161f23888f4b3bb35f9cdbb6462730'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.015715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5239c8-8e23-4acf-b52b-822b17548472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78161f23888f4b3bb35f9cdbb6462730'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.025213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4eed-2c52-44b8-b324-336f59bac48b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.029800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.030460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.030743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.031037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] PATH_INFO: `/v3/projects/c115c3ce2b104b71849aef9802fbba58` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.032184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c115c3ce2b104b71849aef9802fbba58)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.034071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.124473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 855/1726] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:24 2022] DELETE /identity/v3/users/78161f23888f4b3bb35f9cdbb6462730 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:25.127694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdd4c-28eb-4a88-bb07-e0157287b4bd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.127694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdd4c-28eb-4a88-bb07-e0157287b4bd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.127694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdd4c-28eb-4a88-bb07-e0157287b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.159222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b2fdd4c-28eb-4a88-bb07-e0157287b4bd None None] MFA Rules not processed for user `b5a47c8524d04224bcda58e1545a65b1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:25.160592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b2fdd4c-28eb-4a88-bb07-e0157287b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.165094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c115c3ce2b104b71849aef9802fbba58', 'request_id': 'req-05dce525-6112-4a82-97e6-d8dd2d471e02'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.171348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c115c3ce2b104b71849aef9802fbba58', 'request_id': 'req-05dce525-6112-4a82-97e6-d8dd2d471e02'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.177719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c115c3ce2b104b71849aef9802fbba58', 'request_id': 'req-05dce525-6112-4a82-97e6-d8dd2d471e02'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.229913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 856/1727] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.231225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.231546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.231829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.255609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] The token cache is being invalidate because project c115c3ce2b104b71849aef9802fbba58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:25.258399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.258399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-05dce525-6112-4a82-97e6-d8dd2d471e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.259633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] MFA Rules not processed for user `b4effbac6059440f9105f21183de9b23`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:25.260200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 872/1728] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:25 2022] DELETE /identity/v3/projects/c115c3ce2b104b71849aef9802fbba58 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:25.261293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.266031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5194-b2de-4355-a2a0-622aeb227d17 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.266394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5194-b2de-4355-a2a0-622aeb227d17 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.268082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5194-b2de-4355-a2a0-622aeb227d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.278962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:25.295219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6ece5194-b2de-4355-a2a0-622aeb227d17 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:25.297177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6ece5194-b2de-4355-a2a0-622aeb227d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.324268 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 857/1729] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.325364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.326650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.361434 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 873/1730] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.362701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4dcb-b2de-4c07-ae62-75fe5d30afda None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.362995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4dcb-b2de-4c07-ae62-75fe5d30afda None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.363309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4dcb-b2de-4c07-ae62-75fe5d30afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.383162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-206e4dcb-b2de-4c07-ae62-75fe5d30afda None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:25.384420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-206e4dcb-b2de-4c07-ae62-75fe5d30afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.393801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 874/1731] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.395069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.395361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.395637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.395821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaad73-1970-4893-868c-a041d2861922 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.402344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.403064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.403560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.403847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] PATH_INFO: `/v3/projects/69fc984175e248af87dad4c67fb7345c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.406502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fc984175e248af87dad4c67fb7345c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.408798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.417288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:25.418578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.431707 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 875/1732] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.431707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.433874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.514895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aacdc-04d7-479c-ba5c-4d34d376cf26 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.520795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.521533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.521817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.522092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.523913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.588329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:25.593832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.596300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029a88-9846-4b70-bb1e-30118a7d7735 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.608838 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 876/1733] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:25.610185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.610680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.611093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.615502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fc984175e248af87dad4c67fb7345c', 'request_id': 'req-69c43768-28e9-4b73-a178-e226b2e16044'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.622433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fc984175e248af87dad4c67fb7345c', 'request_id': 'req-69c43768-28e9-4b73-a178-e226b2e16044'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.628117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fc984175e248af87dad4c67fb7345c', 'request_id': 'req-69c43768-28e9-4b73-a178-e226b2e16044'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.631513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:25.632723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.708805 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 877/1734] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:25.724795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.724795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.747196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] The token cache is being invalidate because project 69fc984175e248af87dad4c67fb7345c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:25.747801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.749548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:25.751918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 858/1735] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:25 2022] DELETE /identity/v3/projects/69fc984175e248af87dad4c67fb7345c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:25.753761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.755546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.806315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5cffe-73e9-4603-87f6-e33051459906 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.813959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.814579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.814866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.815295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.817332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.824350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c43768-28e9-4b73-a178-e226b2e16044 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.828628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.829242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.829529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.832829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.832829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.845329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.846775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.856917 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 859/1736] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:25.857793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.859717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.883876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f90b-afdc-4399-9bc2-91fd33ff55ea service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.887094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.899355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.899464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.899464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.899464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.899464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.899738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:25.899738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.899870 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 878/1737] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:25.904748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:25.904909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d4b72-4e0c-4b3b-892b-15820c47ea16 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.904991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.921604 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 860/1738] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:25.922963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978de74-0513-4d7b-bfd0-803e32969469 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.923296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978de74-0513-4d7b-bfd0-803e32969469 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.923590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978de74-0513-4d7b-bfd0-803e32969469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.923827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed61df-5f0d-4a9b-9e22-4d08ed035d38 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:25.928486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:25.929318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.929671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.930050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:25.932249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:25.946461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:25.948124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf51b1-a3ad-40ef-96e3-8008486478ce service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:25.965020 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 879/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:25.966550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:25.966949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:25.967296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.008190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:26.011598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.018431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7978de74-0513-4d7b-bfd0-803e32969469 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:26.020286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7978de74-0513-4d7b-bfd0-803e32969469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.031960 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 880/1740] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:26.033134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.034843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.049377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817b556-a3c5-487d-9d23-8bafc011ff86 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.056319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.057019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.057420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.057712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] PATH_INFO: `/v3/users/bfce6a0bfb9a4c8ab68fbd3ae48e8d8c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.058889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfce6a0bfb9a4c8ab68fbd3ae48e8d8c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.061245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.096970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:26.112538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 861/1741] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:26.114024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cea5-0240-47a9-b06b-1be9f0e7d747 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.114325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cea5-0240-47a9-b06b-1be9f0e7d747 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.114608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cea5-0240-47a9-b06b-1be9f0e7d747 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.116005 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 862/1742] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:26.116632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cea5-0240-47a9-b06b-1be9f0e7d747 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.132276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cea5-0240-47a9-b06b-1be9f0e7d747 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.137061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.137781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.137958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.138265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.138910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.141471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.157228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:26.279650 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 863/1743] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:26 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:26.286767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.317276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfce6a0bfb9a4c8ab68fbd3ae48e8d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.330887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfce6a0bfb9a4c8ab68fbd3ae48e8d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.331840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfce6a0bfb9a4c8ab68fbd3ae48e8d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.333088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfce6a0bfb9a4c8ab68fbd3ae48e8d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.356439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfce6a0bfb9a4c8ab68fbd3ae48e8d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.403298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66485bb-d009-4775-94d7-c2d1ea74a9c6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.408986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.409755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.410046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.410706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.411479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:26.411784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.413539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.441443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 864/1744] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:26.441443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:26.442784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.460549 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 881/1745] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:26 2022] DELETE /identity/v3/users/bfce6a0bfb9a4c8ab68fbd3ae48e8d8c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:26.462370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.463612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.562495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.563944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.574814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e5b1-d39c-48ae-923c-e9ad966dd1b3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.585248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.586272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.586588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.588715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.588715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.589903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.637806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4f4e-c09f-42cf-bd1f-1d6afb7c0c38 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.706846 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 882/1746] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:26 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:26.706846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.707569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.720391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c57bc3-b930-4178-a550-b9e5bec9b4b4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.725494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.726147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.726412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.726686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.727388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.729533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.729787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd359c31a7b8145ea947a51adda2ef9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb93b73593f43e78f646cf45490c716', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.730496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.730894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.731259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.732438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorizing `identity:get_project(project_id=eaaf917565724ee4a7c411f950b6aa9a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.735762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.739079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 865/1747] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:26 2022] GET /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a => generated 393 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:26.740149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.744387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.768291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dd4a7-b1fc-42fd-babc-b27fc37eccb2 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.773917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:26.774561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:26.775062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:26.775344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] PATH_INFO: `/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:26.776483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa3489a9bbe41a29a10cb3da1128ca2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:26.778380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:26.822455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 883/1748] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:26 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:26.823261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:26.825015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:26.901982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:26.936011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa3489a9bbe41a29a10cb3da1128ca2', 'request_id': 'req-5febc9b2-e258-48aa-b23a-09d34d1524c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.953988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa3489a9bbe41a29a10cb3da1128ca2', 'request_id': 'req-5febc9b2-e258-48aa-b23a-09d34d1524c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:26.955896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc0ac0-c426-4880-b308-0a1b95611553 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:26.971506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa3489a9bbe41a29a10cb3da1128ca2', 'request_id': 'req-5febc9b2-e258-48aa-b23a-09d34d1524c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.028536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:27.028809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.028931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.029203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.031796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:27.058003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] The token cache is being invalidate because project 3fa3489a9bbe41a29a10cb3da1128ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:27.058667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.059610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.062400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 866/1749] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:26 2022] DELETE /identity/v3/projects/3fa3489a9bbe41a29a10cb3da1128ca2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:27.063550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:27.065794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:27.108950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:27.110969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:27.134968 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 884/1750] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:50:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:50:27.137111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:27.157345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febc9b2-e258-48aa-b23a-09d34d1524c7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:27.162617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:27.163341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.163638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.163983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] PATH_INFO: `/v3/projects/b549b14bedce4fb3a8418a9c63e5ded1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.173907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b549b14bedce4fb3a8418a9c63e5ded1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:27.177970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:27.193715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:27.232508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:27.372648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea7a64-549f-4257-b40e-b565cf43ba07 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:27.405234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b549b14bedce4fb3a8418a9c63e5ded1', 'request_id': 'req-cea58720-db0f-4931-a997-3ef915f7a104'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.424073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b549b14bedce4fb3a8418a9c63e5ded1', 'request_id': 'req-cea58720-db0f-4931-a997-3ef915f7a104'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.436767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b549b14bedce4fb3a8418a9c63e5ded1', 'request_id': 'req-cea58720-db0f-4931-a997-3ef915f7a104'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.519268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16a92c-e0e7-4971-9a00-5c122d7e6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:27.540198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a92c-e0e7-4971-9a00-5c122d7e6e6a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.540678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a92c-e0e7-4971-9a00-5c122d7e6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.541539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a92c-e0e7-4971-9a00-5c122d7e6e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.542081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] The token cache is being invalidate because project b549b14bedce4fb3a8418a9c63e5ded1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:27.542475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.543384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16a92c-e0e7-4971-9a00-5c122d7e6e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:27.543895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:27.546480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16a92c-e0e7-4971-9a00-5c122d7e6e6a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:27.552372 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 867/1751] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:27 2022] DELETE /identity/v3/projects/b549b14bedce4fb3a8418a9c63e5ded1 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:27.554440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:27.558316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:27.583895 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 885/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:27.585581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb419ec2-4d60-4167-a460-7b50e98ef2d8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.585931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb419ec2-4d60-4167-a460-7b50e98ef2d8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.586212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb419ec2-4d60-4167-a460-7b50e98ef2d8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.589061 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 886/1753] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:27.591043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb419ec2-4d60-4167-a460-7b50e98ef2d8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:27.594016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eb419ec2-4d60-4167-a460-7b50e98ef2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:27.594457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58720-db0f-4931-a997-3ef915f7a104 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:27.600256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d9ceb-6f14-42e9-9860-a460182e757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:27.600929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d9ceb-6f14-42e9-9860-a460182e757e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.601217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d9ceb-6f14-42e9-9860-a460182e757e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.601523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d9ceb-6f14-42e9-9860-a460182e757e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.602352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d9ceb-6f14-42e9-9860-a460182e757e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:27.605078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d9ceb-6f14-42e9-9860-a460182e757e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:27.644027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb419ec2-4d60-4167-a460-7b50e98ef2d8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:27.661478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:27.661947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.662239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.662560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] PATH_INFO: `/v3/users/f9acf67bba9b4971b79bf08f86bead61` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.664550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9acf67bba9b4971b79bf08f86bead61)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:27.673031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:27.718906 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 868/1754] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:27 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:27.718906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.719331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.720280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.793275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:27.794632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:27.880915 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 869/1755] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Sep 6 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:27.882553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:27.884483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:27.913041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5d25-3e0b-40a8-836a-dd54f71aad58 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:27.924828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:27.929602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:27.929602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:27.929602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] PATH_INFO: `/v3/projects/0c357f7b38c84c40bf47211a0acae2d7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:27.929602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c357f7b38c84c40bf47211a0acae2d7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:27.930229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:28.017191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9acf67bba9b4971b79bf08f86bead61'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.037317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9acf67bba9b4971b79bf08f86bead61'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.037317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9acf67bba9b4971b79bf08f86bead61'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.037317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9acf67bba9b4971b79bf08f86bead61'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.039267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9acf67bba9b4971b79bf08f86bead61'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.145614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c357f7b38c84c40bf47211a0acae2d7', 'request_id': 'req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.160990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c357f7b38c84c40bf47211a0acae2d7', 'request_id': 'req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.168075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c357f7b38c84c40bf47211a0acae2d7', 'request_id': 'req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.448713 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 887/1756] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:27 2022] DELETE /identity/v3/users/f9acf67bba9b4971b79bf08f86bead61 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:28.449770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:28.451299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:28.490893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:28.544713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00069d2a-c60d-448e-bdb7-109e28116be2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:28.544713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:28.546139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:28.546421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:28.546741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] PATH_INFO: `/v3/users/40617844ed874bfb8a64be2fdd09fa22` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:28.548081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] The token cache is being invalidate because project 0c357f7b38c84c40bf47211a0acae2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:28.548570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.548652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40617844ed874bfb8a64be2fdd09fa22)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:28.550304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.550686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:28.553121 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 870/1757] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:27 2022] DELETE /identity/v3/projects/0c357f7b38c84c40bf47211a0acae2d7 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:28.555963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:28.559954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:28.676078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e9c0-a2d8-4b5c-bbe6-2cb004ccf4ea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:28.680838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:28.681452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:28.681734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:28.682016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:28.682809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:28.684602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:28.712637 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 871/1758] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:28.718171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:28.718171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:28.770520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:28.790414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40617844ed874bfb8a64be2fdd09fa22'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.803528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40617844ed874bfb8a64be2fdd09fa22'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.806121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40617844ed874bfb8a64be2fdd09fa22'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.806121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40617844ed874bfb8a64be2fdd09fa22'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.820928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40617844ed874bfb8a64be2fdd09fa22'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:28.836531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:28.838033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:28.940362 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 888/1759] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:28 2022] DELETE /identity/v3/users/40617844ed874bfb8a64be2fdd09fa22 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:28.941508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:28.943176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:28.945217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d14a4-e9e7-4055-8a1d-80cea293205c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.083072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd359c31a7b8145ea947a51adda2ef9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb93b73593f43e78f646cf45490c716', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.085240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba6e4-06f8-4ce1-b1fe-59eefe72739c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.085664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.085963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.086247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.088808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorizing `identity:get_project(project_id=eaaf917565724ee4a7c411f950b6aa9a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.093388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.098210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f1cec-1585-45d5-8bfa-52c631f14fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.099548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f1cec-1585-45d5-8bfa-52c631f14fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.100091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f1cec-1585-45d5-8bfa-52c631f14fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.100622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f1cec-1585-45d5-8bfa-52c631f14fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.101583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f1cec-1585-45d5-8bfa-52c631f14fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.103901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f1cec-1585-45d5-8bfa-52c631f14fe8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.109981 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 872/1760] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:28 2022] GET /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a => generated 393 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:29.109981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.117170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.122074 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 889/1761] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:29.122074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.122074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.122397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.170390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:29.171745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.182144 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 890/1762] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:29.185029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.186830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.242440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76135b5-176e-48b5-bbf2-77b8f6cf9c91 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.257034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.258306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.258686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.259073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] PATH_INFO: `/v3/projects/b5f346ce1f8d43b6bf7796526a1270ae/users/1d2b5ed384d548968672226861f1dd32/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.270831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5478dbb-aa23-4a0a-8f57-37ea34a32951 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.274729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.275445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.276125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.276244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.278845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:29.280907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.292347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.294018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.314836 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 873/1763] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:29.315679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.329752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f346ce1f8d43b6bf7796526a1270ae, user_id=1d2b5ed384d548968672226861f1dd32, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.337352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5ce24-8ee0-47e7-ae2c-7204664c1576 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.337783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.345087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2ca34-b758-485c-a777-6b60a45cf3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.345900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ca34-b758-485c-a777-6b60a45cf3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.346336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ca34-b758-485c-a777-6b60a45cf3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.346710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ca34-b758-485c-a777-6b60a45cf3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.347554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2ca34-b758-485c-a777-6b60a45cf3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.350194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2ca34-b758-485c-a777-6b60a45cf3d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.366182 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 874/1764] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:29.367696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46d65-2b32-44b3-8691-70f9824a1adb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.368082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46d65-2b32-44b3-8691-70f9824a1adb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.368442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46d65-2b32-44b3-8691-70f9824a1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.395324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-76f46d65-2b32-44b3-8691-70f9824a1adb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:29.396790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-76f46d65-2b32-44b3-8691-70f9824a1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.410056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 875/1765] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:29.410056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4ba9-7b06-4e6f-b916-740ecc3d977f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.410056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4ba9-7b06-4e6f-b916-740ecc3d977f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.410056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a4ba9-7b06-4e6f-b916-740ecc3d977f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.412048 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 876/1766] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:29.412932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4ba9-7b06-4e6f-b916-740ecc3d977f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.432756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a4ba9-7b06-4e6f-b916-740ecc3d977f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.448273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.448273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.448273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.448273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] PATH_INFO: `/v3/projects/c2078a32d1694ba3b1393762add00729/users/6f59260019b34b0b8c4c8792afe8b317/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.452551 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 891/1767] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:29 2022] PUT /identity/v3/projects/b5f346ce1f8d43b6bf7796526a1270ae/users/1d2b5ed384d548968672226861f1dd32/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:29.454288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.487376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2078a32d1694ba3b1393762add00729, user_id=6f59260019b34b0b8c4c8792afe8b317, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.490714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.584933 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 877/1768] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:29 2022] PUT /identity/v3/projects/c2078a32d1694ba3b1393762add00729/users/6f59260019b34b0b8c4c8792afe8b317/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:29.584933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:29.584933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.598457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1f44-c8da-464b-9816-0e37c8c5d173 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.687789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:29.692955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.692955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.692955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.692955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.699565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:29.699966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.706626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.735709 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 892/1769] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:29.738870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.741042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.758308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b85aaf-5770-4448-bd6a-0e55727c3320 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.766854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.767891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.769156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.769977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] PATH_INFO: `/v3/projects/c222b7c95f984cff91408ba03070a207` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.772585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:29.774486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c222b7c95f984cff91408ba03070a207)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.776542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.777050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.860651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b7a73-3216-4697-ac76-9c38f52db6c6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:29.867402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5f14-d2a4-4b1e-ac60-69974ca40625 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd359c31a7b8145ea947a51adda2ef9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb93b73593f43e78f646cf45490c716', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:29.868127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5f14-d2a4-4b1e-ac60-69974ca40625 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.868412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5f14-d2a4-4b1e-ac60-69974ca40625 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.868759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5f14-d2a4-4b1e-ac60-69974ca40625 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.869983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d5f14-d2a4-4b1e-ac60-69974ca40625 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorizing `identity:get_project(project_id=eaaf917565724ee4a7c411f950b6aa9a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:29.872699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d5f14-d2a4-4b1e-ac60-69974ca40625 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:29.878592 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 878/1770] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:29 2022] GET /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a => generated 393 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:29.880564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:29.880564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:29.880564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:29.937823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c222b7c95f984cff91408ba03070a207', 'request_id': 'req-d90656ea-0cf7-47de-9219-b58a1beb3537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:29.947655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c222b7c95f984cff91408ba03070a207', 'request_id': 'req-d90656ea-0cf7-47de-9219-b58a1beb3537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:29.950987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] MFA Rules not processed for user `1d2b5ed384d548968672226861f1dd32`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:29.952948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:29.963322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c222b7c95f984cff91408ba03070a207', 'request_id': 'req-d90656ea-0cf7-47de-9219-b58a1beb3537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.060874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] The token cache is being invalidate because project c222b7c95f984cff91408ba03070a207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:30.061675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.062640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d90656ea-0cf7-47de-9219-b58a1beb3537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.065031 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 893/1771] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:29 2022] DELETE /identity/v3/projects/c222b7c95f984cff91408ba03070a207 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:30.066172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.066541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.066739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.079523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:30.095808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:30.097288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.132283 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 879/1772] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:30.133465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:30.183476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 894/1773] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:30.185853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:30.199886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.232150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b627d4-ad76-40c4-8ac4-76b3c483c5a7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:30.237593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:30.238335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.238671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.238973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] PATH_INFO: `/v3/projects/84361292e17e482db5ca24c7a85b490b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.240270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84361292e17e482db5ca24c7a85b490b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:30.242277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:30.317695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b0d8-1060-4c63-a5fb-e98188cb00d6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:30.322747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ab147-e653-4875-b6df-18353387defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:30.323454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ab147-e653-4875-b6df-18353387defc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.323741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ab147-e653-4875-b6df-18353387defc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.324064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ab147-e653-4875-b6df-18353387defc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.326291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ab147-e653-4875-b6df-18353387defc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:30.329538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ab147-e653-4875-b6df-18353387defc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:30.398326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84361292e17e482db5ca24c7a85b490b', 'request_id': 'req-e0953221-8cf0-4e2a-9f83-d146138602c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.423002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84361292e17e482db5ca24c7a85b490b', 'request_id': 'req-e0953221-8cf0-4e2a-9f83-d146138602c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.432693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84361292e17e482db5ca24c7a85b490b', 'request_id': 'req-e0953221-8cf0-4e2a-9f83-d146138602c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.474099 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 880/1774] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:30 2022] POST /identity/v3/projects => generated 393 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:30.476291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.477933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.477933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.537117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] The token cache is being invalidate because project 84361292e17e482db5ca24c7a85b490b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:30.538054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.539870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:30.540656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:30.542219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.548926 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 895/1775] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:30 2022] DELETE /identity/v3/projects/84361292e17e482db5ca24c7a85b490b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:30.551419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:30.563906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.692520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:30.712962 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 881/1776] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:30.715993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:30.719627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.772303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953221-8cf0-4e2a-9f83-d146138602c1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:30.787314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577da644-94b6-454c-ada9-6df9f3081f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:30.791791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da644-94b6-454c-ada9-6df9f3081f5f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.792454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da644-94b6-454c-ada9-6df9f3081f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.794359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577da644-94b6-454c-ada9-6df9f3081f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.795075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577da644-94b6-454c-ada9-6df9f3081f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:30.801962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577da644-94b6-454c-ada9-6df9f3081f5f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:30.819757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9aa5-0bf1-431b-a82a-921ce6c3bba4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:30.828516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:30.829546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.830161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.830677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.832734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.864110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:30.866084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:30.898477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 882/1777] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:30.898477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:30.899312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:30.910882 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 896/1778] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:30 2022] POST /identity/v3/projects => generated 373 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:30.913450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6b39-4df4-4b7c-827a-286822e08f3c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:30.913753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7bbc-8d1f-4f4f-a525-4f30afce4c76 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:30.914248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6b39-4df4-4b7c-827a-286822e08f3c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:30.915585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6b39-4df4-4b7c-827a-286822e08f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:30.943695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a01a6b39-4df4-4b7c-827a-286822e08f3c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:30.945503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a01a6b39-4df4-4b7c-827a-286822e08f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:31.047940 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 897/1779] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:31.047940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.047940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.047940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.070833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:31.071635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:31.084742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 898/1780] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:31.086535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.088093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f312135-5d7b-4472-98ee-1206c65f30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.093218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f312135-5d7b-4472-98ee-1206c65f30ee admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.093218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f312135-5d7b-4472-98ee-1206c65f30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.093218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f312135-5d7b-4472-98ee-1206c65f30ee admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.095366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f312135-5d7b-4472-98ee-1206c65f30ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.104158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f312135-5d7b-4472-98ee-1206c65f30ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.109877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9b9b-961d-4781-bbaa-a3534ce0c134 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.117412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.118094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.118630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.118630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.120742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.123304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.268630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 883/1781] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:30 2022] POST /identity/v3/users => generated 297 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:31.270232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6dd76-972a-4c70-9ca8-54c892dc1737 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.270669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6dd76-972a-4c70-9ca8-54c892dc1737 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.271101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6dd76-972a-4c70-9ca8-54c892dc1737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.273458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 899/1782] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:31 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:31.274548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.288124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ff19-a562-4148-9aec-8b919912f400 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.294152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-afd6dd76-972a-4c70-9ca8-54c892dc1737 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:31.294450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.295364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.296398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.296774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.297080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-afd6dd76-972a-4c70-9ca8-54c892dc1737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:31.297693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:31.298112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.299961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.306162 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 884/1783] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:31.308772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61fc1b-33b1-4c19-897a-03da023702a9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.308772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61fc1b-33b1-4c19-897a-03da023702a9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.308772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61fc1b-33b1-4c19-897a-03da023702a9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.310456 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 885/1784] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:31.312112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61fc1b-33b1-4c19-897a-03da023702a9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.314384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2f61fc1b-33b1-4c19-897a-03da023702a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:31.337009 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 900/1785] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:31.337978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.380612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1405-e3e5-41e8-8a42-1dc0f9ecd120 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.396292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.398428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.398745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.400321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.401277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61fc1b-33b1-4c19-897a-03da023702a9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.403602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.406910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.415212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.415847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.416135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.416410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.424696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:31.434237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 901/1786] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:31.437763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.460292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5794021-061d-40bc-9bd3-0f8582da6f38 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.468613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.469526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.469883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.470225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.471210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.472935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.492219 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 902/1787] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:31.493451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.513342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f71b9-d2bf-422b-9381-1c3a3b7b28bf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.518704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:31.523138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.532248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.532248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.532248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.532248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:31.532248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.532248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44ceac-5ced-4922-a662-4dbcc7e74fb1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.558351 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 903/1788] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:31.560790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.561912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.562311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.579972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.581834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.590393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:31.590393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:31.600382 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 886/1789] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:31.601671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.637881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453d789-97fa-43d3-80fc-efe1a9cd93d6 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.638643 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 904/1790] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:31.641378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.659174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.662535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.663174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.663621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.664273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.666664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.682507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14ed28-11e2-42e7-9e1e-02cd009c2e81 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.710910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.712814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.713114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.714128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.714128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.721549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.746476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 905/1791] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:31.746476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.762440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e81e0-d164-4ab0-b41e-6d7a6a19fde5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:31.770159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:31.772954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:31.772954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:31.773487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] PATH_INFO: `/v3/projects/668a433b32b94e72b978b892312c615a/users/c11b2e709adb4a8cafefd20d3055f425/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:31.797200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668a433b32b94e72b978b892312c615a, user_id=c11b2e709adb4a8cafefd20d3055f425, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:31.800859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:31.865459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 887/1792] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:31 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:31.866361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.891238 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 906/1793] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:31 2022] PUT /identity/v3/projects/668a433b32b94e72b978b892312c615a/users/c11b2e709adb4a8cafefd20d3055f425/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:31.892320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:31.964113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:32.020396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ab32-7d3a-406f-82ba-082c6429e2cc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.053262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be53c-155e-40e5-a753-39fe8610e441 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.065802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.066561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.066930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.067176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] PATH_INFO: `/v3/projects/a545fe2917464057aafce35738f48b7c/users/fe654e4ddf8a46708ebc36537efdbd7b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.100126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a545fe2917464057aafce35738f48b7c, user_id=fe654e4ddf8a46708ebc36537efdbd7b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.102881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.138520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.142260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.142260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.142260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.142260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.143360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.218008 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 907/1794] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:31 2022] PUT /identity/v3/projects/a545fe2917464057aafce35738f48b7c/users/fe654e4ddf8a46708ebc36537efdbd7b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:32.218868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.251743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:32.331071 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 888/1795] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:31 2022] POST /identity/v3/projects => generated 375 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:32.333462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.348870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77ea40-9e03-4297-be11-e27993757aa7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.456233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d3513-c0b1-4a17-be7c-0b4e0792c951 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.461361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16196bf9-66a5-463f-8174-8c977e257636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.461984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16196bf9-66a5-463f-8174-8c977e257636 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.462453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16196bf9-66a5-463f-8174-8c977e257636 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.462924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16196bf9-66a5-463f-8174-8c977e257636 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.463802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16196bf9-66a5-463f-8174-8c977e257636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.465402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16196bf9-66a5-463f-8174-8c977e257636 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.477840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 889/1796] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:32.479265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.479375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.479657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.491495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.492702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.492996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.493469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.494833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.499889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.546415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] MFA Rules not processed for user `fe654e4ddf8a46708ebc36537efdbd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:32.549196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:32.668000 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 908/1797] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:32 2022] POST /identity/v3/users => generated 294 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:32.668957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.685863 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 890/1798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:32.695223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.695455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d5b6-6ca2-43dc-bf44-f68304c13c69 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.711356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.712060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.712354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.712851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.713886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.716124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.781601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e8a8-66bf-4196-9484-963c0a06faeb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.788312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1916c-4d6c-451d-b624-e15e0795c113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.788945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1916c-4d6c-451d-b624-e15e0795c113 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.789342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1916c-4d6c-451d-b624-e15e0795c113 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.789498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1916c-4d6c-451d-b624-e15e0795c113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.812661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1916c-4d6c-451d-b624-e15e0795c113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.814298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1916c-4d6c-451d-b624-e15e0795c113 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.817531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 909/1799] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:32 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:32.819348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.841507 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 891/1800] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:32.842174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ee36-a9dd-441f-8bf5-8c1b24374f69 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.843267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efb83c-799e-4186-9f66-dac14656be98 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.843656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efb83c-799e-4186-9f66-dac14656be98 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.843945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efb83c-799e-4186-9f66-dac14656be98 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.845528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 892/1801] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:32.846264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efb83c-799e-4186-9f66-dac14656be98 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.865245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.866266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.867627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.867627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] PATH_INFO: `/v3/projects/668a433b32b94e72b978b892312c615a/users/c11b2e709adb4a8cafefd20d3055f425/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.870158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668a433b32b94e72b978b892312c615a, user_id=c11b2e709adb4a8cafefd20d3055f425, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.872703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efb83c-799e-4186-9f66-dac14656be98 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:32.881934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.885825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:32.887898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:32.888224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:32.888932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:32.889628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:32.892056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:32.914808 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 910/1802] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:32 2022] PUT /identity/v3/projects/668a433b32b94e72b978b892312c615a/users/c11b2e709adb4a8cafefd20d3055f425/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:32.916358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.923424 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 893/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:32.924869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:32.971450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cab79a-d757-47a7-a15c-9290960df9a8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:33.045292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cde24-5fd3-4310-beda-d5d8008c3cd9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:33.072950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93db4aa-fe87-40ab-8916-063f407a3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:33.073859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db4aa-fe87-40ab-8916-063f407a3af0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.074379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db4aa-fe87-40ab-8916-063f407a3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.074787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db4aa-fe87-40ab-8916-063f407a3af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.075471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93db4aa-fe87-40ab-8916-063f407a3af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:33.081040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:33.082247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93db4aa-fe87-40ab-8916-063f407a3af0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:33.109737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:33.110447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.113963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.113963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.113963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:33.118938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:33.144544 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 894/1804] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:33.145852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:33.148540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:33.236690 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 911/1805] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:32 2022] POST /identity/v3/projects => generated 391 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:33.239800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.240167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.240624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.298786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] MFA Rules not processed for user `c11b2e709adb4a8cafefd20d3055f425`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:33.301909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:33.303230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:33.307969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:33.424464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:33.426740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306789-f75b-42cf-ab4d-2bcff8cedc5a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:33.500042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd359c31a7b8145ea947a51adda2ef9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb93b73593f43e78f646cf45490c716', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:33.500828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.501016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.519621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.519621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorizing `identity:get_project(project_id=eaaf917565724ee4a7c411f950b6aa9a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:33.519621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:33.520200 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 895/1806] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:33 2022] GET /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a => generated 393 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:33.521294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:33.584869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 912/1807] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:33.585998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:33.637636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:33.743828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b59b6c-b4f0-4f6a-b358-7e03d33c3488 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:33.751478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce1c2-0731-413f-85b3-692caca06c17 tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:33.758605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:33.759404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.759760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.760028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.760769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:33.762585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:33.768804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:33.770000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.770349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.770707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.771464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:33.773207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:33.781539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 896/1808] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:33.785266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:33.799410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 913/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:33.801526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:33.812391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ee84-2ff3-4186-b6fc-05dfe871fdff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:33.823826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:33.825217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:33.827452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:33.827795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:33.829853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:33.834460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:34.011205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 897/1810] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:33 2022] POST /identity/v3/users => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:34.012404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de989d4c-d132-4d96-9a0f-5a4c4e26aa05 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:34.012747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:34.024164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:34.025482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.025482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.025482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.030532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54256d4-43a0-447f-acda-2375c7ee9d37 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:34.035156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:34.036270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.036943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.037848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] PATH_INFO: `/v3/projects/63103b35b05047b6baf96c988e41a4f0/users/a1d99ec0a2ae4f8185a0d19edcb0e2ad/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.059926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:34.062094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:34.062744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=63103b35b05047b6baf96c988e41a4f0, user_id=a1d99ec0a2ae4f8185a0d19edcb0e2ad, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:34.070702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:34.091696 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 914/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:34.100371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:34.126780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bdd39-8459-4343-b45a-2f120c22f393 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:34.135756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e7597-bb70-4c02-b22e-48f887ce95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:34.136490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7597-bb70-4c02-b22e-48f887ce95d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.136716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7597-bb70-4c02-b22e-48f887ce95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.136991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e7597-bb70-4c02-b22e-48f887ce95d6 admin admin] PATH_INFO: `/v3/projects/cc665fdb6c1a4851b48452dc4471987d/users/81e7c8ed90d147fe9286714311aaa82d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.195867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e7597-bb70-4c02-b22e-48f887ce95d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc665fdb6c1a4851b48452dc4471987d, user_id=81e7c8ed90d147fe9286714311aaa82d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:34.197516 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 898/1812] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:34 2022] PUT /identity/v3/projects/63103b35b05047b6baf96c988e41a4f0/users/a1d99ec0a2ae4f8185a0d19edcb0e2ad/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:34.198589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:34.199388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e7597-bb70-4c02-b22e-48f887ce95d6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:34.310222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:34.332059 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 915/1813] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:34 2022] PUT /identity/v3/projects/cc665fdb6c1a4851b48452dc4471987d/users/81e7c8ed90d147fe9286714311aaa82d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:34.333368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ed04-a91e-48f9-af32-69429f1bb8c5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.333979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ed04-a91e-48f9-af32-69429f1bb8c5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.333979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ed04-a91e-48f9-af32-69429f1bb8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.401385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503968a-57e4-421f-8ea2-c35802ea9eec admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:34.411591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-69b4ed04-a91e-48f9-af32-69429f1bb8c5 None None] MFA Rules not processed for user `a1d99ec0a2ae4f8185a0d19edcb0e2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:34.412953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-69b4ed04-a91e-48f9-af32-69429f1bb8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:34.565030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:34.565757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.566027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.566299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.566949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:34.568615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:34.580949 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 916/1814] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:34.585389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e8f1-a19d-47c5-8ee6-fc276e8c43cb None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.585389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e8f1-a19d-47c5-8ee6-fc276e8c43cb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.585389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e8f1-a19d-47c5-8ee6-fc276e8c43cb None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.585389 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 917/1815] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:34.586058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.586168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.586581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.622141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 899/1816] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:34.623071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:34.660309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] MFA Rules not processed for user `81e7c8ed90d147fe9286714311aaa82d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:34.662843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c5d9-a684-41e7-bc3b-6fd616381a3f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:34.663607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:34.688904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:34.689713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:34.690158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:34.690573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:34.691565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:34.693611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:34.783186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:34.835769 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 900/1817] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:34 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:34.839965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:34.869093 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 918/1818] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:34.870360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:34.899419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306278-bd20-4ecc-a6de-8ab0847f143f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.050107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.057306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.059033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.059330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] PATH_INFO: `/v3/projects/3363f295d1714faa9aff71d8648e8592/users/5cc4f56a1fa24260876997d4fd15b77b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.078209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.118521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3363f295d1714faa9aff71d8648e8592, user_id=5cc4f56a1fa24260876997d4fd15b77b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.138593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.190144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e12ee-666c-411f-9b81-ce1f6a310bbb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.196537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd359c31a7b8145ea947a51adda2ef9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb93b73593f43e78f646cf45490c716', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.196537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.196537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.207318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.207318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorizing `identity:get_project(project_id=eaaf917565724ee4a7c411f950b6aa9a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.207318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.207318 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 901/1819] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:34 2022] GET /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a => generated 393 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:35.207318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.224349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedaf89-4dd3-4db9-b331-f5b41142af3a tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.229838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.231127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.232123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.232514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.234769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.236658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.274698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 919/1820] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:34 2022] PUT /identity/v3/projects/3363f295d1714faa9aff71d8648e8592/users/5cc4f56a1fa24260876997d4fd15b77b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:35.277446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.312601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:35.350128 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 902/1821] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:35 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:35.350839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.370229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:35.374140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71176e-7b8a-4ffb-a3c8-8502d4c13dd8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.508645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.509889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.510186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.510636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.513460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.541346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.596187 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 903/1822] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:35.597399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.618110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431c13-6af2-4bb1-86d1-136895533fe6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.621804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7d8c-84ff-4cd4-8391-d15c566c1f1b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.630550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.631369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.631663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.632013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.632734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.634597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.657246 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 904/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:35.658332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.659906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea6e1-6de8-4dbb-8f48-73a3160daa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.663733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea6e1-6de8-4dbb-8f48-73a3160daa40 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.665523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea6e1-6de8-4dbb-8f48-73a3160daa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.666922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea6e1-6de8-4dbb-8f48-73a3160daa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.667671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea6e1-6de8-4dbb-8f48-73a3160daa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.671779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0ccb0-4b70-4d10-804e-9a044764f8af admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.679650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.681065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.681546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.682045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] PATH_INFO: `/v3/projects/3363f295d1714faa9aff71d8648e8592/users/5cc4f56a1fa24260876997d4fd15b77b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.683949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea6e1-6de8-4dbb-8f48-73a3160daa40 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.684602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3363f295d1714faa9aff71d8648e8592, user_id=5cc4f56a1fa24260876997d4fd15b77b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.688798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.733574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 905/1824] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:35 2022] PUT /identity/v3/projects/3363f295d1714faa9aff71d8648e8592/users/5cc4f56a1fa24260876997d4fd15b77b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:35.736118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:35.823836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dea4d4-3d38-4bc5-a457-4fcc56caa878 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:35.830983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:35.831758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.832074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.832359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] PATH_INFO: `/v3/projects/8befab9dcbdb4c3ba21b676d466bed0b/users/b2906d0ad43e4258b82b9a5030a1bbe3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:35.859689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8befab9dcbdb4c3ba21b676d466bed0b, user_id=b2906d0ad43e4258b82b9a5030a1bbe3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:35.875231 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 920/1825] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:35 2022] POST /identity/v3/projects => generated 373 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:35.876318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:35.878847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:35.879051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:35.882238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.016595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 906/1826] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:35 2022] PUT /identity/v3/projects/8befab9dcbdb4c3ba21b676d466bed0b/users/b2906d0ad43e4258b82b9a5030a1bbe3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:36.028157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:36.045864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] MFA Rules not processed for user `5cc4f56a1fa24260876997d4fd15b77b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:36.047475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:36.240139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c7f3-b405-4452-a02b-b251a1391441 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:36.257459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 921/1827] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:36.258353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:36.262763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f34289-72fb-426e-ae9e-4b5f495212da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:36.263656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34289-72fb-426e-ae9e-4b5f495212da admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.264832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34289-72fb-426e-ae9e-4b5f495212da admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.265772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34289-72fb-426e-ae9e-4b5f495212da admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.269069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f34289-72fb-426e-ae9e-4b5f495212da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:36.276496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e6acc-dc0c-45da-80ef-2f39e9d04c14 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:36.282614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:36.284202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.284483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.284755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.285424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:36.294500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f34289-72fb-426e-ae9e-4b5f495212da admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:36.302256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:36.323900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 922/1828] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:36.330923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:36.354055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374a88a-d09c-4b24-a68c-45466d731b99 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:36.367517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:36.374036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.374036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.374036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] PATH_INFO: `/v3/projects/8befab9dcbdb4c3ba21b676d466bed0b/users/b2906d0ad43e4258b82b9a5030a1bbe3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.376110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8befab9dcbdb4c3ba21b676d466bed0b, user_id=b2906d0ad43e4258b82b9a5030a1bbe3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:36.392904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:36.415653 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 923/1829] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:36 2022] PUT /identity/v3/projects/8befab9dcbdb4c3ba21b676d466bed0b/users/b2906d0ad43e4258b82b9a5030a1bbe3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:36.425024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:36.516963 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 907/1830] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:36 2022] POST /identity/v3/users => generated 293 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:36.518330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf83a-c114-4402-9508-8f29980ea79d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.518630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf83a-c114-4402-9508-8f29980ea79d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.518909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf83a-c114-4402-9508-8f29980ea79d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.551262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 908/1831] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:50:36 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:36.572644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.582167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.582167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.606031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:36.611392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd192e-13fa-4957-8043-445654dd2e01 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:36.627594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:36.638014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.638394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.638772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] PATH_INFO: `/v3/users/fe654e4ddf8a46708ebc36537efdbd7b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.640777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe654e4ddf8a46708ebc36537efdbd7b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:36.644082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:36.722059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] MFA Rules not processed for user `b2906d0ad43e4258b82b9a5030a1bbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:36.723338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:36.871873 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 909/1832] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:36.875512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:36.897789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5d505-98b3-48c0-aec3-5bf5c6332021 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:36.911133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92256900-31ae-48dd-bafc-abb584115b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:36.914168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92256900-31ae-48dd-bafc-abb584115b03 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.915285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92256900-31ae-48dd-bafc-abb584115b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.915578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92256900-31ae-48dd-bafc-abb584115b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.918776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92256900-31ae-48dd-bafc-abb584115b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:36.920800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92256900-31ae-48dd-bafc-abb584115b03 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:36.947923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 910/1833] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:36.963179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70358-7729-4eab-8805-803a79e5e189 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:36.963179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70358-7729-4eab-8805-803a79e5e189 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:36.963179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd70358-7729-4eab-8805-803a79e5e189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:36.979207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7cd70358-7729-4eab-8805-803a79e5e189 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:36.990113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7cd70358-7729-4eab-8805-803a79e5e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:37.103131 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 911/1834] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:37.105691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b3bcc-fff9-4726-8a58-1c8d126d2a5d None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:37.106107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b3bcc-fff9-4726-8a58-1c8d126d2a5d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:37.106423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b3bcc-fff9-4726-8a58-1c8d126d2a5d None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:37.113240 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 912/1835] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:37.114666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b3bcc-fff9-4726-8a58-1c8d126d2a5d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:37.147196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b3bcc-fff9-4726-8a58-1c8d126d2a5d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:37.170054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:37.171377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:37.171670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:37.171952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] PATH_INFO: `/v3/projects/ab80b8b5f632481084aed230a3810680/users/343cdef3396142d0bf2977f5e36a6c30/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:37.197895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab80b8b5f632481084aed230a3810680, user_id=343cdef3396142d0bf2977f5e36a6c30, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:37.201016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.087354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:38.107531 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 913/1836] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:37 2022] PUT /identity/v3/projects/ab80b8b5f632481084aed230a3810680/users/343cdef3396142d0bf2977f5e36a6c30/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:38.107531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:50:38.181791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe654e4ddf8a46708ebc36537efdbd7b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:38.198505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe654e4ddf8a46708ebc36537efdbd7b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:38.199394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe654e4ddf8a46708ebc36537efdbd7b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:38.206280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe654e4ddf8a46708ebc36537efdbd7b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:38.234951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe654e4ddf8a46708ebc36537efdbd7b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:38.260559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:38.328200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35ec84-27e9-4edf-a677-1b4aff122c56 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:38.333924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd359c31a7b8145ea947a51adda2ef9ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ceb93b73593f43e78f646cf45490c716', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:38.334693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.335110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.335490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] PATH_INFO: `/v3/projects/233ccb254c784281864e757a9b9a3a84` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.336755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorizing `identity:get_project(project_id=233ccb254c784281864e757a9b9a3a84)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:38.340972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.346451 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 914/1837] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:50:38 2022] GET /identity/v3/projects/233ccb254c784281864e757a9b9a3a84 => generated 395 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:38.348939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:38.356088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 924/1838] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:36 2022] DELETE /identity/v3/users/fe654e4ddf8a46708ebc36537efdbd7b => generated 0 bytes in 1934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:38.356088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:38.356088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.357030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.383497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3780bd-5986-416f-8a83-60f41243656f tempest-FlavorsAccessNegativeTestJSON-168001775 tempest-FlavorsAccessNegativeTestJSON-168001775-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:38.454177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:38.455258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.455792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.456196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.458970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.459578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f34ed-4780-482d-a25b-44b89cccde97 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:38.466977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd992d3b-7079-4c00-9dff-ae625ad23179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:38.468428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd992d3b-7079-4c00-9dff-ae625ad23179 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.469532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd992d3b-7079-4c00-9dff-ae625ad23179 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.469532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd992d3b-7079-4c00-9dff-ae625ad23179 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.469917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd992d3b-7079-4c00-9dff-ae625ad23179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:38.471635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd992d3b-7079-4c00-9dff-ae625ad23179 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.486370 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 925/1839] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:38.486370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.486370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.486370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.510583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:38.512025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.526641 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 926/1840] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:38.530514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:38.540127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2c6d-834d-4851-a6f7-030af1214ec5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:38.545167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:38.546451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.546764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.547075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] PATH_INFO: `/v3/projects/ab80b8b5f632481084aed230a3810680/users/343cdef3396142d0bf2977f5e36a6c30/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.547581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:38.549582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab80b8b5f632481084aed230a3810680, user_id=343cdef3396142d0bf2977f5e36a6c30, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:38.550663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedfcdb-93ed-4e4a-9b44-64b76ae8e40a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.552299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.562781 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 915/1841] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:38.563272 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 927/1842] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:38 2022] PUT /identity/v3/projects/ab80b8b5f632481084aed230a3810680/users/343cdef3396142d0bf2977f5e36a6c30/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:38.572713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:38.574009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.574492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.574762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.575221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.611878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] MFA Rules not processed for user `343cdef3396142d0bf2977f5e36a6c30`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:38.614790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.637150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27458681-8218-4d22-97e1-3cd41299595a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:38.652082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:38.652082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.652082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.652082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.727936 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 916/1843] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:38.735167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:38.735806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:38.736671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.737512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.750251 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 928/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:38.846063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bb7c5-2fca-4713-9615-5c87497fd525 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:38.856046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:38.858618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:38.858618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:38.858618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:38.860408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:38.876703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:38.879223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:38.891745 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 917/1845] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:50:39.210923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.228946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5081f00-16cd-46bc-a828-49e7105fc84c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:39.235167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:39.236170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:39.238776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:39.238776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:39.247740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:39.250593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:39.266907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 929/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:39.319634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.327192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.329485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:39.337213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531794a-d7a7-47ba-9ee1-c051a6a57f8a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:39.344770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8df06-c7b7-41ea-903e-5b8a625c7395 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:39.346832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:39.348149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:39.348446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:39.348724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:39.350596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:39.350734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:39.350910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:39.351556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:39.351556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] PATH_INFO: `/v3/users/9771badb71674d49a2bfc93cbfca1b79` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:39.352624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9771badb71674d49a2bfc93cbfca1b79)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:39.354947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:39.417233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:39.418958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:39.429126 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 918/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:50:39.453419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.466684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb9e42-1492-4194-a660-14b9dbe28c92 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:39.475520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:39.476232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:39.476511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:39.476780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:39.478548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:39.564959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:39.564959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:39.575984 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 919/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:50:39.577572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.579548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:39.580757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9771badb71674d49a2bfc93cbfca1b79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.593234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:39.597185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9cd4b-8736-4800-b66a-0e921bc3a3aa service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:39.605678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9771badb71674d49a2bfc93cbfca1b79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.605678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9771badb71674d49a2bfc93cbfca1b79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.605678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9771badb71674d49a2bfc93cbfca1b79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.607242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:39.608512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:39.608843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:39.609127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] PATH_INFO: `/v3/projects/a545fe2917464057aafce35738f48b7c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:39.610350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a545fe2917464057aafce35738f48b7c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:39.612808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:39.636163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4a93438-f330-4e81-b024-486d533d2f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9771badb71674d49a2bfc93cbfca1b79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.763110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 930/1849] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:39 2022] DELETE /identity/v3/users/9771badb71674d49a2bfc93cbfca1b79 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:50:39.764901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:39.766681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:39.766968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:39.797943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a545fe2917464057aafce35738f48b7c', 'request_id': 'req-fd08a55b-d485-4004-a822-a2e12cf4ab04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.815515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a545fe2917464057aafce35738f48b7c', 'request_id': 'req-fd08a55b-d485-4004-a822-a2e12cf4ab04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.827552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:39.829225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:39.831847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a545fe2917464057aafce35738f48b7c', 'request_id': 'req-fd08a55b-d485-4004-a822-a2e12cf4ab04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.864779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:39.940475 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 931/1850] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:39.949764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.951778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:39.975285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] The token cache is being invalidate because project a545fe2917464057aafce35738f48b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:39.975722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.976582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:39.978186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 920/1851] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:39 2022] DELETE /identity/v3/projects/a545fe2917464057aafce35738f48b7c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:39.982581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:39.984743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:40.059522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213d62d-acb0-407f-ab89-a8deaaffcb08 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:40.064355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:40.079046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08a55b-d485-4004-a822-a2e12cf4ab04 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:40.080893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:40.081169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:40.081456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:40.083986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:40.089076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:40.089076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:40.089076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:40.089076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] PATH_INFO: `/v3/users/5cc4f56a1fa24260876997d4fd15b77b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:40.090559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc4f56a1fa24260876997d4fd15b77b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:40.093825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:40.126984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:40.129909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:40.157872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 932/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:40.160596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:40.162139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:40.274813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc097d4-07e9-4975-be2d-5984b0e6b38d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:40.283054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:40.283716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:40.284007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:40.284322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:40.286247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:40.369636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:40.371680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:40.377420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc4f56a1fa24260876997d4fd15b77b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:40.384240 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 933/1853] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:40.400236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc4f56a1fa24260876997d4fd15b77b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:40.401814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc4f56a1fa24260876997d4fd15b77b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:40.432227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc4f56a1fa24260876997d4fd15b77b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:40.433184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc4f56a1fa24260876997d4fd15b77b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:40.521170 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 921/1854] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:39 2022] DELETE /identity/v3/users/5cc4f56a1fa24260876997d4fd15b77b => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:40.661400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:40.805626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:40.807492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:40.826479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f70db-3892-479f-ad3f-0cc683fe619b service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:40.899313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:40.904707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:40.916687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:40.917333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:40.917617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:40.918141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] PATH_INFO: `/v3/users/81e7c8ed90d147fe9286714311aaa82d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:40.919132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e7c8ed90d147fe9286714311aaa82d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:40.921086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:41.069575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc254-2c25-42ca-a65d-323aefb8316b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:41.084965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:41.085697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:41.085984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:41.086265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] PATH_INFO: `/v3/projects/eaaf917565724ee4a7c411f950b6aa9a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:41.087464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaf917565724ee4a7c411f950b6aa9a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:41.089394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:41.185733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e7c8ed90d147fe9286714311aaa82d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.198665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e7c8ed90d147fe9286714311aaa82d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.199466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e7c8ed90d147fe9286714311aaa82d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.200160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e7c8ed90d147fe9286714311aaa82d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.216132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e7c8ed90d147fe9286714311aaa82d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.325074 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 934/1855] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:40 2022] DELETE /identity/v3/users/81e7c8ed90d147fe9286714311aaa82d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:41.327255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:41.333564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaf917565724ee4a7c411f950b6aa9a', 'request_id': 'req-ccdefcf6-637b-469c-9fdc-286fc155ba41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.334670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:41.354594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaf917565724ee4a7c411f950b6aa9a', 'request_id': 'req-ccdefcf6-637b-469c-9fdc-286fc155ba41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.368336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaf917565724ee4a7c411f950b6aa9a', 'request_id': 'req-ccdefcf6-637b-469c-9fdc-286fc155ba41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.460931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] The token cache is being invalidate because project eaaf917565724ee4a7c411f950b6aa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:41.461565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.468304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccdefcf6-637b-469c-9fdc-286fc155ba41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.470103 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 922/1856] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:40 2022] DELETE /identity/v3/projects/eaaf917565724ee4a7c411f950b6aa9a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:41.471694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:41.471984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:41.472266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:41.481956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e1a2-6d1a-4163-9aac-2c58d3462dd5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:41.489477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:41.490591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:41.491929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:41.492491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] PATH_INFO: `/v3/users/a1d99ec0a2ae4f8185a0d19edcb0e2ad` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:41.500172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d99ec0a2ae4f8185a0d19edcb0e2ad)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:41.500172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:41.516816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:41.519256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:41.546018 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 923/1857] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:41.547349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:41.549324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:41.570768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10e258-6718-4aa4-8989-de1b0ab2c711 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:41.577206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:41.578341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:41.578830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:41.579347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] PATH_INFO: `/v3/users/d359c31a7b8145ea947a51adda2ef9ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:41.582548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d359c31a7b8145ea947a51adda2ef9ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:41.585299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:41.714163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d99ec0a2ae4f8185a0d19edcb0e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.728596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d99ec0a2ae4f8185a0d19edcb0e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.729825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d99ec0a2ae4f8185a0d19edcb0e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.730761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d99ec0a2ae4f8185a0d19edcb0e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.760620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d99ec0a2ae4f8185a0d19edcb0e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.827653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd359c31a7b8145ea947a51adda2ef9ce'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.834741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd359c31a7b8145ea947a51adda2ef9ce'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.835625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd359c31a7b8145ea947a51adda2ef9ce'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.849863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd359c31a7b8145ea947a51adda2ef9ce'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.850604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-40bd39f0-41f6-4ffd-9211-370cc130435d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd359c31a7b8145ea947a51adda2ef9ce'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:41.893754 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 935/1858] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:41 2022] DELETE /identity/v3/users/a1d99ec0a2ae4f8185a0d19edcb0e2ad => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:41.895625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:41.899488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:41.978661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afab203-02d1-4e63-b125-0b5d7cc9d110 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:41.983551 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 924/1859] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:41 2022] DELETE /identity/v3/users/d359c31a7b8145ea947a51adda2ef9ce => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:41.984474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b9565-5034-454d-9410-680ad1da9217 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:41.984961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b9565-5034-454d-9410-680ad1da9217 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:41.985644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b9565-5034-454d-9410-680ad1da9217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:41.986440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:41.987168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:41.987455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:41.987878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.023547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.034693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-092b9565-5034-454d-9410-680ad1da9217 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:42.037958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-092b9565-5034-454d-9410-680ad1da9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.177965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:42.179560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:42.196617 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 936/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:42.197540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:42.199481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.215541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 925/1861] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:42.224283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b013a-9893-4724-9a91-1d0e4884003f service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:42.229991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:42.231165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.231775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.232561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] PATH_INFO: `/v3/projects/3363f295d1714faa9aff71d8648e8592` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.234572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3363f295d1714faa9aff71d8648e8592)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:42.236809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:42.238838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b9565-5034-454d-9410-680ad1da9217 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:42.240338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-092b9565-5034-454d-9410-680ad1da9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.297363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:42.381000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b9565-5034-454d-9410-680ad1da9217 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:42.386462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1532f-7d70-49df-9a42-1e88f5c83fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:42.387688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1532f-7d70-49df-9a42-1e88f5c83fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.388149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1532f-7d70-49df-9a42-1e88f5c83fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.388565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1532f-7d70-49df-9a42-1e88f5c83fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.401168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1532f-7d70-49df-9a42-1e88f5c83fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:42.404125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1532f-7d70-49df-9a42-1e88f5c83fa2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:42.406117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3363f295d1714faa9aff71d8648e8592', 'request_id': 'req-24fbc22a-9c1b-44e8-9543-8e5188c119f9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:42.412572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3363f295d1714faa9aff71d8648e8592', 'request_id': 'req-24fbc22a-9c1b-44e8-9543-8e5188c119f9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:42.423365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3363f295d1714faa9aff71d8648e8592', 'request_id': 'req-24fbc22a-9c1b-44e8-9543-8e5188c119f9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:42.423652 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 926/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:42.522499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] The token cache is being invalidate because project 3363f295d1714faa9aff71d8648e8592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:42.523043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:42.524065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-24fbc22a-9c1b-44e8-9543-8e5188c119f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:42.526216 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 937/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:42 2022] DELETE /identity/v3/projects/3363f295d1714faa9aff71d8648e8592 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:42.535182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.536128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.536604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.560419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:42.562034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.673804 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 927/1864] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:42.677849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.678219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.678526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.718924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:42.720643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.734324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:42.736146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:42.745751 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 938/1865] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:42.751345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:42.760613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648c248-fceb-444e-9c83-8b72aa97aa8c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:42.771309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab260bcc-b556-4794-a3ac-c478cdf61e51 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:42.773538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:42.774727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.775847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.777172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] PATH_INFO: `/v3/projects/ceb93b73593f43e78f646cf45490c716` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.780687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb93b73593f43e78f646cf45490c716)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:42.784864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:42.785552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.785660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:42.787616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.787924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.788606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:42.788908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:42.792198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:42.846048 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 939/1866] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:42.851395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:42.869598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e200-7d3f-4737-9db3-82011ad8dbf4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:42.901982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:42.904219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:42.904506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:42.905537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:42.906044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:42.908071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:42.987496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb93b73593f43e78f646cf45490c716', 'request_id': 'req-5d699f0d-52ea-4436-8f2e-33c5dee6121f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.007093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb93b73593f43e78f646cf45490c716', 'request_id': 'req-5d699f0d-52ea-4436-8f2e-33c5dee6121f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.016995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb93b73593f43e78f646cf45490c716', 'request_id': 'req-5d699f0d-52ea-4436-8f2e-33c5dee6121f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.076233 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 940/1867] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:42 2022] POST /identity/v3/projects => generated 395 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:43.078556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:43.081244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:43.143625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] The token cache is being invalidate because project ceb93b73593f43e78f646cf45490c716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:43.143625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.143625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.144503 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 928/1868] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:42 2022] DELETE /identity/v3/projects/ceb93b73593f43e78f646cf45490c716 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:43.149556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:43.152944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:43.283977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c8763-0533-4ca8-9493-a0bd1927cf9f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:43.295912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:43.296902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:43.301577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:43.301577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] PATH_INFO: `/v3/projects/cc665fdb6c1a4851b48452dc4471987d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:43.301577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc665fdb6c1a4851b48452dc4471987d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:43.301577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:43.321100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699f0d-52ea-4436-8f2e-33c5dee6121f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:43.341641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:43.341641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:43.341641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:43.341641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:43.341949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:43.341949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:43.457921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:43.462268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc665fdb6c1a4851b48452dc4471987d', 'request_id': 'req-47eca62e-344f-4dc4-8114-7e7e26707f1f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.478868 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 929/1869] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:43 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:43.481592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:43.482737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc665fdb6c1a4851b48452dc4471987d', 'request_id': 'req-47eca62e-344f-4dc4-8114-7e7e26707f1f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.485857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:43.493274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc665fdb6c1a4851b48452dc4471987d', 'request_id': 'req-47eca62e-344f-4dc4-8114-7e7e26707f1f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.520412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab5c8-557d-46f1-bce3-b58afc17d4ea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:43.589756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] The token cache is being invalidate because project cc665fdb6c1a4851b48452dc4471987d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:43.590054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.596432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.599310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 941/1870] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:43 2022] DELETE /identity/v3/projects/cc665fdb6c1a4851b48452dc4471987d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:43.602846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:43.607691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:43.644770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:43.646220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:43.646718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:43.647349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] PATH_INFO: `/v3/users/b5a47c8524d04224bcda58e1545a65b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:43.650210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a47c8524d04224bcda58e1545a65b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:43.660716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:43.688050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca62e-344f-4dc4-8114-7e7e26707f1f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:43.692896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:43.693777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:43.693777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:43.694036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:43.694679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:43.697151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:43.721719 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 942/1871] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:43.723782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:43.726171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:43.747348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062e75-20a4-4ef4-b649-ee3a6fc76ac5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:43.757726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:43.758384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:43.758662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:43.759692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] PATH_INFO: `/v3/users/343cdef3396142d0bf2977f5e36a6c30` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:43.760905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343cdef3396142d0bf2977f5e36a6c30)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:43.769437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:43.903130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a47c8524d04224bcda58e1545a65b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.912062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a47c8524d04224bcda58e1545a65b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.912877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a47c8524d04224bcda58e1545a65b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.930666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a47c8524d04224bcda58e1545a65b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.931463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7e372b9-ad41-486e-83db-5cb233d9611b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a47c8524d04224bcda58e1545a65b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.941232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343cdef3396142d0bf2977f5e36a6c30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.955764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343cdef3396142d0bf2977f5e36a6c30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.956550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343cdef3396142d0bf2977f5e36a6c30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.957211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343cdef3396142d0bf2977f5e36a6c30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:43.970385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343cdef3396142d0bf2977f5e36a6c30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.007302 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 930/1872] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:43 2022] DELETE /identity/v3/users/b5a47c8524d04224bcda58e1545a65b1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:44.012103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.012597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.013624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.053855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] MFA Rules not processed for user `6f59260019b34b0b8c4c8792afe8b317`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:44.055433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.082822 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 943/1873] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:43 2022] DELETE /identity/v3/users/343cdef3396142d0bf2977f5e36a6c30 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:44.084020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.085732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.183545 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 931/1874] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:44.183545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.184074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.203701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d742e-50b1-4574-adf1-324c13e4f9d5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.209917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:44.210750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.212568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.212961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] PATH_INFO: `/v3/projects/63103b35b05047b6baf96c988e41a4f0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.215640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=63103b35b05047b6baf96c988e41a4f0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:44.219379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:44.296328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7ea2c-bf1c-4212-a7b4-2aa3bec41d60 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.302562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:44.302727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.303043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.303325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.303985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:44.305932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:44.316978 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 932/1875] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:44.317863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.320110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.352661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3564a9-755c-43ab-86b3-8c1aeb604492 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.407395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63103b35b05047b6baf96c988e41a4f0', 'request_id': 'req-9230f259-1e57-4210-b3bb-1f6f822efd2d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.414868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63103b35b05047b6baf96c988e41a4f0', 'request_id': 'req-9230f259-1e57-4210-b3bb-1f6f822efd2d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.421738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63103b35b05047b6baf96c988e41a4f0', 'request_id': 'req-9230f259-1e57-4210-b3bb-1f6f822efd2d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.449793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:44.450443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.450721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.452306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] PATH_INFO: `/v3/users/1d2b5ed384d548968672226861f1dd32` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.453411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2b5ed384d548968672226861f1dd32)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:44.456334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:44.505085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] The token cache is being invalidate because project 63103b35b05047b6baf96c988e41a4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:44.505604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.506085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.507911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 944/1876] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:44 2022] DELETE /identity/v3/projects/63103b35b05047b6baf96c988e41a4f0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:44.508616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.509951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.524738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f259-1e57-4210-b3bb-1f6f822efd2d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.548116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:44.549178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.549652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.550128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.550969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:44.553129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:44.660152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2b5ed384d548968672226861f1dd32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.677250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2b5ed384d548968672226861f1dd32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.678089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2b5ed384d548968672226861f1dd32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.690541 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 945/1877] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:44 2022] POST /identity/v3/projects => generated 403 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:44.691939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.694023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.700751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2b5ed384d548968672226861f1dd32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.701659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2b5ed384d548968672226861f1dd32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:44.797495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01358de3-dd6b-4682-8d1d-9e57751b19a0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.803266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:44.803959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.804247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.804527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] PATH_INFO: `/v3/projects/b22f4ed6b0e743c0a58fbb2e165f2e2d/users/94224df8a6774bf099653765b57d0e45/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.824878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22f4ed6b0e743c0a58fbb2e165f2e2d, user_id=94224df8a6774bf099653765b57d0e45, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:44.825624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 933/1878] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:44 2022] DELETE /identity/v3/users/1d2b5ed384d548968672226861f1dd32 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:44.826550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.837970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:44.838163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.916133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08dff-d670-4557-a5c8-e83545565383 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.918955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 946/1879] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:44 2022] PUT /identity/v3/projects/b22f4ed6b0e743c0a58fbb2e165f2e2d/users/94224df8a6774bf099653765b57d0e45/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:44.919792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:44.922268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:44.981767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:44.982646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:44.983635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:44.984061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] PATH_INFO: `/v3/users/b2906d0ad43e4258b82b9a5030a1bbe3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:44.985323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2906d0ad43e4258b82b9a5030a1bbe3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:44.987412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:44.991001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a084c-0855-4430-b122-7aab9279ac7b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:44.997903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.000636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.001131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.003294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.004409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.006273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.103354 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 947/1880] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:44 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:45.104473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:45.106806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.121156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588db37-755d-4606-9fe8-1e68f6b81ee4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:45.127494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.128219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.128575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.128920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] PATH_INFO: `/v3/projects/233ccb254c784281864e757a9b9a3a84` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.130119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233ccb254c784281864e757a9b9a3a84)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.132205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.161062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2906d0ad43e4258b82b9a5030a1bbe3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.169720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2906d0ad43e4258b82b9a5030a1bbe3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.171104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2906d0ad43e4258b82b9a5030a1bbe3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.187924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2906d0ad43e4258b82b9a5030a1bbe3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.188672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2906d0ad43e4258b82b9a5030a1bbe3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.224450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:45.243443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233ccb254c784281864e757a9b9a3a84', 'request_id': 'req-fb5bad4d-081a-47e3-9c5b-24092d6869c2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.250907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233ccb254c784281864e757a9b9a3a84', 'request_id': 'req-fb5bad4d-081a-47e3-9c5b-24092d6869c2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.258440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233ccb254c784281864e757a9b9a3a84', 'request_id': 'req-fb5bad4d-081a-47e3-9c5b-24092d6869c2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.283075 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 934/1881] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:44 2022] DELETE /identity/v3/users/b2906d0ad43e4258b82b9a5030a1bbe3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:45.283075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:45.286577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.363943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd351cc-17ec-45ef-94fb-0156de04f72b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:45.369980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.370922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.371612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.372051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] PATH_INFO: `/v3/projects/ab80b8b5f632481084aed230a3810680` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.372359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] The token cache is being invalidate because project 233ccb254c784281864e757a9b9a3a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:45.372661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.373939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb5bad4d-081a-47e3-9c5b-24092d6869c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.374115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab80b8b5f632481084aed230a3810680)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.375605 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 948/1882] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:45 2022] DELETE /identity/v3/projects/233ccb254c784281864e757a9b9a3a84 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:45.376801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd47d94-6dcf-489f-baca-4c99901f21a2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.381105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd47d94-6dcf-489f-baca-4c99901f21a2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.381419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd47d94-6dcf-489f-baca-4c99901f21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.381607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.424260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8fd47d94-6dcf-489f-baca-4c99901f21a2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:45.425771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fd47d94-6dcf-489f-baca-4c99901f21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.439654 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 949/1883] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:45.439654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.439654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.439654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.487432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] MFA Rules not processed for user `94224df8a6774bf099653765b57d0e45`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:45.488670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.527063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:45.557283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab80b8b5f632481084aed230a3810680', 'request_id': 'req-1e2ce5df-d225-43ff-8003-e9ff168208ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.566022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab80b8b5f632481084aed230a3810680', 'request_id': 'req-1e2ce5df-d225-43ff-8003-e9ff168208ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.573043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab80b8b5f632481084aed230a3810680', 'request_id': 'req-1e2ce5df-d225-43ff-8003-e9ff168208ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.574151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 950/1884] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:45.579140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:45.579140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.596741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1f8ed-29f4-482e-968d-faaf881c7f08 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:45.665270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7b04-9d2d-4a56-902a-5b7d505f7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.665270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7b04-9d2d-4a56-902a-5b7d505f7694 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.665803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7b04-9d2d-4a56-902a-5b7d505f7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.666086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7b04-9d2d-4a56-902a-5b7d505f7694 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.666734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa7b04-9d2d-4a56-902a-5b7d505f7694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.668379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa7b04-9d2d-4a56-902a-5b7d505f7694 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.679584 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 951/1885] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:45.683612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.683899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.684174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.693221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] The token cache is being invalidate because project ab80b8b5f632481084aed230a3810680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:45.694219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.696727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e2ce5df-d225-43ff-8003-e9ff168208ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:45.700121 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 935/1886] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:45 2022] DELETE /identity/v3/projects/ab80b8b5f632481084aed230a3810680 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:45.701507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abf1f8-f3aa-4b66-81f4-5ab867ec12be None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.701800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abf1f8-f3aa-4b66-81f4-5ab867ec12be None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.702074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abf1f8-f3aa-4b66-81f4-5ab867ec12be None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.703566 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 936/1887] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:45.704552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abf1f8-f3aa-4b66-81f4-5ab867ec12be None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:45.706085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-96abf1f8-f3aa-4b66-81f4-5ab867ec12be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.714364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:45.715816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.725078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 952/1888] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:45.725797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:45.727375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.741710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76328-26a3-4b5b-be2c-83032bcd1f56 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:45.751316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a6705-73c4-4eb1-a44c-8e1f0c055a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.751316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6705-73c4-4eb1-a44c-8e1f0c055a45 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.751316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6705-73c4-4eb1-a44c-8e1f0c055a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.751316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6705-73c4-4eb1-a44c-8e1f0c055a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.751856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6705-73c4-4eb1-a44c-8e1f0c055a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.752081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6705-73c4-4eb1-a44c-8e1f0c055a45 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.800051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abf1f8-f3aa-4b66-81f4-5ab867ec12be None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:45.803813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.804611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.804897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.805172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.810633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.821993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.823594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.835599 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 937/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:45.837011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:45.837759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:45.851389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840c79f-3048-40dc-ac02-4217b49afc83 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:45.863685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ebc5-d128-4fd0-bfad-2911efbf648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:45.864398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ebc5-d128-4fd0-bfad-2911efbf648e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.869422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ebc5-d128-4fd0-bfad-2911efbf648e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.869422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ebc5-d128-4fd0-bfad-2911efbf648e admin admin] PATH_INFO: `/v3/projects/965ebea2660546ef8361b78215321dbb/users/039f9584f5f44d779f709d56dc3ebd3d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.869600 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 953/1890] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:45 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:45.869600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371178b-0c79-4f38-a193-93e270841970 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:45.869600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371178b-0c79-4f38-a193-93e270841970 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:45.869600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371178b-0c79-4f38-a193-93e270841970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:45.887841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ebc5-d128-4fd0-bfad-2911efbf648e admin admin] RBAC: Authorizing `identity:create_grant(project_id=965ebea2660546ef8361b78215321dbb, user_id=039f9584f5f44d779f709d56dc3ebd3d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:45.891647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ebc5-d128-4fd0-bfad-2911efbf648e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:45.921299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d371178b-0c79-4f38-a193-93e270841970 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:45.926317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d371178b-0c79-4f38-a193-93e270841970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.005550 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 938/1891] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:45 2022] PUT /identity/v3/projects/965ebea2660546ef8361b78215321dbb/users/039f9584f5f44d779f709d56dc3ebd3d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:46.007174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.007467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.008099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.030981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 954/1892] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:46.034637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.035155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.037664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.046047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:46.047362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.085063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:46.088566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.186675 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 939/1893] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:46.187486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.193349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.202745 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 955/1894] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:46.204290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.216848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e673-3c41-4752-afd4-3f2673358c79 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.227353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a533404-b2b6-4c51-bf98-45c8e9cb1e48 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.229577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.230208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.230528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.230795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.231715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.234592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.240981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.241592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.242022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.242307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] PATH_INFO: `/v3/projects/8befab9dcbdb4c3ba21b676d466bed0b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.245887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8befab9dcbdb4c3ba21b676d466bed0b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.249612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.335530 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 956/1895] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:46.337985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.346678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780c08-80c9-48d4-8b5a-b5782eae6c96 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.351561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86239873-6ce7-4b10-87c8-822ded3dc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.352149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86239873-6ce7-4b10-87c8-822ded3dc8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.352426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86239873-6ce7-4b10-87c8-822ded3dc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.352696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86239873-6ce7-4b10-87c8-822ded3dc8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.353357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86239873-6ce7-4b10-87c8-822ded3dc8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.354944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86239873-6ce7-4b10-87c8-822ded3dc8c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.367932 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 957/1896] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:46.372281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.372281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.372281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.396413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8befab9dcbdb4c3ba21b676d466bed0b', 'request_id': 'req-becce012-e9e6-4000-9ed6-ec9ce5cfe853'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.406273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:46.406273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.407333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8befab9dcbdb4c3ba21b676d466bed0b', 'request_id': 'req-becce012-e9e6-4000-9ed6-ec9ce5cfe853'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.414081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8befab9dcbdb4c3ba21b676d466bed0b', 'request_id': 'req-becce012-e9e6-4000-9ed6-ec9ce5cfe853'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.464521 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 958/1897] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:46.465786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.475445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e2ba9-b8a6-4a1e-80b8-f2a0b03a3d42 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.480118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.480716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.481001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.481273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.481922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:46.482308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.484673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.496927 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 959/1898] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:46.498291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.503060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.560380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] The token cache is being invalidate because project 8befab9dcbdb4c3ba21b676d466bed0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:46.560380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.560380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.560380 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 940/1899] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:46 2022] DELETE /identity/v3/projects/8befab9dcbdb4c3ba21b676d466bed0b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:46.560380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.563564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.578241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce012-e9e6-4000-9ed6-ec9ce5cfe853 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.583462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.584075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.590706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.590706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.590706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.590925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab615ac-6e33-45f2-8eb8-08329b41c3f1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.591362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.593184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.594133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.594505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.594853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.596844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.597673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 941/1900] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:46.601577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.603306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.614956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.616833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.618532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7736d-1920-408f-8619-7b2f996198c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.625222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.625960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.626275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.626554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] PATH_INFO: `/v3/projects/b5f346ce1f8d43b6bf7796526a1270ae` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.627702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f346ce1f8d43b6bf7796526a1270ae)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.629605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.630209 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 960/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:46.631071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.632432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.648597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79739d49-8b72-4993-b0c3-52a3931eaa54 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.653621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.654280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.654596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.655198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] PATH_INFO: `/v3/projects/965ebea2660546ef8361b78215321dbb/users/039f9584f5f44d779f709d56dc3ebd3d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.657125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965ebea2660546ef8361b78215321dbb, user_id=039f9584f5f44d779f709d56dc3ebd3d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.660312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.676600 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 961/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:46 2022] PUT /identity/v3/projects/965ebea2660546ef8361b78215321dbb/users/039f9584f5f44d779f709d56dc3ebd3d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:46.676600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.676600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.768831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce517e-ba2f-4ad7-b224-0dd53d9c0f41 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.779718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f346ce1f8d43b6bf7796526a1270ae', 'request_id': 'req-aedf929f-a0c3-4221-9c89-4168dc8262bb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.786956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f346ce1f8d43b6bf7796526a1270ae', 'request_id': 'req-aedf929f-a0c3-4221-9c89-4168dc8262bb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.793295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f346ce1f8d43b6bf7796526a1270ae', 'request_id': 'req-aedf929f-a0c3-4221-9c89-4168dc8262bb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.832739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.833365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.833691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.834013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.841072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:46.841072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.841072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.849204 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 962/1903] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:46.850131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.851948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.865488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335d3a-a15c-4a98-a8ee-51690dc0ca93 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.870145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.870746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.871062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.871342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.872232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:46.874835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:46.896547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] The token cache is being invalidate because project b5f346ce1f8d43b6bf7796526a1270ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:46.896932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.897727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aedf929f-a0c3-4221-9c89-4168dc8262bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:46.899415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 942/1904] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:46 2022] DELETE /identity/v3/projects/b5f346ce1f8d43b6bf7796526a1270ae => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:46.902794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.902794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.902794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.918111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:46.929698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:46.930982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.941003 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 943/1905] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:46.943930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.948064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.964017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb41db9-3f75-40ee-ab99-0b93b1b9f6be None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:46.969154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:46.969957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:46.970243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:46.970521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] PATH_INFO: `/v3/projects/239b00b40f1f4104981af279a57f79bf/users/492fb8a4e0414e52a7e2b0f1d56d4ece/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:46.987316 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 963/1906] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:46.989251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:46.993541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:46.999744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=239b00b40f1f4104981af279a57f79bf, user_id=492fb8a4e0414e52a7e2b0f1d56d4ece, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.003802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.027054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:47.074402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 944/1907] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:46 2022] PUT /identity/v3/projects/239b00b40f1f4104981af279a57f79bf/users/492fb8a4e0414e52a7e2b0f1d56d4ece/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:47.075174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621671f1-e269-4219-a1f3-4f6121df5a5b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.075633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.078283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.163037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4edc6c-1763-4914-83a4-f295b9d71c7b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.169037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc7ec-c6b0-422a-89f9-2dd6dbf8c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.171148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc7ec-c6b0-422a-89f9-2dd6dbf8c0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.171148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc7ec-c6b0-422a-89f9-2dd6dbf8c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.171148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc7ec-c6b0-422a-89f9-2dd6dbf8c0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.171865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddc7ec-c6b0-422a-89f9-2dd6dbf8c0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.173247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddc7ec-c6b0-422a-89f9-2dd6dbf8c0a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.177737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.178652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.179202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.179634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] PATH_INFO: `/v3/users/c11b2e709adb4a8cafefd20d3055f425` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.181769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11b2e709adb4a8cafefd20d3055f425)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.184612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.295692 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 964/1908] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:46 2022] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:47.297185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.297584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.297766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.320314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:47.321709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.435426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 965/1909] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:47.436976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.438379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.438495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11b2e709adb4a8cafefd20d3055f425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:47.455223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11b2e709adb4a8cafefd20d3055f425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:47.455769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0685950-b959-4ff9-a1fc-c5b990f94a09 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.456816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11b2e709adb4a8cafefd20d3055f425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:47.462194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.471107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.471107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.471107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.471107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.471107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.479425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11b2e709adb4a8cafefd20d3055f425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:47.480669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11b2e709adb4a8cafefd20d3055f425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:47.555798 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 966/1910] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:47 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:47.556702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.558712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.571245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25e2f3-261f-49f5-bdce-79d33ef38e03 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.576072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.577305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.577728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.578013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.578654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.580346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.596218 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 967/1911] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:47.596218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.597818 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 945/1912] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:47 2022] DELETE /identity/v3/users/c11b2e709adb4a8cafefd20d3055f425 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:47.597933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.598734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.602385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.619781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314629fd-8c85-4d19-8e9c-6903633d3f67 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.724319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.725313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.725901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.726377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.727713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.733355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.739541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb9f7a-351a-43b9-8e5a-0eb049e52d3c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.747367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.748148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.749232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.749343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.750116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:47.750644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.752416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.766467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 946/1913] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:47.767476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.770856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:47.785993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d1d4-c988-40c3-a5b0-e81b7d0fb0f8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.791376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.791991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.792274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.792549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.793195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.794958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.808119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 947/1914] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:47.809014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.820464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2f8c-649b-4536-ba6a-f8dc73cfc8d3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.831194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.831194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.831194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.831194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] PATH_INFO: `/v3/projects/239b00b40f1f4104981af279a57f79bf/users/492fb8a4e0414e52a7e2b0f1d56d4ece/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.834124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=239b00b40f1f4104981af279a57f79bf, user_id=492fb8a4e0414e52a7e2b0f1d56d4ece, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.837759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:47.860754 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 948/1915] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:47 2022] PUT /identity/v3/projects/239b00b40f1f4104981af279a57f79bf/users/492fb8a4e0414e52a7e2b0f1d56d4ece/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:47.860754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.861129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 968/1916] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:47 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:47.861129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:47.874061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e4c6-afab-4d6d-b02e-3b254db024d2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:47.992364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04103a89-1304-4862-a744-b9fa7786d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:47.993087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04103a89-1304-4862-a744-b9fa7786d41c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:47.993331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04103a89-1304-4862-a744-b9fa7786d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:47.998332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04103a89-1304-4862-a744-b9fa7786d41c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:47.998332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04103a89-1304-4862-a744-b9fa7786d41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:47.998332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04103a89-1304-4862-a744-b9fa7786d41c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.001378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ecc2e-6a61-49a5-8319-f01a6be7f6fc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.007561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.008588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.008878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.009153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.013055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.013055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.016030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 969/1917] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:48.019551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.019551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.019858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.060206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] MFA Rules not processed for user `492fb8a4e0414e52a7e2b0f1d56d4ece`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:48.061660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:48.129929 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 949/1918] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:47 2022] POST /identity/v3/projects => generated 403 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:48.130887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.171071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 970/1919] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:48.171071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.188455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987ae0-3245-4458-a8b2-452a5d338b22 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.208225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ca33d-e82e-471a-a84c-ac9ce53178ca admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.213371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.214003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.214293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.214566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.215263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.216999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.228146 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 950/1920] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:48.231223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.240375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e2b4-cd2e-4e5b-9d27-36a9927916d3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.245565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.246185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.246766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.247070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.247715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.250346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.267128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.267810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.268096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.268375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] PATH_INFO: `/v3/projects/0ddcd8cb880a473cbf7d06613b9f4fbf/users/cb499e5264164058a7ca318ddc84c49a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.285497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddcd8cb880a473cbf7d06613b9f4fbf, user_id=cb499e5264164058a7ca318ddc84c49a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.288225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.362548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:48.367817 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 951/1922] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:48 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:48.372433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.374265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:48.378825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 971/1922] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:48 2022] PUT /identity/v3/projects/0ddcd8cb880a473cbf7d06613b9f4fbf/users/cb499e5264164058a7ca318ddc84c49a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:48.380383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.462916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a442-5ee2-4d40-b215-06f0bc87be0c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.478812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.479485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.479774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.480054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.482155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.488729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.492441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3a30e-21f8-494f-821c-41abc154baad admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.501820 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 972/1923] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:48.505806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.507770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:48.528455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cb715-4c77-4759-be68-f23c74128d34 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.533989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.534891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.535849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.536242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] PATH_INFO: `/v3/projects/668a433b32b94e72b978b892312c615a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.537896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=668a433b32b94e72b978b892312c615a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.540383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.628049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.629088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.629379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.629660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.713571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.716583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.720804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668a433b32b94e72b978b892312c615a', 'request_id': 'req-48374a94-74fc-433e-94c9-8f6933b01cbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:48.728129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668a433b32b94e72b978b892312c615a', 'request_id': 'req-48374a94-74fc-433e-94c9-8f6933b01cbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:48.735780 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 952/1924] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:48.737261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.749817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f5c7-8995-4f84-9b1f-6cfe193b8344 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.755582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668a433b32b94e72b978b892312c615a', 'request_id': 'req-48374a94-74fc-433e-94c9-8f6933b01cbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:48.868341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6c81c-560e-468a-965f-15978a72ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.869265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6c81c-560e-468a-965f-15978a72ffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.869560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6c81c-560e-468a-965f-15978a72ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.869842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6c81c-560e-468a-965f-15978a72ffe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.870504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6c81c-560e-468a-965f-15978a72ffe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:48.872452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6c81c-560e-468a-965f-15978a72ffe4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:48.887037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] The token cache is being invalidate because project 668a433b32b94e72b978b892312c615a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:48.887229 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 953/1925] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:48.887453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:48.889621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.890106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.890554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.896046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:48.904030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 973/1926] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:48 2022] DELETE /identity/v3/projects/668a433b32b94e72b978b892312c615a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:48.910431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:48.930245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:48.952053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374a94-74fc-433e-94c9-8f6933b01cbb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:48.959263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:48.960713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:48.961129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:48.961457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:48.962364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] PATH_INFO: `/v3/projects/cb96f1aa78db438886c1f130a5075d8f/users/b09f8679c57f454986117ddefc73f2e6/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:48.979463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] MFA Rules not processed for user `cb499e5264164058a7ca318ddc84c49a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:48.984431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:48.997233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb96f1aa78db438886c1f130a5075d8f, user_id=b09f8679c57f454986117ddefc73f2e6, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:49.000502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:49.086144 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 954/1927] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:49.087504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:49.089081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.110766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:49.120139 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 974/1928] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:48 2022] PUT /identity/v3/projects/cb96f1aa78db438886c1f130a5075d8f/users/b09f8679c57f454986117ddefc73f2e6/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:49.121220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:49.125217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.126723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862f274-ce29-4c8d-a100-b1e3693054ce None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:49.227739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b464b4-9370-48d9-ab90-9644cee79bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:49.228745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b464b4-9370-48d9-ab90-9644cee79bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.230771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b464b4-9370-48d9-ab90-9644cee79bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.230771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b464b4-9370-48d9-ab90-9644cee79bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.232410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b464b4-9370-48d9-ab90-9644cee79bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:49.234953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b464b4-9370-48d9-ab90-9644cee79bd8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:49.260244 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 955/1929] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:49.261860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.262302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.262738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.265856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae53c-7e2c-479a-8b8e-ff71901eedd4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:49.306912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:49.308025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.308657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.309080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] PATH_INFO: `/v3/users/94224df8a6774bf099653765b57d0e45` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.310441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94224df8a6774bf099653765b57d0e45)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:49.312759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:49.331608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:49.337720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.356095 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 956/1930] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:49.357010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:49.358977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.372593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20179495-99b3-4459-a5d0-ec1b05b15e1d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:49.378607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb1963-795f-4dd5-aa03-df2ce9d7576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:49.379837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb1963-795f-4dd5-aa03-df2ce9d7576d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.380185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb1963-795f-4dd5-aa03-df2ce9d7576d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.380473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb1963-795f-4dd5-aa03-df2ce9d7576d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.381133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb1963-795f-4dd5-aa03-df2ce9d7576d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:49.383083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb1963-795f-4dd5-aa03-df2ce9d7576d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:49.502644 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 957/1931] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:49 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:49.504470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.504858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.505232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.547999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] MFA Rules not processed for user `b09f8679c57f454986117ddefc73f2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:49.549333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.553838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94224df8a6774bf099653765b57d0e45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:49.562766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94224df8a6774bf099653765b57d0e45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:49.564438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94224df8a6774bf099653765b57d0e45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:49.569272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94224df8a6774bf099653765b57d0e45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:49.586398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f087f589-a65a-426f-a90f-4507c5518098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94224df8a6774bf099653765b57d0e45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:49.616337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:49.665619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 958/1932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:49.666599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:49.668082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.720939 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 975/1933] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:49 2022] DELETE /identity/v3/users/94224df8a6774bf099653765b57d0e45 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:49.722702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.723150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.724614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.756470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:49.758469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.782550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e9e8-0d0f-4f64-8937-da0ca9d9a248 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:49.883149 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 976/1934] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:49.884331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:49.886061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:49.898628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:49.900022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.902276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.902654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] PATH_INFO: `/v3/projects/ad1f8fbd81984512a7b38a5a01f21ae6/users/04e5b3b3591f4daf974896ad09651fd2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.912490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4e885-9390-4b12-89aa-cd09916774e3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:49.920677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6152b-a5d5-4e1b-bf10-f4598de519d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:49.921662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6152b-a5d5-4e1b-bf10-f4598de519d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:49.922797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6152b-a5d5-4e1b-bf10-f4598de519d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:49.923370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6152b-a5d5-4e1b-bf10-f4598de519d3 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:49.926190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6152b-a5d5-4e1b-bf10-f4598de519d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:49.927234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6152b-a5d5-4e1b-bf10-f4598de519d3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:49.930797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1f8fbd81984512a7b38a5a01f21ae6, user_id=04e5b3b3591f4daf974896ad09651fd2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:49.934027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.013308 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 959/1935] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:49 2022] PUT /identity/v3/projects/ad1f8fbd81984512a7b38a5a01f21ae6/users/04e5b3b3591f4daf974896ad09651fd2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:50.015469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.016991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:50.039921 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 977/1936] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:49 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:50.040064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.044378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.044378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.089770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:50.092818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:50.135121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803c79-de6f-44a5-a0da-db94c6d41a39 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.147545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.148327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.148988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.150513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.151574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.157412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.216585 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 978/1937] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:50.220534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.228267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a23d8-d9ca-46e9-8d39-da7525cd3b20 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.234012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.234733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.235113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.236105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.237615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:50.238086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.240723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2981-ecea-49cc-9015-4ddc138cbb83 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.262402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 979/1938] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:50.262402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.262402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.262701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.274742 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 960/1939] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:50.275870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.332196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] MFA Rules not processed for user `04e5b3b3591f4daf974896ad09651fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:50.333715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:50.378201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c4be5-50e2-4eee-9d2c-d5cd0a15b212 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.384723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.385684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.385978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.386509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.387228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.389834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.393682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:50.403521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 961/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:50.404668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.406807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:50.460220 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 980/1941] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:50.460220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.488020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3c550-cdd2-40f4-b5f2-496c7850cb80 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.493744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.494535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.495761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.505387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.505387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.505387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.533073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe55de8-9fd9-4cf1-b623-30b3bf12424b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.537450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.538227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.538585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.538929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.551992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.553621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.568750 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 962/1942] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:50.569621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.582696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e2753-24da-4ef5-9f35-5d7355e919e0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.590162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.590827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.591209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.592632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.593317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.595650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.659497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 981/1943] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:50.659497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.749554 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 963/1944] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:50.750399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.783269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca587-aa1b-431f-8777-9c46710123b8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.788902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eead0-bf85-4f3e-83a0-952135644434 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:50.798044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.798895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.799307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.800598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] PATH_INFO: `/v3/projects/c03e362d88bd458fad37e6d854371d49/users/0927dd1b825b4c8bbbb28cc0250a5212/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.812073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:50.812073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:50.812073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:50.812073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:50.812471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.814157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.830123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03e362d88bd458fad37e6d854371d49, user_id=0927dd1b825b4c8bbbb28cc0250a5212, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:50.833800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:50.963309 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 964/1945] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/projects => generated 401 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:50.964006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:50.966759 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 982/1946] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:50 2022] PUT /identity/v3/projects/c03e362d88bd458fad37e6d854371d49/users/0927dd1b825b4c8bbbb28cc0250a5212/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:50.968284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.101729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714be4-7dfe-4a1b-bf69-6ac644bad3ea admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.107568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831a227-14b7-4d03-8243-7b432ae65b5c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.109217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.109987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.110817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.111298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.112017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.114628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.122964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.124239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.124530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.124805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.125455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.129751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.138143 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 983/1947] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:51.139613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.159978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1af02-1673-4dbe-a844-ee0c29d6849f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.169265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.169902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.170700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.170973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.171641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.173591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.319614 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 984/1948] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:51 2022] POST /identity/v3/users => generated 307 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:51.320210 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 965/1949] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:50 2022] POST /identity/v3/users => generated 296 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:51.321123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.321839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.335629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a7c69-8c56-4c71-b028-68925e392839 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.340293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.340984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.341271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.341549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] PATH_INFO: `/v3/projects/026da7196278493fb128e5e8e212b21f/users/3b281392148c49fb9092a7b45fe7d769/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.342574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e017963-47dc-47bb-9f1b-e90cbe5ce9b5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.348394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.349122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.350524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.350524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.350524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.352061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.367762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:51.390131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=026da7196278493fb128e5e8e212b21f, user_id=3b281392148c49fb9092a7b45fe7d769, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.393069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.396200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 985/1950] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:51.397522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.408234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8dea-d2d7-479c-90b9-1fcfa6acef14 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.413266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.413868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.414149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.414423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.415152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.417495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.430712 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 986/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:51.431531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.446027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e583b-f7fa-4dba-b0d0-b0227cbbf49c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.450838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.452084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.452424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.452850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.453326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.454920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.468382 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 987/1952] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:51.468382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.470286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:51.504879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2965f2-bc82-4457-b49d-c3336d644f22 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.510976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.511662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.512737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.513025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] PATH_INFO: `/v3/projects/b22f4ed6b0e743c0a58fbb2e165f2e2d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.515034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22f4ed6b0e743c0a58fbb2e165f2e2d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.520343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.602703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 966/1953] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:51 2022] PUT /identity/v3/projects/026da7196278493fb128e5e8e212b21f/users/3b281392148c49fb9092a7b45fe7d769/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:51.603789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.734481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22f4ed6b0e743c0a58fbb2e165f2e2d', 'request_id': 'req-fe89e61f-db53-4597-ae2c-8d0078587988'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:51.741270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1195a5-c237-480e-a541-1c5ec027ecdb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:51.744030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22f4ed6b0e743c0a58fbb2e165f2e2d', 'request_id': 'req-fe89e61f-db53-4597-ae2c-8d0078587988'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:51.762240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22f4ed6b0e743c0a58fbb2e165f2e2d', 'request_id': 'req-fe89e61f-db53-4597-ae2c-8d0078587988'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:51.849338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:51.850370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:51.850954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:51.851453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] PATH_INFO: `/v3/projects/c03e362d88bd458fad37e6d854371d49/users/0927dd1b825b4c8bbbb28cc0250a5212/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:51.854372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03e362d88bd458fad37e6d854371d49, user_id=0927dd1b825b4c8bbbb28cc0250a5212, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:51.857743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:51.883781 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 967/1954] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:51 2022] PUT /identity/v3/projects/c03e362d88bd458fad37e6d854371d49/users/0927dd1b825b4c8bbbb28cc0250a5212/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:51.891186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] The token cache is being invalidate because project b22f4ed6b0e743c0a58fbb2e165f2e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:51.891727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:51.892870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:51.895998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.908435 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 988/1955] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:51 2022] DELETE /identity/v3/projects/b22f4ed6b0e743c0a58fbb2e165f2e2d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:51.909491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:51.916181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:51.918650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:51.953631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89e61f-db53-4597-ae2c-8d0078587988 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.101000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db22889-daee-47f6-93c9-2318ce047ef4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.106846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0e186-eb2c-4bfe-aeab-f49222112d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.107569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e186-eb2c-4bfe-aeab-f49222112d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.107949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e186-eb2c-4bfe-aeab-f49222112d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.108368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e186-eb2c-4bfe-aeab-f49222112d19 admin admin] PATH_INFO: `/v3/projects/1e1a08ee14ba4961a722997512bb6c06/users/bcd5497a97094ac182916c9a82fe5ccf/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.114111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.119103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.119656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.120140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.121039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.123909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.126684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0e186-eb2c-4bfe-aeab-f49222112d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a08ee14ba4961a722997512bb6c06, user_id=bcd5497a97094ac182916c9a82fe5ccf, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.130199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0e186-eb2c-4bfe-aeab-f49222112d19 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.157282 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 968/1956] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:52.157282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.157282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.185008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d2b8-268e-4721-8d88-41ea3aecf69d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.200653 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 989/1957] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:51 2022] PUT /identity/v3/projects/1e1a08ee14ba4961a722997512bb6c06/users/bcd5497a97094ac182916c9a82fe5ccf/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:52.202607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.202978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.203412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.204013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.204742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.205094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.205469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.206192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.207945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.231057 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 969/1958] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:52.231888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.237765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.256487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748f548-46ee-4e2f-be8a-6df7f2099b21 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.256792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] MFA Rules not processed for user `0927dd1b825b4c8bbbb28cc0250a5212`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:52.258188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.313309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:52.334769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.335470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.336402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.336689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] PATH_INFO: `/v3/users/492fb8a4e0414e52a7e2b0f1d56d4ece` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.338996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492fb8a4e0414e52a7e2b0f1d56d4ece)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.341864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.393251 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 990/1959] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:52.394334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.418410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43307b-b83a-4e1a-a129-6f63a8ca426a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.424499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.425334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.425630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.425952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] PATH_INFO: `/v3/projects/2cfa516c35244707b4f5490606603828/users/9c82a1a9f7b24c5dbc065562d9bc502f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.444664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfa516c35244707b4f5490606603828, user_id=9c82a1a9f7b24c5dbc065562d9bc502f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.447394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.564873 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 991/1960] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:52 2022] PUT /identity/v3/projects/2cfa516c35244707b4f5490606603828/users/9c82a1a9f7b24c5dbc065562d9bc502f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:52.566065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.568618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.573476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492fb8a4e0414e52a7e2b0f1d56d4ece'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:52.585940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492fb8a4e0414e52a7e2b0f1d56d4ece'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:52.586772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492fb8a4e0414e52a7e2b0f1d56d4ece'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:52.613036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492fb8a4e0414e52a7e2b0f1d56d4ece'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:52.615399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492fb8a4e0414e52a7e2b0f1d56d4ece'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:52.676810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8408-9d20-4f44-9902-7cae4b1d1de3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.683298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.683906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.684187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.684459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.686748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.721862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 970/1961] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:52 2022] DELETE /identity/v3/users/492fb8a4e0414e52a7e2b0f1d56d4ece => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:52.722931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.724449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.798599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.801047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.828159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 992/1962] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:52.828159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.829178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.857631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179a67-9618-4f42-ba6f-a2962bd0f115 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.873850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.874489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.874804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.875147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.875804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.880506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:52.894913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 971/1963] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:52.895860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:52.898238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:52.969986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f758e-3083-438d-a277-c5ffff467833 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:52.975052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5eba2-8a0e-4c60-ab51-0504f340f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:52.976446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5eba2-8a0e-4c60-ab51-0504f340f6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:52.976446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5eba2-8a0e-4c60-ab51-0504f340f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:52.977135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5eba2-8a0e-4c60-ab51-0504f340f6f9 admin admin] PATH_INFO: `/v3/projects/026da7196278493fb128e5e8e212b21f/users/3b281392148c49fb9092a7b45fe7d769/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:52.979450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5eba2-8a0e-4c60-ab51-0504f340f6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026da7196278493fb128e5e8e212b21f, user_id=3b281392148c49fb9092a7b45fe7d769, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:52.984523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5eba2-8a0e-4c60-ab51-0504f340f6f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:53.011129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 993/1964] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:52 2022] PUT /identity/v3/projects/026da7196278493fb128e5e8e212b21f/users/3b281392148c49fb9092a7b45fe7d769/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:53.015193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:53.019066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:53.019066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:53.090221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e7d4-fde7-4b37-83f2-ea432f6307c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:53.097913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] MFA Rules not processed for user `9c82a1a9f7b24c5dbc065562d9bc502f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:53.102283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:53.209259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:53.209886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:53.210167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:53.210438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:53.215077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:53.296665 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 994/1965] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:53.297766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:53.406549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:53.414465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1af69-9d47-4fc9-9f53-0a412658bbed service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:53.432060 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 972/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:53.433851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f0344-3f57-43e1-b480-85073f7164c1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:53.438184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bfe55-a3e1-4827-b472-9f6fd38a7f25 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:53.441186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bfe55-a3e1-4827-b472-9f6fd38a7f25 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:53.441186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bfe55-a3e1-4827-b472-9f6fd38a7f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:53.441393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:53.442175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:53.442599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:53.443038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] PATH_INFO: `/v3/projects/1e1a08ee14ba4961a722997512bb6c06/users/bcd5497a97094ac182916c9a82fe5ccf/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:53.445288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a08ee14ba4961a722997512bb6c06, user_id=bcd5497a97094ac182916c9a82fe5ccf, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:53.448604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:53.462668 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 995/1967] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:53 2022] PUT /identity/v3/projects/1e1a08ee14ba4961a722997512bb6c06/users/bcd5497a97094ac182916c9a82fe5ccf/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:53.462668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:53.469663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:53.481248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a7bfe55-a3e1-4827-b472-9f6fd38a7f25 None None] MFA Rules not processed for user `3b281392148c49fb9092a7b45fe7d769`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:53.482603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a7bfe55-a3e1-4827-b472-9f6fd38a7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:53.570148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:53.616414 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 973/1968] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:53.620211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:53.620692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:53.621545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:53.662815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbe98-6477-4184-a138-4322c91d3dad admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:53.684888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:53.685804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:53.686187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:53.686565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:53.687457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:53.689497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:53.711251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] MFA Rules not processed for user `bcd5497a97094ac182916c9a82fe5ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:53.714146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:53.866167 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 974/1969] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:53.875199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:53.875199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:53.876815 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 996/1970] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:53 2022] POST /identity/v3/projects => generated 391 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:53.880995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:53.914232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d291-6c41-4f5f-94cd-82c74d2b9f33 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:54.025686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d5f60-c91f-4c86-8569-d68f92284f89 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:54.037432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:54.038621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.038908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.039343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.039843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:54.041781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:54.046344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:54.047002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.047318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.047788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] PATH_INFO: `/v3/projects/239b00b40f1f4104981af279a57f79bf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.049086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239b00b40f1f4104981af279a57f79bf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:54.051340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:54.170180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 997/1971] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:53 2022] POST /identity/v3/users => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:50:54.171761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:54.220517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239b00b40f1f4104981af279a57f79bf', 'request_id': 'req-71f7c613-7b04-4657-862e-b5271d0424f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:54.231088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239b00b40f1f4104981af279a57f79bf', 'request_id': 'req-71f7c613-7b04-4657-862e-b5271d0424f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:54.237967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239b00b40f1f4104981af279a57f79bf', 'request_id': 'req-71f7c613-7b04-4657-862e-b5271d0424f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:54.283608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e4b37-9a16-4180-9acf-5895b745ab33 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:54.341927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] The token cache is being invalidate because project 239b00b40f1f4104981af279a57f79bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:54.342760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:54.343461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:54.349261 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 975/1972] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:53 2022] DELETE /identity/v3/projects/239b00b40f1f4104981af279a57f79bf => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:54.350426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:54.353300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:54.360890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:54.401975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:54.402108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.402358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.402631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.405011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:54.501824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:54.506414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:54.524941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 998/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:54.526031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:54.527511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:54.533122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7c613-7b04-4657-862e-b5271d0424f4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:54.540858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de7a7e-b204-4bf3-ad20-5f068424749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:54.541672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de7a7e-b204-4bf3-ad20-5f068424749c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.542063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de7a7e-b204-4bf3-ad20-5f068424749c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.542274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de7a7e-b204-4bf3-ad20-5f068424749c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.543164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de7a7e-b204-4bf3-ad20-5f068424749c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:54.548716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de7a7e-b204-4bf3-ad20-5f068424749c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:54.567897 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 976/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:54.567897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.567897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.567897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.571777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f3e8-8096-41ca-923a-4a8d2ad2e5b2 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:54.596996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:54.598047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.598567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.599096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.601605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:54.612378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:54.613741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:54.658038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 977/1975] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:54.658038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:54.678392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f55ee-c5e6-4859-af23-d413f05d41d9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:54.684419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:54.685268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.686108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.686108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] PATH_INFO: `/v3/projects/6b4231cf7f724130ac367d09ffb171f1/users/38683bc96b224743bdcb72b3cf71e28e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.711301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4231cf7f724130ac367d09ffb171f1, user_id=38683bc96b224743bdcb72b3cf71e28e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:54.713018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:54.714336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:54.714750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc23c89-2343-4e4b-9910-c4d7636580cb service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:54.741307 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 999/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:54 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:54.764769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:54.765060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:54.773473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:54.805607 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 978/1977] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:54 2022] PUT /identity/v3/projects/6b4231cf7f724130ac367d09ffb171f1/users/38683bc96b224743bdcb72b3cf71e28e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:54.811788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:54.833323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:54.852240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:54.856552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.012073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a7fab-c41b-4f94-ac54-9e3cda458bf5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.021657 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1000/1978] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:55.022865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.024489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.025576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.026288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.026568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.026848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.027551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.030433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:55.042314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b6a5-218d-4879-86a3-0d68502a12b5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.048289 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 979/1979] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:50:55.048289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.048502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.048807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.049000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.049282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] PATH_INFO: `/v3/users/cb499e5264164058a7ca318ddc84c49a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.050752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb499e5264164058a7ca318ddc84c49a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.053665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:55.171604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020fb4f-a51b-449a-96e7-2d280a0063a3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.177638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.178429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.178717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.178993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.190135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.269506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb499e5264164058a7ca318ddc84c49a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:55.278618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb499e5264164058a7ca318ddc84c49a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:55.282903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.283377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb499e5264164058a7ca318ddc84c49a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:55.283377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb499e5264164058a7ca318ddc84c49a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:55.283552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:55.293914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 980/1980] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:55.294792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.308836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6606e-7c80-408a-b81d-22a5a4df5871 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.317855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb499e5264164058a7ca318ddc84c49a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:55.324001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.324757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.325242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.325621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.327109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:50:55.327574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.334751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:55.351187 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 981/1981] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:50:55.352253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.354325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.377224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203caa-a330-4805-8f95-e065a3c17e41 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.383646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c799d-2ad0-47ce-af7d-734489cc7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.384428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c799d-2ad0-47ce-af7d-734489cc7416 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.397877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c799d-2ad0-47ce-af7d-734489cc7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.397877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c799d-2ad0-47ce-af7d-734489cc7416 admin admin] PATH_INFO: `/v3/projects/6b4231cf7f724130ac367d09ffb171f1/users/38683bc96b224743bdcb72b3cf71e28e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.397877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c799d-2ad0-47ce-af7d-734489cc7416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4231cf7f724130ac367d09ffb171f1, user_id=38683bc96b224743bdcb72b3cf71e28e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.397877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c799d-2ad0-47ce-af7d-734489cc7416 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:55.407314 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 982/1982] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:55 2022] PUT /identity/v3/projects/6b4231cf7f724130ac367d09ffb171f1/users/38683bc96b224743bdcb72b3cf71e28e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:55.408615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f88dd-a75e-4ffa-b3d6-415725909f86 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.408904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f88dd-a75e-4ffa-b3d6-415725909f86 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.409182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f88dd-a75e-4ffa-b3d6-415725909f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.428407 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1001/1983] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:55 2022] DELETE /identity/v3/users/cb499e5264164058a7ca318ddc84c49a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:55.428407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.428407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.464896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-327f88dd-a75e-4ffa-b3d6-415725909f86 None None] MFA Rules not processed for user `039f9584f5f44d779f709d56dc3ebd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:55.466472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-327f88dd-a75e-4ffa-b3d6-415725909f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.570162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739762b-975a-40da-b917-7f03b7ef50c0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.572185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:55.589682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b618-1887-4167-90c5-1202f83f3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.590353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b618-1887-4167-90c5-1202f83f3219 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.590639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b618-1887-4167-90c5-1202f83f3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.590918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b618-1887-4167-90c5-1202f83f3219 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.593091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b618-1887-4167-90c5-1202f83f3219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.595580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b618-1887-4167-90c5-1202f83f3219 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:55.618440 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 983/1984] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:55.623068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.623068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.623068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.668242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] MFA Rules not processed for user `38683bc96b224743bdcb72b3cf71e28e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:55.670009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.753487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1002/1985] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:55 2022] POST /identity/v3/projects => generated 395 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:55.753487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.753487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.753487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.788253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:55.790721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.797905 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 984/1986] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:55.797905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.797905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:55.921132 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1003/1987] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:55.922023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:55.941006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc5ed-61d6-4dc1-9bcb-95496885dd87 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.943859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a627-61ea-41d5-9881-02a600455f15 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:55.949305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:55.950173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:55.950935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:55.952103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:55.952821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:55.955075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.068898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1004/1988] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:55 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:56.069894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.072402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:56.090488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.091169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.091459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.091740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.093650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:56.177963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.179654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.184142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c6a13-66b3-48ff-bfcd-5e8e6f10f0ce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.190170 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 985/1989] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:56.190937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.192425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:56.203082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.205591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.205591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.205591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.304093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.306120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.320229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626760-fa06-4440-9e67-368c90ef3437 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.325579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.326283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.326618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.326899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.338050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1005/1990] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:56.338346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.342154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.342310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.346675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:56.362383 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 986/1991] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:56.362383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.363336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:56.383922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0b095-84cb-4f94-a428-6e0f68eb5ef4 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.392124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1976c-d1f0-4035-8426-dbe56550c84f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.400637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.401137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.401265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.401712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.401823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.401997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] PATH_INFO: `/v3/users/04e5b3b3591f4daf974896ad09651fd2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.402099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.402285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.402958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.403265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e5b3b3591f4daf974896ad09651fd2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.404628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.405231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.437368 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1006/1992] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:56.437368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.465911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e207c2-9974-4be4-8fb8-5d31f28f6cab admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.478106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.483381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.483381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.483381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.562267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.564082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.580273 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1007/1993] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:56.581481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.592447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ce72d-ea95-40a2-828e-65a87f082b38 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.601501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.602193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.602634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.602951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.603659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.605262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.615795 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1008/1994] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:56.619988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.630734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8233f-622b-4cd5-ba80-bd8e26d850f8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:56.635729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d6e3-3834-4d61-a2e3-214858d477ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:56.636375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d6e3-3834-4d61-a2e3-214858d477ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.636660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d6e3-3834-4d61-a2e3-214858d477ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.636933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d6e3-3834-4d61-a2e3-214858d477ab admin admin] PATH_INFO: `/v3/projects/1f19b2190b36468087146f342878cc87/users/784f7c4384c24adf84e35a5e08b737e9/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.652425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d6e3-3834-4d61-a2e3-214858d477ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f19b2190b36468087146f342878cc87, user_id=784f7c4384c24adf84e35a5e08b737e9, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:56.655246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d6e3-3834-4d61-a2e3-214858d477ab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:56.755166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e5b3b3591f4daf974896ad09651fd2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:56.761004 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1009/1995] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:56 2022] PUT /identity/v3/projects/1f19b2190b36468087146f342878cc87/users/784f7c4384c24adf84e35a5e08b737e9/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:50:56.778666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.778666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.778666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:56.804680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e5b3b3591f4daf974896ad09651fd2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:56.805990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e5b3b3591f4daf974896ad09651fd2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:56.814055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] MFA Rules not processed for user `784f7c4384c24adf84e35a5e08b737e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:56.816873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:56.829822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e5b3b3591f4daf974896ad09651fd2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:56.834942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-91baf94e-966d-4a64-855c-37adb8161d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e5b3b3591f4daf974896ad09651fd2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:56.936579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1010/1996] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:56.940990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:56.942778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:56.963492 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 987/1997] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:56 2022] DELETE /identity/v3/users/04e5b3b3591f4daf974896ad09651fd2 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:56.971586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:56.972206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:56.972681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:57.016526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:57.018418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:57.081396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdab60e-36f8-4b29-86ab-b8419b2d2f90 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:57.134673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 988/1998] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:57.149176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:57.152104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:57.185052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:57.188284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:57.188735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:57.189027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:57.192314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:57.192437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:57.236048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391ed7b-286b-4351-b74f-3c2def5efa18 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:57.241021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:57.241654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:57.241777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:57.242083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:57.242436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:57.255057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:57.256927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:57.288200 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 989/1999] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:50:57.289788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:57.293616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:57.302970 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1011/2000] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:50:56 2022] POST /identity/v3/projects => generated 395 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:50:57.303856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:57.307416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:57.320522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed901-6f20-4fe3-8f65-21da2ab82e30 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:57.388538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa3868-da7b-4b36-bef9-44d6d2f3cade admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:57.393542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:57.394670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:57.395493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:57.396322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] PATH_INFO: `/v3/users/9c82a1a9f7b24c5dbc065562d9bc502f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:57.398312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c82a1a9f7b24c5dbc065562d9bc502f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:57.404134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:57.428476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:57.432069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:57.432069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:57.432069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] PATH_INFO: `/v3/projects/0ddcd8cb880a473cbf7d06613b9f4fbf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:57.436305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddcd8cb880a473cbf7d06613b9f4fbf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:57.438652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:57.722456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c82a1a9f7b24c5dbc065562d9bc502f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.723668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddcd8cb880a473cbf7d06613b9f4fbf', 'request_id': 'req-2ccae5bf-151c-4513-ba5c-ae44f44a4134'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.734125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddcd8cb880a473cbf7d06613b9f4fbf', 'request_id': 'req-2ccae5bf-151c-4513-ba5c-ae44f44a4134'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.742120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c82a1a9f7b24c5dbc065562d9bc502f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.743472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c82a1a9f7b24c5dbc065562d9bc502f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.743948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddcd8cb880a473cbf7d06613b9f4fbf', 'request_id': 'req-2ccae5bf-151c-4513-ba5c-ae44f44a4134'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.744322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c82a1a9f7b24c5dbc065562d9bc502f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.761405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c82a1a9f7b24c5dbc065562d9bc502f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.865921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] The token cache is being invalidate because project 0ddcd8cb880a473cbf7d06613b9f4fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:57.865921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.865921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:57.865921 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 990/2001] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:57 2022] DELETE /identity/v3/projects/0ddcd8cb880a473cbf7d06613b9f4fbf => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:57.865921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:57.872236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:57.961561 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1012/2002] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:57 2022] DELETE /identity/v3/users/9c82a1a9f7b24c5dbc065562d9bc502f => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:57.962586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:57.964600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:57.993843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccae5bf-151c-4513-ba5c-ae44f44a4134 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:58.085705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b575c-a2c1-4d1d-8273-3beef426a447 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:58.098184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:58.099965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.100345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.100621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.101273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:58.103815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:58.104834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:58.104949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.105053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.105317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] PATH_INFO: `/v3/projects/ad1f8fbd81984512a7b38a5a01f21ae6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.106638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1f8fbd81984512a7b38a5a01f21ae6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:58.109859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:58.265141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 991/2003] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:50:57 2022] POST /identity/v3/users => generated 304 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:50:58.266074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:58.269201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:58.282172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1f8fbd81984512a7b38a5a01f21ae6', 'request_id': 'req-27f25270-26fe-49d7-bb91-1f82251e5c10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.288490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9054-8930-4da0-bdbc-513e276367c5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:58.289305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1f8fbd81984512a7b38a5a01f21ae6', 'request_id': 'req-27f25270-26fe-49d7-bb91-1f82251e5c10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.297237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1f8fbd81984512a7b38a5a01f21ae6', 'request_id': 'req-27f25270-26fe-49d7-bb91-1f82251e5c10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.355977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:58.356733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.357025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.357301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] PATH_INFO: `/v3/users/0927dd1b825b4c8bbbb28cc0250a5212` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.359449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0927dd1b825b4c8bbbb28cc0250a5212)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:58.361965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:58.373361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] The token cache is being invalidate because project ad1f8fbd81984512a7b38a5a01f21ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:50:58.373683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.375416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27f25270-26fe-49d7-bb91-1f82251e5c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.377268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1013/2004] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:57 2022] DELETE /identity/v3/projects/ad1f8fbd81984512a7b38a5a01f21ae6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:58.379379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6473-780c-4811-a21e-9647e24f0b15 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.380112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6473-780c-4811-a21e-9647e24f0b15 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.380856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6473-780c-4811-a21e-9647e24f0b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.405821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-73fa6473-780c-4811-a21e-9647e24f0b15 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:58.407439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-73fa6473-780c-4811-a21e-9647e24f0b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:58.424695 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1014/2005] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:58.426089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.426412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.426700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.448551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] MFA Rules not processed for user `3ff6ad8e78ca4b6dbea50007a5737f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:58.450032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:58.504582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:58.528821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1015/2006] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:58.530279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:58.534245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:58.551897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b0da-1ff5-42a9-9349-a97747f118f6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:58.558120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:58.558580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.558866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.559656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.559888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:58.562218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:58.580497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1016/2007] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:58.581241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:58.585241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:58.602688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abf9ab-0b08-4a76-b739-23db1faba4d5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:58.621440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:58.622617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.622793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.623116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] PATH_INFO: `/v3/users/bcd5497a97094ac182916c9a82fe5ccf` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.626168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd5497a97094ac182916c9a82fe5ccf)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:58.631349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:58.675926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0927dd1b825b4c8bbbb28cc0250a5212'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.691193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0927dd1b825b4c8bbbb28cc0250a5212'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.692752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0927dd1b825b4c8bbbb28cc0250a5212'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.713409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0927dd1b825b4c8bbbb28cc0250a5212'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.714925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0927dd1b825b4c8bbbb28cc0250a5212'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:58.866937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 992/2008] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:58 2022] DELETE /identity/v3/users/0927dd1b825b4c8bbbb28cc0250a5212 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:58.868169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:58.869731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:58.974856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6c0b-5df6-48e2-8105-a3d7bcd541db admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:58.979108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:58.979826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:58.980424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:58.980424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:58.982353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.022805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd5497a97094ac182916c9a82fe5ccf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:59.045160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd5497a97094ac182916c9a82fe5ccf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:59.045951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd5497a97094ac182916c9a82fe5ccf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:59.046567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd5497a97094ac182916c9a82fe5ccf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:59.064512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd5497a97094ac182916c9a82fe5ccf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:50:59.074035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:59.075566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:59.090766 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 993/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:50:59.092999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:59.096613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.116315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a8004-6200-4341-b281-bb0a3d93d62b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:59.125389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:59.125389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.125389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.125389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] PATH_INFO: `/v3/projects/897514d21b5d47cc8a8c5bef8218aa22/users/80fdbac49d2e4fe58a876e3404a3cb5d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.153969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897514d21b5d47cc8a8c5bef8218aa22, user_id=80fdbac49d2e4fe58a876e3404a3cb5d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:59.156257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:59.183148 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1017/2010] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:50:58 2022] DELETE /identity/v3/users/bcd5497a97094ac182916c9a82fe5ccf => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:59.265952 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 994/2011] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:59 2022] PUT /identity/v3/projects/897514d21b5d47cc8a8c5bef8218aa22/users/80fdbac49d2e4fe58a876e3404a3cb5d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:50:59.269434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:59.270922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.391103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3913-d875-4329-941c-abe959f4b067 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:59.472831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097855b3-e6a6-46f4-bbd2-108db4736a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:59.473503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097855b3-e6a6-46f4-bbd2-108db4736a88 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.473960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097855b3-e6a6-46f4-bbd2-108db4736a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.476223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097855b3-e6a6-46f4-bbd2-108db4736a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.476802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097855b3-e6a6-46f4-bbd2-108db4736a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:59.478461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097855b3-e6a6-46f4-bbd2-108db4736a88 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:59.492747 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1018/2012] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:50:59.497373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:59.515504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c83d0b-2a77-470a-b69e-d2178ec8bd64 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:59.542795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4f5be-8e50-4041-b19d-b3de395ffd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:59.542795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f5be-8e50-4041-b19d-b3de395ffd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.542795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f5be-8e50-4041-b19d-b3de395ffd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.542795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4f5be-8e50-4041-b19d-b3de395ffd42 admin admin] PATH_INFO: `/v3/projects/897514d21b5d47cc8a8c5bef8218aa22/users/80fdbac49d2e4fe58a876e3404a3cb5d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.546810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4f5be-8e50-4041-b19d-b3de395ffd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897514d21b5d47cc8a8c5bef8218aa22, user_id=80fdbac49d2e4fe58a876e3404a3cb5d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:59.550072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4f5be-8e50-4041-b19d-b3de395ffd42 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:59.577563 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 995/2013] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:50:59 2022] PUT /identity/v3/projects/897514d21b5d47cc8a8c5bef8218aa22/users/80fdbac49d2e4fe58a876e3404a3cb5d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:50:59.578608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.578900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.579216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.586710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1553e-cba5-4f50-b597-e26bd4396ee1 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.586999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1553e-cba5-4f50-b597-e26bd4396ee1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.588226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1553e-cba5-4f50-b597-e26bd4396ee1 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.589830 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 996/2014] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:50:59.596514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.596803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.597081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.613798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] MFA Rules not processed for user `80fdbac49d2e4fe58a876e3404a3cb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:59.615293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.625205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:50:59.627176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.796390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1019/2015] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:59.807782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:59.810172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.833092 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 997/2016] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:50:59.850706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:50:59.853000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:50:59.917614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:50:59.970949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61b0c9-086c-45d8-9baa-fadbdf133670 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:50:59.986768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:50:59.986768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:50:59.986768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:50:59.986768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] PATH_INFO: `/v3/projects/c03e362d88bd458fad37e6d854371d49` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:50:59.988701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03e362d88bd458fad37e6d854371d49)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:50:59.990637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:50:59.997470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5180ef9-b0a2-4951-bdae-7478b30faca5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:00.012037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:00.014513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.014513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.014513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.034439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:00.036385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:00.068419 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1020/2017] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:50:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:00.071732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:00.074110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.096339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d5dba-4d4f-412f-9b5f-91ab362a53ca service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:00.101445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:00.102049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.102336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.102607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.112284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:00.114381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:00.126163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1021/2018] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:00.127141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:00.128656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.144782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68c2dc-9a9a-43c9-82fd-199a548c2cb6 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:00.151092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:00.151904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.152285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.152926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] PATH_INFO: `/v3/projects/2cfa516c35244707b4f5490606603828` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.155560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfa516c35244707b4f5490606603828)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:00.158365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:00.213622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03e362d88bd458fad37e6d854371d49', 'request_id': 'req-88e2c898-d016-41d5-a346-419a815f3b39'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.232617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03e362d88bd458fad37e6d854371d49', 'request_id': 'req-88e2c898-d016-41d5-a346-419a815f3b39'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.240115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03e362d88bd458fad37e6d854371d49', 'request_id': 'req-88e2c898-d016-41d5-a346-419a815f3b39'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.297697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfa516c35244707b4f5490606603828', 'request_id': 'req-564aac57-7617-4d11-89c3-a4f438880210'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.306159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfa516c35244707b4f5490606603828', 'request_id': 'req-564aac57-7617-4d11-89c3-a4f438880210'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.318526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfa516c35244707b4f5490606603828', 'request_id': 'req-564aac57-7617-4d11-89c3-a4f438880210'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.355696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] The token cache is being invalidate because project c03e362d88bd458fad37e6d854371d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:00.356244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.357377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.360021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 998/2019] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:50:59 2022] DELETE /identity/v3/projects/c03e362d88bd458fad37e6d854371d49 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:00.367587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:00.376134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.464030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2c898-d016-41d5-a346-419a815f3b39 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:00.476478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] The token cache is being invalidate because project 2cfa516c35244707b4f5490606603828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:00.476839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.478910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-564aac57-7617-4d11-89c3-a4f438880210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.482251 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1022/2020] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:00 2022] DELETE /identity/v3/projects/2cfa516c35244707b4f5490606603828 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:00.487423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.488406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.488762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.518659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:00.519853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.570068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:00.571234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.571563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.571886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] PATH_INFO: `/v3/projects/1e1a08ee14ba4961a722997512bb6c06` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.573542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1a08ee14ba4961a722997512bb6c06)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:00.575699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:00.631827 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1023/2021] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:00.632814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:00.638865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.651473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb7c5a-2e60-4011-83c0-ae2931640bfc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:00.658962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:00.660621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.663306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.663306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] PATH_INFO: `/v3/users/38683bc96b224743bdcb72b3cf71e28e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.663306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=38683bc96b224743bdcb72b3cf71e28e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:00.665381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:00.700145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1a08ee14ba4961a722997512bb6c06', 'request_id': 'req-d932d44a-885c-466b-9498-7014bca31b73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.707999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1a08ee14ba4961a722997512bb6c06', 'request_id': 'req-d932d44a-885c-466b-9498-7014bca31b73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.714981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1a08ee14ba4961a722997512bb6c06', 'request_id': 'req-d932d44a-885c-466b-9498-7014bca31b73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.788969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] The token cache is being invalidate because project 1e1a08ee14ba4961a722997512bb6c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:00.789605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.790238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d932d44a-885c-466b-9498-7014bca31b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.792157 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 999/2022] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:00 2022] DELETE /identity/v3/projects/1e1a08ee14ba4961a722997512bb6c06 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:00.793201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.793906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.793906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.814267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:00.815540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.876058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38683bc96b224743bdcb72b3cf71e28e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.885087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38683bc96b224743bdcb72b3cf71e28e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.885917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38683bc96b224743bdcb72b3cf71e28e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.887355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38683bc96b224743bdcb72b3cf71e28e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.900862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5e2c723-3a76-4090-8aa1-0d1b71a798ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38683bc96b224743bdcb72b3cf71e28e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:00.903155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1000/2023] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:00.910513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:00.912004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:00.986559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33530d4a-2df5-4cbf-930b-ec4023ab34c9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:00.992326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:00.992981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:00.993261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:00.995944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:00.995944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.024674 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1024/2024] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:00 2022] DELETE /identity/v3/users/38683bc96b224743bdcb72b3cf71e28e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:01.025995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56427f1-f807-4b52-bca9-b05302c7685e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.026285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56427f1-f807-4b52-bca9-b05302c7685e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.026559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56427f1-f807-4b52-bca9-b05302c7685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.054852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e56427f1-f807-4b52-bca9-b05302c7685e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:01.056283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e56427f1-f807-4b52-bca9-b05302c7685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.070973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.072606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.084427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1001/2025] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:01.085296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.097443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ad9fa-b7d5-48c1-bfe4-07f0fd50a2fe service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.146876 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1025/2026] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:01.149178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b486-502a-4168-beb0-015c114b68c8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.149468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b486-502a-4168-beb0-015c114b68c8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.149819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49b486-502a-4168-beb0-015c114b68c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.182263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:01.183779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.184475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.184913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.185197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.186445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:01.186986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.192417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ba49b486-502a-4168-beb0-015c114b68c8 None None] MFA Rules not processed for user `6f59260019b34b0b8c4c8792afe8b317`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:01.192417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ba49b486-502a-4168-beb0-015c114b68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.192879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.204257 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1002/2027] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:01.205209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.207306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.220899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30201b-4487-4178-a8ff-2192a1ca0794 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.227404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.228111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.228466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.228818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] PATH_INFO: `/v3/users/784f7c4384c24adf84e35a5e08b737e9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.230172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=784f7c4384c24adf84e35a5e08b737e9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.242702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.254999 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1026/2028] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:01.256406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.256871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.257154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.290895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:01.290895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.298262 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1027/2029] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:01.299267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.310355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fa7ff-71eb-4d1f-a9c9-f1c790c68531 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.317377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.317996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.319237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.319523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.320161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.322358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.455858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1028/2030] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:01 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:01.455858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.527599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ef30-d708-4f61-812a-f283e2a14d17 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.532836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.533382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.533678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.534019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.534672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:01.534979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.536625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.549842 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1029/2031] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:01.553636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784f7c4384c24adf84e35a5e08b737e9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.555069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.557186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.559354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784f7c4384c24adf84e35a5e08b737e9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.560377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784f7c4384c24adf84e35a5e08b737e9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.571705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29062d93-06a2-45b6-9f9b-aee29346650d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.573136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784f7c4384c24adf84e35a5e08b737e9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.573877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784f7c4384c24adf84e35a5e08b737e9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.580485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.581114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.581444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.581724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] PATH_INFO: `/v3/users/b09f8679c57f454986117ddefc73f2e6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.582948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09f8679c57f454986117ddefc73f2e6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.585480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.635687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:01.666857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1003/2032] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:01 2022] DELETE /identity/v3/users/784f7c4384c24adf84e35a5e08b737e9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:01.671382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.676183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.775253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833e1b-38fd-4b01-a5c3-f7eb3abc3e3c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.786356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.787313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.787940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.788393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.789246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.790353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09f8679c57f454986117ddefc73f2e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.792033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.815893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09f8679c57f454986117ddefc73f2e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.816888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09f8679c57f454986117ddefc73f2e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.819524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09f8679c57f454986117ddefc73f2e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.852742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09f8679c57f454986117ddefc73f2e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:01.927078 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1004/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:01 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:01.927078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.927078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:01.943680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea7437-91ee-4d86-95f8-75c7cca889c6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:01.950967 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1030/2034] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:01 2022] DELETE /identity/v3/users/b09f8679c57f454986117ddefc73f2e6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:01.953324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ba42d-a613-4073-af3b-ae0decf2b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:01.953967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba42d-a613-4073-af3b-ae0decf2b650 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:01.954241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba42d-a613-4073-af3b-ae0decf2b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:01.954518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ba42d-a613-4073-af3b-ae0decf2b650 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:01.955337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba42d-a613-4073-af3b-ae0decf2b650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:01.955622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:01.957296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ba42d-a613-4073-af3b-ae0decf2b650 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:01.957537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.039740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17105b-89d4-43b0-9152-6e4419b39ec7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.046002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.046649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.046927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.047231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] PATH_INFO: `/v3/projects/6b4231cf7f724130ac367d09ffb171f1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.048441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4231cf7f724130ac367d09ffb171f1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.050320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.073193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1005/2035] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:01 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:02.076979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99405-c5da-41da-ae13-4e5f3e7ee420 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.078924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99405-c5da-41da-ae13-4e5f3e7ee420 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.079884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99405-c5da-41da-ae13-4e5f3e7ee420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.101088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-16b99405-c5da-41da-ae13-4e5f3e7ee420 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:02.102978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-16b99405-c5da-41da-ae13-4e5f3e7ee420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.166024 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1006/2036] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:02.167332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58d4d-548b-41b0-bc4f-c86e1cdabe71 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.167621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58d4d-548b-41b0-bc4f-c86e1cdabe71 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.167899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58d4d-548b-41b0-bc4f-c86e1cdabe71 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.169482 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1007/2037] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:51:02.170718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58d4d-548b-41b0-bc4f-c86e1cdabe71 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.173389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54d58d4d-548b-41b0-bc4f-c86e1cdabe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.189647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58d4d-548b-41b0-bc4f-c86e1cdabe71 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.194249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffef6d-d293-4450-a6aa-a01de8d3dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.194825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffef6d-d293-4450-a6aa-a01de8d3dcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.195141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffef6d-d293-4450-a6aa-a01de8d3dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.195419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffef6d-d293-4450-a6aa-a01de8d3dcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.196057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffef6d-d293-4450-a6aa-a01de8d3dcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.197710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffef6d-d293-4450-a6aa-a01de8d3dcf3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.212647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1008/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:02.215730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.216464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.216749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.235470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4231cf7f724130ac367d09ffb171f1', 'request_id': 'req-49460b6e-ecaf-459a-b11f-d6d389e50907'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:02.239869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:02.241298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.242621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4231cf7f724130ac367d09ffb171f1', 'request_id': 'req-49460b6e-ecaf-459a-b11f-d6d389e50907'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:02.252068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4231cf7f724130ac367d09ffb171f1', 'request_id': 'req-49460b6e-ecaf-459a-b11f-d6d389e50907'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:02.307482 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1009/2039] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:02.308745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.320485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc39b5-5a6c-4a99-9812-4e5c862b040f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.327243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.327918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.328197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.328469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.329159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.331130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.369301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] The token cache is being invalidate because project 6b4231cf7f724130ac367d09ffb171f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:02.369779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:02.373965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49460b6e-ecaf-459a-b11f-d6d389e50907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:02.373965 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1031/2040] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:01 2022] DELETE /identity/v3/projects/6b4231cf7f724130ac367d09ffb171f1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:02.374495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.374788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.375428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.396776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:02.402227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.455533 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1010/2041] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:02.456748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.460226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.462044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1032/2042] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:02.462896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.464185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.473903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316b54-625c-4ec2-8d57-3f8c4ba00533 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.478057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.478789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.479182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.479291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff1fc-a5bb-4b53-aabe-7f16fecb865d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.479584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.481480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.488633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6fcd-4fa3-4853-939a-e207e62a4253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.488633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6fcd-4fa3-4853-939a-e207e62a4253 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.488633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6fcd-4fa3-4853-939a-e207e62a4253 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.488633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6fcd-4fa3-4853-939a-e207e62a4253 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.489224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6fcd-4fa3-4853-939a-e207e62a4253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.489395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6fcd-4fa3-4853-939a-e207e62a4253 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.498870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.501150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.515329 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1011/2043] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:02.516205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.523996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1033/2044] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:02.523996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.525303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.525600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.526687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627569cb-e85e-4d18-90d4-d4ca72eea8af service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.532378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.533061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.533353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.534166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.536035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.547678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:02.548936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.552941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.554323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.558946 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1034/2045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:02.559832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.561714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.574243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2dc18-5ff5-4f6f-9c69-4ee51c52a236 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.575270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1012/2046] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:02.577674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.579242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.581545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.582302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.582655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.583100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.583877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.585752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.594410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816abfa-3f98-4e28-a0d8-9a241e011ed8 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.599778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf54eb2-5175-4671-991d-99560cafc469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.600698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1035/2047] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:02.601037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf54eb2-5175-4671-991d-99560cafc469 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.601586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf54eb2-5175-4671-991d-99560cafc469 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.601884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.602986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf54eb2-5175-4671-991d-99560cafc469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.611586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf54eb2-5175-4671-991d-99560cafc469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.613754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf54eb2-5175-4671-991d-99560cafc469 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.614330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3f82-4c5f-47c9-ba67-8c8b20f184b5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.619801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.620594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.621092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.621468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] PATH_INFO: `/v3/projects/f76fffffb198473e9ec823f285489277/users/990aa3b96d8e4366bda76ec07f4f7014/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.627191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1013/2048] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:02.629031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.629929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.631086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.642538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76fffffb198473e9ec823f285489277, user_id=990aa3b96d8e4366bda76ec07f4f7014, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.645510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.673646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:02.675037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:02.693946 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1014/2049] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:02.697424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.717190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82a98-8397-4a7d-8ee8-d2d932a85d1a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.725849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.726481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.726936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.727992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.728679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.730317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.755537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1015/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:02.755537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.780639 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1036/2051] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:02 2022] PUT /identity/v3/projects/f76fffffb198473e9ec823f285489277/users/990aa3b96d8e4366bda76ec07f4f7014/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:02.782501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:02.797631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148e34-8727-463a-8025-5aedf0356950 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.947884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.948733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.949048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.949323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.949979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:02.950287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:02.952469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401cdf-b641-41d9-9ce8-a83732dfc39a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:02.977708 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1016/2052] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:02.979034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.981425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.981728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:02.982260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48306c71-060e-4170-9c82-774326abc627 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:02.988712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:02.989302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:02.989594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:02.989875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] PATH_INFO: `/v3/projects/6a9dd5a1ba964488a234a69b3439d5c5/users/3fe611dd8b0345779ed99a0cd277984e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:03.013334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9dd5a1ba964488a234a69b3439d5c5, user_id=3fe611dd8b0345779ed99a0cd277984e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:03.022564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:03.027860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] MFA Rules not processed for user `990aa3b96d8e4366bda76ec07f4f7014`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:03.029458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:03.128130 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1017/2053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:03.128130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:03.161825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bd2c5-a63c-4a1a-83a6-18cfa1a97bb9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:03.188287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ceb8c-3cb3-41de-889f-de8ea121852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:03.189000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ceb8c-3cb3-41de-889f-de8ea121852c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:03.189274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ceb8c-3cb3-41de-889f-de8ea121852c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:03.189556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ceb8c-3cb3-41de-889f-de8ea121852c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:03.191155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ceb8c-3cb3-41de-889f-de8ea121852c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:03.196651 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1037/2054] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:02 2022] PUT /identity/v3/projects/6a9dd5a1ba964488a234a69b3439d5c5/users/3fe611dd8b0345779ed99a0cd277984e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:03.196757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ceb8c-3cb3-41de-889f-de8ea121852c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:03.197176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:03.352290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b258fe-b050-47a6-afdf-2159b3883eb8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:03.360444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:03.361855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:03.362142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:03.362894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:03.363582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:03.366592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:03.368370 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1018/2055] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:03 2022] POST /identity/v3/projects => generated 409 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:03.383469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:03.383698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:03.383957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:03.475960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] MFA Rules not processed for user `3fe611dd8b0345779ed99a0cd277984e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:03.482022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:03.556213 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1038/2056] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:03 2022] POST /identity/v3/projects => generated 375 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:03.562514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:03.681965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1019/2057] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:03.682984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:03.725443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:03.729579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c234f0-8897-4b44-af50-af96bd2523e4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:03.744270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:03.744950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:03.749182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:03.750024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:03.750717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:03.757925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:03.839313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f506-909a-4d9c-81d1-7db8972f036b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:03.851886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:03.852679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:03.853048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:03.853338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:03.854058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:03.856148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:03.988495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1020/2058] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:03 2022] POST /identity/v3/users => generated 294 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:03.989364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:03.990826 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1039/2059] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:03 2022] POST /identity/v3/users => generated 305 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:03.992385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:03.995000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.004173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653f7d-fcea-4962-8f92-f332edd100ca admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.008880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f3516-ec0b-47d2-a329-8ab22b3d755a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.011931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.012555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.012894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.013109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.013807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.016433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.016637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.017290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.017590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.017856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] PATH_INFO: `/v3/projects/1f19b2190b36468087146f342878cc87` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.019106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f19b2190b36468087146f342878cc87)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.021018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.141655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1040/2060] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:03 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:04.142464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.145789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.162108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:04.182738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f19b2190b36468087146f342878cc87', 'request_id': 'req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.193316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f19b2190b36468087146f342878cc87', 'request_id': 'req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.201030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f19b2190b36468087146f342878cc87', 'request_id': 'req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.237398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c479-a421-44dd-8642-a1b4181c8df0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.278372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] The token cache is being invalidate because project 1f19b2190b36468087146f342878cc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:04.278679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.280047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.281782 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1021/2061] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:03 2022] DELETE /identity/v3/projects/1f19b2190b36468087146f342878cc87 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:04.282660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.284783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.312320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.313153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.313446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.313988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] PATH_INFO: `/v3/projects/cb96f1aa78db438886c1f130a5075d8f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.315678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb96f1aa78db438886c1f130a5075d8f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.318194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.382419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aca7e0-a258-47e4-a703-7a92b5aaeb82 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.387603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.391965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.391965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.391965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] PATH_INFO: `/v3/users/b4effbac6059440f9105f21183de9b23` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.391965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4effbac6059440f9105f21183de9b23)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.393384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.459743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb96f1aa78db438886c1f130a5075d8f', 'request_id': 'req-64739995-1675-4d20-b422-8f383e2306c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.466054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb96f1aa78db438886c1f130a5075d8f', 'request_id': 'req-64739995-1675-4d20-b422-8f383e2306c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.473463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb96f1aa78db438886c1f130a5075d8f', 'request_id': 'req-64739995-1675-4d20-b422-8f383e2306c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.557272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] The token cache is being invalidate because project cb96f1aa78db438886c1f130a5075d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:04.557902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.558307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.559956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1041/2062] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:04 2022] DELETE /identity/v3/projects/cb96f1aa78db438886c1f130a5075d8f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:04.560871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.562035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.607976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4effbac6059440f9105f21183de9b23'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.615748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4effbac6059440f9105f21183de9b23'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.620279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4effbac6059440f9105f21183de9b23'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.629947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64739995-1675-4d20-b422-8f383e2306c1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.635020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.635665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.635968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.636257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.636984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.637714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4effbac6059440f9105f21183de9b23'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.638421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4effbac6059440f9105f21183de9b23'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:04.639297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.653385 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1042/2063] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:04.653385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.653385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.666856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d407bbd-26f6-413f-bd71-d6908f09bef9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.671536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.672144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.672425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.672697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.673332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.675417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.691568 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1043/2064] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:04.691568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.691568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.705223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293baa75-3c11-4c3f-8681-41a037223b98 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.715247 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1022/2065] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:04 2022] DELETE /identity/v3/users/b4effbac6059440f9105f21183de9b23 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:04.716317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.716929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.717787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.718170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.718338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.718862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.719630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.723074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.797569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c5af0-5bf2-4a01-bfe0-af5926e2b3cc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.802659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.803232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.803519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.803794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] PATH_INFO: `/v3/users/80fdbac49d2e4fe58a876e3404a3cb5d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.804951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fdbac49d2e4fe58a876e3404a3cb5d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.806883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:04.868479 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1044/2066] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:04 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:04.873995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:04.875807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:04.888679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e15ee0-cf2b-48ca-ae2c-466901bfc0f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:04.894073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:04.894679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:04.894963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:04.899490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] PATH_INFO: `/v3/users/3b281392148c49fb9092a7b45fe7d769` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:04.899490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b281392148c49fb9092a7b45fe7d769)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:04.899490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.103976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b281392148c49fb9092a7b45fe7d769'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.105396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fdbac49d2e4fe58a876e3404a3cb5d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.111788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b281392148c49fb9092a7b45fe7d769'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.112550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b281392148c49fb9092a7b45fe7d769'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.113185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b281392148c49fb9092a7b45fe7d769'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.119835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fdbac49d2e4fe58a876e3404a3cb5d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.121020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fdbac49d2e4fe58a876e3404a3cb5d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.129548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b281392148c49fb9092a7b45fe7d769'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.137544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fdbac49d2e4fe58a876e3404a3cb5d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.138607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fdbac49d2e4fe58a876e3404a3cb5d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:05.235425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1045/2067] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:04 2022] DELETE /identity/v3/users/3b281392148c49fb9092a7b45fe7d769 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:05.236505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.238138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:05.295595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1023/2068] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:04 2022] DELETE /identity/v3/users/80fdbac49d2e4fe58a876e3404a3cb5d => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:05.297291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.302031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:05.375184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659611d5-ef98-4e33-a0aa-8142eeadcc1e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:05.409218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e72da-23d8-4cf8-9e2c-2f4ae1b70782 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:05.430681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27a730-e9f7-4eb1-ac89-57e78d25842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:05.430681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27a730-e9f7-4eb1-ac89-57e78d25842f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.430958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27a730-e9f7-4eb1-ac89-57e78d25842f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.431259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27a730-e9f7-4eb1-ac89-57e78d25842f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.431946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27a730-e9f7-4eb1-ac89-57e78d25842f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:05.434300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27a730-e9f7-4eb1-ac89-57e78d25842f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.459062 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1024/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:05.459614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.459786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.460070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.481282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:05.485063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:05.488184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:05.497344 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1025/2070] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:05.498849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.500298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:05.528706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4be74-1196-43cd-9452-b852702e5346 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:05.535637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:05.536373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.536780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.537157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.538401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:05.540193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.560044 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1026/2071] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:05.561747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.577090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0c634-8a2b-40bd-b3f6-cde9e3f22b37 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:05.583787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:05.584676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.585058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.585436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] PATH_INFO: `/v3/projects/810fe8e68f7d41288fc90e1ed351f81e/users/1819c62a28c041608b9e4620b938979c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.586945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:05.591817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.593188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.593615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] PATH_INFO: `/v3/projects/9439f8a11f784c8fb52a3738c3d582c6/users/bb65d76aa0264bd5b1a1de9897a689da/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.615674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810fe8e68f7d41288fc90e1ed351f81e, user_id=1819c62a28c041608b9e4620b938979c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:05.629688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.650136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9439f8a11f784c8fb52a3738c3d582c6, user_id=bb65d76aa0264bd5b1a1de9897a689da, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:05.655603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.724077 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1027/2072] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:05 2022] PUT /identity/v3/projects/810fe8e68f7d41288fc90e1ed351f81e/users/1819c62a28c041608b9e4620b938979c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:05.724770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.726746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:05.749929 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1046/2073] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:05 2022] PUT /identity/v3/projects/9439f8a11f784c8fb52a3738c3d582c6/users/bb65d76aa0264bd5b1a1de9897a689da/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:05.752543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.813001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7cf5e-d022-4807-9ee5-702784219154 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:05.846605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f1d63-215b-4dbf-b878-9c8ec3df1198 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:05.859203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:05.859911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.860191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.860467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] PATH_INFO: `/v3/projects/5b00ec5234f14779b819694abbdbf3fe/users/15599c07c0a34b8db2fcce81be09e97e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.876101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49292cf-6b07-4868-ba3f-90a5ac0b00b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:05.876727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49292cf-6b07-4868-ba3f-90a5ac0b00b8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.876845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b00ec5234f14779b819694abbdbf3fe, user_id=15599c07c0a34b8db2fcce81be09e97e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:05.879562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.885889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49292cf-6b07-4868-ba3f-90a5ac0b00b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.886199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49292cf-6b07-4868-ba3f-90a5ac0b00b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.896345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49292cf-6b07-4868-ba3f-90a5ac0b00b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:05.897874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49292cf-6b07-4868-ba3f-90a5ac0b00b8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:05.908690 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1028/2074] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:05.909972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:05.910263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:05.910540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:05.939213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] MFA Rules not processed for user `1819c62a28c041608b9e4620b938979c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:05.940455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:05.984255 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1047/2075] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:05 2022] PUT /identity/v3/projects/5b00ec5234f14779b819694abbdbf3fe/users/15599c07c0a34b8db2fcce81be09e97e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:05.985447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:05.993459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.029925 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1029/2076] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:05 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:06.030861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:06.032248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.052967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1485e-61dd-4fd2-9d26-ab654c48f0d5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.110830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e975-9fa3-49b8-9d0a-cc71524b176d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.118391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.119079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.119330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.119593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.120292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.122413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.134295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.135193 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1048/2077] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:06.139572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.139888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:06.139984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.139984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] PATH_INFO: `/v3/projects/897514d21b5d47cc8a8c5bef8218aa22` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.141347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.141784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897514d21b5d47cc8a8c5bef8218aa22)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.144474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.155993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e1eb0-8d0a-494b-9a48-c29fe6e4c7bb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.162567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.163342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.163700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.164044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] PATH_INFO: `/v3/projects/026da7196278493fb128e5e8e212b21f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.165298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026da7196278493fb128e5e8e212b21f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.174855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.316439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897514d21b5d47cc8a8c5bef8218aa22', 'request_id': 'req-332f4980-49e9-4e95-b5eb-9ff517255085'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.322802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897514d21b5d47cc8a8c5bef8218aa22', 'request_id': 'req-332f4980-49e9-4e95-b5eb-9ff517255085'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.328588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897514d21b5d47cc8a8c5bef8218aa22', 'request_id': 'req-332f4980-49e9-4e95-b5eb-9ff517255085'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.362110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026da7196278493fb128e5e8e212b21f', 'request_id': 'req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.370702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026da7196278493fb128e5e8e212b21f', 'request_id': 'req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.381203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026da7196278493fb128e5e8e212b21f', 'request_id': 'req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.428890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] The token cache is being invalidate because project 897514d21b5d47cc8a8c5bef8218aa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:06.430048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.430201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.433465 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1030/2078] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:06 2022] DELETE /identity/v3/projects/897514d21b5d47cc8a8c5bef8218aa22 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:06.434386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:06.436496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.517630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f4980-49e9-4e95-b5eb-9ff517255085 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.540669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] The token cache is being invalidate because project 026da7196278493fb128e5e8e212b21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:06.546955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.546955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.546955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1049/2079] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:06 2022] DELETE /identity/v3/projects/026da7196278493fb128e5e8e212b21f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:06.546955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:06.548821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.585284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:06.587090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.588014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.588299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.588575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.589224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.590951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.605069 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1031/2080] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:06.611129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:06.611129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.621450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e3452-acf4-42a6-a246-f26f0b9e69f0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.627954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.628638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.628922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.629199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] PATH_INFO: `/v3/projects/9439f8a11f784c8fb52a3738c3d582c6/users/bb65d76aa0264bd5b1a1de9897a689da/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.631226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9439f8a11f784c8fb52a3738c3d582c6, user_id=bb65d76aa0264bd5b1a1de9897a689da, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.633993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.642513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a0e7e-dfea-48ec-a2f6-c44039a6bc41 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.646473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1032/2081] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:06 2022] PUT /identity/v3/projects/9439f8a11f784c8fb52a3738c3d582c6/users/bb65d76aa0264bd5b1a1de9897a689da/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:06.648105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:06.653208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.722270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342af1-36d3-4a63-90ab-c52beaebc16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.722910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342af1-36d3-4a63-90ab-c52beaebc16a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.723230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342af1-36d3-4a63-90ab-c52beaebc16a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.723507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342af1-36d3-4a63-90ab-c52beaebc16a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.726171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342af1-36d3-4a63-90ab-c52beaebc16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.727262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342af1-36d3-4a63-90ab-c52beaebc16a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.760442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8e9c1-3f3e-409e-9b3c-a3f2760c7956 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:06.775200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:06.775200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.775200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.775200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] PATH_INFO: `/v3/projects/2c708f857b3f445985133945eb88d6d3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.775914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c708f857b3f445985133945eb88d6d3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:06.775914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:06.876281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1050/2082] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:06 2022] POST /identity/v3/projects => generated 409 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:06.877724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e450-8d17-4767-9034-87d10a439fbe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:06.878129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e450-8d17-4767-9034-87d10a439fbe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:06.878478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e450-8d17-4767-9034-87d10a439fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:06.906897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:06.908760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3117e450-8d17-4767-9034-87d10a439fbe None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:06.910706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3117e450-8d17-4767-9034-87d10a439fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:06.940575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c708f857b3f445985133945eb88d6d3', 'request_id': 'req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.948382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c708f857b3f445985133945eb88d6d3', 'request_id': 'req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:06.957354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c708f857b3f445985133945eb88d6d3', 'request_id': 'req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.006150 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1051/2083] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:07.007689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b82d-be67-4a40-8e36-8239f1c18377 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.008115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b82d-be67-4a40-8e36-8239f1c18377 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.008402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b82d-be67-4a40-8e36-8239f1c18377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.041324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8bc8b82d-be67-4a40-8e36-8239f1c18377 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:07.041324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8bc8b82d-be67-4a40-8e36-8239f1c18377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.041677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] The token cache is being invalidate because project 2c708f857b3f445985133945eb88d6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:07.041677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.041677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.041677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1033/2084] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:06 2022] DELETE /identity/v3/projects/2c708f857b3f445985133945eb88d6d3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:07.041677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.042031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.105481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1052/2085] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:07.106844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95bec-2fc6-44f7-a506-5f37b5b1dbec None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.107132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95bec-2fc6-44f7-a506-5f37b5b1dbec None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.107484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95bec-2fc6-44f7-a506-5f37b5b1dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.110369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c0ca-d16a-4280-bd6c-3a3ca5d1c731 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.118155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.119521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.120171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.124037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] PATH_INFO: `/v3/projects/5b00ec5234f14779b819694abbdbf3fe/users/15599c07c0a34b8db2fcce81be09e97e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.124037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b00ec5234f14779b819694abbdbf3fe, user_id=15599c07c0a34b8db2fcce81be09e97e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.126769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.139153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1034/2086] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:07 2022] PUT /identity/v3/projects/5b00ec5234f14779b819694abbdbf3fe/users/15599c07c0a34b8db2fcce81be09e97e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:07.139153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.141075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.148613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-06b95bec-2fc6-44f7-a506-5f37b5b1dbec None None] MFA Rules not processed for user `bb65d76aa0264bd5b1a1de9897a689da`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:07.150059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-06b95bec-2fc6-44f7-a506-5f37b5b1dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.242943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02378838-98a0-4ecd-89f6-5d3602eb063f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.248964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db49f-f2e6-4460-a284-4213a3490f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.249567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db49f-f2e6-4460-a284-4213a3490f58 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.249846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db49f-f2e6-4460-a284-4213a3490f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.250114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db49f-f2e6-4460-a284-4213a3490f58 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.250848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4db49f-f2e6-4460-a284-4213a3490f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.252784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4db49f-f2e6-4460-a284-4213a3490f58 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.262882 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1053/2087] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:07.264961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.265368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.267887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.293660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:07.294819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.303947 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1054/2088] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:07.304823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.306108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.321014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b5e3-db65-4698-8576-6ff0c115bba0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.327810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.328540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.328834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.329260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] PATH_INFO: `/v3/users/722e850b74954dbdb49d0feb4e59bdf4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.330469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] RBAC: Authorizing `identity:delete_user(user_id=722e850b74954dbdb49d0feb4e59bdf4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.332656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.373619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1035/2089] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:07.375327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b7264-3898-4d87-815b-503b4d62682b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.375682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b7264-3898-4d87-815b-503b4d62682b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.377402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b7264-3898-4d87-815b-503b4d62682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.400291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-516b7264-3898-4d87-815b-503b4d62682b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:07.401639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-516b7264-3898-4d87-815b-503b4d62682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.411553 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1036/2090] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:07.416745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.417080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.417300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.454478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] MFA Rules not processed for user `15599c07c0a34b8db2fcce81be09e97e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:07.455639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.532078 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1037/2091] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:07.532941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.536165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.556801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722e850b74954dbdb49d0feb4e59bdf4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.567085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722e850b74954dbdb49d0feb4e59bdf4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.567899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722e850b74954dbdb49d0feb4e59bdf4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.568665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722e850b74954dbdb49d0feb4e59bdf4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.583480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722e850b74954dbdb49d0feb4e59bdf4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:07.629548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecacec-761d-4d23-8ecb-da7132132003 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.635224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.635831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.636115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.636392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.638301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.651174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.652876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.660886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1055/2092] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:07 2022] DELETE /identity/v3/users/722e850b74954dbdb49d0feb4e59bdf4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:07.665026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.665698 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1038/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:07.666797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.666895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.668771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.687890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c48779-26b1-430c-bcf2-69a12350b5ce service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.742676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a0ee-8817-4815-8ffb-962a0554061b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.752094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.752712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.752998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.753265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.754001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:07.754465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.759469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.768538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.769320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.769676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.770103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.770766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.772618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.773572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1056/2094] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:07.774703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.777143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.786249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1039/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:07.787480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.791207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.793067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315a9cd-70bb-4ffa-a2da-f0e0dd40bc7a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.799249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.802885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.803653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:07.805511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.805511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.805511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:07.805754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.807356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.823505 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1057/2096] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:07.827481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.840494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153109-a893-4605-a5a3-028dae28e26c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.854907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.855308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.855687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.856412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.857483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:07.862842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:07.919417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522668f-1bbc-47ac-93dc-36f2223f5bc7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:07.925724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:07.926432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:07.926777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:07.927292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:07.929673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:07.988748 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1058/2097] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:07 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:07.988748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:07.997389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.001297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.015214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1040/2098] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:08.016326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.028441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bdd6c-d69d-49e1-bcb0-830ea646bc2e service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.081284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327995e0-a03c-4560-bc4a-d6ece06a0856 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.088283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.088963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.089342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.089623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] PATH_INFO: `/v3/projects/7e1511e862b044419f2b43f401856470/users/41fb2d0cc8654d58b3be7160e8cd1e15/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.102415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.103581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.103937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.104293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.105058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.108652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.119584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:08.129544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1511e862b044419f2b43f401856470, user_id=41fb2d0cc8654d58b3be7160e8cd1e15, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.131841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.206402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1041/2099] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:08 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:08.206402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.224054 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1059/2100] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:07 2022] PUT /identity/v3/projects/7e1511e862b044419f2b43f401856470/users/41fb2d0cc8654d58b3be7160e8cd1e15/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:08.224054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.224054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:08.285974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9a7a3-c02e-4087-be34-48572f762cec admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.291383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e5902-24fd-4fdb-b819-b01e9428ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.292373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5902-24fd-4fdb-b819-b01e9428ad32 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.292663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5902-24fd-4fdb-b819-b01e9428ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.292941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e5902-24fd-4fdb-b819-b01e9428ad32 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.293582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e5902-24fd-4fdb-b819-b01e9428ad32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.296124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e5902-24fd-4fdb-b819-b01e9428ad32 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.324336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93b19-6edb-436b-8d86-129e5ac16ef1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.329328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.330147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.330610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.330959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] PATH_INFO: `/v3/projects/d764a01fa6ba47db9efe3b70401f2089` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.332180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d764a01fa6ba47db9efe3b70401f2089)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.334177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.383046 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1042/2101] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:08 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:08.383418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.383707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.396851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.406398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:08.407741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:08.490430 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1043/2102] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Sep 6 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:08.491537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.505648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c050-2b6d-4517-a9a4-7a6daf4318b9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.517480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.519093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.519701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.520137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.521403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.524054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.774205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd764a01fa6ba47db9efe3b70401f2089', 'request_id': 'req-200c5279-81c5-400c-b88b-24121d27c20e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:08.780341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd764a01fa6ba47db9efe3b70401f2089', 'request_id': 'req-200c5279-81c5-400c-b88b-24121d27c20e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:08.790600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd764a01fa6ba47db9efe3b70401f2089', 'request_id': 'req-200c5279-81c5-400c-b88b-24121d27c20e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:08.939355 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1044/2103] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:08 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:08.939355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.939355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f57c-3b0f-4d08-911b-ced24819e2b0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.939355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.940169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.940169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.940169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.940169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.940169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.940169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1045/2104] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:08.940599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.940599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633d90a-77d2-40d0-81ec-9c907150b1c0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:08.940599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:08.940599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:08.940914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:08.940914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:08.940914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:08.940914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:08.997879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1046/2105] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:08.997879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:08.997879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.021354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601b3f-73af-4f01-8b06-dc4e752cf827 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.035965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.037361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.037685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.037963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.048894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.050388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.058824 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1047/2106] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:09.061293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.082129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988250-a66b-433d-891e-78b0b3ef12f6 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.087741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.088349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.088632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.088913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.089561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.091204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.101903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1048/2107] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:09.102769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.114479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6fd4-e52a-4b44-9169-dfacf1f715fb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.119568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.120348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.120641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.120919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] PATH_INFO: `/v3/projects/7e1511e862b044419f2b43f401856470/users/41fb2d0cc8654d58b3be7160e8cd1e15/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.123955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1511e862b044419f2b43f401856470, user_id=41fb2d0cc8654d58b3be7160e8cd1e15, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.126648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.137473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1049/2108] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:09 2022] PUT /identity/v3/projects/7e1511e862b044419f2b43f401856470/users/41fb2d0cc8654d58b3be7160e8cd1e15/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:09.138322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.201175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2df81-8f29-473e-94e5-e986eb9190dd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.206208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.206808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.207121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.207396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.208063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.209715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.220673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1050/2109] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:09.221610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.223371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.236842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087bb2b-6284-4fca-a27a-7174d8f6329a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.237369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] The token cache is being invalidate because project d764a01fa6ba47db9efe3b70401f2089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:09.237944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.239065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.241528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1060/2110] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:08 2022] DELETE /identity/v3/projects/d764a01fa6ba47db9efe3b70401f2089 => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:09.241716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.242115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.242342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.242625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.242902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] PATH_INFO: `/v3/users/3fe611dd8b0345779ed99a0cd277984e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.244256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.244387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe611dd8b0345779ed99a0cd277984e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.246116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.259381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5279-81c5-400c-b88b-24121d27c20e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.265309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62c5f9-2b6f-4b66-bcca-695e684f9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.267386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c5f9-2b6f-4b66-bcca-695e684f9c7c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.267386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c5f9-2b6f-4b66-bcca-695e684f9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.267386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c5f9-2b6f-4b66-bcca-695e684f9c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.268024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62c5f9-2b6f-4b66-bcca-695e684f9c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.269648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62c5f9-2b6f-4b66-bcca-695e684f9c7c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.280111 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1061/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:09.281331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.281618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.281893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.316300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] MFA Rules not processed for user `41fb2d0cc8654d58b3be7160e8cd1e15`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:09.317822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.396369 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1062/2112] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:09.397221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.399991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.414903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f819-fdc6-492a-8355-de8478426342 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.421116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecdac9-7647-42c5-bf4e-57067b1ae0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.421808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecdac9-7647-42c5-bf4e-57067b1ae0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.422094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecdac9-7647-42c5-bf4e-57067b1ae0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.422372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecdac9-7647-42c5-bf4e-57067b1ae0eb admin admin] PATH_INFO: `/v3/projects/752e7bf666fb4d7a8a997af85d508dd6/users/68b67a91aae74b33959efe4f3e647efb/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.439025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecdac9-7647-42c5-bf4e-57067b1ae0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=752e7bf666fb4d7a8a997af85d508dd6, user_id=68b67a91aae74b33959efe4f3e647efb, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.441972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecdac9-7647-42c5-bf4e-57067b1ae0eb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.442230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe611dd8b0345779ed99a0cd277984e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.452315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe611dd8b0345779ed99a0cd277984e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.453049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe611dd8b0345779ed99a0cd277984e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.464842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe611dd8b0345779ed99a0cd277984e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.465511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe611dd8b0345779ed99a0cd277984e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:09.615422 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1063/2113] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:09 2022] PUT /identity/v3/projects/752e7bf666fb4d7a8a997af85d508dd6/users/68b67a91aae74b33959efe4f3e647efb/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:09.617255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.617745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.618361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.627096 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1051/2114] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:09 2022] DELETE /identity/v3/users/3fe611dd8b0345779ed99a0cd277984e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:09.628903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.630539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.651852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:09.654110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.745001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762296de-9a7d-4765-a820-d9e256911b78 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.750984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.751789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.752074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.752423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] PATH_INFO: `/v3/projects/6d84cdc2d35b477d9a43aead8ad9f51c/users/02ccd58ebd8d4403aa41deb413564248/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.773736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d84cdc2d35b477d9a43aead8ad9f51c, user_id=02ccd58ebd8d4403aa41deb413564248, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.776540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:09.792435 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1064/2115] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:09.793496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.794927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.876676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e29b0-904a-4db3-ad84-220207a64c1e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.892440 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1052/2116] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:09 2022] PUT /identity/v3/projects/6d84cdc2d35b477d9a43aead8ad9f51c/users/02ccd58ebd8d4403aa41deb413564248/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:09.894024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:09.896390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.963202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.963891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.964179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.964459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.966604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:09.978865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226104cd-d1da-4d30-bafd-84babfac1c2a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:09.984257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:09.985191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:09.985317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:09.985601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] PATH_INFO: `/v3/users/990aa3b96d8e4366bda76ec07f4f7014` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:09.986754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990aa3b96d8e4366bda76ec07f4f7014)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:09.988919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.001785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:10.057655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.059325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077443-1eb1-4a58-9042-ac6d16c3e4c2 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.069788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1065/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:09 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:10.071437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f4d20-8851-446d-99e6-91005a4bbe0c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.071437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f4d20-8851-446d-99e6-91005a4bbe0c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.071620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f4d20-8851-446d-99e6-91005a4bbe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.106477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b49f4d20-8851-446d-99e6-91005a4bbe0c None None] MFA Rules not processed for user `68b67a91aae74b33959efe4f3e647efb`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:10.108064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b49f4d20-8851-446d-99e6-91005a4bbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.181510 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1066/2118] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:10.183046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eaa71-9a4e-4333-90c4-9e502a023d61 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.183456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eaa71-9a4e-4333-90c4-9e502a023d61 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.183793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eaa71-9a4e-4333-90c4-9e502a023d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.189492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990aa3b96d8e4366bda76ec07f4f7014'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:10.198558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990aa3b96d8e4366bda76ec07f4f7014'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:10.199534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990aa3b96d8e4366bda76ec07f4f7014'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:10.204643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-af8eaa71-9a4e-4333-90c4-9e502a023d61 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:10.205851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-af8eaa71-9a4e-4333-90c4-9e502a023d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.218599 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1067/2119] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:10.218599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08e57-228a-4b30-b711-89b85a66a0f3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.218599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08e57-228a-4b30-b711-89b85a66a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.218599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08e57-228a-4b30-b711-89b85a66a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.240693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990aa3b96d8e4366bda76ec07f4f7014'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:10.241738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990aa3b96d8e4366bda76ec07f4f7014'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:10.244788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-abd08e57-228a-4b30-b711-89b85a66a0f3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:10.246568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abd08e57-228a-4b30-b711-89b85a66a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.255952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:10.258029 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1068/2120] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:10.258029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.258419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.258798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.289005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] MFA Rules not processed for user `02ccd58ebd8d4403aa41deb413564248`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:10.290227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.340029 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1053/2121] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:09 2022] DELETE /identity/v3/users/990aa3b96d8e4366bda76ec07f4f7014 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:10.342374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.344631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.377231 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1069/2122] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:10.378449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.379615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.395679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e9b2-fa2f-4946-ad22-19d4e03e3a6e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.455497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142153c4-7be7-408f-baf1-e42a0674cd13 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.462460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.462711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.463525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.463884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.464045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.464277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.464629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.465052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.465887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.466299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.469502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.549076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.550999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.564439 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1054/2123] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:10 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:10.565119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.570427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.589231 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1070/2124] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:10.590222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.658594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb340-257a-49a3-8dc3-56fcdf7f6310 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.682296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a9a55-4719-4f67-92c6-db60181e6219 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.688119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.688739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.689032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.689298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.689944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:10.690252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.691920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3423e-f5b0-4d5b-9a28-433ef2024695 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.704689 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1071/2125] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:10.705712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.706001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.706277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.719682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.720388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.720744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.721131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.725914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:10.727156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.730594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.732135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.735496 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1072/2126] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:10.736279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.737486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.743464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1055/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:10.744285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.750762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d322f-0ab3-4a53-9dd4-ffb335a873c9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.754977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae881d-2d2e-4c38-9229-b149dd991c25 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.755821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.756503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.756862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.757266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.757907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.759981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.760117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.760569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.761054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.761334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.762398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.765087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.896500 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1056/2128] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:10.897432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:10.901496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:10.912647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facaa7-2580-428c-8673-bd55c0ff9b7e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:10.917443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:10.918085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:10.918374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:10.919334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] PATH_INFO: `/v3/users/1819c62a28c041608b9e4620b938979c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:10.920565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1819c62a28c041608b9e4620b938979c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:10.922520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:10.935042 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1073/2129] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:10.936514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.022600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd1971-c7ed-4e90-970d-0cb2f27f24c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.027556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.028172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.028479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.028754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.029919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.031961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.133653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1819c62a28c041608b9e4620b938979c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.141516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1819c62a28c041608b9e4620b938979c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.142226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1819c62a28c041608b9e4620b938979c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.156773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1819c62a28c041608b9e4620b938979c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.157512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1819c62a28c041608b9e4620b938979c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.164514 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1074/2130] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:10 2022] POST /identity/v3/projects => generated 397 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:11.164514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.164930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.223516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e4ce9-9510-4ee8-9d85-68327d6da86c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.227367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.227970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.228251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.228523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.230238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.243715 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1057/2131] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:10 2022] DELETE /identity/v3/users/1819c62a28c041608b9e4620b938979c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:11.247547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.247954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.299082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.301839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.310914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1075/2132] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:11.311777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.313048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.324953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528153e-cb63-420c-9f5d-277d65a9a9ce service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.330525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0ac01-7a08-410c-90be-5d67dad50308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.330926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ac01-7a08-410c-90be-5d67dad50308 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.331334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ac01-7a08-410c-90be-5d67dad50308 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.331660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ac01-7a08-410c-90be-5d67dad50308 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.332289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0ac01-7a08-410c-90be-5d67dad50308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.334211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0ac01-7a08-410c-90be-5d67dad50308 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.334569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95c841-83a8-4d64-9243-0556f272d372 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.341576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.342893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.343321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.343678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.344428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.346130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.356393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1058/2133] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:11.357311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.359701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.372620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d232fe-cb33-49cc-8b6e-32ba3fef207d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.377814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.378426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.378713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.378986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.379635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.381646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.438786 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1076/2134] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:11 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:11.440060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.440347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.440625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.456865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:11.460054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:11.461311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.463190 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1059/2135] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:11 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:11.463436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.465237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.469998 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1077/2136] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:11.470752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.477918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef934ca4-c9af-49bd-87d0-22a0dce9cf9f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.480218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e509-13b9-4079-bdf5-95b9e53a35fe None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.483719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.484334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.484620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.484903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] PATH_INFO: `/v3/projects/6a9dd5a1ba964488a234a69b3439d5c5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.485486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.486099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9dd5a1ba964488a234a69b3439d5c5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.486213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.486386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.486655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] PATH_INFO: `/v3/projects/9a83860577084add85ca2af4cf6b548d/users/41a690530c9e455f8b0f975ca13b71fd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.488188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.501835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a83860577084add85ca2af4cf6b548d, user_id=41a690530c9e455f8b0f975ca13b71fd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.504877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.587403 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1078/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:11 2022] PUT /identity/v3/projects/9a83860577084add85ca2af4cf6b548d/users/41a690530c9e455f8b0f975ca13b71fd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:11.588639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.621180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9dd5a1ba964488a234a69b3439d5c5', 'request_id': 'req-0922f469-f18c-4605-b863-2b4169242885'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.628997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9dd5a1ba964488a234a69b3439d5c5', 'request_id': 'req-0922f469-f18c-4605-b863-2b4169242885'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.635607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9dd5a1ba964488a234a69b3439d5c5', 'request_id': 'req-0922f469-f18c-4605-b863-2b4169242885'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.662422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81689caf-259f-4f5a-a600-0de8137ada12 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.676125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:11.712295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] The token cache is being invalidate because project 6a9dd5a1ba964488a234a69b3439d5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:11.712505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.713110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:11.718015 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1060/2138] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:11 2022] DELETE /identity/v3/projects/6a9dd5a1ba964488a234a69b3439d5c5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:11.718015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.718015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.734240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.735544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.735544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.735544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.736114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.737796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.749071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1079/2139] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:11.750669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.752881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.786078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922f469-f18c-4605-b863-2b4169242885 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.791326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.791942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.792243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.792486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.793139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.795082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.813522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1061/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:11.813522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.820130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.827063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a4a9e-f073-4d36-af7c-a1074f0bac08 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.831607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.832224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.832510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.832787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.836233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.838562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db96e-36d0-485e-b8ba-f80f0f5e73d5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.843988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.844475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.844921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.845210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.845912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.847558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.854311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.855888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.859352 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1062/2141] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:11.863138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.864989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.867155 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1080/2142] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:11.867955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.869234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:11.880492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2d9f-ca6a-46c1-b0d0-6175ead6ab64 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.885731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.886859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.887295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.887780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] PATH_INFO: `/v3/users/15599c07c0a34b8db2fcce81be09e97e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.889204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15599c07c0a34b8db2fcce81be09e97e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.889332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645fb8f-4b12-48f8-a63c-61a8ba2441c7 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:11.891388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.899772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:11.900912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:11.900912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:11.901110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] PATH_INFO: `/v3/projects/eacddf449a304b7bb1eda6b547a102ba/users/8de15d3d89a248b3aa5f80de1142fcb1/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:11.918371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacddf449a304b7bb1eda6b547a102ba, user_id=8de15d3d89a248b3aa5f80de1142fcb1, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:11.921723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:11.989288 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1081/2143] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:11 2022] PUT /identity/v3/projects/eacddf449a304b7bb1eda6b547a102ba/users/8de15d3d89a248b3aa5f80de1142fcb1/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:11.990212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:11.997614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.023140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:12.070661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aaac5-1363-419d-8171-d7d35d960eee admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.071321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15599c07c0a34b8db2fcce81be09e97e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.076519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.077332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.077686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.077896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] PATH_INFO: `/v3/projects/f76fffffb198473e9ec823f285489277` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.079233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76fffffb198473e9ec823f285489277)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.081420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:12.082920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15599c07c0a34b8db2fcce81be09e97e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.084444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15599c07c0a34b8db2fcce81be09e97e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.099272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15599c07c0a34b8db2fcce81be09e97e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.100404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15599c07c0a34b8db2fcce81be09e97e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.198503 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1063/2144] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:11 2022] DELETE /identity/v3/users/15599c07c0a34b8db2fcce81be09e97e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:12.199416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.202522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.265997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76fffffb198473e9ec823f285489277', 'request_id': 'req-13e9e612-7849-4fb5-b32f-b4f13605e017'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.281982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76fffffb198473e9ec823f285489277', 'request_id': 'req-13e9e612-7849-4fb5-b32f-b4f13605e017'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.296524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76fffffb198473e9ec823f285489277', 'request_id': 'req-13e9e612-7849-4fb5-b32f-b4f13605e017'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.311466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2642-d6c6-437e-a24c-81aae844a102 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.380722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] The token cache is being invalidate because project f76fffffb198473e9ec823f285489277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:12.381101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.381845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.387504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.388138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.388425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.388737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.389523 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1082/2145] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:11 2022] DELETE /identity/v3/projects/f76fffffb198473e9ec823f285489277 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:12.389646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.390992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:12.393096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.394581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.402189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1064/2146] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:12.403225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.405542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.411968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9e612-7849-4fb5-b32f-b4f13605e017 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.418442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.419273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.419403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010f36d-f9d5-4ba9-8a65-b75dec92cc18 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.419576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.421057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] PATH_INFO: `/v3/projects/9a83860577084add85ca2af4cf6b548d/users/41a690530c9e455f8b0f975ca13b71fd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.422987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a83860577084add85ca2af4cf6b548d, user_id=41a690530c9e455f8b0f975ca13b71fd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.426097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.426933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:12.427433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.428337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.428758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.429506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.431218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:12.439902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1083/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:12 2022] PUT /identity/v3/projects/9a83860577084add85ca2af4cf6b548d/users/41a690530c9e455f8b0f975ca13b71fd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:12.440767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.442498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.452094 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1065/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:12.452939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.468686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.487783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae136daa-177c-4e30-a06c-185eda6498f9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.543863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc27049-b6d9-4d13-bc22-03f9ded4fde5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.548586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.549215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.549499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.549778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] PATH_INFO: `/v3/users/bb65d76aa0264bd5b1a1de9897a689da` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.551042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb65d76aa0264bd5b1a1de9897a689da)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.551767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a8cfd-4d0c-4699-b8c1-6059ad6e9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.552428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8cfd-4d0c-4699-b8c1-6059ad6e9376 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.552709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8cfd-4d0c-4699-b8c1-6059ad6e9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.552979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a8cfd-4d0c-4699-b8c1-6059ad6e9376 admin admin] PATH_INFO: `/v3/projects/6a7773842cb74c92878a6e62fb2dab36/users/a642f5be336548aea66f2ca1f7213e21/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.553087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:12.557948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:12.570725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a8cfd-4d0c-4699-b8c1-6059ad6e9376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7773842cb74c92878a6e62fb2dab36, user_id=a642f5be336548aea66f2ca1f7213e21, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.574050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a8cfd-4d0c-4699-b8c1-6059ad6e9376 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:12.667456 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1066/2149] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:12 2022] PUT /identity/v3/projects/6a7773842cb74c92878a6e62fb2dab36/users/a642f5be336548aea66f2ca1f7213e21/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:12.668787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.669059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.669549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.700566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] MFA Rules not processed for user `41a690530c9e455f8b0f975ca13b71fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:12.702084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.745044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb65d76aa0264bd5b1a1de9897a689da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.752728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb65d76aa0264bd5b1a1de9897a689da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.753464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb65d76aa0264bd5b1a1de9897a689da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.754093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb65d76aa0264bd5b1a1de9897a689da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.766231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb65d76aa0264bd5b1a1de9897a689da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:12.781177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1067/2150] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:12.782193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.784176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.840138 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1084/2151] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:12 2022] DELETE /identity/v3/users/bb65d76aa0264bd5b1a1de9897a689da => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:12.841464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:12.846386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:12.893634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:12.901348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620957d0-93f0-4d7b-b45a-8cbe3ff5d62e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.956241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9874-d34f-4dbb-9d2e-c4b21821a306 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:12.962566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:12.963368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:12.963728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:12.964589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] PATH_INFO: `/v3/projects/810fe8e68f7d41288fc90e1ed351f81e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:12.966222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=810fe8e68f7d41288fc90e1ed351f81e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:12.969029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.012777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe269-d2b0-4ab5-a94b-b95ad6a3fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.012777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe269-d2b0-4ab5-a94b-b95ad6a3fe69 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.012777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe269-d2b0-4ab5-a94b-b95ad6a3fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.012777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe269-d2b0-4ab5-a94b-b95ad6a3fe69 admin admin] PATH_INFO: `/v3/projects/eacddf449a304b7bb1eda6b547a102ba/users/8de15d3d89a248b3aa5f80de1142fcb1/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.013283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe269-d2b0-4ab5-a94b-b95ad6a3fe69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacddf449a304b7bb1eda6b547a102ba, user_id=8de15d3d89a248b3aa5f80de1142fcb1, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:13.014930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe269-d2b0-4ab5-a94b-b95ad6a3fe69 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.027435 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1068/2152] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:12 2022] PUT /identity/v3/projects/eacddf449a304b7bb1eda6b547a102ba/users/8de15d3d89a248b3aa5f80de1142fcb1/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:13.029083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618179-5918-4f98-bfa5-762f46c955d1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.030041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618179-5918-4f98-bfa5-762f46c955d1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.030428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c618179-5918-4f98-bfa5-762f46c955d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.071380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2c618179-5918-4f98-bfa5-762f46c955d1 None None] MFA Rules not processed for user `a642f5be336548aea66f2ca1f7213e21`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:13.072765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2c618179-5918-4f98-bfa5-762f46c955d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.110063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810fe8e68f7d41288fc90e1ed351f81e', 'request_id': 'req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.116544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810fe8e68f7d41288fc90e1ed351f81e', 'request_id': 'req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.126859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810fe8e68f7d41288fc90e1ed351f81e', 'request_id': 'req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.166900 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1069/2153] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:13.173408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada17e-60e1-413c-aa2a-ecca6dd02dc4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.173697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada17e-60e1-413c-aa2a-ecca6dd02dc4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.174429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ada17e-60e1-413c-aa2a-ecca6dd02dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.194739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-28ada17e-60e1-413c-aa2a-ecca6dd02dc4 None None] MFA Rules not processed for user `68b67a91aae74b33959efe4f3e647efb`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:13.196035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-28ada17e-60e1-413c-aa2a-ecca6dd02dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.232699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] The token cache is being invalidate because project 810fe8e68f7d41288fc90e1ed351f81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:13.233046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.233715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.238241 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1085/2154] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:12 2022] DELETE /identity/v3/projects/810fe8e68f7d41288fc90e1ed351f81e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:13.238241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:13.238241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.282004 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1070/2155] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:13.283567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.283863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.284145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.313689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3e38e-5a02-41e1-a6d2-1234be6e5a9c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:13.318951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.319697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.320015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.320294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] PATH_INFO: `/v3/projects/5b00ec5234f14779b819694abbdbf3fe` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.321449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b00ec5234f14779b819694abbdbf3fe)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:13.323446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.324645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] MFA Rules not processed for user `8de15d3d89a248b3aa5f80de1142fcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:13.325985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.416554 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1071/2156] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:13.417763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:13.419201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.434215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c79b9-9af2-4396-b5c0-8395859428a5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:13.439569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.440548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.440548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.440823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.441352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:13.443292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.477264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b00ec5234f14779b819694abbdbf3fe', 'request_id': 'req-c7f2b9e0-39d1-466d-91a5-7eef224faeae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.485862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b00ec5234f14779b819694abbdbf3fe', 'request_id': 'req-c7f2b9e0-39d1-466d-91a5-7eef224faeae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.495565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b00ec5234f14779b819694abbdbf3fe', 'request_id': 'req-c7f2b9e0-39d1-466d-91a5-7eef224faeae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.523338 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1072/2157] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:13 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:13.523338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:13.523338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.587586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff365f63-6e6e-48ca-8892-c8697537297c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:13.593739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.594472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.594796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.595101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] PATH_INFO: `/v3/users/41fb2d0cc8654d58b3be7160e8cd1e15` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.596214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fb2d0cc8654d58b3be7160e8cd1e15)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:13.598134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.606336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] The token cache is being invalidate because project 5b00ec5234f14779b819694abbdbf3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:13.606628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.607819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.609591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1086/2158] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:13 2022] DELETE /identity/v3/projects/5b00ec5234f14779b819694abbdbf3fe => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:13.610098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:13.611506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.684044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2b9e0-39d1-466d-91a5-7eef224faeae admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:13.760603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.761221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.761504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.761783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.764298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.787720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fb2d0cc8654d58b3be7160e8cd1e15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.794536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fb2d0cc8654d58b3be7160e8cd1e15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.795279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fb2d0cc8654d58b3be7160e8cd1e15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.807037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fb2d0cc8654d58b3be7160e8cd1e15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.807732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fb2d0cc8654d58b3be7160e8cd1e15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:13.823516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:13.825166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.834747 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1087/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:13.835575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:13.836896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.849973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48916b4-95cd-4ed1-98a2-38aaaccca2fe service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:13.854587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.855262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.855543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.855846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] PATH_INFO: `/v3/projects/9439f8a11f784c8fb52a3738c3d582c6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.856965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9439f8a11f784c8fb52a3738c3d582c6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:13.858846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:13.870337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1073/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:13 2022] DELETE /identity/v3/users/41fb2d0cc8654d58b3be7160e8cd1e15 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:13.871387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:13.875299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:13.978665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856b376-3cc7-440b-8285-bdf5ad30b084 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:13.984986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:13.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:13.987811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:13.987811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:13.989867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.004761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9439f8a11f784c8fb52a3738c3d582c6', 'request_id': 'req-183df035-e960-462f-807e-d2a121700e9d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.011492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9439f8a11f784c8fb52a3738c3d582c6', 'request_id': 'req-183df035-e960-462f-807e-d2a121700e9d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.020489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9439f8a11f784c8fb52a3738c3d582c6', 'request_id': 'req-183df035-e960-462f-807e-d2a121700e9d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.058516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.060020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.074917 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1074/2161] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:14.075927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.077881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.099107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] The token cache is being invalidate because project 9439f8a11f784c8fb52a3738c3d582c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:14.099420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.108267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183df035-e960-462f-807e-d2a121700e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.108267 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1088/2162] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:13 2022] DELETE /identity/v3/projects/9439f8a11f784c8fb52a3738c3d582c6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:14.108267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149352d-c955-4d92-8313-4fa115eaba81 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.108267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149352d-c955-4d92-8313-4fa115eaba81 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.108267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149352d-c955-4d92-8313-4fa115eaba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.145918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a149352d-c955-4d92-8313-4fa115eaba81 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:14.147046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a149352d-c955-4d92-8313-4fa115eaba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.214046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bfa5-4a8e-468a-9cd9-dd30afe98189 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.238938 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1089/2163] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:14.240419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fe781-77e3-425f-8d74-8c2bc7e486db None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.240712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fe781-77e3-425f-8d74-8c2bc7e486db None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.240995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fe781-77e3-425f-8d74-8c2bc7e486db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.263709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-805fe781-77e3-425f-8d74-8c2bc7e486db None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:14.266837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-805fe781-77e3-425f-8d74-8c2bc7e486db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.276835 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1090/2164] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:14.278250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f4a7-4d26-40ca-99f9-298e81bcbecc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.278636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f4a7-4d26-40ca-99f9-298e81bcbecc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.279044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f4a7-4d26-40ca-99f9-298e81bcbecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.304472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.305331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.305515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.305800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.305967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8665f4a7-4d26-40ca-99f9-298e81bcbecc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:14.306449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.307394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8665f4a7-4d26-40ca-99f9-298e81bcbecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.308974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.317169 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1091/2165] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:14.319724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.320458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.320763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.342502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:14.343756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.352131 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1092/2166] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:14.352730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.362614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b466-e9eb-4a91-a7b3-d2e921450896 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.371466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.372233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.372916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.373358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.374315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:14.374761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.376620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.391269 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1093/2167] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:14.394669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.405318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bdfc8-cd55-43ba-b3af-0800bcf7f7fa admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.407746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:14.415512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.416212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.416694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.416805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.417481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:14.417792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.419541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1075/2168] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/users => generated 305 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:14.420858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.423895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.433822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4286e-a123-472a-8cd2-6b7767dde4af admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.452049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.452674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.453474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.453776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.454478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.457074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.461541 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1094/2169] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:14.462735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.464670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.479961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea0366-0dd4-4287-819f-ad00fa6ed4a7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.485873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.486833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.487249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.487549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] PATH_INFO: `/v3/users/02ccd58ebd8d4403aa41deb413564248` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.488971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ccd58ebd8d4403aa41deb413564248)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.491081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.566990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1076/2170] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:14.567972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.569570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.630520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:14.646281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f65bf-57dc-465f-9224-6c28b5fcdff0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.651513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.652150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.652432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.652837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] PATH_INFO: `/v3/projects/7e1511e862b044419f2b43f401856470` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.653971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1511e862b044419f2b43f401856470)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.656328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.685279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ccd58ebd8d4403aa41deb413564248'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.694514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ccd58ebd8d4403aa41deb413564248'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.695280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ccd58ebd8d4403aa41deb413564248'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.695876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ccd58ebd8d4403aa41deb413564248'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.708342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ccd58ebd8d4403aa41deb413564248'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.783206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1511e862b044419f2b43f401856470', 'request_id': 'req-234a687b-15ce-426b-8fe6-f1de9e41870c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.790349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1511e862b044419f2b43f401856470', 'request_id': 'req-234a687b-15ce-426b-8fe6-f1de9e41870c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.796229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1511e862b044419f2b43f401856470', 'request_id': 'req-234a687b-15ce-426b-8fe6-f1de9e41870c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.835716 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1095/2171] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:14 2022] DELETE /identity/v3/users/02ccd58ebd8d4403aa41deb413564248 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:14.840413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.840413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.905927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502c9d-79f3-4989-8563-67ce3040df61 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.910629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.911744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.911744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.911926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.912411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.914003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.928200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1096/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:14.928200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.928200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:14.941468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbeeeb-122e-47aa-8aac-eba25e9b4d69 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:14.946531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed27c9-1e08-47b4-a638-f3a33ec81ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:14.947187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed27c9-1e08-47b4-a638-f3a33ec81ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:14.947608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed27c9-1e08-47b4-a638-f3a33ec81ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:14.947877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed27c9-1e08-47b4-a638-f3a33ec81ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:14.948509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed27c9-1e08-47b4-a638-f3a33ec81ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:14.950412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed27c9-1e08-47b4-a638-f3a33ec81ea2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:14.966621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] The token cache is being invalidate because project 7e1511e862b044419f2b43f401856470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:14.967272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.969230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:14.972211 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1077/2173] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:14 2022] DELETE /identity/v3/projects/7e1511e862b044419f2b43f401856470 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:14.972778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:14.976173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.045854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a687b-15ce-426b-8fe6-f1de9e41870c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.051216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.051835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.052119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.052402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.053073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.054998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.073716 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1097/2174] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:15.073716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10d20-5256-4ee7-b879-d42f99a6a511 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.073716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10d20-5256-4ee7-b879-d42f99a6a511 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.073716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f10d20-5256-4ee7-b879-d42f99a6a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.096757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e8f10d20-5256-4ee7-b879-d42f99a6a511 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:15.097889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e8f10d20-5256-4ee7-b879-d42f99a6a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.150364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1078/2175] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:14 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:15.151312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.154467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.167382 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1098/2176] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:15.168432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bd38d-3c0a-406b-8be8-c289be6aaff5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.169667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.170582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.170821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.175471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.176709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.178156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.178156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] PATH_INFO: `/v3/projects/ac962a502cf849bfb744f9c83be6acb6/users/f219933dab6c4d64ad844f36b545d542/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.191195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:15.192460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.198568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac962a502cf849bfb744f9c83be6acb6, user_id=f219933dab6c4d64ad844f36b545d542, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.208366 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1099/2177] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:15.208546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.208660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.209902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.225869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6a57f-e141-442f-ab62-0e31654937e1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.233166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.234258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.236046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.236550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.238607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.240831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.319926 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1079/2178] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:15 2022] PUT /identity/v3/projects/ac962a502cf849bfb744f9c83be6acb6/users/f219933dab6c4d64ad844f36b545d542/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:15.320895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.370046 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1100/2179] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:15 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:15.372799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.398606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.405200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edaa4-542e-4e69-a545-606470346e48 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.410283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b5488-51e4-4a9c-9f6e-16599050bbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.410927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5488-51e4-4a9c-9f6e-16599050bbff admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.411252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5488-51e4-4a9c-9f6e-16599050bbff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.411535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5488-51e4-4a9c-9f6e-16599050bbff admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.412409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b5488-51e4-4a9c-9f6e-16599050bbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.414819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b5488-51e4-4a9c-9f6e-16599050bbff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.429437 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1080/2180] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:15.431285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.432764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.432764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.472397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:15.473985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:15.489192 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1081/2181] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:15.489192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.501145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ab246-49ef-4971-b47b-14649e3ee869 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.506592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f577c-69a3-4f73-84b5-cf73eb35c8fc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.508565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.509281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.511037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.511037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.511037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.512191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.523857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1082/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:15.524941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.545992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651205a-bdef-4000-a022-9a15459e2e1f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.555890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.557093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.557093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.557093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.557681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.559329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.571556 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1083/2183] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:15.572645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.576650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.576650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.576650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.576650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.583955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58a3e-8859-4fe0-a48a-d00e349fdcc6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.588689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.588912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.589520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.589807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.590078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.590699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.590798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.593046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.608386 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1084/2184] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:15.608386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.616371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab3bad-bb81-40e9-851e-0eeff776d8b5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.622763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1101/2185] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:15.624926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.625638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.625931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.626218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.626341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.626875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:15.627210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.628818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.642758 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1085/2186] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:15.644147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.651126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2cc8c-71bf-47b1-943c-7fa92a3d7f62 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.656798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bb640-040f-40b8-91ec-4849cf5cbecb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.662630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.663292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.663582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.663862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] PATH_INFO: `/v3/projects/ac962a502cf849bfb744f9c83be6acb6/users/f219933dab6c4d64ad844f36b545d542/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.665908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.666052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac962a502cf849bfb744f9c83be6acb6, user_id=f219933dab6c4d64ad844f36b545d542, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.667112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.667524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.668136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.668790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.668905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.671746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.691270 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1102/2187] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:15 2022] PUT /identity/v3/projects/ac962a502cf849bfb744f9c83be6acb6/users/f219933dab6c4d64ad844f36b545d542/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:15.691270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.691575 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1086/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:15.691575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.704125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c09f4-a2bc-4baf-8368-cf7a56a173d0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.790214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad419-5e4a-48b2-a8eb-39db2a07c2e7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:15.795398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd6de-94b5-4b45-8cc1-24185c2ced4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.802933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd6de-94b5-4b45-8cc1-24185c2ced4f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.802933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd6de-94b5-4b45-8cc1-24185c2ced4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.802933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd6de-94b5-4b45-8cc1-24185c2ced4f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.803295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:15.803411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd6de-94b5-4b45-8cc1-24185c2ced4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.803516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.803516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.803516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] PATH_INFO: `/v3/projects/5a88888b8b2e4698ae4c67198db159e8/users/cb3205571a8e40819cb6fc3532733ee7/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.803747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd6de-94b5-4b45-8cc1-24185c2ced4f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.822356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a88888b8b2e4698ae4c67198db159e8, user_id=cb3205571a8e40819cb6fc3532733ee7, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:15.825281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:15.970410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1103/2189] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:15 2022] PUT /identity/v3/projects/5a88888b8b2e4698ae4c67198db159e8/users/cb3205571a8e40819cb6fc3532733ee7/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:15.970504 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1087/2190] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:15 2022] POST /identity/v3/projects => generated 397 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:15.974078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:15.974212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059afa20-b4f3-4f88-b733-42d1b591fc21 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:15.974212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059afa20-b4f3-4f88-b733-42d1b591fc21 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:15.974212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059afa20-b4f3-4f88-b733-42d1b591fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:15.993032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:16.010175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-059afa20-b4f3-4f88-b733-42d1b591fc21 None None] MFA Rules not processed for user `f219933dab6c4d64ad844f36b545d542`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:16.011518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-059afa20-b4f3-4f88-b733-42d1b591fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.045641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aac03d-2444-4a4f-9aa3-614c63351741 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.084724 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1088/2191] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:16.086122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.086416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.086695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.105690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:16.106923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.108619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.109360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.109644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.109924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] PATH_INFO: `/v3/projects/2b2efb2577ad4c79b4ef0922a60a1b0d/users/e0f3bf660339419c8e88f29abdd87c17/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.116233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1089/2192] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:16.128922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.129052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2efb2577ad4c79b4ef0922a60a1b0d, user_id=e0f3bf660339419c8e88f29abdd87c17, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.129172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ae5ad-7c0f-4d4f-8a6f-eb6cbd9e1c8d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.129251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.132541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.133070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.133350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.133633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.134274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.136270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.217800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1104/2193] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:15 2022] PUT /identity/v3/projects/2b2efb2577ad4c79b4ef0922a60a1b0d/users/e0f3bf660339419c8e88f29abdd87c17/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:16.219400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.221235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.270678 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1090/2194] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:16 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:16.271598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.275279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.297533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17949d-c154-4011-8d84-a6c458b48f0c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.303117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.303722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.304000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.304276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.331928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c683a-bde0-4f77-b9fb-f0f481961894 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.368225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.369843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.380943 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1105/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:16.381570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.382890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.391595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eb03c-9b01-46fe-9434-fd2fd9d9e10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.392209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eb03c-9b01-46fe-9434-fd2fd9d9e10b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.392489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eb03c-9b01-46fe-9434-fd2fd9d9e10b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.392762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eb03c-9b01-46fe-9434-fd2fd9d9e10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.455989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d990a-be6b-41ff-81ad-98d29347ab10 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.459698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7eb03c-9b01-46fe-9434-fd2fd9d9e10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.461251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7eb03c-9b01-46fe-9434-fd2fd9d9e10b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.461992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.463248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.463549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.463810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] PATH_INFO: `/v3/projects/6d84cdc2d35b477d9a43aead8ad9f51c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.464946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d84cdc2d35b477d9a43aead8ad9f51c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.466986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.471375 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1091/2196] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:16.472620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.474516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.474516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.503465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] MFA Rules not processed for user `e0f3bf660339419c8e88f29abdd87c17`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:16.504685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.571248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1092/2197] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:16.572099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.582637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef28f7-d0bf-4e26-82cb-dffcdd836c1c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.589266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.595751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.595751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.595751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.595751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.595751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.606139 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1093/2198] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:16.606139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.615966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a9a04-767d-45d3-9947-1c76aa8f68f9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.621532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.622128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.622678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.623605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.624279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.626207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.640667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:16.661343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d84cdc2d35b477d9a43aead8ad9f51c', 'request_id': 'req-63daf119-e083-4448-82fa-7939f8432863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:16.669093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d84cdc2d35b477d9a43aead8ad9f51c', 'request_id': 'req-63daf119-e083-4448-82fa-7939f8432863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:16.677143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d84cdc2d35b477d9a43aead8ad9f51c', 'request_id': 'req-63daf119-e083-4448-82fa-7939f8432863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:16.779800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] The token cache is being invalidate because project 6d84cdc2d35b477d9a43aead8ad9f51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:16.779800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:16.779800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:16.779800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1106/2199] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:16 2022] DELETE /identity/v3/projects/6d84cdc2d35b477d9a43aead8ad9f51c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:16.780167 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1094/2200] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:16 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:16.780244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.780244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.780374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.782006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.871038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2c641-9d23-4e10-a546-1e1797e5caf5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.877035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.878006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.878488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.879248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] PATH_INFO: `/v3/users/8de15d3d89a248b3aa5f80de1142fcb1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.880980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de15d3d89a248b3aa5f80de1142fcb1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.883842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.898871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daf119-e083-4448-82fa-7939f8432863 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.906539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.907327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.907646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.908001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.908754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.910801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:16.926826 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1107/2201] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:16.927788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:16.929579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:16.953775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469058-bbc7-4c1c-a21e-1c0563cd4508 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:16.954519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:16.955291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:16.956099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:16.956390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:16.957029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:16.958964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.094099 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1108/2202] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:16 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:17.095209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.105320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c57e05-b200-4dbf-a4f0-4ab2c66793e8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:17.120581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4b841-6446-4d16-91a6-a61ad02bc2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:17.121796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b841-6446-4d16-91a6-a61ad02bc2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.122097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de15d3d89a248b3aa5f80de1142fcb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:17.124449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b841-6446-4d16-91a6-a61ad02bc2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.125106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b841-6446-4d16-91a6-a61ad02bc2f9 admin admin] PATH_INFO: `/v3/projects/437799e22df2433a83eca67987e942c6/users/d9f88a4c72854cff9bba7ed2920f55b0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.131871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de15d3d89a248b3aa5f80de1142fcb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:17.133332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de15d3d89a248b3aa5f80de1142fcb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:17.152780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4b841-6446-4d16-91a6-a61ad02bc2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=437799e22df2433a83eca67987e942c6, user_id=d9f88a4c72854cff9bba7ed2920f55b0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:17.161068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4b841-6446-4d16-91a6-a61ad02bc2f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.163586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de15d3d89a248b3aa5f80de1142fcb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:17.163586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de15d3d89a248b3aa5f80de1142fcb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:17.280008 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1095/2203] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:16 2022] DELETE /identity/v3/users/8de15d3d89a248b3aa5f80de1142fcb1 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:17.282576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.285032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:17.291795 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1109/2204] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:17 2022] PUT /identity/v3/projects/437799e22df2433a83eca67987e942c6/users/d9f88a4c72854cff9bba7ed2920f55b0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:17.297376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.297767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.298162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.320302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:17.322843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:17.409254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0162-67fe-46cf-b083-8c75c271b7ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:17.416985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:17.422058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.422058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.422058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.422058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:17.422058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.423544 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1110/2205] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:51:17.443082 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1096/2206] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:17.444419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.456415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.456415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:17.462424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4709e8-2a42-44aa-9474-65c7fb9b9da2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:17.488910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:17.488910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.495168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.496460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] PATH_INFO: `/v3/projects/cce00c89260b498a878f7d5dddcc71ab/users/143f9a1cefa44d94a90650d5ba44e284/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.558937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce00c89260b498a878f7d5dddcc71ab, user_id=143f9a1cefa44d94a90650d5ba44e284, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:17.562729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.570685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b843b-e753-4167-8a04-4d09fa4f9861 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:17.575617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:17.577388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.577820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.578087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.611641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:17.613994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.630148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1097/2207] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:17.679555 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1111/2208] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:17 2022] PUT /identity/v3/projects/cce00c89260b498a878f7d5dddcc71ab/users/143f9a1cefa44d94a90650d5ba44e284/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:17.683347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.699329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb92e3-fecc-4c71-864a-123b4238b129 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:17.847197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc70a-d963-4bb7-b3c1-64eb0e9097ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:17.848122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc70a-d963-4bb7-b3c1-64eb0e9097ff admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.848553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc70a-d963-4bb7-b3c1-64eb0e9097ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.848969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc70a-d963-4bb7-b3c1-64eb0e9097ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.851695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc70a-d963-4bb7-b3c1-64eb0e9097ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:17.854405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc70a-d963-4bb7-b3c1-64eb0e9097ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.871213 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1098/2209] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:51:17.876595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.896603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e742-10e9-44e7-b2c5-f3d7cee23532 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:17.904488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:17.905620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.912222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.912222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] PATH_INFO: `/v3/projects/cce00c89260b498a878f7d5dddcc71ab/users/143f9a1cefa44d94a90650d5ba44e284/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.915109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce00c89260b498a878f7d5dddcc71ab, user_id=143f9a1cefa44d94a90650d5ba44e284, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:17.918068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:17.941187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1112/2210] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:17 2022] PUT /identity/v3/projects/cce00c89260b498a878f7d5dddcc71ab/users/143f9a1cefa44d94a90650d5ba44e284/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:51:17.943723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:17.944126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:17.944483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:17.985333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:17.994226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:18.038651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] MFA Rules not processed for user `143f9a1cefa44d94a90650d5ba44e284`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:18.039955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:18.122976 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1099/2211] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:51:18.173253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73fb0-a7a1-43b8-aeac-ec1a8ce7347d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:18.181941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:18.182574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:18.182855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:18.183214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:18.185007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:18.274471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:18.276132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:18.288767 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1113/2212] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:18.327708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:18.341478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5243-2bc3-407f-8b47-35ec2a44521c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:18.349427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab246e-58e7-4dd6-88c1-4787aa562b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:18.352459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab246e-58e7-4dd6-88c1-4787aa562b4e service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:18.353568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab246e-58e7-4dd6-88c1-4787aa562b4e service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:18.353993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab246e-58e7-4dd6-88c1-4787aa562b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:18.365484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab246e-58e7-4dd6-88c1-4787aa562b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:18.367411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab246e-58e7-4dd6-88c1-4787aa562b4e service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:18.395731 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1100/2213] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:18.697105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:18.698648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:18.813657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cff9e9-a32a-4283-a965-36a66812a906 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:18.821703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:18.822679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:18.823181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:18.823837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] PATH_INFO: `/v3/projects/eacddf449a304b7bb1eda6b547a102ba` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:18.825633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacddf449a304b7bb1eda6b547a102ba)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:18.830141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:19.024431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacddf449a304b7bb1eda6b547a102ba', 'request_id': 'req-826d7716-2559-437c-9ddc-dacc2c586e4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:19.039172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacddf449a304b7bb1eda6b547a102ba', 'request_id': 'req-826d7716-2559-437c-9ddc-dacc2c586e4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:19.062909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacddf449a304b7bb1eda6b547a102ba', 'request_id': 'req-826d7716-2559-437c-9ddc-dacc2c586e4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:19.221367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] The token cache is being invalidate because project eacddf449a304b7bb1eda6b547a102ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:19.228793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:19.229733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-826d7716-2559-437c-9ddc-dacc2c586e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:19.235002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1114/2214] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:18 2022] DELETE /identity/v3/projects/eacddf449a304b7bb1eda6b547a102ba => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:19.240372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:19.241229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:19.241837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:19.291313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:19.292713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:19.390372 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1101/2215] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:19.398554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:19.398969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:19.399316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:19.438600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:19.445131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:19.489459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:19.490560 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1115/2216] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:19.509250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f918ea7-9622-4d95-aee6-24a2d32ffa51 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:19.516753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:19.517156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:19.517512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:19.517867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:19.518594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:19.518973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:19.524697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:19.540325 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1102/2217] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:19.544217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:19.554727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c7a1-26ea-44a8-84ad-b32b1fc0f3fc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:19.559862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:19.562153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:19.562424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:19.562980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:19.563831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:19.566716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:19.575178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:19.722218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:19.722858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1116/2218] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:19 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:19.735196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d96f7b-9222-4134-96bd-c4c3f79e7d06 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:19.865237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:19.866006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:19.871455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:19.871455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:19.871455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:19.871455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:19.981537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1103/2219] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:19 2022] POST /identity/v3/users => generated 286 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:19.985523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:20.003627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a776f-18f0-4551-937a-932a868d8b6d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:20.016080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:20.016968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:20.017417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:20.017936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:20.018749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:20.020824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:20.051743 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1117/2220] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:20.053119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:20.074754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb26c7-a1bf-4740-a5a5-9a1b2922ea02 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:20.104869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b38d4-579a-4e35-91f8-70cdb8015563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:20.104869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b38d4-579a-4e35-91f8-70cdb8015563 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:20.104869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b38d4-579a-4e35-91f8-70cdb8015563 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:20.104869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b38d4-579a-4e35-91f8-70cdb8015563 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:20.105248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b38d4-579a-4e35-91f8-70cdb8015563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:20.109163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b38d4-579a-4e35-91f8-70cdb8015563 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:20.151797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1104/2221] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:20.153059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:20.168469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911877-017b-48ff-9341-01dea82df55b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:20.174890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:20.175829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:20.176210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:20.176526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] PATH_INFO: `/v3/projects/fb1af95268504c5bbed702fce756f5f4/users/c4e1ac1b40e94dbc80548a1f45919b6f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:20.204265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1af95268504c5bbed702fce756f5f4, user_id=c4e1ac1b40e94dbc80548a1f45919b6f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:20.207755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:20.309599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:20.320924 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1118/2222] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:20 2022] PUT /identity/v3/projects/fb1af95268504c5bbed702fce756f5f4/users/c4e1ac1b40e94dbc80548a1f45919b6f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:20.326305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:20.326710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:20.327188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:20.390137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:20.391884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:20.492175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:20.493055 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1105/2223] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:20.497281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:20.511095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:20.512572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:20.518789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fa193-ad57-4cca-8442-30402f1763a1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:20.536590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:20.537896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:20.538856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:20.554856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] PATH_INFO: `/v3/users/e0f3bf660339419c8e88f29abdd87c17` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:20.557435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f3bf660339419c8e88f29abdd87c17)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:20.566941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:20.627977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9400c05-b09b-4132-9b35-2fea8e3ee301 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:20.633123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11f41-4d24-4cc0-9064-6bbc0811c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:20.634116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11f41-4d24-4cc0-9064-6bbc0811c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:20.634634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11f41-4d24-4cc0-9064-6bbc0811c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:20.634989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11f41-4d24-4cc0-9064-6bbc0811c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:20.649018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11f41-4d24-4cc0-9064-6bbc0811c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:20.652061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11f41-4d24-4cc0-9064-6bbc0811c0f2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:20.673352 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1106/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:20.925081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f3bf660339419c8e88f29abdd87c17'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:20.936287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f3bf660339419c8e88f29abdd87c17'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:20.937278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f3bf660339419c8e88f29abdd87c17'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:20.938028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f3bf660339419c8e88f29abdd87c17'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:20.962061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f3bf660339419c8e88f29abdd87c17'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:21.079721 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1119/2225] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:20 2022] DELETE /identity/v3/users/e0f3bf660339419c8e88f29abdd87c17 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:21.083023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:21.083932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:21.084592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:21.133098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:21.137205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:21.309516 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1107/2226] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:21.339702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:21.393423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:21.395173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:21.528965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507e044-6217-4e53-b1a8-0861dfd28258 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:21.536345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:21.536974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:21.537261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:21.537539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:21.550895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:21.552406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:21.571108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1120/2227] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:22.004810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:22.562466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:23.146068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:23.298884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:23.300515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:23.314007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feb24f-afe7-4efb-9b78-47d76dd693b3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:23.319255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:23.320273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:23.320273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:23.320448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] PATH_INFO: `/v3/projects/2b2efb2577ad4c79b4ef0922a60a1b0d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:23.321693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2efb2577ad4c79b4ef0922a60a1b0d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:23.323877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:23.530906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2efb2577ad4c79b4ef0922a60a1b0d', 'request_id': 'req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:23.546970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2efb2577ad4c79b4ef0922a60a1b0d', 'request_id': 'req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:23.559111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2efb2577ad4c79b4ef0922a60a1b0d', 'request_id': 'req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:23.663296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] The token cache is being invalidate because project 2b2efb2577ad4c79b4ef0922a60a1b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:23.664034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:23.664285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:23.666386 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1108/2228] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:23 2022] DELETE /identity/v3/projects/2b2efb2577ad4c79b4ef0922a60a1b0d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:23.670731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:23.690152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d250e8-f1ad-4db2-82aa-54d66bc204a4 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:23.734378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:23.785033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:23.787880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:23.788421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:23.788890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] PATH_INFO: `/v3/users/143f9a1cefa44d94a90650d5ba44e284` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:23.790432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143f9a1cefa44d94a90650d5ba44e284)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:23.797273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:23.864599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:23.866977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:23.910922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51c96f-ea5b-4d08-bfda-e2e6d6fac1e8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:23.941979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:23.943073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:23.943719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:23.943997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] PATH_INFO: `/v3/users/a642f5be336548aea66f2ca1f7213e21` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:23.945928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a642f5be336548aea66f2ca1f7213e21)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:23.951706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:24.127656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143f9a1cefa44d94a90650d5ba44e284'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.141078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143f9a1cefa44d94a90650d5ba44e284'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.141078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143f9a1cefa44d94a90650d5ba44e284'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.141078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143f9a1cefa44d94a90650d5ba44e284'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.157489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e86904d1-9834-4d09-a426-97f5f0b583d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143f9a1cefa44d94a90650d5ba44e284'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.262323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a642f5be336548aea66f2ca1f7213e21'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.277317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a642f5be336548aea66f2ca1f7213e21'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.281268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a642f5be336548aea66f2ca1f7213e21'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.304413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a642f5be336548aea66f2ca1f7213e21'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.306039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a642f5be336548aea66f2ca1f7213e21'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:24.336593 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1121/2229] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:23 2022] DELETE /identity/v3/users/143f9a1cefa44d94a90650d5ba44e284 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:24.418327 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1109/2230] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:23 2022] DELETE /identity/v3/users/a642f5be336548aea66f2ca1f7213e21 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:51:24.423138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:24.423650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:24.424135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:24.460534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:24.462057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:24.528379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:24.631984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1122/2231] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:24.652751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:24.654803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:24.762215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954d90d-ada7-4067-85e7-05cf253eb07e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:24.767682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b589d9-216d-4487-a06a-5fed23648496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:24.770286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b589d9-216d-4487-a06a-5fed23648496 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:24.771148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b589d9-216d-4487-a06a-5fed23648496 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:24.771699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b589d9-216d-4487-a06a-5fed23648496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:24.802826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b589d9-216d-4487-a06a-5fed23648496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:24.806932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b589d9-216d-4487-a06a-5fed23648496 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:24.840923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1110/2232] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:25.040766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:26.198272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:26.254137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:26.255654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:26.276657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceaaf9-ac29-4155-96e3-b5366f83aa93 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:26.293685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:26.294351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:26.295389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:26.295853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] PATH_INFO: `/v3/projects/cce00c89260b498a878f7d5dddcc71ab` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:26.297958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce00c89260b498a878f7d5dddcc71ab)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:26.301224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:26.486423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce00c89260b498a878f7d5dddcc71ab', 'request_id': 'req-b359b7ec-1310-4589-9631-dcf8de33a723'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:26.513227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce00c89260b498a878f7d5dddcc71ab', 'request_id': 'req-b359b7ec-1310-4589-9631-dcf8de33a723'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:26.532591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce00c89260b498a878f7d5dddcc71ab', 'request_id': 'req-b359b7ec-1310-4589-9631-dcf8de33a723'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:26.661267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] The token cache is being invalidate because project cce00c89260b498a878f7d5dddcc71ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:26.663906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:26.665926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:26.668429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1123/2233] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:26 2022] DELETE /identity/v3/projects/cce00c89260b498a878f7d5dddcc71ab => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:26.673586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ee9c7-8d90-4acd-9eb8-6cc13907e3af None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:26.674509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ee9c7-8d90-4acd-9eb8-6cc13907e3af None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:26.674999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ee9c7-8d90-4acd-9eb8-6cc13907e3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:26.705415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4c6ee9c7-8d90-4acd-9eb8-6cc13907e3af None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:26.707225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4c6ee9c7-8d90-4acd-9eb8-6cc13907e3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:26.730122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:26.741127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:26.846565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1111/2234] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:26.846725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:26.862704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:26.862704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:26.862704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:26.881365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:26.883326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:26.898233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1112/2235] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:26.908068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:26.919345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603af16-5ca0-4380-94ae-c5de7484dd8f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:26.927986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:26.928964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:26.929456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:26.929951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:26.930828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:26.931413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:26.936569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:26.958543 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1113/2236] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:26.959793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:26.973043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665c39c-081b-4a8e-a0cb-ae7d882c81fc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:26.979868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:26.984817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:26.984817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:26.984817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:26.987203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:26.991836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.014925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359b7ec-1310-4589-9631-dcf8de33a723 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:27.035359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:27.036271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.036712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.037922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] PATH_INFO: `/v3/projects/6a7773842cb74c92878a6e62fb2dab36` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.044128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7773842cb74c92878a6e62fb2dab36)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:27.047173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.122220 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1114/2237] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:26 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:27.126435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:27.229735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7773842cb74c92878a6e62fb2dab36', 'request_id': 'req-ac3e7dc9-31cd-4595-9728-b4195a329122'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.240802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7773842cb74c92878a6e62fb2dab36', 'request_id': 'req-ac3e7dc9-31cd-4595-9728-b4195a329122'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.260951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7773842cb74c92878a6e62fb2dab36', 'request_id': 'req-ac3e7dc9-31cd-4595-9728-b4195a329122'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.287534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5783e-4efa-451e-8894-8c1cdf74d3a2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:27.370591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] The token cache is being invalidate because project 6a7773842cb74c92878a6e62fb2dab36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:27.370591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.370591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.378308 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1124/2238] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:26 2022] DELETE /identity/v3/projects/6a7773842cb74c92878a6e62fb2dab36 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:27.382708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:27.384391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:27.401096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:27.402143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.402755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.403184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.404483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:27.407554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.541659 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1115/2239] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:27 2022] POST /identity/v3/users => generated 288 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:27.545654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:27.548884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:27.564440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7dc9-31cd-4595-9728-b4195a329122 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:27.572656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7e3c-4aa2-48c7-a128-d2bdc27e2ef0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:27.574483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:27.575409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.575643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.576518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] PATH_INFO: `/v3/users/f219933dab6c4d64ad844f36b545d542` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.586693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:27.587725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.588188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.588621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.589518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:27.592002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.592177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f219933dab6c4d64ad844f36b545d542)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:27.596422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.618380 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1116/2240] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:27.619266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:27.638382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd871b0-1169-4dd4-a70d-7beed29200f9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:27.645501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:27.646797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.647124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.647724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.654399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:27.657871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.675670 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1117/2241] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:27.677889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:27.713605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abe00-25c7-414f-8d25-60e6f53626c8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:27.728106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fb6a7-5487-49c6-9219-b09f9b03d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:27.728965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb6a7-5487-49c6-9219-b09f9b03d2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.729258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb6a7-5487-49c6-9219-b09f9b03d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.730039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb6a7-5487-49c6-9219-b09f9b03d2c5 admin admin] PATH_INFO: `/v3/projects/6762d983fa9a424893de242cdb9ce3e1/users/26932ae8c6af401ba81b4e34c490fc8d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.775071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb6a7-5487-49c6-9219-b09f9b03d2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6762d983fa9a424893de242cdb9ce3e1, user_id=26932ae8c6af401ba81b4e34c490fc8d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:27.781813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fb6a7-5487-49c6-9219-b09f9b03d2c5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:27.860487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f219933dab6c4d64ad844f36b545d542'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.867102 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1118/2242] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:27 2022] PUT /identity/v3/projects/6762d983fa9a424893de242cdb9ce3e1/users/26932ae8c6af401ba81b4e34c490fc8d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:27.878777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:27.879259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:27.879712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:27.881210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f219933dab6c4d64ad844f36b545d542'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.886030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f219933dab6c4d64ad844f36b545d542'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.887256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f219933dab6c4d64ad844f36b545d542'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.922626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f219933dab6c4d64ad844f36b545d542'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:27.992356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] MFA Rules not processed for user `26932ae8c6af401ba81b4e34c490fc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:27.993807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:27.996917 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1125/2243] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:27 2022] DELETE /identity/v3/users/f219933dab6c4d64ad844f36b545d542 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:28.218245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:28.218499 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1119/2244] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:28.220619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:28.250751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:28.393437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:28.410900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f9f89-cc37-4093-b740-9b2ba28b2e30 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:28.430990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:28.433452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:28.433933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:28.434307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:28.439992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:28.448915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:28.613985 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1126/2245] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:28 2022] POST /identity/v3/projects => generated 373 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:28.619193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:28.791730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f315fba-b474-47ad-9c3c-c3a68c0e02e3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:28.926329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:28.930995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:28.930995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:28.930995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:28.930995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:28.930995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:29.078681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:29.081422 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1120/2246] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:28 2022] POST /identity/v3/users => generated 293 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:29.104047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e721d-e126-475b-8b81-ac9dcf56403b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:29.115417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:29.115417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:29.115417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:29.115417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:29.115762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:29.115762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:29.152655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1127/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:29.159458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:29.176637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b94604-6520-4885-8b34-b15ce6cdd691 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:29.186375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:29.187141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:29.187441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:29.187724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] PATH_INFO: `/v3/projects/0e0263796d604e1b909fe9f25774ebca/users/f994c8b554b54f46b965174b82d0d865/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:29.263830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0263796d604e1b909fe9f25774ebca, user_id=f994c8b554b54f46b965174b82d0d865, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:29.267770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:29.365324 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1121/2248] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:29 2022] PUT /identity/v3/projects/0e0263796d604e1b909fe9f25774ebca/users/f994c8b554b54f46b965174b82d0d865/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:29.368235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:29.384753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:29.403033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0fee9-ae09-4a63-bfaf-2fcb0f843299 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:29.571891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:29.572793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:29.573223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:29.579709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:29.580916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:29.582954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:29.610761 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1128/2249] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:29.615503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:29.635701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bc61a-69f6-4dba-bd40-f421bd83b6ca admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:29.649298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:29.649618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178711e8-c8e9-434d-bf4f-b4b91c2078f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:29.650628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178711e8-c8e9-434d-bf4f-b4b91c2078f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:29.651099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178711e8-c8e9-434d-bf4f-b4b91c2078f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:29.651604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178711e8-c8e9-434d-bf4f-b4b91c2078f3 admin admin] PATH_INFO: `/v3/projects/0e0263796d604e1b909fe9f25774ebca/users/f994c8b554b54f46b965174b82d0d865/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:29.651827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:29.658454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178711e8-c8e9-434d-bf4f-b4b91c2078f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0263796d604e1b909fe9f25774ebca, user_id=f994c8b554b54f46b965174b82d0d865, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:29.661693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178711e8-c8e9-434d-bf4f-b4b91c2078f3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:29.682176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f8fe0-a4cd-4a79-bf9b-e42aa24c2164 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:29.722262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1122/2250] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:29 2022] PUT /identity/v3/projects/0e0263796d604e1b909fe9f25774ebca/users/f994c8b554b54f46b965174b82d0d865/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:29.725048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef6a7-2cf3-4bdd-a87e-e47d29fd51f0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:29.725341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef6a7-2cf3-4bdd-a87e-e47d29fd51f0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:29.725622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef6a7-2cf3-4bdd-a87e-e47d29fd51f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:29.830770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6c3ef6a7-2cf3-4bdd-a87e-e47d29fd51f0 None None] MFA Rules not processed for user `f994c8b554b54f46b965174b82d0d865`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:29.834178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c3ef6a7-2cf3-4bdd-a87e-e47d29fd51f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:29.896956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:29.898227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:29.898517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:29.898974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] PATH_INFO: `/v3/projects/ac962a502cf849bfb744f9c83be6acb6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:29.909219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac962a502cf849bfb744f9c83be6acb6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:29.911782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:30.053421 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1123/2251] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:30.055966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.055966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.056300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.090591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] MFA Rules not processed for user `cb3205571a8e40819cb6fc3532733ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:30.093012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:30.096978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac962a502cf849bfb744f9c83be6acb6', 'request_id': 'req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:30.127796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac962a502cf849bfb744f9c83be6acb6', 'request_id': 'req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:30.154654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac962a502cf849bfb744f9c83be6acb6', 'request_id': 'req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:30.214839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1124/2252] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:30.215678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:30.268449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] The token cache is being invalidate because project ac962a502cf849bfb744f9c83be6acb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:30.268886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:30.270706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:30.272635 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1129/2253] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:29 2022] DELETE /identity/v3/projects/ac962a502cf849bfb744f9c83be6acb6 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:30.273566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:30.276361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:30.380198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed95a-2af2-48f2-9a1b-11a8378d51ac None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:30.388437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:30.393384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:30.395541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.396803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.397443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.400196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:30.401990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:30.403830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2fd00-9d07-4202-9fad-ee3142b2bd2b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:30.427561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4cb0-33a3-448c-b20b-8f774e5f4dac admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:30.437145 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1125/2254] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:30.441232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c9e9c-c9bf-4050-b8ea-af0dbdf6a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:30.441590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.442419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c9e9c-c9bf-4050-b8ea-af0dbdf6a079 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.442940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c9e9c-c9bf-4050-b8ea-af0dbdf6a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.443506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c9e9c-c9bf-4050-b8ea-af0dbdf6a079 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.444371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c9e9c-c9bf-4050-b8ea-af0dbdf6a079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:30.445155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.445470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.446970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c9e9c-c9bf-4050-b8ea-af0dbdf6a079 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:30.503372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:30.506841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:30.530132 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1126/2255] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:30.540685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:30.545881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:30.572126 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1130/2256] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:30 2022] POST /identity/v3/projects => generated 403 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:30.574058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.576504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.577024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.584323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba25d2b-304d-4ff8-a26d-fb65bd47d44b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:30.625255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:30.630281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:30.721210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:30.722148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.722437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.722947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.723950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:30.725942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:30.773392 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1131/2257] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:30.774754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:30.787872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3780-0bb5-4497-a6a2-a82f97f26c19 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:30.800749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:30.801593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:30.808259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:30.808259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:30.808259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:30.808259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:30.842829 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1127/2258] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:30 2022] POST /identity/v3/projects => generated 367 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:30.843953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:30.947791 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1132/2259] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:30 2022] POST /identity/v3/users => generated 308 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:30.949357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:30.984790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784463-506e-4979-9e3b-6b6abd70d4fc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.009803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84296e38-64bf-470d-87d5-6ce9ccbf5fa1 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.025139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.027509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.029368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.029767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.030556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:31.032545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.036400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.048586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:31.068787 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1128/2260] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:31.068787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.093154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472be3d-0c21-43fa-87a6-937fce3aa866 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.107491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.108717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.108717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.108969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.109783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:31.110183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.112751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.119270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.120526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.120526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.120526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.123773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.128358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.135670 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1133/2261] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:31.135670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.160280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1129/2262] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:31.164915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.170660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:31.183936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948765e0-6c56-45ec-984f-92e2657962b8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.188839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.189564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.189921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.190274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.190987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.194237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.303682 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1134/2263] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:31 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:31.304889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.338667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf02085-7809-450a-a14d-0a04f8afa282 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.418230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988e408-0d3c-4105-9b7d-e0c2d358f7f7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.425717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.430630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.430630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.430630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] PATH_INFO: `/v3/projects/28b8a026daa8470088129962d493ca68/users/d2a12eeff77c4fda8921764118c48863/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.455575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8a026daa8470088129962d493ca68, user_id=d2a12eeff77c4fda8921764118c48863, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.458627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.486096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.495226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.495226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.495226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.585118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1135/2264] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:31 2022] PUT /identity/v3/projects/28b8a026daa8470088129962d493ca68/users/d2a12eeff77c4fda8921764118c48863/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:31.586459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.589683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:31.600027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:31.612423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.614065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.641080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1130/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:31.648476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.661971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd97cb0-fd34-41ef-b01b-e1616d1aed83 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.747438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.749843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.750467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.751081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.752753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.755391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.781826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fc99-287d-42e5-ac33-29f0ddc9a460 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:31.797666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:31.798359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:31.798525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:31.798802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] PATH_INFO: `/v3/users/3ff6ad8e78ca4b6dbea50007a5737f5e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:31.800068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff6ad8e78ca4b6dbea50007a5737f5e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:31.802038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:31.940590 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1131/2266] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:31 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:31.942778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:31.984219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01edfc1-3918-43a6-b8ac-3d3332b3dd5e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.005851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827ad64-c8f7-49ea-8a3c-da6f22b5c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.008264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827ad64-c8f7-49ea-8a3c-da6f22b5c82c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.008836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827ad64-c8f7-49ea-8a3c-da6f22b5c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.009576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827ad64-c8f7-49ea-8a3c-da6f22b5c82c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.010749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827ad64-c8f7-49ea-8a3c-da6f22b5c82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.013026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827ad64-c8f7-49ea-8a3c-da6f22b5c82c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.031671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1132/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:32.037300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad2a3-2cbf-45a2-acdf-eda52869ae8c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.037594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad2a3-2cbf-45a2-acdf-eda52869ae8c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.037878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad2a3-2cbf-45a2-acdf-eda52869ae8c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.039594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1133/2268] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:51:32.040724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad2a3-2cbf-45a2-acdf-eda52869ae8c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.087296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad2a3-2cbf-45a2-acdf-eda52869ae8c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.103881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b449bd-959b-411b-a98e-0052c80a2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.104515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b449bd-959b-411b-a98e-0052c80a2883 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.104901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b449bd-959b-411b-a98e-0052c80a2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.105080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b449bd-959b-411b-a98e-0052c80a2883 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.115407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b449bd-959b-411b-a98e-0052c80a2883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.122441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b449bd-959b-411b-a98e-0052c80a2883 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.151251 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1134/2269] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:32.151251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.151995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.152277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.161769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff6ad8e78ca4b6dbea50007a5737f5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:32.178383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff6ad8e78ca4b6dbea50007a5737f5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:32.179217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff6ad8e78ca4b6dbea50007a5737f5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:32.180219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff6ad8e78ca4b6dbea50007a5737f5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:32.193073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] MFA Rules not processed for user `d9f88a4c72854cff9bba7ed2920f55b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:32.198840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.218116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff6ad8e78ca4b6dbea50007a5737f5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:32.296694 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1136/2270] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:31 2022] DELETE /identity/v3/users/3ff6ad8e78ca4b6dbea50007a5737f5e => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:32.296694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.298495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.318912 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1135/2271] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:32.320246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:51:32.324507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.426885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc64b-1c24-4083-8bd2-d3d83c576eb1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.438200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.439545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.440214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.440580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] PATH_INFO: `/v3/projects/28b8a026daa8470088129962d493ca68/users/d2a12eeff77c4fda8921764118c48863/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.447295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8a026daa8470088129962d493ca68, user_id=d2a12eeff77c4fda8921764118c48863, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.453143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.496290 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1137/2272] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:32 2022] PUT /identity/v3/projects/28b8a026daa8470088129962d493ca68/users/d2a12eeff77c4fda8921764118c48863/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:32.496290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.502290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.526173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.527925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.602009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443864f-3052-492b-84f0-4add88308b98 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.607678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17ec78-f495-4e47-ae66-f2512294930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.608302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17ec78-f495-4e47-ae66-f2512294930e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.608584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17ec78-f495-4e47-ae66-f2512294930e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.608857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17ec78-f495-4e47-ae66-f2512294930e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.609916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17ec78-f495-4e47-ae66-f2512294930e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.611238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17ec78-f495-4e47-ae66-f2512294930e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.626089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1138/2273] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:32.629043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.629342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.630769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.668476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:32.670178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.685805 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1139/2274] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:32.686713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.688438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:32.688954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161bc0a-d349-4736-bbd4-98778d369310 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.702520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6cc7-c65a-42ab-9172-f40265228374 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.709416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.710051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.710387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.710667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.711360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.713592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.806288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.807145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.807436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.807990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/projects/7c0e46bde29145e0849ca2f92c145654` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.810777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:get_project(project_id=7c0e46bde29145e0849ca2f92c145654)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.814841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.822680 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1136/2275] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:51:32 2022] GET /identity/v3/projects/7c0e46bde29145e0849ca2f92c145654 => generated 367 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:32.823753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.850172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629592-1a91-44aa-8893-3c0a28ea6b7b tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:32.862375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:32.863828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:32.863828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:32.863828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] PATH_INFO: `/v3/projects/de9e608da6374619b6f3df4d214dc065/users/ec72b141a68542a7b7e24b4d0cf8a133/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:32.890719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9e608da6374619b6f3df4d214dc065, user_id=ec72b141a68542a7b7e24b4d0cf8a133, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:32.895748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:32.944728 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1140/2276] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:32 2022] POST /identity/v3/projects => generated 395 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:32.945834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:32.951741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:33.021417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1137/2277] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:32 2022] PUT /identity/v3/projects/de9e608da6374619b6f3df4d214dc065/users/ec72b141a68542a7b7e24b4d0cf8a133/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:33.033003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:33.070485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aba4b-5de4-489e-9623-0521a8e0ac6b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:33.220797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d54215-7b5c-4f4f-a156-5c7ceb5ac199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:33.225271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54215-7b5c-4f4f-a156-5c7ceb5ac199 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:33.225609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54215-7b5c-4f4f-a156-5c7ceb5ac199 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:33.225889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54215-7b5c-4f4f-a156-5c7ceb5ac199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:33.304980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676ac49-b676-4321-a9f5-cac524b6ea70 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:33.321571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eefe74-d2aa-4b93-8d48-1177b1c8f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:33.322861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefe74-d2aa-4b93-8d48-1177b1c8f17c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:33.323401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefe74-d2aa-4b93-8d48-1177b1c8f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:33.323681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefe74-d2aa-4b93-8d48-1177b1c8f17c admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:33.324346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefe74-d2aa-4b93-8d48-1177b1c8f17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:33.329079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefe74-d2aa-4b93-8d48-1177b1c8f17c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:33.440064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d54215-7b5c-4f4f-a156-5c7ceb5ac199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:33.447942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d54215-7b5c-4f4f-a156-5c7ceb5ac199 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:33.469217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1141/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:33.487343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:33.487343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:33.487343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:33.521876 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1138/2279] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:33 2022] POST /identity/v3/users => generated 304 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:33.526343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467867-9d86-408c-8d2f-50b1c1bee22e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:33.526733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467867-9d86-408c-8d2f-50b1c1bee22e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:33.527728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467867-9d86-408c-8d2f-50b1c1bee22e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:33.530536 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1139/2280] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:51:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:51:33.537814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d467867-9d86-408c-8d2f-50b1c1bee22e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:33.541425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] MFA Rules not processed for user `ec72b141a68542a7b7e24b4d0cf8a133`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:33.542994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:33.566005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d467867-9d86-408c-8d2f-50b1c1bee22e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:33.593247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:33.603803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:33.604904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:33.605182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:33.605951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:33.608587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:33.653549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1140/2281] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:33.655481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:51:33.737453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1142/2282] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:33.743175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:33.759649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:33.778940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4ce08-e57f-494f-9b23-bd7b0f7cd524 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:33.787386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:33.789192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:33.789770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:33.790286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] PATH_INFO: `/v3/projects/03ee8cf2ad5141c5b8d7c4c935a409bd/users/fe55f7413ca34eb6af1c74a7f5e6ade3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:33.815977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ee8cf2ad5141c5b8d7c4c935a409bd, user_id=fe55f7413ca34eb6af1c74a7f5e6ade3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:33.820411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:33.837020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:33.955669 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1143/2283] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:33 2022] PUT /identity/v3/projects/03ee8cf2ad5141c5b8d7c4c935a409bd/users/fe55f7413ca34eb6af1c74a7f5e6ade3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:33.956936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:33.989172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71f371-115a-4378-8a65-b553aabcc7bc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:34.165624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab419-fbd4-422a-bf16-3dea7f1abb5b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:34.171992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90272786-c748-44de-a286-287324af3797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:34.173523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90272786-c748-44de-a286-287324af3797 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:34.173864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90272786-c748-44de-a286-287324af3797 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:34.174241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90272786-c748-44de-a286-287324af3797 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:34.175167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90272786-c748-44de-a286-287324af3797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:34.177677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90272786-c748-44de-a286-287324af3797 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:34.220113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:34.235514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:34.237813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:34.239534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:34.240404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/projects/7c0e46bde29145e0849ca2f92c145654` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:34.247090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:get_project(project_id=7c0e46bde29145e0849ca2f92c145654)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:34.255629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:34.274993 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1141/2284] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:51:33 2022] GET /identity/v3/projects/7c0e46bde29145e0849ca2f92c145654 => generated 367 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:34.277080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:34.299098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abd103-f5b0-4aa5-afca-7caea4bd351e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:34.309652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1144/2285] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:33 2022] POST /identity/v3/projects => generated 387 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:34.312422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90272786-c748-44de-a286-287324af3797 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:34.314569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-90272786-c748-44de-a286-287324af3797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:34.480655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:34.481372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:34.481657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:34.482460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:34.483688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:34.486769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:34.509427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1142/2286] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:34.513748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:34.540186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90272786-c748-44de-a286-287324af3797 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:34.554773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573372fa-d992-4432-b99d-f78051bffe32 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:34.559554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:34.561392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:34.562046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:34.562534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] PATH_INFO: `/v3/projects/8f141429ddf044e1812ea5e3dbecd995` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:34.565602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f141429ddf044e1812ea5e3dbecd995)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:34.574396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:34.578301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:34.578301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:34.583201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:34.583878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:34.584854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:34.588835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:34.712973 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1143/2287] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:34 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:34.714071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:34.763900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f141429ddf044e1812ea5e3dbecd995', 'request_id': 'req-ad362f86-af8f-4722-a920-00369656036e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:34.784560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f141429ddf044e1812ea5e3dbecd995', 'request_id': 'req-ad362f86-af8f-4722-a920-00369656036e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:34.794405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f141429ddf044e1812ea5e3dbecd995', 'request_id': 'req-ad362f86-af8f-4722-a920-00369656036e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:34.899394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] The token cache is being invalidate because project 8f141429ddf044e1812ea5e3dbecd995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:34.899694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:34.900373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:34.905840 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1145/2288] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:34 2022] DELETE /identity/v3/projects/8f141429ddf044e1812ea5e3dbecd995 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:34.905840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:34.906743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:34.923428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc2bb-52ad-4d8d-8f15-fcf9e8a3ef08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:35.103505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:35.104329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:35.104726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:35.105004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:35.105824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:35.106139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:35.107867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:35.135949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad362f86-af8f-4722-a920-00369656036e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:35.166138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:35.174234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:35.174563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:35.176774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] PATH_INFO: `/v3/projects/03ee8cf2ad5141c5b8d7c4c935a409bd/users/fe55f7413ca34eb6af1c74a7f5e6ade3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:35.185393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1144/2289] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:35.186299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:35.188630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ee8cf2ad5141c5b8d7c4c935a409bd, user_id=fe55f7413ca34eb6af1c74a7f5e6ade3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:35.195129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:35.196077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:35.273104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1146/2290] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:34 2022] PUT /identity/v3/projects/03ee8cf2ad5141c5b8d7c4c935a409bd/users/fe55f7413ca34eb6af1c74a7f5e6ade3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:35.280528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:35.299571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2e04-e7e3-4b0a-a80f-e0d7aa6c8e90 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:35.306901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:35.483038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad620bf-4da4-4b90-9870-d06f854b0af6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:35.490836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:35.492374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:35.492741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:35.493167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] PATH_INFO: `/v3/users/2be10b88d4d64e29b2c590ac7a413d34` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:35.494535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be10b88d4d64e29b2c590ac7a413d34)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:35.498400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:35.568304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:35.568958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:35.569243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:35.569518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:35.570191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:35.572449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:35.598480 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1145/2291] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:35.599703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:35.607819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:35.737143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4615e0-2307-4e40-ac73-7dc67a02ca51 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:35.742072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:35.742784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:35.743155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:35.743442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:35.744249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:35.746440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:35.852789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be10b88d4d64e29b2c590ac7a413d34'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:35.865452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be10b88d4d64e29b2c590ac7a413d34'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:35.865799 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1146/2292] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:35 2022] POST /identity/v3/users => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:35.866811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be10b88d4d64e29b2c590ac7a413d34'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:35.867549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be10b88d4d64e29b2c590ac7a413d34'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:35.867802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:35.870036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:35.896077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c08272fa-8ce6-4cb3-be1f-6252e0ee55bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be10b88d4d64e29b2c590ac7a413d34'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:35.900067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523cf82-4bc4-432d-b480-9d83a0441269 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:35.910765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:35.914563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:35.915104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:35.915483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] PATH_INFO: `/v3/projects/3d7353155c8b41bb845c42980a324282/users/63de5e1379d14ae7b49beec637fd6352/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:35.943354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7353155c8b41bb845c42980a324282, user_id=63de5e1379d14ae7b49beec637fd6352, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:35.944109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:35.997276 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1147/2293] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:35 2022] DELETE /identity/v3/users/2be10b88d4d64e29b2c590ac7a413d34 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:36.000081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.014095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.014459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.026993 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1147/2294] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:35 2022] PUT /identity/v3/projects/3d7353155c8b41bb845c42980a324282/users/63de5e1379d14ae7b49beec637fd6352/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:36.028699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:36.033415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:36.094009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] MFA Rules not processed for user `c4e1ac1b40e94dbc80548a1f45919b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:36.100164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:36.222338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d503f0-a7f4-439c-a538-51fa11d2e134 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:36.254688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:36.259502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.259801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.260301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.260901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:36.261229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:36.262854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:36.300290 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1148/2295] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:36.300290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:36.301044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1148/2296] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:36.307083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:36.309647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:36.393542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:36.449577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592f67f-8149-4755-899d-165caf008479 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:36.463462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff2e54-d06d-4a99-ba93-3656696b2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:36.464191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2e54-d06d-4a99-ba93-3656696b2b61 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.464707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2e54-d06d-4a99-ba93-3656696b2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.465035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2e54-d06d-4a99-ba93-3656696b2b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.465756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff2e54-d06d-4a99-ba93-3656696b2b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:36.474485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff2e54-d06d-4a99-ba93-3656696b2b61 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:36.483289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4408ce-7b18-49a1-a56c-de09d5655339 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:36.490189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:36.493702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.493702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.493702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.495822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:36.503441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:36.507472 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1149/2297] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:36.509864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605874f-8ce6-4514-8148-437f63075566 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.511770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605874f-8ce6-4514-8148-437f63075566 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.516499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605874f-8ce6-4514-8148-437f63075566 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.519956 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1150/2298] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:51:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:51:36.525164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605874f-8ce6-4514-8148-437f63075566 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:36.556449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605874f-8ce6-4514-8148-437f63075566 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:36.576301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:36.576964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.578092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.578384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] PATH_INFO: `/v3/projects/3d7353155c8b41bb845c42980a324282/users/63de5e1379d14ae7b49beec637fd6352/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.584482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7353155c8b41bb845c42980a324282, user_id=63de5e1379d14ae7b49beec637fd6352, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:36.591511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:36.617961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1151/2299] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:36 2022] PUT /identity/v3/projects/3d7353155c8b41bb845c42980a324282/users/63de5e1379d14ae7b49beec637fd6352/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:36.627734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:51:36.629719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:36.631381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1149/2300] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:36 2022] POST /identity/v3/projects => generated 369 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:36.632327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:36.635754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:36.675003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:36.755361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:36.788349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739250-c661-4cd9-86af-5d6e6d80b48c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:36.795526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:36.796194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:36.796487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:36.796764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:36.798922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:36.893155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d19cd-839a-42fa-bbe4-d5ed4ad877f0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:36.983805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:36.994315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:36.998567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f792-9e31-4e2d-8ac7-014c7cc24ccb tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:36.999657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f792-9e31-4e2d-8ac7-014c7cc24ccb tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.000127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f792-9e31-4e2d-8ac7-014c7cc24ccb tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.000574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f792-9e31-4e2d-8ac7-014c7cc24ccb tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/projects/7c0e46bde29145e0849ca2f92c145654` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.003766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9f792-9e31-4e2d-8ac7-014c7cc24ccb tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:get_project(project_id=7c0e46bde29145e0849ca2f92c145654)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:37.005793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9f792-9e31-4e2d-8ac7-014c7cc24ccb tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:37.008164 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1152/2301] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:51:36 2022] GET /identity/v3/projects/7c0e46bde29145e0849ca2f92c145654 => generated 367 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:37.009498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.009857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.010202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.054741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] MFA Rules not processed for user `63de5e1379d14ae7b49beec637fd6352`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:37.056977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.058353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1150/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:37.059476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:37.161081 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1153/2303] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:37.161081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:37.161961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.261760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c51b3-7dbd-4871-be0e-b0f5123d82ae service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:37.283724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:37.284368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.284650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.284938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.285585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:37.292939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1186f-17c6-4c4f-9f3b-4f0c3fc1a4f6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:37.298822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:37.303695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:37.304968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.305884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.307682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] PATH_INFO: `/v3/projects/9af44e9347ef4fbf8bac035e9c494411` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.309254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af44e9347ef4fbf8bac035e9c494411)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:37.312567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:37.411918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1151/2304] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:37 2022] POST /identity/v3/users => generated 291 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:37.412983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:37.449518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d2bc-1232-4c4d-9f7d-97f80c9dd527 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:37.474669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af44e9347ef4fbf8bac035e9c494411', 'request_id': 'req-51ed8819-9416-4fad-9834-802878b83ea5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:37.483988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af44e9347ef4fbf8bac035e9c494411', 'request_id': 'req-51ed8819-9416-4fad-9834-802878b83ea5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:37.506632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af44e9347ef4fbf8bac035e9c494411', 'request_id': 'req-51ed8819-9416-4fad-9834-802878b83ea5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:37.580772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca70f1-b574-4183-afad-fcda7c8079ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:37.581402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca70f1-b574-4183-afad-fcda7c8079ad service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.581685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca70f1-b574-4183-afad-fcda7c8079ad service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.581958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca70f1-b574-4183-afad-fcda7c8079ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.632955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] The token cache is being invalidate because project 9af44e9347ef4fbf8bac035e9c494411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:37.633242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:37.635412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:37.637488 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1154/2305] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:37 2022] DELETE /identity/v3/projects/9af44e9347ef4fbf8bac035e9c494411 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:37.638874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:37.644796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.713123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca70f1-b574-4183-afad-fcda7c8079ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:37.719762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca70f1-b574-4183-afad-fcda7c8079ad service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:37.731453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1152/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:37.732977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539cb5-98ab-40f6-ab6b-38f0f1f815ef None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.733332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539cb5-98ab-40f6-ab6b-38f0f1f815ef None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.733636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539cb5-98ab-40f6-ab6b-38f0f1f815ef None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.734979 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1153/2307] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:51:37.736057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.736394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.736674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.774035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:37.777076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.797468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed8819-9416-4fad-9834-802878b83ea5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:37.798529 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1154/2308] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:37.799410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:51:37.808072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.813703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b73bf-9449-49bc-8e1e-646c9f53a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:37.814335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b73bf-9449-49bc-8e1e-646c9f53a31a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.814629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b73bf-9449-49bc-8e1e-646c9f53a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.814907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b73bf-9449-49bc-8e1e-646c9f53a31a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.815664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b73bf-9449-49bc-8e1e-646c9f53a31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:37.821465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b73bf-9449-49bc-8e1e-646c9f53a31a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:37.839436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:37.843886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.845161 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1155/2309] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:37.850020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.851095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.851382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.881601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:37.883392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:37.902513 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1156/2310] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:37.902513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:37.912972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8cd5-a4d8-4b4a-92a2-05b0e29bd716 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:37.922236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:37.928157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.928450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.928735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] PATH_INFO: `/v3/projects/c749505ca3fa4d9fad77a9ddf33aac43/users/d5d302ff09154360a47801a0a064c578/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.977545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c749505ca3fa4d9fad77a9ddf33aac43, user_id=d5d302ff09154360a47801a0a064c578, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:37.980292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:37.985455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71bfe-84b0-4108-9e54-5b250bd50f6b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:37.994192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:37.995967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:37.996515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:37.996865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/projects/7c0e46bde29145e0849ca2f92c145654` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:37.999969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:get_project(project_id=7c0e46bde29145e0849ca2f92c145654)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.004237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.007604 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1155/2311] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:51:37 2022] GET /identity/v3/projects/7c0e46bde29145e0849ca2f92c145654 => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:38.008537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.026804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8fde-4cb7-4eed-9772-0cecfdb03ea3 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.032913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.040440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.041018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.041419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.042128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:38.042433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.044121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.073222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1157/2312] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:37 2022] PUT /identity/v3/projects/c749505ca3fa4d9fad77a9ddf33aac43/users/d5d302ff09154360a47801a0a064c578/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:38.074657 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1156/2313] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:38.077456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.079520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.084850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:38.109094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33896b1-fab6-424c-8e91-056becf7dde0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.229243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.229953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.230597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.231036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.232357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.235841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.255486 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1157/2314] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:38.256629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.259551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d878c-c566-43b9-b3ae-d0c117b84129 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.274008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.274720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.275113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.275474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.279262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:38.412078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6b9d-bab2-4396-aa82-f5c97da9832b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.419039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.420544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.420833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.421314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/users/1679d253bef444b79349f9fb993f6414` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.442663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:38.445589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1679d253bef444b79349f9fb993f6414)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.448102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.454837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.456619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.475466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1158/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:38.476002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.500225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0553f-00ab-482b-9fa2-9ba43ff671b9 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.519837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.520478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.520769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.521050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.521708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.525142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.648641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1679d253bef444b79349f9fb993f6414'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:38.677624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1679d253bef444b79349f9fb993f6414'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:38.678881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1679d253bef444b79349f9fb993f6414'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:38.681352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1679d253bef444b79349f9fb993f6414'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:38.689683 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1159/2316] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:38 2022] POST /identity/v3/projects => generated 391 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:38.689683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.696211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:38.717685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1679d253bef444b79349f9fb993f6414'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:38.802612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:38.807831 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1158/2317] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:38 2022] DELETE /identity/v3/users/1679d253bef444b79349f9fb993f6414 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:38.811165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:38.811767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:38.946606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5b011-7734-4b33-9ac7-bf7171ff7ae6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.963736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.964750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.965476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.965972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] PATH_INFO: `/v3/projects/c749505ca3fa4d9fad77a9ddf33aac43/users/d5d302ff09154360a47801a0a064c578/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.967510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecfb6a-4135-4b8f-9b33-6bde87cb0af8 tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:38.969621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c749505ca3fa4d9fad77a9ddf33aac43, user_id=d5d302ff09154360a47801a0a064c578, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.975110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:38.975110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:38.975110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:38.975110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:38.979445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:38.979445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:38.983782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:39.000886 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1160/2318] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:38 2022] PUT /identity/v3/projects/c749505ca3fa4d9fad77a9ddf33aac43/users/d5d302ff09154360a47801a0a064c578/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:39.002186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:39.014489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:39.106432 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1159/2319] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:38 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:39.107656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:39.110674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:39.131234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f15a8-3ee8-422d-9e7c-15f8d3fca5d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:39.137325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f994c8b554b54f46b965174b82d0d865', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e0263796d604e1b909fe9f25774ebca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:39.137523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf7b12-31bb-4c2a-9b61-2bf2462964fb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:39.138565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:39.139517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:39.140416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] PATH_INFO: `/v3/projects/7c0e46bde29145e0849ca2f92c145654` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:39.142070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c0e46bde29145e0849ca2f92c145654)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:39.145706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:39.249719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:39.250554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:39.250937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:39.251348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] PATH_INFO: `/v3/users/ec72b141a68542a7b7e24b4d0cf8a133` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:39.252648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec72b141a68542a7b7e24b4d0cf8a133)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:39.255238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:39.330128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0e46bde29145e0849ca2f92c145654', 'request_id': 'req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.347708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0e46bde29145e0849ca2f92c145654', 'request_id': 'req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.357541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0e46bde29145e0849ca2f92c145654', 'request_id': 'req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.477562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] The token cache is being invalidate because project 7c0e46bde29145e0849ca2f92c145654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:39.481476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.494273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec72b141a68542a7b7e24b4d0cf8a133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.500032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.503712 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1161/2320] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:39 2022] DELETE /identity/v3/projects/7c0e46bde29145e0849ca2f92c145654 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:39.505203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:39.508326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:39.513731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec72b141a68542a7b7e24b4d0cf8a133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.515937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec72b141a68542a7b7e24b4d0cf8a133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.520147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec72b141a68542a7b7e24b4d0cf8a133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.543168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec72b141a68542a7b7e24b4d0cf8a133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:39.633138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5abcd4-f1b9-47d6-afb6-5144cfbd6c3e tempest-QuotasAdminTestV236-112455193 tempest-QuotasAdminTestV236-112455193-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:39.638974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:39.639785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:39.640084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:39.646184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:39.646184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:39.646184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:39.667284 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1162/2321] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:39.668254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:39.672319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:39.682860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1160/2322] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:39 2022] DELETE /identity/v3/users/ec72b141a68542a7b7e24b4d0cf8a133 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:39.686218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:39.686706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:39.703732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e28f9-b586-4169-a1b7-a2d8663b76bd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:39.844406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae43c0-96f4-4d20-8dea-afe054c84721 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:39.854754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b186b-9c2c-4af0-a69e-b093719c10e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:39.855488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b186b-9c2c-4af0-a69e-b093719c10e0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:39.855774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b186b-9c2c-4af0-a69e-b093719c10e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:39.856047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b186b-9c2c-4af0-a69e-b093719c10e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:39.857865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b186b-9c2c-4af0-a69e-b093719c10e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:39.860997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b186b-9c2c-4af0-a69e-b093719c10e0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:39.867377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:39.887793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:39.887793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:39.887793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] PATH_INFO: `/v3/users/26932ae8c6af401ba81b4e34c490fc8d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:39.887793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26932ae8c6af401ba81b4e34c490fc8d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:39.887793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:39.895201 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1161/2323] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:39.896559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:39.898773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:39.898953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:40.051545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:40.051545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:40.051545 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1162/2324] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:40.051545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:40.051545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433ff38-a861-43b0-be09-a3a45aa1075c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:40.052152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:40.052152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:40.052152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:40.052152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] PATH_INFO: `/v3/projects/6d2c19485ea24162995d4d0a00956a5c/users/66dbdfb62bea4d6ab2f38a1cad9abf83/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:40.052723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2c19485ea24162995d4d0a00956a5c, user_id=66dbdfb62bea4d6ab2f38a1cad9abf83, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:40.059670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:40.403592 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1163/2325] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:39 2022] PUT /identity/v3/projects/6d2c19485ea24162995d4d0a00956a5c/users/66dbdfb62bea4d6ab2f38a1cad9abf83/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:40.403592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:40.403592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:40.547781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1350-b2f5-469a-b2e3-ef0801690e8c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:40.554742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc9bdc-cd5b-4740-9a09-883340f4b53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:40.555649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc9bdc-cd5b-4740-9a09-883340f4b53f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:40.556100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc9bdc-cd5b-4740-9a09-883340f4b53f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:40.556560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc9bdc-cd5b-4740-9a09-883340f4b53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:40.604551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:40.635372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26932ae8c6af401ba81b4e34c490fc8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:40.657780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26932ae8c6af401ba81b4e34c490fc8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:40.663065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26932ae8c6af401ba81b4e34c490fc8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:40.680546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc9bdc-cd5b-4740-9a09-883340f4b53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:40.682294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc9bdc-cd5b-4740-9a09-883340f4b53f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:40.696668 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1164/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:40.697940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:40.698474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:40.698762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:40.711135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26932ae8c6af401ba81b4e34c490fc8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:40.712045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-444c7a18-7e29-4a86-8804-b3395717febc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26932ae8c6af401ba81b4e34c490fc8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:40.752243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] MFA Rules not processed for user `66dbdfb62bea4d6ab2f38a1cad9abf83`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:40.753570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:40.815979 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1163/2327] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:39 2022] DELETE /identity/v3/users/26932ae8c6af401ba81b4e34c490fc8d => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:40.824301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:40.824945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:40.825472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:40.868331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1165/2328] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:40.869290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:40.870995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:40.881465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:40.883109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:40.913461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795466f-2fb4-4cda-bd95-7bf45f2ef397 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.027152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.027152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.027152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.027152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.027663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.027776 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1164/2329] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:51:41.029755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.037333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:41.065585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:41.068349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:41.188179 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1166/2330] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:40 2022] POST /identity/v3/projects => generated 389 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:41.190671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:41.225334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bc652-68d4-4f9c-8714-a2c6dfec24fa None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.283937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75882478-777b-4f26-a5c4-67e9078bc80c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.289594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.290459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.290852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.291316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.292067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.294243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.296843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.297916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.298399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.298837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.333096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.335901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.364770 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1165/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:41.442534 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1167/2332] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:41 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:51:41.446809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:41.467959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc86a-4c6e-4813-85e3-a2d94e4cc2f5 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.477255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.478245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.478755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.479362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.481093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.484342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.506717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1166/2333] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:41.510808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:41.524228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04a2e7-4127-499e-88ce-324d394d34e4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.529852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.538743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.539234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.545599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] PATH_INFO: `/v3/projects/92726da23f6f4a6e804bdb1e972fb458/users/1248f3d6494d45159ab2a81fe09b31cf/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.563826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92726da23f6f4a6e804bdb1e972fb458, user_id=1248f3d6494d45159ab2a81fe09b31cf, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.574276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.584682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:41.660573 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1168/2334] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:41 2022] PUT /identity/v3/projects/92726da23f6f4a6e804bdb1e972fb458/users/1248f3d6494d45159ab2a81fe09b31cf/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:41.665591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:41.683439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4b4bc-fcf1-4203-91ff-f05bea4252f2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.813480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126f211-83c2-4901-8bd5-15014d1e1cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.814370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f211-83c2-4901-8bd5-15014d1e1cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.815362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f211-83c2-4901-8bd5-15014d1e1cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.815797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126f211-83c2-4901-8bd5-15014d1e1cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.817284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f211-83c2-4901-8bd5-15014d1e1cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.819963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126f211-83c2-4901-8bd5-15014d1e1cf5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.863353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:41.881402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1167/2335] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:41.887879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe393b9d-6a14-4787-917c-a6ab2ba6540c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:41.898054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:41.899770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.900221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.900714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] PATH_INFO: `/v3/projects/92726da23f6f4a6e804bdb1e972fb458/users/1248f3d6494d45159ab2a81fe09b31cf/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:41.904305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=92726da23f6f4a6e804bdb1e972fb458, user_id=1248f3d6494d45159ab2a81fe09b31cf, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:41.908031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:41.938858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1169/2336] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:41 2022] PUT /identity/v3/projects/92726da23f6f4a6e804bdb1e972fb458/users/1248f3d6494d45159ab2a81fe09b31cf/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:41.942115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:41.951588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:41.957340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:42.024591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] MFA Rules not processed for user `1248f3d6494d45159ab2a81fe09b31cf`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:42.027425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:42.193680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:42.217594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1168/2337] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:42.237013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:42.237013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:42.415338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7dec-9005-4434-97f2-331520d66aef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:42.431820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:42.432530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:42.433020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:42.433139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:42.456489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:42.462572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:42.486784 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1170/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:43.001451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:43.178900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6d97b-e4ca-4a77-9b3f-5f0b6e31600b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:43.190399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:43.192494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:43.194691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:43.195025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:43.195323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] PATH_INFO: `/v3/users/66dbdfb62bea4d6ab2f38a1cad9abf83` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:43.202507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dbdfb62bea4d6ab2f38a1cad9abf83)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:43.204338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:43.394495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:43.395637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:43.419156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4c29b-38bb-4c98-9262-eac18152d55a service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:43.439699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:43.446483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:43.446483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:43.446483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] PATH_INFO: `/v3/projects/de9e608da6374619b6f3df4d214dc065` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:43.446483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9e608da6374619b6f3df4d214dc065)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:43.446483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:43.585555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dbdfb62bea4d6ab2f38a1cad9abf83'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.615936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dbdfb62bea4d6ab2f38a1cad9abf83'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.621359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9e608da6374619b6f3df4d214dc065', 'request_id': 'req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.631390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dbdfb62bea4d6ab2f38a1cad9abf83'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.640805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9e608da6374619b6f3df4d214dc065', 'request_id': 'req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.648934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9e608da6374619b6f3df4d214dc065', 'request_id': 'req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.666314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dbdfb62bea4d6ab2f38a1cad9abf83'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.667913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dbdfb62bea4d6ab2f38a1cad9abf83'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.761958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] The token cache is being invalidate because project de9e608da6374619b6f3df4d214dc065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:43.765467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.765467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:43.771043 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1171/2339] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:43 2022] DELETE /identity/v3/projects/de9e608da6374619b6f3df4d214dc065 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:43.772351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:43.781423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:43.797271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:43.876494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1169/2340] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:43 2022] DELETE /identity/v3/users/66dbdfb62bea4d6ab2f38a1cad9abf83 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:43.888897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:43.893537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:44.004380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ac93-a0ba-4c5c-8e14-25d58fe0ebc8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:44.115002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d5edc-54d1-4092-b8e4-590887464459 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:44.133360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:44.134472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:44.134767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:44.135117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] PATH_INFO: `/v3/users/63de5e1379d14ae7b49beec637fd6352` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:44.136678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63de5e1379d14ae7b49beec637fd6352)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:44.163712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:44.186312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:44.187092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:44.188019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:44.188019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] PATH_INFO: `/v3/projects/6762d983fa9a424893de242cdb9ce3e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:44.190266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6762d983fa9a424893de242cdb9ce3e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:44.192680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:44.417503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6762d983fa9a424893de242cdb9ce3e1', 'request_id': 'req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.426616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6762d983fa9a424893de242cdb9ce3e1', 'request_id': 'req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.438544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6762d983fa9a424893de242cdb9ce3e1', 'request_id': 'req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.568991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] The token cache is being invalidate because project 6762d983fa9a424893de242cdb9ce3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:44.569232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.575122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6ac22ec0-6dc5-4765-8be9-ba2de21c65a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.578124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1172/2341] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:43 2022] DELETE /identity/v3/projects/6762d983fa9a424893de242cdb9ce3e1 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:44.580155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:44.580709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:44.581184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:44.583755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:44.598650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63de5e1379d14ae7b49beec637fd6352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.612784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:44.613934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63de5e1379d14ae7b49beec637fd6352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.614223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:44.617404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63de5e1379d14ae7b49beec637fd6352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.650104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63de5e1379d14ae7b49beec637fd6352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.651495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63de5e1379d14ae7b49beec637fd6352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:44.698011 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1173/2342] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:44.699640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:44.702658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:44.737398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527cec9-4cf0-4ac7-bdb7-a613b3536891 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:44.753778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:44.754814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:44.756075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:44.757562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] PATH_INFO: `/v3/users/f994c8b554b54f46b965174b82d0d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:44.765811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f994c8b554b54f46b965174b82d0d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:44.768274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1170/2343] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:43 2022] DELETE /identity/v3/users/63de5e1379d14ae7b49beec637fd6352 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:44.768417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:44.773037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:44.776306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:44.929630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af0eda-c0e3-4041-a969-b3e7b156aee6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:44.935918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:44.936906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:44.937394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:44.937821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:45.048460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f994c8b554b54f46b965174b82d0d865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:45.056711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:45.060658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:45.061846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f994c8b554b54f46b965174b82d0d865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:45.063033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f994c8b554b54f46b965174b82d0d865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:45.067431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f994c8b554b54f46b965174b82d0d865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:45.086070 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1171/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:45.107381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-be2da6d2-0a98-42e0-aaed-07abba5d957d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f994c8b554b54f46b965174b82d0d865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:45.213786 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1174/2345] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:44 2022] DELETE /identity/v3/users/f994c8b554b54f46b965174b82d0d865 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:45.438110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:45.442956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:45.499878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa17bb-e73b-4efe-ac35-948574090ff8 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:45.681696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:45.681866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:45.682767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:45.683158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] PATH_INFO: `/v3/users/68b67a91aae74b33959efe4f3e647efb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:45.686082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b67a91aae74b33959efe4f3e647efb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:45.694677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:46.118548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b67a91aae74b33959efe4f3e647efb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:46.158432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b67a91aae74b33959efe4f3e647efb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:46.159993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b67a91aae74b33959efe4f3e647efb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:46.164107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:46.189826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b67a91aae74b33959efe4f3e647efb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:46.190656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-635b88d8-4d69-4ddc-ac36-2164bc3efa7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b67a91aae74b33959efe4f3e647efb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:46.277420 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1172/2346] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:45 2022] DELETE /identity/v3/users/68b67a91aae74b33959efe4f3e647efb => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:46.279275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:46.279607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:46.279896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:46.328942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:46.330251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:46.449801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1175/2347] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:46.487567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:46.734244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4a4b-61d1-4136-a584-443f784c0a59 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:46.734532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4a4b-61d1-4136-a584-443f784c0a59 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:46.735035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4a4b-61d1-4136-a584-443f784c0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:46.751042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:46.752461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:46.796750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3f2b4a4b-61d1-4136-a584-443f784c0a59 None None] MFA Rules not processed for user `fe55f7413ca34eb6af1c74a7f5e6ade3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:46.798099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3f2b4a4b-61d1-4136-a584-443f784c0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:46.830648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f0b9-fdfc-4279-bf8e-8294ab7b5335 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:46.835423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:46.836045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:46.837184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:46.837470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:46.866548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:46.868880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:46.882973 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1176/2348] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:46.884090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:46.885632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:46.906910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317525-ceb0-4384-b7e9-e15b03c2e708 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:46.913858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:46.914906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:46.915427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:46.915918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] PATH_INFO: `/v3/projects/3d7353155c8b41bb845c42980a324282` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:46.917303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7353155c8b41bb845c42980a324282)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:46.920024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:46.938538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1173/2349] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:46.944581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:46.944879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:46.945142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:46.967768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] MFA Rules not processed for user `d9f88a4c72854cff9bba7ed2920f55b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:46.968954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.055798 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1174/2350] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:47.056820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:47.058313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.063237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7353155c8b41bb845c42980a324282', 'request_id': 'req-83b645bf-7080-44f3-bab8-05c1e7cac4f2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.080302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7353155c8b41bb845c42980a324282', 'request_id': 'req-83b645bf-7080-44f3-bab8-05c1e7cac4f2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.089330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7353155c8b41bb845c42980a324282', 'request_id': 'req-83b645bf-7080-44f3-bab8-05c1e7cac4f2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.158399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] The token cache is being invalidate because project 3d7353155c8b41bb845c42980a324282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:47.163053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.163053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83b645bf-7080-44f3-bab8-05c1e7cac4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.163248 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1177/2351] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:46 2022] DELETE /identity/v3/projects/3d7353155c8b41bb845c42980a324282 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:47.168424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fdcb-e675-483b-96fc-04468cef9a12 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.169049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fdcb-e675-483b-96fc-04468cef9a12 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.169345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fdcb-e675-483b-96fc-04468cef9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.221990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-68c0fdcb-e675-483b-96fc-04468cef9a12 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:47.225861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68c0fdcb-e675-483b-96fc-04468cef9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.229863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac4c80-6507-4222-9646-14867c47f59e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:47.377862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:47.382800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.382800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.382800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.382800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.386083 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1178/2352] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:47.395452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.398043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.399379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.465032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:47.466547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.482920 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1179/2353] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:47.489882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:47.506594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:47.511098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a623-eaeb-49af-9ffc-b322e2964433 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:47.512157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:47.526388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:47.527147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.527499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.527847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.528607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:47.528981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:47.530679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec2ac0-205e-43b5-a81c-ccd864383f27 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:47.548947 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1175/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:47.565810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:47.567438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.583133 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1180/2355] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:47.584597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.590505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.590952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.612336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bf40-db4c-4b35-8e35-69697f127c8b service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:47.617504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:47.618260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.618610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.618892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] PATH_INFO: `/v3/projects/0e0263796d604e1b909fe9f25774ebca` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.620094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0263796d604e1b909fe9f25774ebca)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:47.622124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:47.628332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] MFA Rules not processed for user `d2a12eeff77c4fda8921764118c48863`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:47.630970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.738367 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1181/2356] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:47 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:47.738867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:47.750999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f480394-73d0-4d26-98d2-f1540ce1c683 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:47.759354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:47.760010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:47.760299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:47.760621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:47.761259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:47.763902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:47.805661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0263796d604e1b909fe9f25774ebca', 'request_id': 'req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.818293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0263796d604e1b909fe9f25774ebca', 'request_id': 'req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.825186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0263796d604e1b909fe9f25774ebca', 'request_id': 'req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.890183 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1182/2357] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:47 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:47.890183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:47.896559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:47.942931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] The token cache is being invalidate because project 0e0263796d604e1b909fe9f25774ebca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:47.943910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.947637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:47.948319 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1176/2358] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:47 2022] DELETE /identity/v3/projects/0e0263796d604e1b909fe9f25774ebca => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:47.949823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:47.954705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:48.077526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4bdc4-1a22-4aed-a0cb-f4ab632fba98 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:48.095070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:48.098785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:48.099395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:48.099865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] PATH_INFO: `/v3/projects/6d2c19485ea24162995d4d0a00956a5c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:48.102298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2c19485ea24162995d4d0a00956a5c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:48.107636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:48.197752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbbd9a-fe43-4d2e-9d9e-49e6aaa82271 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:48.209147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:48.210237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:48.210724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:48.211223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] PATH_INFO: `/v3/projects/752e7bf666fb4d7a8a997af85d508dd6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:48.217620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] RBAC: Authorizing `identity:delete_project(project_id=752e7bf666fb4d7a8a997af85d508dd6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:48.220071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:48.325122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2c19485ea24162995d4d0a00956a5c', 'request_id': 'req-cebd653f-cc96-4f32-b228-12f84c61fd44'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.341355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2c19485ea24162995d4d0a00956a5c', 'request_id': 'req-cebd653f-cc96-4f32-b228-12f84c61fd44'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.352271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2c19485ea24162995d4d0a00956a5c', 'request_id': 'req-cebd653f-cc96-4f32-b228-12f84c61fd44'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.401585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:48.424812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752e7bf666fb4d7a8a997af85d508dd6', 'request_id': 'req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.433367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752e7bf666fb4d7a8a997af85d508dd6', 'request_id': 'req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.444937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752e7bf666fb4d7a8a997af85d508dd6', 'request_id': 'req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.474667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] The token cache is being invalidate because project 6d2c19485ea24162995d4d0a00956a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:48.474667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.474667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.474667 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1183/2359] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:47 2022] DELETE /identity/v3/projects/6d2c19485ea24162995d4d0a00956a5c => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:48.474667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:48.480169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:48.562518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:48.598657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] The token cache is being invalidate because project 752e7bf666fb4d7a8a997af85d508dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:48.606560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.606560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b8c3a94-d0b1-4ddd-b717-c47e4bcb083f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:48.612168 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1177/2360] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:47 2022] DELETE /identity/v3/projects/752e7bf666fb4d7a8a997af85d508dd6 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:48.612168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:48.612168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:48.612168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:48.631734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd653f-cc96-4f32-b228-12f84c61fd44 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:48.647290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:48.658006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:48.742736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:48.743593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:48.743981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:48.744298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:48.745007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:48.749585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:48.891728 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1178/2361] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:48.891728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:48.892052 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1184/2362] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:48 2022] POST /identity/v3/users => generated 300 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:48.892052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:48.892240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:48.897720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:48.908021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f87f-db79-4698-a09e-0c5c4f7edb64 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:48.918390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:48.919625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:48.919923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:48.920202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] PATH_INFO: `/v3/users/1248f3d6494d45159ab2a81fe09b31cf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:48.922524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1248f3d6494d45159ab2a81fe09b31cf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:48.924698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:48.933741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d4d3-133a-4000-82e8-7098d28ce184 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:48.945317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:48.945973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:48.946253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:48.946682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] PATH_INFO: `/v3/users/41a690530c9e455f8b0f975ca13b71fd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:48.948718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a690530c9e455f8b0f975ca13b71fd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:48.951693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:49.187855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1248f3d6494d45159ab2a81fe09b31cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.213085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1248f3d6494d45159ab2a81fe09b31cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.214094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1248f3d6494d45159ab2a81fe09b31cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.235319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1248f3d6494d45159ab2a81fe09b31cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.236177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1248f3d6494d45159ab2a81fe09b31cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.314542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a690530c9e455f8b0f975ca13b71fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.362155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1179/2363] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:48 2022] DELETE /identity/v3/users/1248f3d6494d45159ab2a81fe09b31cf => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:49.366007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:49.367618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:49.367805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a690530c9e455f8b0f975ca13b71fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.369193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a690530c9e455f8b0f975ca13b71fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.370262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a690530c9e455f8b0f975ca13b71fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.404321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962b3a5d-3263-4706-b9d0-797a6613e6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a690530c9e455f8b0f975ca13b71fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:49.515003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1185/2364] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:48 2022] DELETE /identity/v3/users/41a690530c9e455f8b0f975ca13b71fd => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:49.519539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:49.519819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:49.520098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:49.573634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:49.575138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:49.575903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45440c-c443-4a13-9a09-90e95d8a70b0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:49.736513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:49.738748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:49.738748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:49.748017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:49.750639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:49.775252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:49.790300 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1186/2365] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:49.794914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:49.819689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1180/2366] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:49.823420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:49.825963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:49.830912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2eb7e-d60c-4f14-9917-28920844664f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:49.846627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:49.847361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:49.847695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:49.847971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:49.848730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:49.849096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:49.851160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:49.871186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2cba-abae-4f41-a4d1-745d4acafff2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:49.879003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1187/2367] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:49.882999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:49.897511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:49.898243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:49.898606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:49.898985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:49.899759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:49.901468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:49.901878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644098b5-75e7-4977-9898-c69e26b1f0c5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:49.915480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:49.917212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:49.917789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:49.924886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:49.926241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:49.929787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:49.935692 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1181/2368] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:51:49.938440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:49.965101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f27b9-362a-4226-8d64-74686d3de123 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:49.985136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50ec8c-0b58-4d3e-84df-fdae8d258910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:49.986020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ec8c-0b58-4d3e-84df-fdae8d258910 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:49.987550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ec8c-0b58-4d3e-84df-fdae8d258910 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:49.988007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50ec8c-0b58-4d3e-84df-fdae8d258910 admin admin] PATH_INFO: `/v3/projects/9d7dedf5039043e99d49f60d147cfe3a/users/483145a466ca47029d351d05525b7e05/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:50.001155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:50.018169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50ec8c-0b58-4d3e-84df-fdae8d258910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7dedf5039043e99d49f60d147cfe3a, user_id=483145a466ca47029d351d05525b7e05, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:50.022890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50ec8c-0b58-4d3e-84df-fdae8d258910 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:50.087399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1188/2369] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:49 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:51:50.099343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:50.130777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1182/2370] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:49 2022] PUT /identity/v3/projects/9d7dedf5039043e99d49f60d147cfe3a/users/483145a466ca47029d351d05525b7e05/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:50.142616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:50.143724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:50.143889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:50.257181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] MFA Rules not processed for user `483145a466ca47029d351d05525b7e05`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:50.259595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:50.399151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432a92-0177-41a5-ab21-3186f221a609 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:50.427108 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1183/2371] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:51:50.429250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:50.614701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:50.616389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:50.623043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:50.623043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:50.627638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:50.629211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:50.660930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368a1b-368e-4d6e-b0fe-fb3669049b49 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:50.675445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:50.676315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:50.676701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:50.677083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:50.677860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:50.687158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:50.756029 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1189/2372] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:50 2022] POST /identity/v3/users => generated 297 bytes in 663 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:51:50.756029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:50.766855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ce3c2-b0b9-4aee-99a9-c3fdde974ae9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:50.773250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:50.774182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:50.774722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:50.775242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:50.776219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:50.778167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:50.797023 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1190/2373] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:50.798354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:50.801108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:50.832827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325db9e-e2a6-49fd-a05e-2524cdef16f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:50.845579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:50.846432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:50.846826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:50.847318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] PATH_INFO: `/v3/projects/92726da23f6f4a6e804bdb1e972fb458` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:50.849393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92726da23f6f4a6e804bdb1e972fb458)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:50.855866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:50.890565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1184/2374] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:50 2022] POST /identity/v3/projects => generated 399 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:50.891971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:50.928221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:51.092905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92726da23f6f4a6e804bdb1e972fb458', 'request_id': 'req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:51.099145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabe946-9a99-450d-8ab1-155e69546d14 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:51.111368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92726da23f6f4a6e804bdb1e972fb458', 'request_id': 'req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:51.131430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92726da23f6f4a6e804bdb1e972fb458', 'request_id': 'req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:51.230756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a026a-c07c-4f9c-a287-c99f6f8440e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:51.231874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a026a-c07c-4f9c-a287-c99f6f8440e0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.234076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a026a-c07c-4f9c-a287-c99f6f8440e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.234771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a026a-c07c-4f9c-a287-c99f6f8440e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.235643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a026a-c07c-4f9c-a287-c99f6f8440e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:51.237563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a026a-c07c-4f9c-a287-c99f6f8440e0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:51.248970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] The token cache is being invalidate because project 92726da23f6f4a6e804bdb1e972fb458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:51.251319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:51.251319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:51.251515 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1191/2375] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:50 2022] DELETE /identity/v3/projects/92726da23f6f4a6e804bdb1e972fb458 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:51.256083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:51.261046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:51.265496 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1185/2376] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:51.270276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.270678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.271097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.308435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4cfe3-3d48-4e60-a3cf-c30439155c10 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:51.318245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:51.319898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:51.323508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:51.324859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.327231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.327717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.331475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:51.331475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:51.348537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1186/2377] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:51.348537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:51.349660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:51.370590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4080cb-29cb-4784-b53c-7d0c00a5baf2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:51.377726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32824d72-275f-4cd9-9bbf-601756aaa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:51.378663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824d72-275f-4cd9-9bbf-601756aaa554 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.379158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824d72-275f-4cd9-9bbf-601756aaa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.379898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32824d72-275f-4cd9-9bbf-601756aaa554 admin admin] PATH_INFO: `/v3/projects/4882f2c8ef9c4f29bf3cbaa93cf9d488/users/e425c7348db042389a189daa866ea06d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.401699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824d72-275f-4cd9-9bbf-601756aaa554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4882f2c8ef9c4f29bf3cbaa93cf9d488, user_id=e425c7348db042389a189daa866ea06d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:51.405345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32824d72-275f-4cd9-9bbf-601756aaa554 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:51.458835 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1192/2378] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:51 2022] POST /identity/v3/users => generated 306 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:51.458835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:51.463213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:51.515335 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1187/2379] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:51 2022] PUT /identity/v3/projects/4882f2c8ef9c4f29bf3cbaa93cf9d488/users/e425c7348db042389a189daa866ea06d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:51.516983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.518096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.519187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.525697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f295cd-a2ac-44e7-8670-2f87001cc090 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:51.599002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:51.600707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:51.774550 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1188/2380] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:51.777063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:51.790506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:51.792357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.792656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.792929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] PATH_INFO: `/v3/projects/9a83860577084add85ca2af4cf6b548d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.796982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aa376-e95f-42a9-bb11-d5a229f34d25 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:51.797696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a83860577084add85ca2af4cf6b548d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:51.800213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:51.818830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006df41-30af-47a0-b825-ca57dbb4ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:51.819460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006df41-30af-47a0-b825-ca57dbb4ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.819750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006df41-30af-47a0-b825-ca57dbb4ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.820028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006df41-30af-47a0-b825-ca57dbb4ce9e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:51.821331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006df41-30af-47a0-b825-ca57dbb4ce9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:51.827991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006df41-30af-47a0-b825-ca57dbb4ce9e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:51.940120 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1189/2381] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:51.944597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:51.945692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:51.945993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.046711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] MFA Rules not processed for user `e425c7348db042389a189daa866ea06d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:52.051235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:52.082464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a83860577084add85ca2af4cf6b548d', 'request_id': 'req-97a21fa6-fa0e-41f8-8a44-b98790299279'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:52.102788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a83860577084add85ca2af4cf6b548d', 'request_id': 'req-97a21fa6-fa0e-41f8-8a44-b98790299279'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:52.131095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a83860577084add85ca2af4cf6b548d', 'request_id': 'req-97a21fa6-fa0e-41f8-8a44-b98790299279'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:52.167810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:52.249360 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1190/2382] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:52.250358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:52.272709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] The token cache is being invalidate because project 9a83860577084add85ca2af4cf6b548d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:52.273277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:52.274279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:52.280320 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1193/2383] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:51 2022] DELETE /identity/v3/projects/9a83860577084add85ca2af4cf6b548d => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:52.286240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:52.313683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:52.421873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7937843-055a-4467-b8d1-98427a47a106 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:52.447736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:52.449633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:52.450269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.450584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.450944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.455025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:52.455025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:52.458016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:52.493364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1191/2384] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:52.493364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:52.493364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:52.496077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a21fa6-fa0e-41f8-8a44-b98790299279 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:52.505934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387e0c0-ee92-45ee-81e4-2d4036f1dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:52.507115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387e0c0-ee92-45ee-81e4-2d4036f1dd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.507328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2219a-bcb0-460a-9f35-5bd9aa9b10f9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:52.507723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387e0c0-ee92-45ee-81e4-2d4036f1dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.508179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387e0c0-ee92-45ee-81e4-2d4036f1dd75 admin admin] PATH_INFO: `/v3/projects/5a7a8a969966467291c440899443b8c5/users/d184ba9bb82a4cae820b2270bf1ff561/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.517180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:52.517959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.518338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.518749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.519664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:52.529281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387e0c0-ee92-45ee-81e4-2d4036f1dd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7a8a969966467291c440899443b8c5, user_id=d184ba9bb82a4cae820b2270bf1ff561, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:52.533158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387e0c0-ee92-45ee-81e4-2d4036f1dd75 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:52.534140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:52.620036 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1194/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:52 2022] PUT /identity/v3/projects/5a7a8a969966467291c440899443b8c5/users/d184ba9bb82a4cae820b2270bf1ff561/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:52.621537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.623224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.623888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.652327 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1192/2386] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:52 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:52.656935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:52.659142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:52.676584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:52.683305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:52.834761 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1195/2387] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:52.835772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:52.841523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37d47e-d119-4d49-bea9-79552a431387 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:52.852187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142a16-8642-42e5-a331-a4869ab79c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:52.855257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142a16-8642-42e5-a331-a4869ab79c0d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.855690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142a16-8642-42e5-a331-a4869ab79c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.858730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b87ca-53fd-478f-9219-60d0ad7ada63 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:52.858891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142a16-8642-42e5-a331-a4869ab79c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.859694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142a16-8642-42e5-a331-a4869ab79c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:52.869813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:52.870438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.870718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.870989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.871660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:52.873298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:52.882138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142a16-8642-42e5-a331-a4869ab79c0d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:52.895353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1196/2388] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:52.896337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:52.916764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a08e3-91d5-42fc-950b-552cb2f3e089 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:52.933640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:52.934280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:52.934553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:52.935975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:52.936115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:52.937975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.085359 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1193/2389] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:52 2022] POST /identity/v3/projects => generated 407 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:53.086419 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1197/2390] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:52 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:53.087603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.087841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.088313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.089412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.107313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703f85-2426-497e-8d80-c299d76d6bfc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.137407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:53.139141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:53.214812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.215783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.217297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.218457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] PATH_INFO: `/v3/projects/5a7a8a969966467291c440899443b8c5/users/d184ba9bb82a4cae820b2270bf1ff561/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.224681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7a8a969966467291c440899443b8c5, user_id=d184ba9bb82a4cae820b2270bf1ff561, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.232998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.269636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1194/2391] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:53.273685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.276807 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1198/2392] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:53 2022] PUT /identity/v3/projects/5a7a8a969966467291c440899443b8c5/users/d184ba9bb82a4cae820b2270bf1ff561/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:53.277393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.301909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f2696-3d97-4a10-a0b4-33a6d1ca980b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.367187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892845a-f852-4a89-8599-0cd3cd2e318d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.375716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.380960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.381261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.384317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.384317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.386639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.398964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.399899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.400290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.400668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.401425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.403277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.419824 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1195/2393] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:53.419824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.430166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab4bc-ecf1-4f96-9ae4-43d0ce6e7d96 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.436418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.437308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.437748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.438072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.438854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:51:53.439343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.439865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:53.441375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58473f-1012-437d-aac7-f04dd142bf7e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.459470 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1196/2394] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:51:53.462010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.462010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.462010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.509532 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1199/2395] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:53 2022] POST /identity/v3/users => generated 304 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:53.510386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.513249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] MFA Rules not processed for user `d184ba9bb82a4cae820b2270bf1ff561`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:53.514636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:53.533086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ef7d-c337-453d-8505-e819d899d281 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.541960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.543383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.546151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.546151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] PATH_INFO: `/v3/projects/4da8b0a081964e2191d0e5e3e9eac26f/users/66e653c2ba034b269a99e7335e810861/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.580116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da8b0a081964e2191d0e5e3e9eac26f, user_id=66e653c2ba034b269a99e7335e810861, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.583148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.602313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1197/2396] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:53.603561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.617801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92328-b7ac-44cb-8554-e4a8f9e65310 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.629643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.633998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.635570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.636703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.641167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.642137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.680519 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1200/2397] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:53 2022] PUT /identity/v3/projects/4da8b0a081964e2191d0e5e3e9eac26f/users/66e653c2ba034b269a99e7335e810861/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:53.681591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.803517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1198/2398] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:53 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:53.808172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.812872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:53.823002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a273-3e26-444e-88c6-6209544a0ecd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.923300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.923944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.924235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.924511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.925168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.926888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:53.951185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1201/2399] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:53.952717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:53.966580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8119b0-cd54-4c20-acbf-622ad62aedf7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:53.972787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:53.973562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:53.974157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:53.974448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:53.975174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:53.986359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.001348 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1202/2400] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:54.002897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:54.015993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f824d8-c626-4083-a290-e07d329be2ce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.026627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.027296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.027580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.027851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.028520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:54.030497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.040594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064d6b-fc0e-42c4-aa73-a374f1f72f10 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.056665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.058535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.059547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.060588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.063141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:54.166608 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1203/2401] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:54 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:54.171365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:54.190662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:54.193324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.209775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7bd49-5784-4a83-bd32-bd9f7a15c54c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.231113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2143e63-940a-4172-b362-44b96e3f513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.232402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2143e63-940a-4172-b362-44b96e3f513a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.232744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2143e63-940a-4172-b362-44b96e3f513a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.233028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2143e63-940a-4172-b362-44b96e3f513a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.233786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2143e63-940a-4172-b362-44b96e3f513a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:54.245090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2143e63-940a-4172-b362-44b96e3f513a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.257101 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1199/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:54.257101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:54.272849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2eacb-49b1-441a-8cdd-60eecfba781a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.279000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.281668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.281668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.281668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] PATH_INFO: `/v3/projects/4da8b0a081964e2191d0e5e3e9eac26f/users/66e653c2ba034b269a99e7335e810861/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.289531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1204/2403] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:54.301824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.303056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.303056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.334479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da8b0a081964e2191d0e5e3e9eac26f, user_id=66e653c2ba034b269a99e7335e810861, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:54.346918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.368851 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1200/2404] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:54 2022] PUT /identity/v3/projects/4da8b0a081964e2191d0e5e3e9eac26f/users/66e653c2ba034b269a99e7335e810861/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:54.370225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:54.385741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] MFA Rules not processed for user `d5d302ff09154360a47801a0a064c578`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:54.386936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:54.496837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ca8c7-2d3f-4048-a38c-1297b7d0c577 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.503596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.508997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.509617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.510141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.510911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:54.512962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.544923 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1205/2405] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:54.545940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:54.547806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:54.555570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1201/2406] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:54.556627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:54.565395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7df68-b9e6-44d0-919f-9fb7208242f5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.573181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd9e6-f730-4037-9ccc-626e8db914c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.574925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd9e6-f730-4037-9ccc-626e8db914c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.576065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd9e6-f730-4037-9ccc-626e8db914c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.576352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd9e6-f730-4037-9ccc-626e8db914c4 admin admin] PATH_INFO: `/v3/projects/485c44e342ed40efac7984922701f623/users/5076cb5048a647f48c286d54fef25506/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.608396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd9e6-f730-4037-9ccc-626e8db914c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485c44e342ed40efac7984922701f623, user_id=5076cb5048a647f48c286d54fef25506, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:54.614553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd9e6-f730-4037-9ccc-626e8db914c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:54.713221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1206/2407] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:54 2022] PUT /identity/v3/projects/485c44e342ed40efac7984922701f623/users/5076cb5048a647f48c286d54fef25506/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:54.713221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b694a-d3bf-4acd-bc88-4d4da5ecf7d6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.713221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b694a-d3bf-4acd-bc88-4d4da5ecf7d6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.713221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b694a-d3bf-4acd-bc88-4d4da5ecf7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:54.731561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1043-5cb6-4a77-9274-a41196040c80 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:54.798152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-076b694a-d3bf-4acd-bc88-4d4da5ecf7d6 None None] MFA Rules not processed for user `66e653c2ba034b269a99e7335e810861`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:54.800875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-076b694a-d3bf-4acd-bc88-4d4da5ecf7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:54.889424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:54.890174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:54.893651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:54.894236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.029792 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1207/2408] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:55.031314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a8b5d-6fe6-4b9a-a1b7-f60458e00e45 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.031706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a8b5d-6fe6-4b9a-a1b7-f60458e00e45 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.031869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a8b5d-6fe6-4b9a-a1b7-f60458e00e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.035678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:55.037325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:55.066739 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1202/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:55.067773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:55.079944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f24a8b5d-6fe6-4b9a-a1b7-f60458e00e45 None None] MFA Rules not processed for user `c4e1ac1b40e94dbc80548a1f45919b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:55.081186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f24a8b5d-6fe6-4b9a-a1b7-f60458e00e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:55.288134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1208/2410] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:55.292472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b814c60-25a6-4a2a-9213-10165c7d741e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.292472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b814c60-25a6-4a2a-9213-10165c7d741e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.292472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b814c60-25a6-4a2a-9213-10165c7d741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.333955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eb8c1-1bf2-4ded-853c-47db678afcaf service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:55.341442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4b814c60-25a6-4a2a-9213-10165c7d741e None None] MFA Rules not processed for user `5076cb5048a647f48c286d54fef25506`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:55.341442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b814c60-25a6-4a2a-9213-10165c7d741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:55.348405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8fe0e-70e2-4902-bd08-2655b1bed251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:55.349073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8fe0e-70e2-4902-bd08-2655b1bed251 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.349422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8fe0e-70e2-4902-bd08-2655b1bed251 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.349692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8fe0e-70e2-4902-bd08-2655b1bed251 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.350349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8fe0e-70e2-4902-bd08-2655b1bed251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:55.352026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8fe0e-70e2-4902-bd08-2655b1bed251 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:55.380548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1203/2411] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:55.382102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.385530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.385894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.440473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] MFA Rules not processed for user `6f59260019b34b0b8c4c8792afe8b317`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:55.444055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:55.470566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:55.520399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1209/2412] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:55.521600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.521902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.522180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.561276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] MFA Rules not processed for user `e425c7348db042389a189daa866ea06d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:55.562471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:55.641125 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1204/2413] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:55.641125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:55.642762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:55.665736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afe8f2-fd2c-4aa6-9646-83d12aced972 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:55.685594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:55.686245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.686527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.686801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.690098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:55.706274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:55.707195 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1210/2414] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:55.707693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:55.708251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:55.730286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf35fbf-05e4-4ad4-be82-c338d08c591a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:55.739848 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1205/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:55.741073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:55.743994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:55.745465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.745465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.745465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] PATH_INFO: `/v3/projects/7118c94664984394b216e9f1d77cef7d/users/a0ea2319d9794a5a8ce7de8b5df76fec/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.772605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5d95c-ada7-4df7-91d4-d40f6cc2d030 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:55.780544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7118c94664984394b216e9f1d77cef7d, user_id=a0ea2319d9794a5a8ce7de8b5df76fec, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:55.785787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:55.786681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:55.787951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:55.789779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:55.793524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] PATH_INFO: `/v3/users/483145a466ca47029d351d05525b7e05` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:55.800832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483145a466ca47029d351d05525b7e05)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:55.802714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:55.887802 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1211/2416] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:55 2022] PUT /identity/v3/projects/7118c94664984394b216e9f1d77cef7d/users/a0ea2319d9794a5a8ce7de8b5df76fec/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:55.889416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:56.001697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:56.016155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d56cc6-3461-40dc-8693-06a43bdc4536 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:56.021497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a35693-ed16-4313-8a05-fc295fcd2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:56.022126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a35693-ed16-4313-8a05-fc295fcd2676 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.022412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a35693-ed16-4313-8a05-fc295fcd2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.022793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a35693-ed16-4313-8a05-fc295fcd2676 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.023770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a35693-ed16-4313-8a05-fc295fcd2676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:56.025991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a35693-ed16-4313-8a05-fc295fcd2676 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:56.084361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483145a466ca47029d351d05525b7e05'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:56.104285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483145a466ca47029d351d05525b7e05'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:56.105666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483145a466ca47029d351d05525b7e05'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:56.153163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1212/2417] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:51:55 2022] POST /identity/v3/projects => generated 409 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:56.154440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483145a466ca47029d351d05525b7e05'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:56.158563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678676f-dad4-4e3e-9a28-f90bb8b4a508 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.160191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483145a466ca47029d351d05525b7e05'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:56.161359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678676f-dad4-4e3e-9a28-f90bb8b4a508 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.161836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678676f-dad4-4e3e-9a28-f90bb8b4a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.270696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f678676f-dad4-4e3e-9a28-f90bb8b4a508 None None] MFA Rules not processed for user `a0ea2319d9794a5a8ce7de8b5df76fec`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:56.273964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f678676f-dad4-4e3e-9a28-f90bb8b4a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:56.289574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1206/2418] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:55 2022] DELETE /identity/v3/users/483145a466ca47029d351d05525b7e05 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:56.295568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:56.302733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:56.381590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:56.446863 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1213/2419] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:56.449135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.449766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.450345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.510033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094c151-0946-4ef5-ba59-2e2939643ae7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:56.513481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:56.522782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:56.531409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:56.532139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.532341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.532618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.533274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:56.535271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:56.551638 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1214/2420] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:56.577776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:56.582050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:56.677871 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1207/2421] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:51:56 2022] POST /identity/v3/users => generated 311 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:51:56.679197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:56.710047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfa92a-0d76-4a3f-b7d0-7b77165762c3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:56.726416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:56.729438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.729946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.731227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df4032-3582-4a1e-abe3-7f3f52f2f6c4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:56.732355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.734656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:56.737515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:56.745071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:56.746291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.747447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.748917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.766734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1208/2422] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:56.771540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:56.772238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:56.780383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:56.787753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a60f-5aa6-4efd-9796-cca9258022ad admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:56.789336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1215/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:51:56.810035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:56.810748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:56.811121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:56.811896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] PATH_INFO: `/v3/projects/db54fd3987e9474ab1d8d095ad58ed27/users/5c9544c4607443cea7e9c5a454619d41/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:56.832038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db54fd3987e9474ab1d8d095ad58ed27, user_id=5c9544c4607443cea7e9c5a454619d41, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:56.835400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:56.985278 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1209/2424] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:56 2022] PUT /identity/v3/projects/db54fd3987e9474ab1d8d095ad58ed27/users/5c9544c4607443cea7e9c5a454619d41/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:56.985434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:56.995506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3b833-34f5-4679-857e-a4f0fda91345 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:57.157841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3201a29-db5e-4612-a1b3-9fc2a315aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:57.159236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201a29-db5e-4612-a1b3-9fc2a315aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:57.159833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201a29-db5e-4612-a1b3-9fc2a315aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:57.160260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201a29-db5e-4612-a1b3-9fc2a315aa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:57.166100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201a29-db5e-4612-a1b3-9fc2a315aa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:57.166100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201a29-db5e-4612-a1b3-9fc2a315aa86 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:57.174134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1216/2425] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:51:57.178501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:57.191337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d5a9-2c08-44bd-817f-70c76a993f54 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:57.196932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914099dd-3918-4e7d-853d-fd677a65192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:57.197968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914099dd-3918-4e7d-853d-fd677a65192b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:57.198517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914099dd-3918-4e7d-853d-fd677a65192b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:57.199038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914099dd-3918-4e7d-853d-fd677a65192b admin admin] PATH_INFO: `/v3/projects/db54fd3987e9474ab1d8d095ad58ed27/users/5c9544c4607443cea7e9c5a454619d41/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:57.201628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914099dd-3918-4e7d-853d-fd677a65192b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db54fd3987e9474ab1d8d095ad58ed27, user_id=5c9544c4607443cea7e9c5a454619d41, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:57.205083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914099dd-3918-4e7d-853d-fd677a65192b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:57.228736 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1210/2426] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:51:57 2022] PUT /identity/v3/projects/db54fd3987e9474ab1d8d095ad58ed27/users/5c9544c4607443cea7e9c5a454619d41/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:57.232173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:57.232477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:57.232759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:57.270104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] MFA Rules not processed for user `5c9544c4607443cea7e9c5a454619d41`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:57.271476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:57.418174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1217/2427] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:51:57 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:57.529026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3037782-dabb-477f-a93c-4f8c619b9798 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:57.529696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3037782-dabb-477f-a93c-4f8c619b9798 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:57.530155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3037782-dabb-477f-a93c-4f8c619b9798 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:57.532181 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1211/2428] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:51:57.632610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:57.634423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:57.702626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:57.702922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:57.703422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:57.737125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:57.739126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:57.758207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004a17-e25c-4bfe-9d95-1b0aed44652e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:57.764555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:57.765494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:57.765835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:57.766120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] PATH_INFO: `/v3/projects/9d7dedf5039043e99d49f60d147cfe3a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:57.768381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7dedf5039043e99d49f60d147cfe3a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:57.770774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:57.804990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:57.830434 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1212/2429] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:51:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:57.880734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:57.944792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7dedf5039043e99d49f60d147cfe3a', 'request_id': 'req-6a15f794-cb84-481b-afaf-19331281fe3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:57.954424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7dedf5039043e99d49f60d147cfe3a', 'request_id': 'req-6a15f794-cb84-481b-afaf-19331281fe3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:57.966143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7dedf5039043e99d49f60d147cfe3a', 'request_id': 'req-6a15f794-cb84-481b-afaf-19331281fe3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.010716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:58.012206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:58.033930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f98b4-21c7-4155-9798-8973a26842e4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:58.050452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] The token cache is being invalidate because project 9d7dedf5039043e99d49f60d147cfe3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:51:58.050962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.051798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a15f794-cb84-481b-afaf-19331281fe3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.056432 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1218/2430] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:51:57 2022] DELETE /identity/v3/projects/9d7dedf5039043e99d49f60d147cfe3a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:58.056432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:58.056432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:58.056432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:58.082094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:51:58.083795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:58.110983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:58.111994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:58.112371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:58.112697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:58.114625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:58.128050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:58.129797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:58.143749 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1213/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:58.144346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:58.145329 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1219/2432] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:51:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:51:58.149017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:58.190118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:58.191805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:58.209453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44177e-71a9-4d31-8366-e3b0b1d94135 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:58.218385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:58.219033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:58.219306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:58.219574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:58.239629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:58.242801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:58.250216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1b232-858e-440d-86a7-013e408b04cc service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:58.255400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:58.255899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1220/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:58.256253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:58.256741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:58.257015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] PATH_INFO: `/v3/users/d184ba9bb82a4cae820b2270bf1ff561` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:58.258386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d184ba9bb82a4cae820b2270bf1ff561)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:58.260487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:58.269009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:58.460838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:58.462416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:58.545001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd184ba9bb82a4cae820b2270bf1ff561'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.562744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd184ba9bb82a4cae820b2270bf1ff561'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.564485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd184ba9bb82a4cae820b2270bf1ff561'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.600385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd184ba9bb82a4cae820b2270bf1ff561'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.601570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd184ba9bb82a4cae820b2270bf1ff561'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:51:58.702460 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1214/2434] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:51:58 2022] DELETE /identity/v3/users/d184ba9bb82a4cae820b2270bf1ff561 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:51:58.710945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1860-edbe-4893-8a2d-d13849948c9b service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:58.759547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:58.932846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:58.933549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:58.936043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:58.936043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:58.937240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:59.115966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:59.117707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:59.122964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:59.122964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:59.147909 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1221/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:59.153206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaff17-ef4c-4d9a-bba1-19c8b2e0864b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:59.180763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:59.181789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:59.182231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:59.182673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:59.188621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:51:59.345430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:51:59.347259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:51:59.370458 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1215/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:51:59.601863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:51:59.897740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:51:59.918845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd804a-0813-44f6-b90f-33d871e0dd0e service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:51:59.939381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:51:59.940556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:51:59.941577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:51:59.942007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:51:59.948051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:00.062322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:00.194051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:00.195750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:00.230308 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1222/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:51:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:00.662083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:00.667114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:00.897140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:00.898624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:00.940257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a98b-ce5d-4336-84a4-3bb008c19c1f service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:00.967887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:00.970899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:00.971490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:00.971978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:00.978013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:01.005509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:01.014754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1f2a-fc7e-463b-bb89-1b8a4f508e79 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:01.044009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:01.046996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:01.049257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:01.049802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] PATH_INFO: `/v3/projects/5a7a8a969966467291c440899443b8c5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:01.052979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7a8a969966467291c440899443b8c5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:01.060860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:01.369266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:01.378741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287626-ec2b-4827-8bb4-cbf78a3f937b service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:01.394493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7a8a969966467291c440899443b8c5', 'request_id': 'req-45042470-e688-4aa6-87e6-7fc29996a19e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:01.415571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7a8a969966467291c440899443b8c5', 'request_id': 'req-45042470-e688-4aa6-87e6-7fc29996a19e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:01.422267 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1223/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:00 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:01.437569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7a8a969966467291c440899443b8c5', 'request_id': 'req-45042470-e688-4aa6-87e6-7fc29996a19e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:01.575251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] The token cache is being invalidate because project 5a7a8a969966467291c440899443b8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:01.575564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:01.576284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:01.577932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1216/2439] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:00 2022] DELETE /identity/v3/projects/5a7a8a969966467291c440899443b8c5 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:01.586115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e539-1ce3-4aeb-8163-81aef14aa111 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:01.586476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e539-1ce3-4aeb-8163-81aef14aa111 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:01.586763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e539-1ce3-4aeb-8163-81aef14aa111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:01.669901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-92e2e539-1ce3-4aeb-8163-81aef14aa111 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:01.669901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92e2e539-1ce3-4aeb-8163-81aef14aa111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:01.765407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:01.769522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:01.887199 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1224/2440] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:01.895553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:01.896068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:01.896576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:01.940830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:01.943678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:01.946720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45042470-e688-4aa6-87e6-7fc29996a19e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:01.956392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:01.958508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:01.959847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:01.960686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] PATH_INFO: `/v3/users/a0ea2319d9794a5a8ce7de8b5df76fec` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:01.964323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ea2319d9794a5a8ce7de8b5df76fec)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:01.967651 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1225/2441] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:01.968007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:01.970271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:01.992131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa486f-c890-44ca-a1ee-34c4b478b37b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:02.015171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:02.016823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:02.017255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:02.017583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:02.020785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:02.021301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:02.029373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:02.052101 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1226/2442] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:02.058117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:02.071094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6ada-b802-4478-871f-777d4b3e5007 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:02.081711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:02.085345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:02.085345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:02.085345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:02.085970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:02.089832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:02.291261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ea2319d9794a5a8ce7de8b5df76fec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.295799 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1227/2443] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:02 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:02.296709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:02.300674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:02.324039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ea2319d9794a5a8ce7de8b5df76fec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.326495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ea2319d9794a5a8ce7de8b5df76fec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.382860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ea2319d9794a5a8ce7de8b5df76fec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.384225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ea2319d9794a5a8ce7de8b5df76fec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.483880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b816e-1e01-465a-a445-142a8fd78a0b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:02.494687 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1217/2444] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:01 2022] DELETE /identity/v3/users/a0ea2319d9794a5a8ce7de8b5df76fec => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:02.504416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:02.504416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:02.504648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:02.504648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:02.504648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:02.504648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] PATH_INFO: `/v3/users/5076cb5048a647f48c286d54fef25506` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:02.507244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5076cb5048a647f48c286d54fef25506)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:02.514703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:02.652021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fa617-c691-4ce0-8c60-aa11516edd85 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:02.659639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf7fe2-b17c-4e56-b4e8-e690928885fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:02.660382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf7fe2-b17c-4e56-b4e8-e690928885fe admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:02.660961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf7fe2-b17c-4e56-b4e8-e690928885fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:02.661569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf7fe2-b17c-4e56-b4e8-e690928885fe admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:02.662932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf7fe2-b17c-4e56-b4e8-e690928885fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:02.665476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf7fe2-b17c-4e56-b4e8-e690928885fe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:02.760757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:02.801127 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1218/2445] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:02 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:02.802528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:02.802822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:02.803130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:02.821930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5076cb5048a647f48c286d54fef25506'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.838459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5076cb5048a647f48c286d54fef25506'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.840956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5076cb5048a647f48c286d54fef25506'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.842223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5076cb5048a647f48c286d54fef25506'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.878839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:02.881538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:02.883934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5076cb5048a647f48c286d54fef25506'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:02.949699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1219/2446] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:02.951950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:02.959055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:03.026222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cf425-35e8-4669-8492-4e9b98372df7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:03.063293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89a466-ed41-497d-ba82-33ade5ebeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:03.064720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a466-ed41-497d-ba82-33ade5ebeaac admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.066045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a466-ed41-497d-ba82-33ade5ebeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.066045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a466-ed41-497d-ba82-33ade5ebeaac admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.066566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a466-ed41-497d-ba82-33ade5ebeaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:03.067241 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1228/2447] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:02 2022] DELETE /identity/v3/users/5076cb5048a647f48c286d54fef25506 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:03.070825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:03.071372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:03.073651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a466-ed41-497d-ba82-33ade5ebeaac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:03.094807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1220/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:03.094807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.094807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.094807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.171950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:03.176624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:03.332458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc033f8d-4b37-488b-bb6f-2891f4a3ea6f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:03.353724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:03.355377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.357777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.361107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.433932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1221/2449] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:03.438058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:03.463525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb5be1-65e3-4c33-aff6-d102a6018e68 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:03.473264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:03.473901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.480296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.480296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.480296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:03.480296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:03.509339 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1222/2450] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:03.509339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:03.518102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:03.551697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc6e46-bbe7-4672-928e-7d5049f4a169 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:03.570774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b21cb-dd33-4f23-bc44-6319e53d3020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:03.571485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b21cb-dd33-4f23-bc44-6319e53d3020 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.571767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b21cb-dd33-4f23-bc44-6319e53d3020 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.572045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b21cb-dd33-4f23-bc44-6319e53d3020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.585463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:03.589178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:03.609579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b21cb-dd33-4f23-bc44-6319e53d3020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:03.610984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b21cb-dd33-4f23-bc44-6319e53d3020 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:03.628242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1229/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:03.654428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:03.664042 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1223/2452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:03.674430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553fefe-b6db-4e75-9d44-bf43600db0b9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:03.691324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:03.692012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.692293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.692567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] PATH_INFO: `/v3/projects/080ecbe08b1c4b05aff5538389f4a61e/users/d6536eb00ae1439e86079a232a8cc7f4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.697434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:03.729569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=080ecbe08b1c4b05aff5538389f4a61e, user_id=d6536eb00ae1439e86079a232a8cc7f4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:03.735665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:03.853687 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1230/2453] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:03 2022] PUT /identity/v3/projects/080ecbe08b1c4b05aff5538389f4a61e/users/d6536eb00ae1439e86079a232a8cc7f4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:03.866031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:03.866909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:03.867456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:03.920542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] MFA Rules not processed for user `d6536eb00ae1439e86079a232a8cc7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:03.922525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:04.076931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1224/2454] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:04.077153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:04.228079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239692-8b78-4bab-a624-5081001ff7fd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:04.237343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:04.237994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:04.238455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:04.238737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:04.239436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:04.242182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:04.416359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1231/2455] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:04.418820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:04.433779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08547056-b113-4d84-85dd-fa30f1c8ed11 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:04.623626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:04.624530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:04.624827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:04.625084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:04.632707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:04.634936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:04.793512 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1225/2456] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:04 2022] POST /identity/v3/users => generated 299 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:04.794844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:04.810990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351024-26d7-4121-bd88-a354922887a4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:04.832133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:04.833678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:04.841820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:04.841820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:04.841820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:04.841820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:04.874234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:04.886872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1232/2457] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:04.889719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c8018-7c42-4d82-a986-9b79f621c013 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:04.922313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:04.925313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:04.926015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:04.926488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] PATH_INFO: `/v3/projects/4312100902594e85b627cc22bb77c304/users/574964da3b8e4320b307434a1e861bfc/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:04.970536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4312100902594e85b627cc22bb77c304, user_id=574964da3b8e4320b307434a1e861bfc, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:04.973914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:05.129561 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1226/2458] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:04 2022] PUT /identity/v3/projects/4312100902594e85b627cc22bb77c304/users/574964da3b8e4320b307434a1e861bfc/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:05.133854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:05.149246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acd8c-49e1-4379-a3e3-f1f784133c28 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:05.316408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca0e15-57ce-4d78-b97e-eaf27426b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:05.317263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0e15-57ce-4d78-b97e-eaf27426b33d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:05.317709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0e15-57ce-4d78-b97e-eaf27426b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:05.318136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca0e15-57ce-4d78-b97e-eaf27426b33d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:05.319459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca0e15-57ce-4d78-b97e-eaf27426b33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:05.321567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca0e15-57ce-4d78-b97e-eaf27426b33d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:05.339033 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1233/2459] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:05.343150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:05.355332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc549-6f72-4ea2-bc9b-a0d752d614ff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:05.368329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:05.369022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:05.369304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:05.369575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] PATH_INFO: `/v3/projects/4312100902594e85b627cc22bb77c304/users/574964da3b8e4320b307434a1e861bfc/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:05.371723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4312100902594e85b627cc22bb77c304, user_id=574964da3b8e4320b307434a1e861bfc, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:05.380928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:05.413984 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1227/2460] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:05 2022] PUT /identity/v3/projects/4312100902594e85b627cc22bb77c304/users/574964da3b8e4320b307434a1e861bfc/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:05.420536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:05.420736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:05.420975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:05.475880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] MFA Rules not processed for user `574964da3b8e4320b307434a1e861bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:05.476853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:05.536594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:05.639353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1234/2461] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:05.689137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:05.692916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:05.914782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010526-9f00-46ce-9aaf-3f3a0bfcebfe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:05.925079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:05.926095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:05.926803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:05.927344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:05.940263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:05.942994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:05.956609 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1228/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:06.087412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:06.089157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:06.207870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169d13f-d873-4110-8d12-dff0d43834ed None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:06.219617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:06.220402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.220519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.220795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] PATH_INFO: `/v3/projects/7118c94664984394b216e9f1d77cef7d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.223887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7118c94664984394b216e9f1d77cef7d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:06.225825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:06.441776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:06.443552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:06.451187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7118c94664984394b216e9f1d77cef7d', 'request_id': 'req-617cc678-1615-41d6-a225-95202de1505c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.461578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ae5d9-a4a6-4060-b6db-b3e98bab4ef4 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:06.462530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7118c94664984394b216e9f1d77cef7d', 'request_id': 'req-617cc678-1615-41d6-a225-95202de1505c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.469356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7118c94664984394b216e9f1d77cef7d', 'request_id': 'req-617cc678-1615-41d6-a225-95202de1505c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.527902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:06.549068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:06.549068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.549068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.549068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] PATH_INFO: `/v3/projects/485c44e342ed40efac7984922701f623` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.550966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] RBAC: Authorizing `identity:delete_project(project_id=485c44e342ed40efac7984922701f623)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:06.553452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:06.573566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] The token cache is being invalidate because project 7118c94664984394b216e9f1d77cef7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:06.577146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.577146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-617cc678-1615-41d6-a225-95202de1505c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.578636 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1235/2463] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:06 2022] DELETE /identity/v3/projects/7118c94664984394b216e9f1d77cef7d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:06.584283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507755c-8641-48cc-81c1-b8d4c570a62c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.584843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507755c-8641-48cc-81c1-b8d4c570a62c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.585394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507755c-8641-48cc-81c1-b8d4c570a62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.628548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4507755c-8641-48cc-81c1-b8d4c570a62c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:06.630177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4507755c-8641-48cc-81c1-b8d4c570a62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:06.647499 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1236/2464] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:06.656179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.657127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.658511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.685539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:06.687701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:06.708887 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1237/2465] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:06.710332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:06.723499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92404b4c-301d-4a93-8e4d-b81614e52ad2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:06.754243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485c44e342ed40efac7984922701f623', 'request_id': 'req-5568a73c-d42f-4990-9515-e6d0f4d4464a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.767343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485c44e342ed40efac7984922701f623', 'request_id': 'req-5568a73c-d42f-4990-9515-e6d0f4d4464a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.780864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485c44e342ed40efac7984922701f623', 'request_id': 'req-5568a73c-d42f-4990-9515-e6d0f4d4464a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.833348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:06.833985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.834529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.834529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.835720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:06.835720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:06.837397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:06.855265 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1238/2466] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:06.859312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:06.868316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b58ff-5230-47fb-aaf0-db15236b5b20 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:06.874410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:06.875408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.875766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.876114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.877723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:06.879891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:06.890261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] The token cache is being invalidate because project 485c44e342ed40efac7984922701f623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:06.890574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.891289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:06.898324 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1229/2467] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:06 2022] DELETE /identity/v3/projects/485c44e342ed40efac7984922701f623 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:06.899467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:06.900892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:06.936307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568a73c-d42f-4990-9515-e6d0f4d4464a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:06.958242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:06.958242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:06.958242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:06.958242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] PATH_INFO: `/v3/users/5c9544c4607443cea7e9c5a454619d41` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:06.959142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9544c4607443cea7e9c5a454619d41)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:06.961162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:06.978690 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1239/2468] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:06 2022] POST /identity/v3/projects => generated 397 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:06.983659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:06.987720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:07.128400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60543f4-c692-49e2-bbf8-77bb6ab71bdd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:07.134902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:07.135699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:07.136077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:07.136448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:07.137223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:07.140569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:07.266486 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1240/2469] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:06 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:07.270851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:07.298856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9544c4607443cea7e9c5a454619d41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:07.316123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9544c4607443cea7e9c5a454619d41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:07.317294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9544c4607443cea7e9c5a454619d41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:07.326618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a735e-1d0f-4101-96ca-903b08163a05 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:07.338380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:07.340767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:07.341029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9544c4607443cea7e9c5a454619d41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:07.341853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-156f7eec-de4b-4c1a-b8f9-367692a78dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9544c4607443cea7e9c5a454619d41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:07.342159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:07.344393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:07.346730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:07.349928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:07.379455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1241/2470] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:52:07.380794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:07.382633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:07.399881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da4b26-4f69-49d0-8620-037dbddf5e75 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:07.409591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:07.410431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:07.410737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:07.411153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:07.411876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:07.413812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:07.443070 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1242/2471] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:07.446843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:07.454591 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1230/2472] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:06 2022] DELETE /identity/v3/users/5c9544c4607443cea7e9c5a454619d41 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:07.473671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74293-c8b8-44b3-b0f5-9b5cc9cb1f37 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:07.643376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:07.649804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:07.649804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:07.649804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] PATH_INFO: `/v3/projects/52177b94887d409f9034b3cee40237dd/users/117e12084c60416aabce823ebae4f214/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:07.677462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52177b94887d409f9034b3cee40237dd, user_id=117e12084c60416aabce823ebae4f214, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:07.680547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:07.772344 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1243/2473] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:07 2022] PUT /identity/v3/projects/52177b94887d409f9034b3cee40237dd/users/117e12084c60416aabce823ebae4f214/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:07.774104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:07.774401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:07.774680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:07.799685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:07.801152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:07.899680 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1231/2474] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:07.953984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:07.955184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:08.027386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984ffca-595e-4456-8ab1-f167ee32e89f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:08.033368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:08.034393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:08.034675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:08.034950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:08.057813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:08.060133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:08.078764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:08.115983 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1244/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:52:08.843304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:08.848827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:08.849278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:08.851202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:08.878720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07009ada-a8e5-4554-b68a-8f3d09095a2d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:08.896944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:08.897865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:08.898180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:08.898617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] PATH_INFO: `/v3/users/d6536eb00ae1439e86079a232a8cc7f4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:08.901002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6536eb00ae1439e86079a232a8cc7f4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:08.904047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:09.062873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497df66e-22ec-4933-a247-5fe93c2e1365 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:09.072521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:09.073236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.073425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.073853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.077356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.235668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6536eb00ae1439e86079a232a8cc7f4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.238831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:09.242562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:09.254561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6536eb00ae1439e86079a232a8cc7f4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.255429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6536eb00ae1439e86079a232a8cc7f4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.256168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6536eb00ae1439e86079a232a8cc7f4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.259537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1232/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:09.260580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:09.262280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.266008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:09.285693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6466fc-d0e7-415e-87d8-6c9dd613f643 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:09.297541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:09.297541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.298182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.298661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] PATH_INFO: `/v3/projects/db54fd3987e9474ab1d8d095ad58ed27` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.301364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db54fd3987e9474ab1d8d095ad58ed27)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:09.316346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:09.319189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-edba4172-3fc8-49e2-95e9-5504c94eacc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6536eb00ae1439e86079a232a8cc7f4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.423634 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1245/2477] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:08 2022] DELETE /identity/v3/users/d6536eb00ae1439e86079a232a8cc7f4 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:09.428338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee903-dd27-4c45-9359-a35559fed89f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.428883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee903-dd27-4c45-9359-a35559fed89f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.429369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee903-dd27-4c45-9359-a35559fed89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.456757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-254ee903-dd27-4c45-9359-a35559fed89f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:09.458573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-254ee903-dd27-4c45-9359-a35559fed89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.528746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db54fd3987e9474ab1d8d095ad58ed27', 'request_id': 'req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.543000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db54fd3987e9474ab1d8d095ad58ed27', 'request_id': 'req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.555251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db54fd3987e9474ab1d8d095ad58ed27', 'request_id': 'req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.624242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1246/2478] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:09.629147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] The token cache is being invalidate because project db54fd3987e9474ab1d8d095ad58ed27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:09.629477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.631291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bad4a6e-d55d-4a20-b449-89fdb46e8d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:09.639202 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1233/2479] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:09 2022] DELETE /identity/v3/projects/db54fd3987e9474ab1d8d095ad58ed27 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:09.640596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.640990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.641368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.682319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:09.683744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.753047 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1247/2480] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:09.761709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.762337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.762919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.815569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:09.817486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.832039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1234/2481] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:09.836428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:09.846640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:09.849411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f24a8-cc17-4726-9aef-061a1d763c09 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:09.850977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.857467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:09.858225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.858581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.859146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.860174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:09.860554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:09.863261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:09.881762 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1248/2482] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:09.887770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:09.901222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1023e1-ab85-4c7e-ac22-2d274676452a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:09.912171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:09.914157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.915494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.915882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.916634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:09.919517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:09.940730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baece8-94ff-4879-bb08-88fc11e123c5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:09.946195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:09.947194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:09.947638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:09.948015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:09.950180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:09.969906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:09.971060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:09.982973 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1235/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:10.035891 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1249/2484] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:09 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:10.037355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:10.048629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42be8f5-2a7d-426c-bf21-37add57f440a service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:10.122635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:10.127389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:10.128806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.129256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.129687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.130492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:10.132751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:10.218322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1236/2485] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:10 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:10.220583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:10.246457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63905499-e788-4a67-95fa-91b7430d8009 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:10.252816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:10.253828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.258634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.259800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.260697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:10.263554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:10.276174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1250/2486] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:10.285538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:10.300842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe505353-f199-4ebd-b653-12118c129f0e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:10.305973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da39dd-2109-46e3-bfd6-c792c1ec772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:10.306815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da39dd-2109-46e3-bfd6-c792c1ec772a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.307358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da39dd-2109-46e3-bfd6-c792c1ec772a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.311650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da39dd-2109-46e3-bfd6-c792c1ec772a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.311650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da39dd-2109-46e3-bfd6-c792c1ec772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:10.311650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da39dd-2109-46e3-bfd6-c792c1ec772a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:10.321492 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1237/2487] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:10.326380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:10.337624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeea03-e62c-4db7-a4b0-2bceb752d42c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:10.343359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:10.344338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.344673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.345165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96/users/e12f56e39d3847dc886258de14e533ef/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.364347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c94fb551d3488ea0bbf8e8249bff96, user_id=e12f56e39d3847dc886258de14e533ef, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:10.367213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:10.470113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1251/2488] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:10 2022] PUT /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96/users/e12f56e39d3847dc886258de14e533ef/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:10.479925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.480219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.480506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.511209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] MFA Rules not processed for user `e12f56e39d3847dc886258de14e533ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:10.512473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:10.602999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:10.603315 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1238/2489] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:10.674199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef54b0-1a59-4965-a49f-cc66e157182d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:10.679445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:10.680062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.680346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.680620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.681247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:10.683446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:10.822855 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1252/2490] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:10 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:10.823963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:10.836597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd70fd6-01ee-4e26-bfef-770bb43eeaab None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:10.902729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:10.904081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:10.904565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:10.905069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:10.906017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:10.908279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:11.473355 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1239/2491] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:10 2022] POST /identity/v3/users => generated 297 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:11.477372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:11.490284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed80e1-0ef3-4fad-ad6e-0319c097794b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:11.495653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:11.496264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:11.496547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:11.496847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:11.497489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:11.499549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:11.514726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1253/2492] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:11.517847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:11.531501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05601d46-fd55-474f-bb32-ad605a716bd2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:11.536466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:11.537383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:11.537776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:11.538597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] PATH_INFO: `/v3/projects/6f4cb36eb34c4461bd73c1ce2c945628/users/a1eb77b7185e45f1835dc101b05d6b66/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:11.554862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cb36eb34c4461bd73c1ce2c945628, user_id=a1eb77b7185e45f1835dc101b05d6b66, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:11.557775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:11.601369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:11.603630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:11.618885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce00989-b2cf-48de-b0e4-6ab6d4384fff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:11.625212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:11.625984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:11.626265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:11.626539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] PATH_INFO: `/v3/users/cb3205571a8e40819cb6fc3532733ee7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:11.627750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3205571a8e40819cb6fc3532733ee7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:11.629763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:11.665740 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1240/2493] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:11 2022] PUT /identity/v3/projects/6f4cb36eb34c4461bd73c1ce2c945628/users/a1eb77b7185e45f1835dc101b05d6b66/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:11.670738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:11.767927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff846a-b970-447e-9dc4-73c7341058df admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:11.773949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:11.774678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:11.775150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:11.775436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:11.776153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:11.777686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:11.785987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:11.810738 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1241/2494] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:11.836423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:11.872223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa688a-71e9-4a8a-86fb-becbe317ec34 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:11.874280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3205571a8e40819cb6fc3532733ee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:11.893474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65662a4-c146-451c-817c-728fb243bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:11.895068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65662a4-c146-451c-817c-728fb243bbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:11.895363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65662a4-c146-451c-817c-728fb243bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:11.895905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65662a4-c146-451c-817c-728fb243bbaf admin admin] PATH_INFO: `/v3/projects/6f4cb36eb34c4461bd73c1ce2c945628/users/a1eb77b7185e45f1835dc101b05d6b66/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:11.897791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3205571a8e40819cb6fc3532733ee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:11.898874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65662a4-c146-451c-817c-728fb243bbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cb36eb34c4461bd73c1ce2c945628, user_id=a1eb77b7185e45f1835dc101b05d6b66, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:11.899476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3205571a8e40819cb6fc3532733ee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:11.902740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65662a4-c146-451c-817c-728fb243bbaf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:11.906144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3205571a8e40819cb6fc3532733ee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:11.926719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1242/2495] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:11 2022] PUT /identity/v3/projects/6f4cb36eb34c4461bd73c1ce2c945628/users/a1eb77b7185e45f1835dc101b05d6b66/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:11.938444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3205571a8e40819cb6fc3532733ee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:11.941730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:11.942252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:11.942774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:11.994545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] MFA Rules not processed for user `a1eb77b7185e45f1835dc101b05d6b66`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:11.995724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:12.041591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1254/2496] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:11 2022] DELETE /identity/v3/users/cb3205571a8e40819cb6fc3532733ee7 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:12.123270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:12.125494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:12.133080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1243/2497] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:12.195312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:12.197049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:12.259553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedc61-5775-4168-a91b-ef169fbcbffb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:12.266690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:12.267629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:12.268183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:12.268626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:12.272131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:12.299859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:12.302133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:12.317249 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1255/2498] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:12.357488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6c145-62af-4900-89f0-060cad6b745a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:12.449872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:12.460247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:12.462457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:12.462457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] PATH_INFO: `/v3/projects/080ecbe08b1c4b05aff5538389f4a61e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:12.463102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080ecbe08b1c4b05aff5538389f4a61e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:12.473308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:12.641410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080ecbe08b1c4b05aff5538389f4a61e', 'request_id': 'req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:12.662146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080ecbe08b1c4b05aff5538389f4a61e', 'request_id': 'req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:12.671947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080ecbe08b1c4b05aff5538389f4a61e', 'request_id': 'req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:12.754820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] The token cache is being invalidate because project 080ecbe08b1c4b05aff5538389f4a61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:12.755748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:12.757009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:12.761510 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1244/2499] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:12 2022] DELETE /identity/v3/projects/080ecbe08b1c4b05aff5538389f4a61e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:12.764026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:12.797833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a7bb9-621b-4b81-8a4b-f64c83eaddfa service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:12.805331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:12.807204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:12.891226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:12.891872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:12.892159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:12.892442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] PATH_INFO: `/v3/users/574964da3b8e4320b307434a1e861bfc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:12.893662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574964da3b8e4320b307434a1e861bfc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:12.895686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:12.936039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7344c8-180a-45be-b2fc-43b8f2dc4d44 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:12.942412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:12.943320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:12.943669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:12.943949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:12.945859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:13.034960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:13.036765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69db9c-2d85-43b2-9432-d20defc7ea12 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:13.050135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1245/2500] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:13.066394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc46b-30c0-401c-b0af-8e272ac0b028 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:13.067379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc46b-30c0-401c-b0af-8e272ac0b028 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:13.067903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc46b-30c0-401c-b0af-8e272ac0b028 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:13.070264 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1246/2501] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:52:13.076466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc46b-30c0-401c-b0af-8e272ac0b028 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:13.093754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc46b-30c0-401c-b0af-8e272ac0b028 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:13.108084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc46b-30c0-401c-b0af-8e272ac0b028 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:13.114781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:13.115292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:13.115801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:13.115801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:13.117591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:13.119886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:13.122772 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1247/2502] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:13 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:13.238166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574964da3b8e4320b307434a1e861bfc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.246452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574964da3b8e4320b307434a1e861bfc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.248261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574964da3b8e4320b307434a1e861bfc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.251906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574964da3b8e4320b307434a1e861bfc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.284476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574964da3b8e4320b307434a1e861bfc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.362907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1256/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:12 2022] DELETE /identity/v3/users/574964da3b8e4320b307434a1e861bfc => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:13.373899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:13.376021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:13.379578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:13.415120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905caa64-324d-4153-b539-6e2dd6812a93 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:13.540407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:13.545748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:13.545748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:13.545748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] PATH_INFO: `/v3/projects/5a88888b8b2e4698ae4c67198db159e8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:13.545748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a88888b8b2e4698ae4c67198db159e8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:13.545748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:13.731038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a88888b8b2e4698ae4c67198db159e8', 'request_id': 'req-333ba532-a3dd-4708-b921-f7562efe35c5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.768912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a88888b8b2e4698ae4c67198db159e8', 'request_id': 'req-333ba532-a3dd-4708-b921-f7562efe35c5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.776919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a88888b8b2e4698ae4c67198db159e8', 'request_id': 'req-333ba532-a3dd-4708-b921-f7562efe35c5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.879124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] The token cache is being invalidate because project 5a88888b8b2e4698ae4c67198db159e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:13.879124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.879124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-333ba532-a3dd-4708-b921-f7562efe35c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:13.890750 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1248/2504] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:13 2022] DELETE /identity/v3/projects/5a88888b8b2e4698ae4c67198db159e8 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:13.892368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:13.929139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7858f1c-6f6c-4a47-9c3d-e42e5a79d192 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:14.026945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:14.027668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.028169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.028606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] PATH_INFO: `/v3/users/d2a12eeff77c4fda8921764118c48863` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.029935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a12eeff77c4fda8921764118c48863)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:14.032125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:14.046309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.046881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.047019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.048865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1249/2505] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:52:14.056593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:14.066965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.169200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:14.170603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.264193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f2274-4fd1-4e6e-b9a3-77b997329134 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:14.270496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:14.271577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.271876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.272160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.273684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:14.275976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:14.278819 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1250/2506] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:14 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:14.279983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:14.282146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.296499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a12eeff77c4fda8921764118c48863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.301143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a866e-602d-4198-a2ac-09699b9f25f9 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:14.305924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a12eeff77c4fda8921764118c48863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.306997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a12eeff77c4fda8921764118c48863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.307891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a12eeff77c4fda8921764118c48863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.308151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:14.309104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.310408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.310838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] PATH_INFO: `/v3/projects/4312100902594e85b627cc22bb77c304` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.312429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4312100902594e85b627cc22bb77c304)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:14.321170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:14.328417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da46e786-6b0f-4733-82fd-8b335d208b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a12eeff77c4fda8921764118c48863'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.393889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1257/2507] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:13 2022] DELETE /identity/v3/users/d2a12eeff77c4fda8921764118c48863 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:14.395666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba852fd-b5a2-4837-838d-ab13a6c5ac7b None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.396745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba852fd-b5a2-4837-838d-ab13a6c5ac7b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.396745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba852fd-b5a2-4837-838d-ab13a6c5ac7b None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.401410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1258/2508] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:52:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:14.407423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4979-f514-45b9-9712-5433d2a0a825 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.407710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4979-f514-45b9-9712-5433d2a0a825 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.407949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4979-f514-45b9-9712-5433d2a0a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.467306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c83a4979-f514-45b9-9712-5433d2a0a825 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:14.469140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c83a4979-f514-45b9-9712-5433d2a0a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.485258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4312100902594e85b627cc22bb77c304', 'request_id': 'req-753259f8-81dd-4ca6-94f0-c22df9446f4e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.499424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4312100902594e85b627cc22bb77c304', 'request_id': 'req-753259f8-81dd-4ca6-94f0-c22df9446f4e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.510835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4312100902594e85b627cc22bb77c304', 'request_id': 'req-753259f8-81dd-4ca6-94f0-c22df9446f4e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.607509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] The token cache is being invalidate because project 4312100902594e85b627cc22bb77c304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:14.607859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.608706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-753259f8-81dd-4ca6-94f0-c22df9446f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:14.616273 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1259/2510] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:14.616273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca2e8-a159-4df0-b4ef-93f6c1ce9001 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.616532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca2e8-a159-4df0-b4ef-93f6c1ce9001 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.616629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbca2e8-a159-4df0-b4ef-93f6c1ce9001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.621355 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1251/2510] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:14 2022] DELETE /identity/v3/projects/4312100902594e85b627cc22bb77c304 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:14.623508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.624066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.624821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.643004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9cbca2e8-a159-4df0-b4ef-93f6c1ce9001 None None] MFA Rules not processed for user `e12f56e39d3847dc886258de14e533ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:14.644602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9cbca2e8-a159-4df0-b4ef-93f6c1ce9001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.648650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:14.649951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.733663 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1252/2511] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:14.738792 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1260/2512] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:14.741721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:14.742338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.744081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.744557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.744937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.771636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:14.773266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.782698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1261/2513] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:14.787448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:14.810214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12955d93-f744-4561-82e1-1a1a0b052ec8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:14.816435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:14.817055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.817335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.817607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.818321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:14.826026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:14.827967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:14.838036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d77d-6f14-4102-be1b-33e976c8d6cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:14.842338 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1262/2514] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:14.846540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa54bd5-3353-4075-8cbc-c45ace519750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:14.846721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:14.848001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa54bd5-3353-4075-8cbc-c45ace519750 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.848259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa54bd5-3353-4075-8cbc-c45ace519750 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.848722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa54bd5-3353-4075-8cbc-c45ace519750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.858424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7010-5c9f-4871-b395-1e16535bab23 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:14.863851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:14.864460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.864738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.864960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa54bd5-3353-4075-8cbc-c45ace519750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:14.865068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.865706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:14.867569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:14.874460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa54bd5-3353-4075-8cbc-c45ace519750 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:14.895267 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1253/2515] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:14.922366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:14.922699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:14.922959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:14.966146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:14.967436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:14.975313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1254/2516] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:14.987237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:14.989207 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1263/2517] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:14.993192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.002464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fd18-43ca-4859-8640-c657e486a8ee None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.077915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ccd2-2dd3-4832-9456-e17e5e10cb47 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.078063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.078661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.078947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.079502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.087709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.089668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.096313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.097542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.097985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.098437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.099345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.100040 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1255/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:15.105180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.164550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.166863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:15.189868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5a8ab-b6d5-47cc-8ea3-5b495ff66f8c service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.195286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.196299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.196799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.197228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] PATH_INFO: `/v3/projects/28b8a026daa8470088129962d493ca68` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.198541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b8a026daa8470088129962d493ca68)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.201424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.229012 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1264/2519] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:14 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:15.229964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.236707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:15.378494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b8a026daa8470088129962d493ca68', 'request_id': 'req-b86a3422-f07a-4860-8eb5-f6acad57302b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:15.395937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf328-ab1a-46a6-ae06-23ab238b539d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.398129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b8a026daa8470088129962d493ca68', 'request_id': 'req-b86a3422-f07a-4860-8eb5-f6acad57302b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:15.411610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b8a026daa8470088129962d493ca68', 'request_id': 'req-b86a3422-f07a-4860-8eb5-f6acad57302b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:15.504292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] The token cache is being invalidate because project 28b8a026daa8470088129962d493ca68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:15.505288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:15.506670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:15.509137 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1256/2520] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:15 2022] DELETE /identity/v3/projects/28b8a026daa8470088129962d493ca68 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:15.510250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.517224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:15.553330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.566835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.567849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.568446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.582189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:15.666687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3422-f07a-4860-8eb5-f6acad57302b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.679311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e9a39-8f56-4352-a46d-14d63137d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.679942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9a39-8f56-4352-a46d-14d63137d04a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.680226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9a39-8f56-4352-a46d-14d63137d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.680652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e9a39-8f56-4352-a46d-14d63137d04a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.681315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9a39-8f56-4352-a46d-14d63137d04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.682972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e9a39-8f56-4352-a46d-14d63137d04a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.683854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.686443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.704752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1257/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:15.706294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58a331-69de-45b8-af9c-72695e586141 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.706743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58a331-69de-45b8-af9c-72695e586141 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.707202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58a331-69de-45b8-af9c-72695e586141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.718446 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1265/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:15.719469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.757409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364055d7-090b-4f61-8e7f-14766af81566 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.760793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4f58a331-69de-45b8-af9c-72695e586141 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:15.762929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f58a331-69de-45b8-af9c-72695e586141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:15.763999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.764812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.765342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.766922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.770828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.770828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.783526 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1258/2523] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:15.791347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.791657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.791918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.798266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1266/2524] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:15.802663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.821525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacbdcc-e425-4307-9b9d-680c2f42fdd3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.831116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558593ab-4dd1-4207-9c58-e20c47e70976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.831890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558593ab-4dd1-4207-9c58-e20c47e70976 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.832462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558593ab-4dd1-4207-9c58-e20c47e70976 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.832861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558593ab-4dd1-4207-9c58-e20c47e70976 admin admin] PATH_INFO: `/v3/projects/e285e69559d04059b8f46cb6391cf1c5/users/c8e675249c0f418283681a512ffba40f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.840411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:15.843337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:15.857714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558593ab-4dd1-4207-9c58-e20c47e70976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e285e69559d04059b8f46cb6391cf1c5, user_id=c8e675249c0f418283681a512ffba40f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.859801 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1259/2525] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:15.861042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.861374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558593ab-4dd1-4207-9c58-e20c47e70976 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.879061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3977d-ffde-4c23-aad2-0ddd02571095 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.894509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:15.894509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.894509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.894509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:15.894857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:15.894857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:15.897433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:15.931065 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1260/2526] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:15.932019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:15.944347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:15.953551 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1267/2527] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:15 2022] PUT /identity/v3/projects/e285e69559d04059b8f46cb6391cf1c5/users/c8e675249c0f418283681a512ffba40f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:15.956824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d246e-83af-452c-99ce-1b6fa1b8ee57 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:15.966497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:15.967157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:15.967642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.009062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] MFA Rules not processed for user `c8e675249c0f418283681a512ffba40f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:16.010741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:16.052476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.053564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.066013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.067904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.068862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.072255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.102892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:16.139599 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1268/2528] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:16.144104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.158523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514b149-d5b1-453a-8740-1d84db09686a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.163678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.164686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.165116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.165529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.166363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.168609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.188682 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1261/2529] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:15 2022] POST /identity/v3/projects => generated 391 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:16.192899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.288682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99e40-9f7e-4fca-ba97-c5e5ec1275c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.295341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.296420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.306585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.307630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.310163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1269/2530] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:16 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:16.311919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.314343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.314575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.410891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f6b8a-9713-4bbe-821f-6b1f1b7fc5de admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.417264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.417896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.418175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.418448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.419955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.430159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1262/2531] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:16 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:16.431355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.436955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.457654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249f5e3-ebf6-4241-b7a5-c617d5d952bb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.467282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.467788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.468073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.468344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.469006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.470960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.483229 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1263/2532] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:52:16.487138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.498205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24f44d-a8b6-47ff-a7c6-86a7215ed3be admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.503858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.512429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.512429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.512429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.512429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.512429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.518753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1264/2533] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:52:16.523358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.534332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fb1d9-dd6d-4836-b666-3c13308056fb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.539522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958b37-3dec-497d-8be1-d54177ad3964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.542977 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1270/2534] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:16 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:16.543140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958b37-3dec-497d-8be1-d54177ad3964 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.543140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958b37-3dec-497d-8be1-d54177ad3964 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.543140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958b37-3dec-497d-8be1-d54177ad3964 admin admin] PATH_INFO: `/v3/projects/923e4d16ab5e49318d7ab3bf76cb7d6b/users/824952a92a734ea89b736d9d56ce30b9/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.544576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.557244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee64c8-9d75-457b-9109-51143be6edc8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.559989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd958b37-3dec-497d-8be1-d54177ad3964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923e4d16ab5e49318d7ab3bf76cb7d6b, user_id=824952a92a734ea89b736d9d56ce30b9, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.562920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.563139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd958b37-3dec-497d-8be1-d54177ad3964 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.564057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.564057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.564251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.564724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.567238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.579051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1271/2535] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:16.581663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.591992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af208a0-dfb0-4d4d-9d87-444f310152af admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.596893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.605277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.605616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.605894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] PATH_INFO: `/v3/projects/7ecbce5086154613a5f8a93b667ae9f2/users/821b5d456d334f66a80512ac08799b4a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.622910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecbce5086154613a5f8a93b667ae9f2, user_id=821b5d456d334f66a80512ac08799b4a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.626514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.681600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1265/2536] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:16 2022] PUT /identity/v3/projects/923e4d16ab5e49318d7ab3bf76cb7d6b/users/824952a92a734ea89b736d9d56ce30b9/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:16.694344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.694682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.694903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.726845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] MFA Rules not processed for user `824952a92a734ea89b736d9d56ce30b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:16.728165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:16.731152 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1272/2537] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:16 2022] PUT /identity/v3/projects/7ecbce5086154613a5f8a93b667ae9f2/users/821b5d456d334f66a80512ac08799b4a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:16.735954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.853462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2469-6438-47db-a686-b20302ba7856 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.864644 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1266/2538] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:16.866385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.868548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.872324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.875720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.876024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.877877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.898052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.898258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cffdf6-56b2-4089-93e0-32ad8e0a4ebe None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.898258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.898258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.900737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.913273 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1273/2539] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:16.919182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.919182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.919182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.921231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:16.938672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d688ca-56b1-4ed1-aa53-52b18bb1dcd3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:16.952785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398907-5e72-4da4-89dc-9ad5e51f3446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:16.957791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398907-5e72-4da4-89dc-9ad5e51f3446 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.957791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398907-5e72-4da4-89dc-9ad5e51f3446 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.957791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398907-5e72-4da4-89dc-9ad5e51f3446 admin admin] PATH_INFO: `/v3/projects/7ecbce5086154613a5f8a93b667ae9f2/users/821b5d456d334f66a80512ac08799b4a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:16.959926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c398907-5e72-4da4-89dc-9ad5e51f3446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecbce5086154613a5f8a93b667ae9f2, user_id=821b5d456d334f66a80512ac08799b4a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:16.963264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c398907-5e72-4da4-89dc-9ad5e51f3446 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:16.980089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1274/2540] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:16 2022] PUT /identity/v3/projects/7ecbce5086154613a5f8a93b667ae9f2/users/821b5d456d334f66a80512ac08799b4a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:16.993547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:16.994287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:16.994789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.018541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1267/2541] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:16 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:17.022294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.076885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] MFA Rules not processed for user `821b5d456d334f66a80512ac08799b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:17.078251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:17.166288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d440f03-cd34-4f73-b257-0a6e98df41d2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.189045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.189703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.190025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.190314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.191110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.198128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.229277 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1275/2542] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:17.237416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.251089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dce44-ddde-4237-82ce-ead376bcd0a4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.257254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.258531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.258818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.259157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.259831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:17.260134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.261890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.279273 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1276/2543] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:17.280729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.289759 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1268/2544] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:17 2022] POST /identity/v3/users => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:17.299125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.305889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e653-d2d5-4318-bbb4-c57a4d358b48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.313058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38060f30-b469-4e2f-9fa1-3d180c8a5b0d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.319151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.319914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.320207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.320488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.322466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.323580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.324204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.324489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.324900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.329390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.330490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.332523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.359048 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1269/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:17.361272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.373422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749466c-3ad3-4533-8f0c-4a22ab4fff2a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.378795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9402f-438d-4d82-9af8-036eb398aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.379713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9402f-438d-4d82-9af8-036eb398aa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.380011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9402f-438d-4d82-9af8-036eb398aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.380406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9402f-438d-4d82-9af8-036eb398aa94 admin admin] PATH_INFO: `/v3/projects/47a3ae68d1e447509ec043375cc11f2c/users/ac47b1f7a8db42feb9dc829e332567eb/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.398301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9402f-438d-4d82-9af8-036eb398aa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a3ae68d1e447509ec043375cc11f2c, user_id=ac47b1f7a8db42feb9dc829e332567eb, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.401160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9402f-438d-4d82-9af8-036eb398aa94 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.443502 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1277/2546] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:17.447316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.506113 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1270/2547] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:17 2022] PUT /identity/v3/projects/47a3ae68d1e447509ec043375cc11f2c/users/ac47b1f7a8db42feb9dc829e332567eb/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:17.508353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eecc-9963-4818-bb5a-354940c46a7e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.508804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eecc-9963-4818-bb5a-354940c46a7e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.509167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116eecc-9963-4818-bb5a-354940c46a7e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.510703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1271/2548] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:17.511485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eecc-9963-4818-bb5a-354940c46a7e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.543228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655662e-109b-4f7b-8f78-56058f0dc863 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.630184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116eecc-9963-4818-bb5a-354940c46a7e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.634748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:17.645584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.647879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.648202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.648409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.649028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.652412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.655212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.656161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.656639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.657314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.658314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:17.658703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.661142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.664899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:17.666519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1272/2549] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:17.667486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:17.676581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:17.687581 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1278/2550] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:17.689080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.713706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a8c5a-71ea-45fb-9d54-36f013e23693 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.720096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.721074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.721666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.722042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] PATH_INFO: `/v3/projects/47a3ae68d1e447509ec043375cc11f2c/users/ac47b1f7a8db42feb9dc829e332567eb/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.724548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a3ae68d1e447509ec043375cc11f2c, user_id=ac47b1f7a8db42feb9dc829e332567eb, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.728145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.741639 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1279/2551] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:17 2022] PUT /identity/v3/projects/47a3ae68d1e447509ec043375cc11f2c/users/ac47b1f7a8db42feb9dc829e332567eb/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:17.751143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.751143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:17.785255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:17.794895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:17.840976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681da52-59b3-4e77-ad2e-7f8724ee0e9f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.858536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab51fd8-bbdb-486f-b8e4-97634abd99db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:17.859505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab51fd8-bbdb-486f-b8e4-97634abd99db service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:17.859949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab51fd8-bbdb-486f-b8e4-97634abd99db service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:17.860431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab51fd8-bbdb-486f-b8e4-97634abd99db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:17.938703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960cd8-5ce0-4e48-84cc-96ec63d46ee0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:17.980805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab51fd8-bbdb-486f-b8e4-97634abd99db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:17.983930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab51fd8-bbdb-486f-b8e4-97634abd99db service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:17.997790 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1280/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:18.000552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fc96-dade-496f-8851-1669b457304f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.000552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fc96-dade-496f-8851-1669b457304f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.001151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fc96-dade-496f-8851-1669b457304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.008066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d332b3-45af-412b-bece-84e836683a89 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:18.008940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d332b3-45af-412b-bece-84e836683a89 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.009376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d332b3-45af-412b-bece-84e836683a89 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.010393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d332b3-45af-412b-bece-84e836683a89 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.012151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d332b3-45af-412b-bece-84e836683a89 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:18.014382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d332b3-45af-412b-bece-84e836683a89 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:18.017279 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1273/2553] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:17 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:18.034143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5f3a-b995-472c-a51c-a72283cbb307 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.034564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5f3a-b995-472c-a51c-a72283cbb307 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.034934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5f3a-b995-472c-a51c-a72283cbb307 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.039023 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1274/2554] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:18.044123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5f3a-b995-472c-a51c-a72283cbb307 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:18.047210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1c32fc96-dade-496f-8851-1669b457304f None None] MFA Rules not processed for user `ac47b1f7a8db42feb9dc829e332567eb`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:18.054231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1c32fc96-dade-496f-8851-1669b457304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:18.087718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5f3a-b995-472c-a51c-a72283cbb307 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:18.098547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5f3a-b995-472c-a51c-a72283cbb307 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:18.104300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7495d7e-203e-46fa-839d-b6737bfa4245 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:18.105162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7495d7e-203e-46fa-839d-b6737bfa4245 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.105708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7495d7e-203e-46fa-839d-b6737bfa4245 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.107928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7495d7e-203e-46fa-839d-b6737bfa4245 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/6407ee2c2eaa42119a5e47facb834759` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.111572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7495d7e-203e-46fa-839d-b6737bfa4245 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=6407ee2c2eaa42119a5e47facb834759)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:18.111572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7495d7e-203e-46fa-839d-b6737bfa4245 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:18.125717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1275/2555] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:18 2022] GET /identity/v3/projects/6407ee2c2eaa42119a5e47facb834759 => generated 371 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:18.221964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1281/2556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:18.255528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1fea-ec0f-4bf8-b863-8118ee6396c2 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.256317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1fea-ec0f-4bf8-b863-8118ee6396c2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.256609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab1fea-ec0f-4bf8-b863-8118ee6396c2 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.261382 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1276/2557] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:18.267515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fc96-dade-496f-8851-1669b457304f None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:18.282920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fc96-dade-496f-8851-1669b457304f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:18.296604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fc96-dade-496f-8851-1669b457304f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:18.305696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b05caf-bfd6-4a5e-84b4-a9466139ca48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:18.306365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b05caf-bfd6-4a5e-84b4-a9466139ca48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.306649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b05caf-bfd6-4a5e-84b4-a9466139ca48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.306924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b05caf-bfd6-4a5e-84b4-a9466139ca48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/6407ee2c2eaa42119a5e47facb834759` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.308146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b05caf-bfd6-4a5e-84b4-a9466139ca48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=6407ee2c2eaa42119a5e47facb834759)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:18.310945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b05caf-bfd6-4a5e-84b4-a9466139ca48 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:18.324235 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1282/2558] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:18 2022] GET /identity/v3/projects/6407ee2c2eaa42119a5e47facb834759 => generated 371 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:18.473363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab1fea-ec0f-4bf8-b863-8118ee6396c2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:18.507517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8da3-23aa-42f5-b53d-72255f785339 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.512941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8da3-23aa-42f5-b53d-72255f785339 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.512941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e8da3-23aa-42f5-b53d-72255f785339 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.512941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1283/2559] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:18.513278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab1fea-ec0f-4bf8-b863-8118ee6396c2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:18.517498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8da3-23aa-42f5-b53d-72255f785339 None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:18.521138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:18.523173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.523758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.525862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.554261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8da3-23aa-42f5-b53d-72255f785339 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:18.569365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e8da3-23aa-42f5-b53d-72255f785339 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:18.590784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e274c5b-ac05-4e3b-9b2f-f457d5de7d66 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:18.591709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e274c5b-ac05-4e3b-9b2f-f457d5de7d66 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:18.591831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e274c5b-ac05-4e3b-9b2f-f457d5de7d66 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:18.592191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e274c5b-ac05-4e3b-9b2f-f457d5de7d66 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:18.593671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e274c5b-ac05-4e3b-9b2f-f457d5de7d66 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:18.595903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e274c5b-ac05-4e3b-9b2f-f457d5de7d66 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:18.598245 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1284/2560] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:18 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:18.616833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:18.618441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:18.639274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1277/2561] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:18.819339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:18.914102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:20.013527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6effc-5f08-45b5-8982-67bf61687ed1 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.014097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6effc-5f08-45b5-8982-67bf61687ed1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.014181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6effc-5f08-45b5-8982-67bf61687ed1 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.015639 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1285/2562] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:20.020720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:20.032527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:20.043893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988c5a1-893f-4247-8176-293e6d2a8ed3 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:20.048585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:20.049278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.049755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.050036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.051221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:20.053289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:20.055777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1278/2563] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:20 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:20.214030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ca50-c311-4639-a89d-0414def01368 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.214469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ca50-c311-4639-a89d-0414def01368 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.215030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4ca50-c311-4639-a89d-0414def01368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.260350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f5f4ca50-c311-4639-a89d-0414def01368 None None] MFA Rules not processed for user `e12f56e39d3847dc886258de14e533ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:20.261729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f5f4ca50-c311-4639-a89d-0414def01368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:20.284389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:20.314346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d6d7-bd4e-47af-8560-4c1656b41ad1 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:20.366942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:20.367598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.368145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.368599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.374815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:20.492689 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1286/2564] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:20.520279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:20.567999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:20.569758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:20.582300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:20.585324 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1279/2565] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:52:20.660948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91480b2-84ac-44e0-b247-d5f90ef35889 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.661277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91480b2-84ac-44e0-b247-d5f90ef35889 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.661587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91480b2-84ac-44e0-b247-d5f90ef35889 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.664041 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1287/2566] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:20.670923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:20.683102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:20.694300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e382c88-bdb2-417d-b7af-cbe166f554a7 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:20.698953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0047d-e989-4ef7-b6fc-a317ecf72007 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:20.699618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0047d-e989-4ef7-b6fc-a317ecf72007 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.699977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0047d-e989-4ef7-b6fc-a317ecf72007 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.704867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0047d-e989-4ef7-b6fc-a317ecf72007 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/6407ee2c2eaa42119a5e47facb834759` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.707469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0047d-e989-4ef7-b6fc-a317ecf72007 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=6407ee2c2eaa42119a5e47facb834759)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:20.709644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0047d-e989-4ef7-b6fc-a317ecf72007 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:20.717335 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1280/2567] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:20 2022] GET /identity/v3/projects/6407ee2c2eaa42119a5e47facb834759 => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:20.737743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91480b2-84ac-44e0-b247-d5f90ef35889 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:20.754326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91480b2-84ac-44e0-b247-d5f90ef35889 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:20.760701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:20.761339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:20.761622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:20.761901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/6407ee2c2eaa42119a5e47facb834759` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:20.763108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6407ee2c2eaa42119a5e47facb834759)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:20.765207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:20.925313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6407ee2c2eaa42119a5e47facb834759', 'request_id': 'req-8fa42243-38aa-4936-b3ac-177a8bb1597a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:20.931715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6407ee2c2eaa42119a5e47facb834759', 'request_id': 'req-8fa42243-38aa-4936-b3ac-177a8bb1597a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:20.939697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6407ee2c2eaa42119a5e47facb834759', 'request_id': 'req-8fa42243-38aa-4936-b3ac-177a8bb1597a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:21.039813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] The token cache is being invalidate because project 6407ee2c2eaa42119a5e47facb834759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:21.040450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:21.040768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:21.042568 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1288/2568] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:20 2022] DELETE /identity/v3/projects/6407ee2c2eaa42119a5e47facb834759 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:21.801754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613836-51fb-4c55-9fd3-5ed457fc234c None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:21.802308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613836-51fb-4c55-9fd3-5ed457fc234c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:21.802308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613836-51fb-4c55-9fd3-5ed457fc234c None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:21.807284 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1281/2569] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:21.813390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:21.814973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:21.923923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:21.934090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:21.936390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:21.937595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:21.938061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:21.938531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:21.974134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] MFA Rules not processed for user `117e12084c60416aabce823ebae4f214`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:21.975671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:22.003390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:22.031820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa42243-38aa-4936-b3ac-177a8bb1597a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.037085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ab7bd-021c-4ecf-91eb-534f0c10d0d4 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.038159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ab7bd-021c-4ecf-91eb-534f0c10d0d4 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.038799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ab7bd-021c-4ecf-91eb-534f0c10d0d4 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.039385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ab7bd-021c-4ecf-91eb-534f0c10d0d4 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/e285e69559d04059b8f46cb6391cf1c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.040865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ab7bd-021c-4ecf-91eb-534f0c10d0d4 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=e285e69559d04059b8f46cb6391cf1c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:22.044376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ab7bd-021c-4ecf-91eb-534f0c10d0d4 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:22.046860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1289/2570] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:21 2022] GET /identity/v3/projects/e285e69559d04059b8f46cb6391cf1c5 => generated 375 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:22.062826 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1282/2571] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:22.073177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.073467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.073741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.083343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:22.094756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] MFA Rules not processed for user `117e12084c60416aabce823ebae4f214`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:22.096180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:22.098675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca306d-ad12-4792-a975-3ad1871d47cb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.105185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.106728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.107345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.110774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.110774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:22.110980 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1290/2572] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:22.111101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:22.111194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:22.111299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3105525-cd14-4a8e-b287-88a3073b72b1 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:22.112337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:22.126330 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1283/2573] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:22.128056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f596c7-5ab0-4156-bc16-261f49b69cdb None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.128643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f596c7-5ab0-4156-bc16-261f49b69cdb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.136529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f596c7-5ab0-4156-bc16-261f49b69cdb None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.136529 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1284/2574] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:22.136529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f596c7-5ab0-4156-bc16-261f49b69cdb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:22.136985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa7618-126c-4c4b-a624-754f92b17d77 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.137845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.138560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.138912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.139286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.141233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:22.146271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f596c7-5ab0-4156-bc16-261f49b69cdb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.150970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.151600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.151886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.152166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.153479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:22.155514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:22.207681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:22.209275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:22.220444 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1291/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:22.221454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:22.233709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:22.234983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:22.235224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1285/2576] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:22 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:22.239274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:22.318932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154edad8-2440-4772-b45d-cf505ae35e41 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.328856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a073-6e45-4aa7-9249-1c5a4b0d3a97 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.333873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.334497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.334771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.335079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.335734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:22.336050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:22.337655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:22.350872 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1286/2577] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:22.381346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164d86-fe22-4d37-afe4-7b41f7b5fd50 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.382171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164d86-fe22-4d37-afe4-7b41f7b5fd50 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.382954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164d86-fe22-4d37-afe4-7b41f7b5fd50 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.382954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164d86-fe22-4d37-afe4-7b41f7b5fd50 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.384480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58164d86-fe22-4d37-afe4-7b41f7b5fd50 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:22.390962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58164d86-fe22-4d37-afe4-7b41f7b5fd50 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:22.390962 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1292/2578] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:22 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:22.863461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:22.939830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239ae6-3649-4975-94dc-78e11cf66f0c None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.940263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239ae6-3649-4975-94dc-78e11cf66f0c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.940558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f239ae6-3649-4975-94dc-78e11cf66f0c None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:22.942634 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1293/2579] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:22.947785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f239ae6-3649-4975-94dc-78e11cf66f0c None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:22.952036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dff36-a752-484c-bff6-086bf29e869d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:22.959898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95cef7-525b-4939-8e9e-0bc41742240a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:22.960522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95cef7-525b-4939-8e9e-0bc41742240a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:22.960992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95cef7-525b-4939-8e9e-0bc41742240a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:22.961292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95cef7-525b-4939-8e9e-0bc41742240a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:23.003153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f239ae6-3649-4975-94dc-78e11cf66f0c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:23.019046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f239ae6-3649-4975-94dc-78e11cf66f0c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:23.025445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95cef7-525b-4939-8e9e-0bc41742240a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:23.026994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:23.027250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95cef7-525b-4939-8e9e-0bc41742240a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:23.028546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:23.028937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:23.029302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/beef80c06df043d3851b1c276931e881` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:23.030860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=beef80c06df043d3851b1c276931e881)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:23.034702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:23.037457 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1287/2581] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:23.037664 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1294/2581] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:22 2022] GET /identity/v3/projects/beef80c06df043d3851b1c276931e881 => generated 371 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:23.194783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974f8c9-45e4-46d5-ba75-0cd96d8a5446 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:23.195561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974f8c9-45e4-46d5-ba75-0cd96d8a5446 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:23.196078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974f8c9-45e4-46d5-ba75-0cd96d8a5446 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:23.197699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1288/2582] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:23.202837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:23.216008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:23.226383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ef594-bdcb-41e0-a275-a47c083d121a tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:23.231940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:23.232577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:23.232870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:23.233151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:23.235633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:23.239647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:23.239975 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1295/2583] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:23 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:23.438731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:23.464358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:24.127574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:25.139926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:25.445551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eafa5-b3e1-48c3-ad08-8d563169ad8f None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.446467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eafa5-b3e1-48c3-ad08-8d563169ad8f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.446924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eafa5-b3e1-48c3-ad08-8d563169ad8f None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.448673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1289/2584] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:25.454586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:25.470257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:25.482893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276113c-7fa3-44d1-899f-6f95d1654218 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:25.490360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25515322-8613-44f4-a744-9d5d29e2258e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:25.491087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25515322-8613-44f4-a744-9d5d29e2258e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.491385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25515322-8613-44f4-a744-9d5d29e2258e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.491664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25515322-8613-44f4-a744-9d5d29e2258e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/beef80c06df043d3851b1c276931e881` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.492800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25515322-8613-44f4-a744-9d5d29e2258e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=beef80c06df043d3851b1c276931e881)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:25.495183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25515322-8613-44f4-a744-9d5d29e2258e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:25.497092 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1296/2585] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:25 2022] GET /identity/v3/projects/beef80c06df043d3851b1c276931e881 => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:25.548289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eafa5-b3e1-48c3-ad08-8d563169ad8f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:25.550149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec3463-9522-463d-a1f5-767d6e63dd9c None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.550423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec3463-9522-463d-a1f5-767d6e63dd9c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.551247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec3463-9522-463d-a1f5-767d6e63dd9c None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.552218 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1297/2586] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:25.562724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec3463-9522-463d-a1f5-767d6e63dd9c None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:25.569398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14eafa5-b3e1-48c3-ad08-8d563169ad8f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:25.575575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:25.577075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.577526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.577966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.578874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:25.579425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:25.581226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:25.585924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec3463-9522-463d-a1f5-767d6e63dd9c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:25.595727 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1290/2587] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:25.597393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec3463-9522-463d-a1f5-767d6e63dd9c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:25.599591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:25.607121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:25.607796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.608097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.608368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.611590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:25.618330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:25.620938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536ac1-d368-4325-a4ed-83c4fdf9af4e tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:25.621159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1298/2588] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:25 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:25.628125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd1fea-8360-4287-8586-5849764e09bb tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:25.628749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd1fea-8360-4287-8586-5849764e09bb tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.629039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd1fea-8360-4287-8586-5849764e09bb tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.629339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd1fea-8360-4287-8586-5849764e09bb tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.630080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd1fea-8360-4287-8586-5849764e09bb tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:25.632379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd1fea-8360-4287-8586-5849764e09bb tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:25.638879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:25.771283 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1291/2589] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:25 2022] POST /identity/v3/users => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:25.772589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:25.783690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08315f-1311-4997-be70-dbccebf89106 tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:25.788519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:25.789151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.789436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.789715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.790356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:25.790694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:25.792324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bcd6b-8c79-405b-b585-c6d7616e2f42 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:25.810793 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1299/2590] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:25.853117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:25.853392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:25.853699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:25.874984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] MFA Rules not processed for user `e12f56e39d3847dc886258de14e533ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:25.876270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:25.962119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1292/2591] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:27.123459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf95d6-e93e-4031-a0db-425d7517ec46 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:27.124352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf95d6-e93e-4031-a0db-425d7517ec46 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:27.125121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf95d6-e93e-4031-a0db-425d7517ec46 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:27.126941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1300/2592] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:27.133963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:27.148570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:27.164382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e55a0-8007-4175-83dd-4809b96ec593 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:27.169721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ee398-f3a2-483f-ab59-f8f9abd0b6ae tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:27.170419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ee398-f3a2-483f-ab59-f8f9abd0b6ae tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:27.170723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ee398-f3a2-483f-ab59-f8f9abd0b6ae tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:27.170984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ee398-f3a2-483f-ab59-f8f9abd0b6ae tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/beef80c06df043d3851b1c276931e881` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:27.172168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ee398-f3a2-483f-ab59-f8f9abd0b6ae tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=beef80c06df043d3851b1c276931e881)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:27.174277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ee398-f3a2-483f-ab59-f8f9abd0b6ae tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:27.175959 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1293/2593] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:27 2022] GET /identity/v3/projects/beef80c06df043d3851b1c276931e881 => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:27.532538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:27.882076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:28.626170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf95d6-e93e-4031-a0db-425d7517ec46 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:28.644677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf95d6-e93e-4031-a0db-425d7517ec46 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:28.652409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:28.653627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:28.654076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:28.654600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:28.656462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:28.728849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:28.730585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3923-4810-4457-905b-9d0c27ad7732 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:28.741379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1301/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:28.775485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:28.781064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:28.781064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:28.798501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] MFA Rules not processed for user `e425c7348db042389a189daa866ea06d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:28.801056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:28.860265 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1294/2595] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:29.244854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:29.653961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:29.796234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584322-30a6-4eeb-a9da-a3146d902b62 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:29.796809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584322-30a6-4eeb-a9da-a3146d902b62 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:29.796809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584322-30a6-4eeb-a9da-a3146d902b62 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:29.798187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1302/2596] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:29.803234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:29.818773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:29.831439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395385a6-6504-460d-b545-a144787a2dc3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:29.836160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1a64-add7-4d87-9240-fc4dae4eac8d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:29.836796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1a64-add7-4d87-9240-fc4dae4eac8d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:29.837244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1a64-add7-4d87-9240-fc4dae4eac8d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:29.837717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1a64-add7-4d87-9240-fc4dae4eac8d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/beef80c06df043d3851b1c276931e881` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:29.838659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1a64-add7-4d87-9240-fc4dae4eac8d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=beef80c06df043d3851b1c276931e881)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:29.840833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1a64-add7-4d87-9240-fc4dae4eac8d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:29.842649 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1295/2597] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:29 2022] GET /identity/v3/projects/beef80c06df043d3851b1c276931e881 => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:29.875509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2584322-30a6-4eeb-a9da-a3146d902b62 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:29.882576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e28b05-e7fb-43ce-a7c1-bf5d4d9c2b99 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:29.882998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e28b05-e7fb-43ce-a7c1-bf5d4d9c2b99 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:29.884046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e28b05-e7fb-43ce-a7c1-bf5d4d9c2b99 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:29.886110 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1296/2598] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:52:29.890828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e28b05-e7fb-43ce-a7c1-bf5d4d9c2b99 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:29.898174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2584322-30a6-4eeb-a9da-a3146d902b62 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:29.904558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:29.905440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:29.905736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:29.906014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/users/07844b4cfcbe459fbfdf3a53b3a508bc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:29.916010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:29.917063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e28b05-e7fb-43ce-a7c1-bf5d4d9c2b99 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:29.922955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:delete_user(user_id=07844b4cfcbe459fbfdf3a53b3a508bc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:29.925597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:29.930435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e28b05-e7fb-43ce-a7c1-bf5d4d9c2b99 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:29.935929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1eb77b7185e45f1835dc101b05d6b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cb36eb34c4461bd73c1ce2c945628', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:29.936574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:29.936867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:29.937186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:29.938355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorizing `identity:get_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:29.940569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:29.942284 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1297/2599] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:29 2022] GET /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 381 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:30.065252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07844b4cfcbe459fbfdf3a53b3a508bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.072348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07844b4cfcbe459fbfdf3a53b3a508bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.073107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07844b4cfcbe459fbfdf3a53b3a508bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.073793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07844b4cfcbe459fbfdf3a53b3a508bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.086357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07844b4cfcbe459fbfdf3a53b3a508bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.168991 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1303/2600] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:29 2022] DELETE /identity/v3/users/07844b4cfcbe459fbfdf3a53b3a508bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:30.172274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:30.174182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:30.189163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1fa1-479c-4325-8c2b-5151c0c741bb tempest-QuotasAdminNegativeTest-506428954 tempest-QuotasAdminNegativeTest-506428954-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:30.250328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:30.251000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:30.251313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:30.251584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/beef80c06df043d3851b1c276931e881` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:30.252730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:delete_project(project_id=beef80c06df043d3851b1c276931e881)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:30.254937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:30.313328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:30.355680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beef80c06df043d3851b1c276931e881', 'request_id': 'req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.365142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beef80c06df043d3851b1c276931e881', 'request_id': 'req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.371059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beef80c06df043d3851b1c276931e881', 'request_id': 'req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.453944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] The token cache is being invalidate because project beef80c06df043d3851b1c276931e881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:30.454346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.455226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b83ce6b1-26c8-42a8-a6d0-a5fff5c472d6 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:30.456839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1298/2601] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:30 2022] DELETE /identity/v3/projects/beef80c06df043d3851b1c276931e881 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:30.576652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:31.118772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:31.120355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:31.129557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:31.130082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:31.130166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:31.131779 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1299/2602] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 10:52:31.136552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:31.139174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:31.254619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b33f5-b28e-4488-9f10-550bf674623f tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:31.290567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:31.292061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:31.356603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:31.411392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:31.413959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:31.414486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:31.414966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] PATH_INFO: `/v3/users/e12f56e39d3847dc886258de14e533ef` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:31.417193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12f56e39d3847dc886258de14e533ef)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:31.420151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:31.472484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7e994-05c9-43c9-8ef1-a8a6b97d47a4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:31.482227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf125abb-5c96-4b97-8da2-c994cde4825d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:31.483123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125abb-5c96-4b97-8da2-c994cde4825d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:31.483483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125abb-5c96-4b97-8da2-c994cde4825d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:31.483831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125abb-5c96-4b97-8da2-c994cde4825d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/e285e69559d04059b8f46cb6391cf1c5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:31.486365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf125abb-5c96-4b97-8da2-c994cde4825d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=e285e69559d04059b8f46cb6391cf1c5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:31.488851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf125abb-5c96-4b97-8da2-c994cde4825d tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:31.495106 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1300/2603] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:31 2022] GET /identity/v3/projects/e285e69559d04059b8f46cb6391cf1c5 => generated 375 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:31.720059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12f56e39d3847dc886258de14e533ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:31.727581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12f56e39d3847dc886258de14e533ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:31.728307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12f56e39d3847dc886258de14e533ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:31.728913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12f56e39d3847dc886258de14e533ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:31.742686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d75715-ada9-40b1-b9cd-85ef32da1867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12f56e39d3847dc886258de14e533ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:31.813884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:31.819142 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1304/2604] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:31 2022] DELETE /identity/v3/users/e12f56e39d3847dc886258de14e533ef => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:31.823666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:31.823977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:31.825322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:31.859520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:31.859859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:31.860056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:31.861425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:31.861564 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1305/2605] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:31.862618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:31.866314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:31.868031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:31.951488 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1301/2606] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:31.962741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:31.965196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:31.992504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:31.994905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:32.038394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608dbf-152c-41e4-a868-5d7cad66d8c5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:32.044933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:32.046138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:32.046509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:32.046801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:32.060822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:32.062979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:32.083515 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1302/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:52:32.085520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa591a4-e378-4042-95c7-4bb8ab0cd58a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:32.091056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:32.091805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:32.092154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:32.092491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/e285e69559d04059b8f46cb6391cf1c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:32.093655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=e285e69559d04059b8f46cb6391cf1c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:32.095821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:32.099056 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1306/2608] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:31 2022] GET /identity/v3/projects/e285e69559d04059b8f46cb6391cf1c5 => generated 375 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:52:32.534933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:32.534933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:32.551444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39c0c-d89e-449d-a1eb-0f0aed0bbfa5 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:32.565538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:32.566153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:32.566609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:32.567341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] PATH_INFO: `/v3/projects/27c94fb551d3488ea0bbf8e8249bff96` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:32.568763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c94fb551d3488ea0bbf8e8249bff96)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:32.570876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:32.700570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c94fb551d3488ea0bbf8e8249bff96', 'request_id': 'req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:32.707190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c94fb551d3488ea0bbf8e8249bff96', 'request_id': 'req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:32.712780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c94fb551d3488ea0bbf8e8249bff96', 'request_id': 'req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:32.790645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] The token cache is being invalidate because project 27c94fb551d3488ea0bbf8e8249bff96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:32.791126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:32.792468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32ca783a-eff3-44b2-8c4e-e8a35fe4e174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:32.797677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1303/2609] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:32 2022] DELETE /identity/v3/projects/27c94fb551d3488ea0bbf8e8249bff96 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:32.798638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:32.801238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:32.818891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486d1ed-cfaa-4090-b34d-44ae075d6cbe tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:32.885481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:32.886121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:32.886410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:32.886720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] PATH_INFO: `/v3/users/a1eb77b7185e45f1835dc101b05d6b66` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:32.888055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1eb77b7185e45f1835dc101b05d6b66)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:32.889999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:33.075808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1eb77b7185e45f1835dc101b05d6b66'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:33.082816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1eb77b7185e45f1835dc101b05d6b66'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:33.084185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1eb77b7185e45f1835dc101b05d6b66'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:33.084868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1eb77b7185e45f1835dc101b05d6b66'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:33.098772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1eb77b7185e45f1835dc101b05d6b66'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:33.171069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:33.202870 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1307/2610] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:32 2022] DELETE /identity/v3/users/a1eb77b7185e45f1835dc101b05d6b66 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:33.287624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:33.833946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90925-3363-402c-b80e-28ee4161be64 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:33.834483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90925-3363-402c-b80e-28ee4161be64 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:33.834483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90925-3363-402c-b80e-28ee4161be64 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:33.836171 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1304/2611] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 10:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:52:33.841581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 10:52:33.843969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:33.846380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90925-3363-402c-b80e-28ee4161be64 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:33.848797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-abb90925-3363-402c-b80e-28ee4161be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:33.954153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:33.956023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:33.970618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90925-3363-402c-b80e-28ee4161be64 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:33.990163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:33.990622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:33.992991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:33.992991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] PATH_INFO: `/v3/projects/6f4cb36eb34c4461bd73c1ce2c945628` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:33.994031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4cb36eb34c4461bd73c1ce2c945628)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:33.996438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:34.050273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4af1f8-37c9-432a-bf3d-32ce74fbf37c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:34.057255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821b5d456d334f66a80512ac08799b4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ecbce5086154613a5f8a93b667ae9f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:34.058721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.059245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.059703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] PATH_INFO: `/v3/projects/e285e69559d04059b8f46cb6391cf1c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.061217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorizing `identity:get_project(project_id=e285e69559d04059b8f46cb6391cf1c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:34.063976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:34.066430 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1308/2612] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 10:52:33 2022] GET /identity/v3/projects/e285e69559d04059b8f46cb6391cf1c5 => generated 375 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:34.112926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:34.115037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:34.132655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6e575-b28d-48d8-be8c-ba58b0771342 tempest-QuotasAdminTestJSON-775026550 tempest-QuotasAdminTestJSON-775026550-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:34.138338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:34.139227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.139832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.140298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] PATH_INFO: `/v3/users/824952a92a734ea89b736d9d56ce30b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.143174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824952a92a734ea89b736d9d56ce30b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:34.145568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:34.206515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4cb36eb34c4461bd73c1ce2c945628', 'request_id': 'req-bb4ac73c-c76c-4baf-9808-914854be930b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.215756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4cb36eb34c4461bd73c1ce2c945628', 'request_id': 'req-bb4ac73c-c76c-4baf-9808-914854be930b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.226531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4cb36eb34c4461bd73c1ce2c945628', 'request_id': 'req-bb4ac73c-c76c-4baf-9808-914854be930b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.301842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] The token cache is being invalidate because project 6f4cb36eb34c4461bd73c1ce2c945628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:34.302186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.303281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bb4ac73c-c76c-4baf-9808-914854be930b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.304842 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1305/2613] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:33 2022] DELETE /identity/v3/projects/6f4cb36eb34c4461bd73c1ce2c945628 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:34.310763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98491-499a-4873-90ff-c6e948e65486 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.311084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98491-499a-4873-90ff-c6e948e65486 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.311372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98491-499a-4873-90ff-c6e948e65486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.336154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3dc98491-499a-4873-90ff-c6e948e65486 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:34.337421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3dc98491-499a-4873-90ff-c6e948e65486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:34.365918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824952a92a734ea89b736d9d56ce30b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.373634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824952a92a734ea89b736d9d56ce30b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.381375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824952a92a734ea89b736d9d56ce30b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.381375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824952a92a734ea89b736d9d56ce30b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.394495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-436997f5-a469-4813-b69b-e6863ac0c0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824952a92a734ea89b736d9d56ce30b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:34.411175 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1306/2614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:34.412541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaaad8-9ac0-4843-b948-0777992b1f48 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.412831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaaad8-9ac0-4843-b948-0777992b1f48 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.413124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaaad8-9ac0-4843-b948-0777992b1f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.438711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e8eaaad8-9ac0-4843-b948-0777992b1f48 None None] MFA Rules not processed for user `d9f88a4c72854cff9bba7ed2920f55b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:34.438711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8eaaad8-9ac0-4843-b948-0777992b1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:34.496420 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1309/2615] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:34 2022] DELETE /identity/v3/users/824952a92a734ea89b736d9d56ce30b9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:34.498605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.499201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.499932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.519038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1307/2616] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:34.520526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.520821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.521100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.525990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:34.527567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:34.542046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:34.543482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:34.598616 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1310/2617] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:34.602975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:34.612509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717ed8-a77a-479d-b553-68b5ce99e8ab None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:34.617903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:34.618512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.618791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.619265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.619919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:34.620226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:34.621055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:34.621769 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1308/2618] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:34.622093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:34.630533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:34.631986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:34.638706 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1311/2619] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:34.640100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:34.651103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bccb4-bf73-4110-9cfa-3cb65d9e8db3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:34.657123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:34.664136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.664136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.664136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.664136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:34.664136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:34.709396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1104a-db24-49b4-8d68-b406fc8a118b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:34.713400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:34.714609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.714609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.714609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.726063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:34.727512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:34.738828 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1309/2620] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:52:34.791093 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1312/2621] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:34 2022] POST /identity/v3/projects => generated 401 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:34.796341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:34.806280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505228bf-9a87-4f39-9a38-528619d83d1d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:34.881214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:34.881870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:34.882269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:34.882549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:34.883587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:34.886123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.009807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1310/2622] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:34 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:35.015811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.029276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379bb25-47de-477e-9f8c-4b3779d4974b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.038057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.039045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.039495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.039942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.040784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.042624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.056362 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1313/2623] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:35.057639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.069472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168a43f-0eff-4f10-8422-8704ed43819f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.071815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.076974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:35.085221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.085861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.088118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.088412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.093186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.096654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.097416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3dd6b-4c7d-4a2e-af32-03cb2b51964e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.103670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.104447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.104738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.105011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] PATH_INFO: `/v3/projects/923e4d16ab5e49318d7ab3bf76cb7d6b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.107027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=923e4d16ab5e49318d7ab3bf76cb7d6b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.122119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.132708 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1311/2624] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:35.133857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.148495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534df139-7a3c-4899-9776-9cfd7ed8db56 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.155863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b736-e6ff-4370-bb20-a06d18b6b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.156758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b736-e6ff-4370-bb20-a06d18b6b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.157204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b736-e6ff-4370-bb20-a06d18b6b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.157708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b736-e6ff-4370-bb20-a06d18b6b83d admin admin] PATH_INFO: `/v3/projects/b8ac22fb18b840e58301a8e6bb1d780d/users/eaab6d1333c647f79400b4a15ab15309/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.182500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4b736-e6ff-4370-bb20-a06d18b6b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ac22fb18b840e58301a8e6bb1d780d, user_id=eaab6d1333c647f79400b4a15ab15309, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.186765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4b736-e6ff-4370-bb20-a06d18b6b83d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.277715 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1312/2625] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:35 2022] PUT /identity/v3/projects/b8ac22fb18b840e58301a8e6bb1d780d/users/eaab6d1333c647f79400b4a15ab15309/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:35.289106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.289485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.289844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.307543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923e4d16ab5e49318d7ab3bf76cb7d6b', 'request_id': 'req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.320068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923e4d16ab5e49318d7ab3bf76cb7d6b', 'request_id': 'req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.331183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923e4d16ab5e49318d7ab3bf76cb7d6b', 'request_id': 'req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.334386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] MFA Rules not processed for user `eaab6d1333c647f79400b4a15ab15309`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:35.335896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:35.435343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] The token cache is being invalidate because project 923e4d16ab5e49318d7ab3bf76cb7d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:35.437083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.438316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.445824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1314/2626] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:35 2022] DELETE /identity/v3/projects/923e4d16ab5e49318d7ab3bf76cb7d6b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:35.450380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.452370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:35.497856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1313/2627] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:35.502233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.507446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:35.588550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0436d61-90de-4989-abeb-e1fe2bf5bcaa admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.596136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.596739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.601190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.601190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] PATH_INFO: `/v3/users/ac47b1f7a8db42feb9dc829e332567eb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.601190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac47b1f7a8db42feb9dc829e332567eb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.601190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.607313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c2c9b-3ee4-4704-a2b8-fffcf6a393e1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.612470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.613087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.614425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.614425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.614832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.616796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.753403 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1314/2628] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:35 2022] POST /identity/v3/projects => generated 401 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:35.758020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.844953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b679d7-cbdb-4904-8b63-4eec67955580 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:35.850982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:35.851889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:35.852291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:35.852665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:35.853425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:35.855536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:35.889371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:35.916488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac47b1f7a8db42feb9dc829e332567eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.929657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac47b1f7a8db42feb9dc829e332567eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.930292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac47b1f7a8db42feb9dc829e332567eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.931047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac47b1f7a8db42feb9dc829e332567eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.952474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac47b1f7a8db42feb9dc829e332567eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:35.966862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1315/2629] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:35 2022] POST /identity/v3/users => generated 307 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:35.971083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:35.976807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:36.000706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65b92b-03df-47d0-81be-ea28157c355d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:36.005695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:36.006249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.006537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.006817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.007516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:36.009172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:36.023152 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1316/2630] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:36.027144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:36.063654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3fac3-4c12-4f5c-a0c1-343186660cab admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:36.071345 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1315/2631] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:35 2022] DELETE /identity/v3/users/ac47b1f7a8db42feb9dc829e332567eb => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:36.073049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:36.074330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.075245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.075728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] PATH_INFO: `/v3/projects/6636444ced9949b7b97a2f8b8299f719/users/3e044c7cb5f6428ab005191728ae0f74/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.108403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6636444ced9949b7b97a2f8b8299f719, user_id=3e044c7cb5f6428ab005191728ae0f74, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:36.115488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:36.215559 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1317/2632] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:36 2022] PUT /identity/v3/projects/6636444ced9949b7b97a2f8b8299f719/users/3e044c7cb5f6428ab005191728ae0f74/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:36.219305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:36.324520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320738f1-8c04-4321-99ef-fa79440ec8e5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:36.401895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc05189-fc7f-4e57-81cf-7927db8ce921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:36.403673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc05189-fc7f-4e57-81cf-7927db8ce921 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.403968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc05189-fc7f-4e57-81cf-7927db8ce921 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.404299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc05189-fc7f-4e57-81cf-7927db8ce921 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.405009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc05189-fc7f-4e57-81cf-7927db8ce921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:36.406620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc05189-fc7f-4e57-81cf-7927db8ce921 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:36.419049 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1316/2633] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:52:36.421993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:36.432897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65321a-70f6-4a12-9267-702aa58dae06 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:36.437892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:36.438611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.439273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.439273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] PATH_INFO: `/v3/projects/6636444ced9949b7b97a2f8b8299f719/users/3e044c7cb5f6428ab005191728ae0f74/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.441318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6636444ced9949b7b97a2f8b8299f719, user_id=3e044c7cb5f6428ab005191728ae0f74, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:36.444004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:36.455358 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1318/2634] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:36 2022] PUT /identity/v3/projects/6636444ced9949b7b97a2f8b8299f719/users/3e044c7cb5f6428ab005191728ae0f74/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:36.466961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.467339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.467623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.505928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] MFA Rules not processed for user `3e044c7cb5f6428ab005191728ae0f74`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:36.507258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:36.524490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:36.526425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:36.572692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:36.651155 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1317/2635] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:36.651155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:36.670096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:36.789128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4da3c-3eef-49d1-bedd-ab16b81465e1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:36.794980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:36.801104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4c35-1063-474d-a5ed-f3cdd5263b81 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:36.801387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.801387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.801387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] PATH_INFO: `/v3/users/c8e675249c0f418283681a512ffba40f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.801387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e675249c0f418283681a512ffba40f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:36.801668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:36.801668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:36.801668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:36.801668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] PATH_INFO: `/v3/projects/47a3ae68d1e447509ec043375cc11f2c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:36.802225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:36.803200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a3ae68d1e447509ec043375cc11f2c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:36.805166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:37.062272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e675249c0f418283681a512ffba40f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.062459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a3ae68d1e447509ec043375cc11f2c', 'request_id': 'req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.069537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a3ae68d1e447509ec043375cc11f2c', 'request_id': 'req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.069808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e675249c0f418283681a512ffba40f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.071130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e675249c0f418283681a512ffba40f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.071806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e675249c0f418283681a512ffba40f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.078924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a3ae68d1e447509ec043375cc11f2c', 'request_id': 'req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.084931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67db9709-60e0-4911-9006-628e5006ad8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e675249c0f418283681a512ffba40f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.194676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] The token cache is being invalidate because project 47a3ae68d1e447509ec043375cc11f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:37.199896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.199896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:37.199896 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1319/2636] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:36 2022] DELETE /identity/v3/projects/47a3ae68d1e447509ec043375cc11f2c => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:37.199896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:37.199896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:37.256209 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1318/2637] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:36 2022] DELETE /identity/v3/users/c8e675249c0f418283681a512ffba40f => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:37.258826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091633-709b-4774-9efe-119477d44296 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.258953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091633-709b-4774-9efe-119477d44296 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.259331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091633-709b-4774-9efe-119477d44296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.280780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c3091633-709b-4774-9efe-119477d44296 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:37.282105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c3091633-709b-4774-9efe-119477d44296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:37.303304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b026fa5-c83c-41b3-8a33-6dfa0c03cf25 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:37.353188 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1319/2638] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:37.354531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf89e-1c71-4b81-ad07-2aa794e5fd23 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.354814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf89e-1c71-4b81-ad07-2aa794e5fd23 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.355116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf89e-1c71-4b81-ad07-2aa794e5fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.376881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0b7cf89e-1c71-4b81-ad07-2aa794e5fd23 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:37.378114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0b7cf89e-1c71-4b81-ad07-2aa794e5fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:37.386388 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1320/2639] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:37.388471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.389145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.389145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.411828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:37.412452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:37.413281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.413401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:37.413563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.413822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.416963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:37.429411 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1321/2640] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:37.430346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:37.432000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:37.502860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:37.503735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a168b5-2e77-45df-86ec-65efd54bc68f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:37.504636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:37.510558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:37.513880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.513880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.513880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.515908 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1320/2641] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:37.516852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:37.531834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:37.532261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1609f9-9627-4b36-bcd2-dee5ae9b74fe service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:37.533526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:37.538747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:37.539981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.540271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.540874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.541706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:37.542104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:37.544272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:37.548442 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1322/2642] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:37.564312 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1321/2643] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:37.568914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:37.581483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eecc4a-01f7-4117-8b96-4ff37d206f30 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:37.588274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:37.589195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.589695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.590872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.591758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:37.594785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:37.695708 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1323/2644] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:37 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:37.696696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:37.709264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8debcee-68e7-4efa-8c2e-6d731703fa8d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:37.802148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:37.853300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:37.853300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:37.853300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:37.853300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:37.853948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:37.853948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:37.993525 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1322/2645] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:37 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:38.000728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.033953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532025f4-25c6-4697-a469-5190e5ee16b1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.048740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.049444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.049805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.050161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.050981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.057091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.067447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1324/2646] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:38.068939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.089020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39c47-b428-4974-bbce-6ee287371f77 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.095128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.095750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.096032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.096307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.096953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.098541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.114332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.116430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:38.121954 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1323/2647] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:38.133028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.137207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d4965-a588-4ff8-9951-b481e53a7a02 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.143283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.144124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.144670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.145055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] PATH_INFO: `/v3/projects/e285e69559d04059b8f46cb6391cf1c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.146400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e285e69559d04059b8f46cb6391cf1c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.148461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.160725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd5d8e-e729-452a-9218-abc5ed37d36c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.170164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.171809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.172410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.177019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] PATH_INFO: `/v3/projects/fb1bb71c2e344a579584add8a97863f1/users/42902f5389b747b18216571f47b9e537/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.189895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1bb71c2e344a579584add8a97863f1, user_id=42902f5389b747b18216571f47b9e537, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.192567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.196202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:38.287461 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1324/2648] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:38 2022] PUT /identity/v3/projects/fb1bb71c2e344a579584add8a97863f1/users/42902f5389b747b18216571f47b9e537/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:38.288397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.299566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e285e69559d04059b8f46cb6391cf1c5', 'request_id': 'req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.306456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e285e69559d04059b8f46cb6391cf1c5', 'request_id': 'req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.315090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e285e69559d04059b8f46cb6391cf1c5', 'request_id': 'req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.374368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4fac9-bc29-4ccc-9c82-5d2425d097a7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.404530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] The token cache is being invalidate because project e285e69559d04059b8f46cb6391cf1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:38.412718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.412718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43d74eb5-c94b-49bf-89ce-2a6cbaf5779f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.412718 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1325/2649] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:38 2022] DELETE /identity/v3/projects/e285e69559d04059b8f46cb6391cf1c5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:38.412718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.412718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.412718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.435781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:38.437030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:38.461672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.462969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.463517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.463742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.466628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:38.546788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1326/2650] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:38.548004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.550114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:38.568919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464b9ec-a55d-48cf-8a3d-30f685bf5eb3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.575621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.576513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.577572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.577944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.578239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.578519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] PATH_INFO: `/v3/users/821b5d456d334f66a80512ac08799b4a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.581405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=821b5d456d334f66a80512ac08799b4a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.584920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.591872 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1325/2651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:38.592476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.594027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:38.678651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8c79d-2c2f-4711-a338-232314b22ce4 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.684790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.685729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.685967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.686318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.698947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.700723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.713704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1326/2652] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:38.714743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:38.716726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:38.732906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3def3-51d7-40e9-a8f3-5f95db7880dc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:38.738812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:38.739884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:38.740188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:38.740451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] PATH_INFO: `/v3/users/eaab6d1333c647f79400b4a15ab15309` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:38.741649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaab6d1333c647f79400b4a15ab15309)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:38.743722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:38.893217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821b5d456d334f66a80512ac08799b4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.900623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821b5d456d334f66a80512ac08799b4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.901319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821b5d456d334f66a80512ac08799b4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.901931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821b5d456d334f66a80512ac08799b4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.910762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:38.919952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a441cbf9-433a-4a42-b434-6d87ca05ec0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821b5d456d334f66a80512ac08799b4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.962554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaab6d1333c647f79400b4a15ab15309'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.973022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaab6d1333c647f79400b4a15ab15309'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.973839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaab6d1333c647f79400b4a15ab15309'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.975855 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1327/2653] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:38 2022] DELETE /identity/v3/users/821b5d456d334f66a80512ac08799b4a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:38.995791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaab6d1333c647f79400b4a15ab15309'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:38.997836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaab6d1333c647f79400b4a15ab15309'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:39.057305 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1327/2654] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:38 2022] DELETE /identity/v3/users/eaab6d1333c647f79400b4a15ab15309 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:39.062584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:39.063169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:39.063799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:39.097108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:39.099825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:39.184867 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1328/2655] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:39.220452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:39.221914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:39.296206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cf37a-5beb-45f5-95c6-78b8bd83b498 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:39.301733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:39.302423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:39.302708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:39.302982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:39.316776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:39.318513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:39.332647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1328/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:39.577007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:40.045081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:40.046731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:40.065717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ea77b-6a8b-4888-9446-872955f38f68 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:40.071717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:40.076149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.076698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.077148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] PATH_INFO: `/v3/projects/7ecbce5086154613a5f8a93b667ae9f2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.078664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecbce5086154613a5f8a93b667ae9f2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:40.082120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:40.117011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:40.156719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:40.159935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:40.185036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f991-9dab-469e-b9a6-e0ea2a24371f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:40.191767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:40.192379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.192665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.192951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] PATH_INFO: `/v3/projects/b8ac22fb18b840e58301a8e6bb1d780d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.197794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ac22fb18b840e58301a8e6bb1d780d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:40.197794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:40.284734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecbce5086154613a5f8a93b667ae9f2', 'request_id': 'req-d433ce50-bf0f-40ee-88ac-32a1c360230e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.291301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecbce5086154613a5f8a93b667ae9f2', 'request_id': 'req-d433ce50-bf0f-40ee-88ac-32a1c360230e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.314572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecbce5086154613a5f8a93b667ae9f2', 'request_id': 'req-d433ce50-bf0f-40ee-88ac-32a1c360230e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.401833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] The token cache is being invalidate because project 7ecbce5086154613a5f8a93b667ae9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:40.402136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.403142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d433ce50-bf0f-40ee-88ac-32a1c360230e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.411961 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1329/2657] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:40 2022] DELETE /identity/v3/projects/7ecbce5086154613a5f8a93b667ae9f2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:40.413862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9df5-807f-483f-b6f3-6f12fd2f56ad None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.414159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9df5-807f-483f-b6f3-6f12fd2f56ad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.414439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9df5-807f-483f-b6f3-6f12fd2f56ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.420238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ac22fb18b840e58301a8e6bb1d780d', 'request_id': 'req-782ebce9-6c93-4650-a51d-fdfaa84665ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.427683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ac22fb18b840e58301a8e6bb1d780d', 'request_id': 'req-782ebce9-6c93-4650-a51d-fdfaa84665ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.435392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ac22fb18b840e58301a8e6bb1d780d', 'request_id': 'req-782ebce9-6c93-4650-a51d-fdfaa84665ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.442093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e20e9df5-807f-483f-b6f3-6f12fd2f56ad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:40.443819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e20e9df5-807f-483f-b6f3-6f12fd2f56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:40.514011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] The token cache is being invalidate because project b8ac22fb18b840e58301a8e6bb1d780d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:40.514308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.515181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.516960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1329/2658] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:40 2022] DELETE /identity/v3/projects/b8ac22fb18b840e58301a8e6bb1d780d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:40.521181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:40.522795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:40.535187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1330/2659] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:40.545841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ebce9-6c93-4650-a51d-fdfaa84665ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:40.545841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:40.545841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.545841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.547068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] PATH_INFO: `/v3/users/3e044c7cb5f6428ab005191728ae0f74` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.547068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e044c7cb5f6428ab005191728ae0f74)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:40.549069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:40.556565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.556852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.557193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.598274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:40.600431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:40.617014 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1331/2660] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:40.624557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:40.641225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f8502-58e6-4a3c-9f70-3a433ddef845 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:40.656003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:40.660342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.660342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.660342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.660342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:40.660342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:40.660342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:40.678100 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1332/2661] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:40.682116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:40.694305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34547b21-62c0-4ee8-8595-810417eb683b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:40.699207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:40.699857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.700272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.702314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.702314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:40.703119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:40.837294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e044c7cb5f6428ab005191728ae0f74'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.845264 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1333/2662] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:40 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:40.846482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:40.868043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e044c7cb5f6428ab005191728ae0f74'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.871649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e044c7cb5f6428ab005191728ae0f74'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.908561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e044c7cb5f6428ab005191728ae0f74'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.910107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e044c7cb5f6428ab005191728ae0f74'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:40.963712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fee8-f78c-4697-a695-4a11ad64f949 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:40.969615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:40.969919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:40.969919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:40.970320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:40.971256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:40.973645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:41.039411 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1330/2663] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:40 2022] DELETE /identity/v3/users/3e044c7cb5f6428ab005191728ae0f74 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:41.114314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1334/2664] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:40 2022] POST /identity/v3/users => generated 305 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:41.121209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:41.123443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:41.229733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ba9f-26cf-40f2-b4a8-ac19e3b3cab8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:41.236515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:41.237812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:41.238113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:41.238438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:41.239138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:41.241344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:41.260547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1331/2665] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:41.264630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:41.281519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed7fe-0dfe-4d0b-80b2-d135b4db514a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:41.288861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123db43-5aba-4b10-9c58-86b0a64a91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:41.290845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123db43-5aba-4b10-9c58-86b0a64a91d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:41.291462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123db43-5aba-4b10-9c58-86b0a64a91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:41.292010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123db43-5aba-4b10-9c58-86b0a64a91d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:41.292878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123db43-5aba-4b10-9c58-86b0a64a91d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:41.295247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123db43-5aba-4b10-9c58-86b0a64a91d3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:41.316267 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1335/2666] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:41.317930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:41.336307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd29c3-77e9-4613-9578-61dac0586f8d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:41.342833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:41.343862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:41.344437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:41.344888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] PATH_INFO: `/v3/projects/baedf0fad29c45569bc0a070f59a7ac4/users/6d25394a93f9472787bf740223a64f57/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:41.363422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baedf0fad29c45569bc0a070f59a7ac4, user_id=6d25394a93f9472787bf740223a64f57, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:41.366069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:41.498801 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1332/2667] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:41 2022] PUT /identity/v3/projects/baedf0fad29c45569bc0a070f59a7ac4/users/6d25394a93f9472787bf740223a64f57/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:41.514647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:41.516207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:41.517473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:41.517969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:41.584488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] MFA Rules not processed for user `6d25394a93f9472787bf740223a64f57`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:41.586432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:41.617600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:41.714747 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1336/2668] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:41.715691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:41.837596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54627376-790e-43b5-8f97-0dc57fe002f1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:41.845973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:41.847464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:41.849196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:41.849501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:41.850943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:41.861965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:42.206521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:42.215073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1333/2669] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:41 2022] POST /identity/v3/projects => generated 409 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:52:42.229835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3c6b-18bb-4d89-877c-ce8ef136b845 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:42.270745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:42.328886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:42.330659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:42.331270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:42.331778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:42.332752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:42.335685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:42.428615 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1337/2670] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:42 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:42.430857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:42.457400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2fd9-b82a-4754-b167-d7bd746e9bd6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:42.479330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:42.482851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:42.485908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:42.485908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:42.488461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:42.490718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:42.522002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:42.527798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:42.544886 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1334/2671] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:42.550131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:42.579164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c1eb2-9000-4610-a05b-c7d935f4980b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:42.595403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:42.596946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:42.598618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:42.599417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] PATH_INFO: `/v3/projects/c3e2895e2cea44b88f964620477c3266/users/dd95c1e0eaa74b76ac7c1aad82cdf7f8/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:42.603784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d7130-682b-4108-85ab-7c2641d3730e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:42.653838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:42.654736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:42.655088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:42.656170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] PATH_INFO: `/v3/projects/6636444ced9949b7b97a2f8b8299f719` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:42.660263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e2895e2cea44b88f964620477c3266, user_id=dd95c1e0eaa74b76ac7c1aad82cdf7f8, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:42.661127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6636444ced9949b7b97a2f8b8299f719)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:42.663099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:42.663593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:42.771988 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1335/2672] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:42 2022] PUT /identity/v3/projects/c3e2895e2cea44b88f964620477c3266/users/dd95c1e0eaa74b76ac7c1aad82cdf7f8/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:42.777074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:42.867380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6636444ced9949b7b97a2f8b8299f719', 'request_id': 'req-6762316b-c20c-4466-a604-dc58e73610cc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:42.880157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6636444ced9949b7b97a2f8b8299f719', 'request_id': 'req-6762316b-c20c-4466-a604-dc58e73610cc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:42.896435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6636444ced9949b7b97a2f8b8299f719', 'request_id': 'req-6762316b-c20c-4466-a604-dc58e73610cc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:42.918661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01f261-5bc0-4e07-9cd2-509e4e9b23c3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:42.981449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] The token cache is being invalidate because project 6636444ced9949b7b97a2f8b8299f719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:42.990006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:42.990006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6762316b-c20c-4466-a604-dc58e73610cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:42.990006 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1338/2673] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:42 2022] DELETE /identity/v3/projects/6636444ced9949b7b97a2f8b8299f719 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:42.991203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4252e-b26e-4fdb-8a3b-ef850a4356b0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:42.991496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4252e-b26e-4fdb-8a3b-ef850a4356b0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:42.991817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4252e-b26e-4fdb-8a3b-ef850a4356b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.036316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-29a4252e-b26e-4fdb-8a3b-ef850a4356b0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:43.038228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29a4252e-b26e-4fdb-8a3b-ef850a4356b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:43.101722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e973-1d0a-40bd-be4b-da3ead899774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.102352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e973-1d0a-40bd-be4b-da3ead899774 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.110687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e973-1d0a-40bd-be4b-da3ead899774 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.111198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e973-1d0a-40bd-be4b-da3ead899774 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.114640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e973-1d0a-40bd-be4b-da3ead899774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.119692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e973-1d0a-40bd-be4b-da3ead899774 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:43.181802 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1339/2674] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:43.183502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.184485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.184869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.207377 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1336/2675] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:43.210235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007603-adef-4288-b4dd-968284a85945 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.213298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] MFA Rules not processed for user `c4e1ac1b40e94dbc80548a1f45919b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:43.213607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007603-adef-4288-b4dd-968284a85945 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.215075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:43.215409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007603-adef-4288-b4dd-968284a85945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.263774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-84007603-adef-4288-b4dd-968284a85945 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:43.265015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84007603-adef-4288-b4dd-968284a85945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:43.284436 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1337/2676] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:43.289516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007603-adef-4288-b4dd-968284a85945 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:43.289516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84007603-adef-4288-b4dd-968284a85945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:43.310208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007603-adef-4288-b4dd-968284a85945 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:43.313317 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1340/2677] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:43.318317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:43.328763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf1cdd-b695-498e-bfa7-1e3ca9749d28 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:43.329470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb77f3-d6af-4e6c-9c51-e752d94ea5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.330302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb77f3-d6af-4e6c-9c51-e752d94ea5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.330651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb77f3-d6af-4e6c-9c51-e752d94ea5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.330993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb77f3-d6af-4e6c-9c51-e752d94ea5f4 admin admin] PATH_INFO: `/v3/projects/c3e2895e2cea44b88f964620477c3266/users/dd95c1e0eaa74b76ac7c1aad82cdf7f8/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.336119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb77f3-d6af-4e6c-9c51-e752d94ea5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e2895e2cea44b88f964620477c3266, user_id=dd95c1e0eaa74b76ac7c1aad82cdf7f8, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.339224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb77f3-d6af-4e6c-9c51-e752d94ea5f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:43.339544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:43.340801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.347189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.347189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.347189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.347189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:43.347189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.348528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:43.372483 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1338/2678] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:43 2022] PUT /identity/v3/projects/c3e2895e2cea44b88f964620477c3266/users/dd95c1e0eaa74b76ac7c1aad82cdf7f8/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:43.374546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1341/2679] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:43.387832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.389049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.389498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.392345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:43.409186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc947-08d9-47ca-8990-57ee637967a8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:43.433091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] MFA Rules not processed for user `dd95c1e0eaa74b76ac7c1aad82cdf7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:43.438843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:43.491431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.492171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.492494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.499253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.500270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.503390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:43.537961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1339/2680] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:43.547675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:43.583424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98724a-42a2-4da9-805a-674332bce52a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:43.592439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.593099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.593645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.593923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] PATH_INFO: `/v3/users/6d25394a93f9472787bf740223a64f57` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.596622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d25394a93f9472787bf740223a64f57)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.599159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:43.614515 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1342/2681] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:43 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:43.618352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:43.788202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cae6-d6b7-4998-8756-75408b8e9819 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:43.793747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.795224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.795515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.795850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.797018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.799707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:43.929280 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1343/2682] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:43 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:43.936008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d25394a93f9472787bf740223a64f57'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:43.937363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:43.945031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d25394a93f9472787bf740223a64f57'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:43.945869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d25394a93f9472787bf740223a64f57'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:43.983004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435f86f-4978-453b-adb9-f317ac4b074a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:43.995428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:43.996557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:43.996856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:43.997129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:43.997773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:43.998584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d25394a93f9472787bf740223a64f57'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:44.000763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df62b209-c6d0-4a54-80bd-36b56353f962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d25394a93f9472787bf740223a64f57'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:44.004402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:44.030799 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1344/2683] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:44.031903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:44.035522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:44.049993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86499a33-5ad6-45cc-925d-973ce8d6bfe9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:44.055714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:44.056337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:44.056619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:44.057041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:44.057774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:44.060678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:44.073187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1345/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:44.079584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:44.091918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51988ae-534d-4cf4-8eb3-19b018892c4d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:44.097280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:44.098745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:44.098745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:44.098959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] PATH_INFO: `/v3/projects/c75bc66c9c9b4fc4b76380e47b40b0b5/users/6559ac446c4640218ce700687045bb0d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:44.143266 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1340/2685] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:43 2022] DELETE /identity/v3/users/6d25394a93f9472787bf740223a64f57 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:44.146999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955990f9-1f76-4a41-8d7c-1345d2ec50f7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:44.148070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955990f9-1f76-4a41-8d7c-1345d2ec50f7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:44.148879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955990f9-1f76-4a41-8d7c-1345d2ec50f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:44.170788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75bc66c9c9b4fc4b76380e47b40b0b5, user_id=6559ac446c4640218ce700687045bb0d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:44.177541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:44.195753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-955990f9-1f76-4a41-8d7c-1345d2ec50f7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:44.197595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-955990f9-1f76-4a41-8d7c-1345d2ec50f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:44.279680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:44.357055 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1341/2687] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:44.357781 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1346/2687] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:44 2022] PUT /identity/v3/projects/c75bc66c9c9b4fc4b76380e47b40b0b5/users/6559ac446c4640218ce700687045bb0d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:44.361767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:44.362891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:44.365796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:44.373136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:44.377008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:44.416691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:44.418252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:44.499788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a15b1-6aea-43bb-a62b-3b8b29b08450 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:44.538794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:44.540518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:44.540940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:44.541568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:44.619400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1342/2688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:44.686099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:44.692127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:44.709708 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1347/2689] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:44.726989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:44.728463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:44.751441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa7228-438a-473a-8f22-9f7542115beb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:44.770099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:44.780228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:44.780228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:44.780228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:44.790402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:44.796570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:44.827771 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1343/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:44.978907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:45.418723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:45.693047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:45.900767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:45.903360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:45.919954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ef35-8c67-4516-8121-3b993dfc1ad9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:45.929017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:45.929017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:45.929017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:45.929017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] PATH_INFO: `/v3/projects/baedf0fad29c45569bc0a070f59a7ac4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:45.930244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baedf0fad29c45569bc0a070f59a7ac4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:45.932949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:46.481834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baedf0fad29c45569bc0a070f59a7ac4', 'request_id': 'req-700550d1-374d-4026-a4a6-f349df1f1092'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:46.496155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baedf0fad29c45569bc0a070f59a7ac4', 'request_id': 'req-700550d1-374d-4026-a4a6-f349df1f1092'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:46.512326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baedf0fad29c45569bc0a070f59a7ac4', 'request_id': 'req-700550d1-374d-4026-a4a6-f349df1f1092'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:46.631425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] The token cache is being invalidate because project baedf0fad29c45569bc0a070f59a7ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:46.631425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:46.631425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:46.632264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:46.634838 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1348/2691] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:45 2022] DELETE /identity/v3/projects/baedf0fad29c45569bc0a070f59a7ac4 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:46.639249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:46.649252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e3bc-2327-41cc-bc4b-68ecd30cde90 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:46.782512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:46.782512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:46.782512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:46.782512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] PATH_INFO: `/v3/users/dd95c1e0eaa74b76ac7c1aad82cdf7f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:46.788073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd95c1e0eaa74b76ac7c1aad82cdf7f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:46.792935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:47.121035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd95c1e0eaa74b76ac7c1aad82cdf7f8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:47.133320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd95c1e0eaa74b76ac7c1aad82cdf7f8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:47.134936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd95c1e0eaa74b76ac7c1aad82cdf7f8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:47.183546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd95c1e0eaa74b76ac7c1aad82cdf7f8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:47.185930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c9ec353-89ea-4dff-8987-a5e6b9aaf062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd95c1e0eaa74b76ac7c1aad82cdf7f8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:47.261928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1344/2692] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:52:46 2022] DELETE /identity/v3/users/dd95c1e0eaa74b76ac7c1aad82cdf7f8 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:48.300389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:48.302179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:48.329396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700550d1-374d-4026-a4a6-f349df1f1092 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:48.443769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:48.444266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:48.444435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:48.514634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:48.515500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:48.516135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:48.516736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] PATH_INFO: `/v3/projects/c3e2895e2cea44b88f964620477c3266` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:48.520034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] MFA Rules not processed for user `42902f5389b747b18216571f47b9e537`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:48.523139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:48.541396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e2895e2cea44b88f964620477c3266)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:48.549483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:48.623866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1345/2693] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:48.707587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e2895e2cea44b88f964620477c3266', 'request_id': 'req-b4338d70-6351-47f9-9cdb-6ad943129928'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:48.715110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e2895e2cea44b88f964620477c3266', 'request_id': 'req-b4338d70-6351-47f9-9cdb-6ad943129928'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:48.726935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e2895e2cea44b88f964620477c3266', 'request_id': 'req-b4338d70-6351-47f9-9cdb-6ad943129928'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:48.805122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:48.806737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:48.816423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] The token cache is being invalidate because project c3e2895e2cea44b88f964620477c3266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:52:48.816846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:48.818853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b4338d70-6351-47f9-9cdb-6ad943129928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:52:48.827221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1349/2694] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:52:48 2022] DELETE /identity/v3/projects/c3e2895e2cea44b88f964620477c3266 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:48.828821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd34d8-2e97-447a-b941-91df058eb0ab None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:48.829169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd34d8-2e97-447a-b941-91df058eb0ab None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:48.829649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd34d8-2e97-447a-b941-91df058eb0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:48.872338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-39dd34d8-2e97-447a-b941-91df058eb0ab None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:48.873573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-39dd34d8-2e97-447a-b941-91df058eb0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:48.983935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e962-8ba2-426b-9953-29f173c9cc48 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.017941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1350/2695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:52:49.029116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.029237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.029554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.071559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:49.073225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:49.085989 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1351/2696] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:49.086945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:49.097470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f75916-c9c6-4f17-989c-261a7f983cdc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.103540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.104399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.104399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.104693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.105401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:52:49.105745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.107583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.116777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.125608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.125984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.126872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.128774 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1352/2697] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:52:49.129821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:49.132649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:49.148216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846222e0-4d22-4f1f-96e7-1b5e7bf9ebbe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.162771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.162771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.162771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.163510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.164450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.166739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.216897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.218611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.234477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1346/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:48 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:52:49.315977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:49.360002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1353/2699] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:49 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:49.365804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:49.385191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a1f7-d95c-45bf-a793-1bd1af5aa255 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.480335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.481080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.481436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.481777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.485979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.488059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.625430 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1347/2700] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:49 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:49.629906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:49.643817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c33907-daf0-4bb8-a463-2328253abe50 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.654715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.656681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.657012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.657297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.660620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.665982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.684505 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1354/2701] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:49.688274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:49.698518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b10b9-b62b-43c7-9a72-6eda29eb94d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.713381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034b74-b95e-41a7-889e-2dac40419e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.715225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034b74-b95e-41a7-889e-2dac40419e79 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.715225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034b74-b95e-41a7-889e-2dac40419e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.715225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034b74-b95e-41a7-889e-2dac40419e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.715549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034b74-b95e-41a7-889e-2dac40419e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.717425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034b74-b95e-41a7-889e-2dac40419e79 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.737122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:49.744381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1348/2702] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:49.749113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a7a3-6506-46de-aa1d-0ca02eb7f955 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:49.754912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:49.755824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.756308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.756732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] PATH_INFO: `/v3/projects/37509f3214ec4a83a0db84a1c5377690/users/42a1b77561bd4df3a751dea07b1c6cda/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:49.778643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37509f3214ec4a83a0db84a1c5377690, user_id=42a1b77561bd4df3a751dea07b1c6cda, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:49.781892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:49.899128 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1355/2703] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:49 2022] PUT /identity/v3/projects/37509f3214ec4a83a0db84a1c5377690/users/42a1b77561bd4df3a751dea07b1c6cda/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:49.990307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:49.990621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:49.990866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:50.052087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] MFA Rules not processed for user `42a1b77561bd4df3a751dea07b1c6cda`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:50.057026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:50.114003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:50.224299 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1349/2704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:50.228567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:50.364900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c1193-9b03-4e82-aea6-b179a7a48082 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:50.373267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:50.375559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:50.376024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:50.376455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:50.377262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:50.380092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:50.511996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1356/2705] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:52:50 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:50.513068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:50.525671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8ace-5392-49cf-be66-e15431483529 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:50.606478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:50.607634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:50.608132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:50.608919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:50.609845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:50.612235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:50.734468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1350/2706] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:52:50 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:52:50.738947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:50.759904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76f6e-e643-4d22-8b49-4092fee2ff66 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:50.767702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:50.768601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:50.769070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:50.769498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:50.770302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:50.777720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:50.805560 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1357/2707] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:50.809938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:50.821599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1519bf-b0ad-4c69-bf60-7b5fe8960a4a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:50.829719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:50.830413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:50.830700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:50.835636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] PATH_INFO: `/v3/projects/c848bf30ab3948549504d01b5bc5af06/users/16805afaab38461cb3bf8363782ce07e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:50.857365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c848bf30ab3948549504d01b5bc5af06, user_id=16805afaab38461cb3bf8363782ce07e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:50.860548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:50.979580 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1351/2708] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:50 2022] PUT /identity/v3/projects/c848bf30ab3948549504d01b5bc5af06/users/16805afaab38461cb3bf8363782ce07e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:52:50.984913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:50.998300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470979-e842-4001-96eb-3c8787a37fe7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:51.094847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46951c60-e1ae-40d3-994b-d33d3a7e1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:51.095829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951c60-e1ae-40d3-994b-d33d3a7e1475 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:51.096418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951c60-e1ae-40d3-994b-d33d3a7e1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:51.096853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951c60-e1ae-40d3-994b-d33d3a7e1475 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:51.098417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46951c60-e1ae-40d3-994b-d33d3a7e1475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:51.100754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46951c60-e1ae-40d3-994b-d33d3a7e1475 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:51.128331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1358/2709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:52:51.132400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:51.143985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ad302-4f23-4418-93d2-01e740dd8759 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:51.153822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063554f1-5f70-465e-bb2d-4f8d58a36f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:51.154573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063554f1-5f70-465e-bb2d-4f8d58a36f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:51.154813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063554f1-5f70-465e-bb2d-4f8d58a36f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:51.155121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063554f1-5f70-465e-bb2d-4f8d58a36f17 admin admin] PATH_INFO: `/v3/projects/c848bf30ab3948549504d01b5bc5af06/users/16805afaab38461cb3bf8363782ce07e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:51.162596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063554f1-5f70-465e-bb2d-4f8d58a36f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c848bf30ab3948549504d01b5bc5af06, user_id=16805afaab38461cb3bf8363782ce07e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:51.162596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063554f1-5f70-465e-bb2d-4f8d58a36f17 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:51.184501 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1352/2710] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:52:51 2022] PUT /identity/v3/projects/c848bf30ab3948549504d01b5bc5af06/users/16805afaab38461cb3bf8363782ce07e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:52:51.201694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:51.201694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:51.201694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:51.201959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:51.254703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] MFA Rules not processed for user `16805afaab38461cb3bf8363782ce07e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:51.256531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:51.376630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:51.435151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1359/2711] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:51.445799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c258e-dc3c-4c4d-8d5f-5259a6e0ff66 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:51.446096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c258e-dc3c-4c4d-8d5f-5259a6e0ff66 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:51.446586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c258e-dc3c-4c4d-8d5f-5259a6e0ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:51.484121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-230c258e-dc3c-4c4d-8d5f-5259a6e0ff66 None None] MFA Rules not processed for user `42a1b77561bd4df3a751dea07b1c6cda`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:51.503079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-230c258e-dc3c-4c4d-8d5f-5259a6e0ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:51.607999 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1353/2712] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:52.106647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:52:52.116955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:52.221759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e03311-d77c-43e9-ab6b-05dcc636417c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:52:52.248994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23234e-569b-4ec6-a519-c89460198c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:52:52.251831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23234e-569b-4ec6-a519-c89460198c41 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:52.252642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23234e-569b-4ec6-a519-c89460198c41 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:52.253102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23234e-569b-4ec6-a519-c89460198c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:52.295082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23234e-569b-4ec6-a519-c89460198c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:52:52.309278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23234e-569b-4ec6-a519-c89460198c41 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:52:52.354171 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1360/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:52:52.413002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:52.699692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:53.392508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:52:53.393273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:52:53.395107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:52:53.457206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] MFA Rules not processed for user `42a1b77561bd4df3a751dea07b1c6cda`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:52:53.460523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:52:53.470836 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1354/2714] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:52:54.839938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:55.923872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:56.901414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:58.715713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:52:59.833788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:00.409950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:00.412288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:00.412288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:00.442453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] MFA Rules not processed for user `6559ac446c4640218ce700687045bb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:00.443970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:00.549624 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1361/2715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:00.557109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:00.559168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:00.654268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eb589-2e4b-4787-bd2d-c6cb996bacc4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:00.659402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd3cd3-92ea-48f0-901f-28d0c9c49635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:00.660013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd3cd3-92ea-48f0-901f-28d0c9c49635 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:00.660453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd3cd3-92ea-48f0-901f-28d0c9c49635 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:00.660877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd3cd3-92ea-48f0-901f-28d0c9c49635 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:00.661669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd3cd3-92ea-48f0-901f-28d0c9c49635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:00.663902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd3cd3-92ea-48f0-901f-28d0c9c49635 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:00.702481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:00.761541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1355/2716] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:00 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:00.766026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:00.780721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca71def-1119-4fb5-ae06-8f8143127f72 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:00.893396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:00.897453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:00.897453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:00.924538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:00.926123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:00.928955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:00.929840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:00.931386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:00.938966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:00.946592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] MFA Rules not processed for user `117e12084c60416aabce823ebae4f214`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:00.947835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:01.044594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1356/2717] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:01.046160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:01.051397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:01.059622 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1362/2718] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:00 2022] POST /identity/v3/users => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:01.060800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:01.062777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:01.081144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96661-d855-4056-b0c1-14e69b8a9209 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:01.090324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:01.093522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:01.093814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:01.094094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] PATH_INFO: `/v3/users/42902f5389b747b18216571f47b9e537` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:01.096675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42902f5389b747b18216571f47b9e537)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:01.100242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:01.228882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1df421-5747-48b5-8a4d-1aae10ce7bb1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:01.235812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:01.236498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:01.236891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:01.237409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:01.240454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:01.257431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:01.262078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:01.276444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1357/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:01.278240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:01.296975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7393209-b22f-4bcf-a037-2fee2cb33bac service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:01.317719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:01.317719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:01.317719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:01.317719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:01.318176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:01.320109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:01.356437 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1358/2720] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:01.361194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:01.389601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1417-4878-4265-afd6-6f9f0032a9a5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:01.399859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42902f5389b747b18216571f47b9e537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:01.406047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:01.407469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:01.408005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:01.412787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] PATH_INFO: `/v3/projects/69b39ad3919a435287317512fdf3fb31/users/708c339746d34f61b3f1d5338002db2a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:01.417245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42902f5389b747b18216571f47b9e537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:01.420755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42902f5389b747b18216571f47b9e537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:01.422957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42902f5389b747b18216571f47b9e537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:01.428409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b39ad3919a435287317512fdf3fb31, user_id=708c339746d34f61b3f1d5338002db2a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:01.433935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:01.442612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42902f5389b747b18216571f47b9e537'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:01.576965 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1363/2721] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:01 2022] DELETE /identity/v3/users/42902f5389b747b18216571f47b9e537 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:01.590348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1359/2722] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:01 2022] PUT /identity/v3/projects/69b39ad3919a435287317512fdf3fb31/users/708c339746d34f61b3f1d5338002db2a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:53:01.594662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:01.596374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:01.759555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7a97f-cc0f-4ea3-8ae8-2102e5ecd736 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:01.786099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:01.786282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:01.786736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:01.787205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:01.788532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:01.790588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:01.828657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:01.840411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:01.841145 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1364/2723] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:02.003846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9302e-4f03-4279-bb4e-c589518b73ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:02.008792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba515de-de61-4121-b75b-c0a71bfe3db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:02.010052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba515de-de61-4121-b75b-c0a71bfe3db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:02.011143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba515de-de61-4121-b75b-c0a71bfe3db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:02.012189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba515de-de61-4121-b75b-c0a71bfe3db9 admin admin] PATH_INFO: `/v3/projects/69b39ad3919a435287317512fdf3fb31/users/708c339746d34f61b3f1d5338002db2a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:02.014638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba515de-de61-4121-b75b-c0a71bfe3db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b39ad3919a435287317512fdf3fb31, user_id=708c339746d34f61b3f1d5338002db2a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:02.018049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba515de-de61-4121-b75b-c0a71bfe3db9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:02.039110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:02.039110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:02.043601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1360/2724] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:01 2022] PUT /identity/v3/projects/69b39ad3919a435287317512fdf3fb31/users/708c339746d34f61b3f1d5338002db2a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:02.074289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a48d6d-ba81-4b18-b236-0745f8778a84 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:02.162486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:02.163435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:02.163925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:02.164951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] PATH_INFO: `/v3/projects/fb1bb71c2e344a579584add8a97863f1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:02.165667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1bb71c2e344a579584add8a97863f1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:02.168026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:02.357089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1bb71c2e344a579584add8a97863f1', 'request_id': 'req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:02.373387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1bb71c2e344a579584add8a97863f1', 'request_id': 'req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:02.385784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1bb71c2e344a579584add8a97863f1', 'request_id': 'req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:02.500268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] The token cache is being invalidate because project fb1bb71c2e344a579584add8a97863f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:02.502302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:02.504173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a612a4e-25e0-40b0-8f88-7b50d5eedd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:02.506385 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1365/2725] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:02 2022] DELETE /identity/v3/projects/fb1bb71c2e344a579584add8a97863f1 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:02.516378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:02.516378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:02.516378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:02.557546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:02.560396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:02.718443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1361/2726] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:02.726860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:02.727541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:02.727989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:02.755361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:02.757896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:02.783544 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1366/2727] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:02.784092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:02.797888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535767b7-df45-4d9b-98d6-3c17a00e6ac5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:02.829991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:02.833075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:02.833483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:02.834176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:02.836297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:53:02.842458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:02.842458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:02.886567 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1362/2728] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:53:02.891365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:02.920092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b73b-07fe-452e-a25d-02f7da6d9fee None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:02.948541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:02.949845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:02.950125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:02.950406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:02.951086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:02.953165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:03.165040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1367/2729] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:02 2022] POST /identity/v3/projects => generated 363 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:53:03.173161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:03.186256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87bee-99b3-4663-ba38-5293a180cc76 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:03.299723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:03.318091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:03.318471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:03.318810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:03.319817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:03.322188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:03.440001 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1363/2730] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:03 2022] POST /identity/v3/users => generated 282 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:03.442390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:03.456742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39f83-3927-4141-b42b-09f994647484 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:03.472904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:03.473638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:03.473995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:03.474354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:03.475382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:03.477114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:03.496587 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1368/2731] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:03.497959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:03.510299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4d7a-730a-4538-845b-fa68069172e6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:03.517868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534fc65-8860-4020-8460-73c3344cc978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:03.518877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534fc65-8860-4020-8460-73c3344cc978 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:03.519467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534fc65-8860-4020-8460-73c3344cc978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:03.519966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534fc65-8860-4020-8460-73c3344cc978 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:03.521238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534fc65-8860-4020-8460-73c3344cc978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:03.532326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534fc65-8860-4020-8460-73c3344cc978 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:03.544029 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1364/2732] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:03.544247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:03.556757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae710-e153-4430-aaf5-6d5acac7eee6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:03.564047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:03.564862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:03.565271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:03.565625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] PATH_INFO: `/v3/projects/e047ab9362dc476c9a4b4aee7223d042/users/d79046739b2d4572b0aedef59e621ab8/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:03.584362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:03.592513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e047ab9362dc476c9a4b4aee7223d042, user_id=d79046739b2d4572b0aedef59e621ab8, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:03.597483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:03.686681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1369/2733] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:03 2022] PUT /identity/v3/projects/e047ab9362dc476c9a4b4aee7223d042/users/d79046739b2d4572b0aedef59e621ab8/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:53:03.691523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c95c-e6b2-42d5-a829-70b1270dc11d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:03.691818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c95c-e6b2-42d5-a829-70b1270dc11d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:03.692096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c95c-e6b2-42d5-a829-70b1270dc11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:03.724533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-75b2c95c-e6b2-42d5-a829-70b1270dc11d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:03.726117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-75b2c95c-e6b2-42d5-a829-70b1270dc11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:03.836169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1365/2734] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:03.842092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:03.844351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:03.975633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a1d67-3d73-48e5-9bad-eead5a209665 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:03.982313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82d668-b5b8-4d5f-9d6b-7b50a999c016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:03.982942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82d668-b5b8-4d5f-9d6b-7b50a999c016 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:03.984058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82d668-b5b8-4d5f-9d6b-7b50a999c016 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:03.984348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82d668-b5b8-4d5f-9d6b-7b50a999c016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:03.996379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82d668-b5b8-4d5f-9d6b-7b50a999c016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:03.998516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82d668-b5b8-4d5f-9d6b-7b50a999c016 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:04.013892 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1370/2735] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:05.309220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:07.111998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:07.393920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:08.942955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66439759-c64a-4178-a8db-d1b917974ad9 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:08.943642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66439759-c64a-4178-a8db-d1b917974ad9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:08.943642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66439759-c64a-4178-a8db-d1b917974ad9 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:08.945192 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1366/2736] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:53:08.954548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099cde-e8ed-4240-9f33-c076d7f823b5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:08.955304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099cde-e8ed-4240-9f33-c076d7f823b5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:08.955432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b099cde-e8ed-4240-9f33-c076d7f823b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:09.001699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9b099cde-e8ed-4240-9f33-c076d7f823b5 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:09.003446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b099cde-e8ed-4240-9f33-c076d7f823b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:09.138369 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1371/2737] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:09.190891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66439759-c64a-4178-a8db-d1b917974ad9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:09.194185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-66439759-c64a-4178-a8db-d1b917974ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:09.219353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66439759-c64a-4178-a8db-d1b917974ad9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:09.226419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:09.229538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:09.230667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:09.248239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:09.308858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:09.315802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:09.358394 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1367/2738] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:09.479498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:09.510526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:09.749813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86a70-42dd-4e5d-9637-7a0184528028 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:09.750366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86a70-42dd-4e5d-9637-7a0184528028 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:09.751135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86a70-42dd-4e5d-9637-7a0184528028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:09.779414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cae86a70-42dd-4e5d-9637-7a0184528028 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:09.781082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cae86a70-42dd-4e5d-9637-7a0184528028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:09.788065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1372/2739] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:09.847334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:09.858202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8116ca-51c9-4465-b271-01135ed9a005 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:09.863107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dcf86-365b-43d4-a53c-3f545fbb7374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:09.864422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dcf86-365b-43d4-a53c-3f545fbb7374 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:09.864888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dcf86-365b-43d4-a53c-3f545fbb7374 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:09.865398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dcf86-365b-43d4-a53c-3f545fbb7374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:09.881232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dcf86-365b-43d4-a53c-3f545fbb7374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:09.883561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dcf86-365b-43d4-a53c-3f545fbb7374 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:09.904015 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1368/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:11.248312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:11.485130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:13.710836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:13.932268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539245d2-1050-453a-a429-992d9814a900 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:13.933736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539245d2-1050-453a-a429-992d9814a900 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:13.934814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539245d2-1050-453a-a429-992d9814a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:13.977104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-539245d2-1050-453a-a429-992d9814a900 None None] MFA Rules not processed for user `d79046739b2d4572b0aedef59e621ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:13.978517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-539245d2-1050-453a-a429-992d9814a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:14.005746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:14.174339 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1373/2741] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:14.180021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:14.180376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:14.180664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:14.219206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] MFA Rules not processed for user `d79046739b2d4572b0aedef59e621ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:14.222220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:14.246674 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1369/2742] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:14.889379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539245d2-1050-453a-a429-992d9814a900 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:14.891228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-539245d2-1050-453a-a429-992d9814a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:14.941520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539245d2-1050-453a-a429-992d9814a900 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:14.957861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:14.959357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:14.960564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:14.962285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] PATH_INFO: `/v3/users/e425c7348db042389a189daa866ea06d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:14.965817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e425c7348db042389a189daa866ea06d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:14.970405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:15.146598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:15.148920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:15.172087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:15.178525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64996900-33b4-48c3-a33b-c789befac8a0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:15.191993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b06da-a2f2-4a00-a1e8-32b0273efc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:15.192953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b06da-a2f2-4a00-a1e8-32b0273efc34 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:15.193267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b06da-a2f2-4a00-a1e8-32b0273efc34 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:15.193547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b06da-a2f2-4a00-a1e8-32b0273efc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:15.214869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b06da-a2f2-4a00-a1e8-32b0273efc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:15.226907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b06da-a2f2-4a00-a1e8-32b0273efc34 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:15.260943 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1370/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:53:15.316157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e425c7348db042389a189daa866ea06d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:15.382935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e425c7348db042389a189daa866ea06d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:15.384382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e425c7348db042389a189daa866ea06d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:15.385505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e425c7348db042389a189daa866ea06d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:15.427268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e425c7348db042389a189daa866ea06d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:15.537788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1374/2744] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:14 2022] DELETE /identity/v3/users/e425c7348db042389a189daa866ea06d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:15.543021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:15.543464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:15.543748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:15.576979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:15.578403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:15.630157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:15.724054 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1371/2745] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:15.728957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:15.731623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:15.862303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ebf59-cca1-40ca-acee-8ba8ff4c2a36 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:15.878820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:15.879797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:15.880088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:15.880359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:15.906338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:15.908569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:15.932574 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1375/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:16.271774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:16.274022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:16.304945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb2d11-7928-411c-aab7-b309dae30a86 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:16.318845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:16.320901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:16.322053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:16.323073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] PATH_INFO: `/v3/projects/4882f2c8ef9c4f29bf3cbaa93cf9d488` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:16.327773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4882f2c8ef9c4f29bf3cbaa93cf9d488)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:16.332269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:16.475896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'request_id': 'req-71338056-67ce-484a-8f1d-5c0306a11258'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.483581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'request_id': 'req-71338056-67ce-484a-8f1d-5c0306a11258'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.507497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4882f2c8ef9c4f29bf3cbaa93cf9d488', 'request_id': 'req-71338056-67ce-484a-8f1d-5c0306a11258'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.610551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] The token cache is being invalidate because project 4882f2c8ef9c4f29bf3cbaa93cf9d488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:16.610862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.611581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.613236 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1372/2747] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:16 2022] DELETE /identity/v3/projects/4882f2c8ef9c4f29bf3cbaa93cf9d488 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:16.618875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:16.631074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27eb8-112c-4b37-bd08-eab7d8f877e9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:16.714919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:16.715878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:16.716376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:16.716761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] PATH_INFO: `/v3/users/66e653c2ba034b269a99e7335e810861` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:16.718172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e653c2ba034b269a99e7335e810861)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:16.720698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:16.978096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e653c2ba034b269a99e7335e810861'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.988119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e653c2ba034b269a99e7335e810861'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.989248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e653c2ba034b269a99e7335e810861'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:16.990081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e653c2ba034b269a99e7335e810861'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:17.005165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d13b2ea2-57c6-4b1c-a508-6f06e83ef871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e653c2ba034b269a99e7335e810861'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:17.104082 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1376/2748] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:16 2022] DELETE /identity/v3/users/66e653c2ba034b269a99e7335e810861 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:17.379121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:17.505899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:17.507820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:17.537822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338056-67ce-484a-8f1d-5c0306a11258 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:17.751851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:17.752719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:17.753004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:17.753282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] PATH_INFO: `/v3/projects/4da8b0a081964e2191d0e5e3e9eac26f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:17.754442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da8b0a081964e2191d0e5e3e9eac26f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:17.772609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:17.863644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:17.940008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da8b0a081964e2191d0e5e3e9eac26f', 'request_id': 'req-24560370-981d-43a5-b69c-8cb2d0057855'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:17.951131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da8b0a081964e2191d0e5e3e9eac26f', 'request_id': 'req-24560370-981d-43a5-b69c-8cb2d0057855'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:17.958433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da8b0a081964e2191d0e5e3e9eac26f', 'request_id': 'req-24560370-981d-43a5-b69c-8cb2d0057855'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:18.047418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] The token cache is being invalidate because project 4da8b0a081964e2191d0e5e3e9eac26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:18.047523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:18.048342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24560370-981d-43a5-b69c-8cb2d0057855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:18.050684 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1373/2749] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:17 2022] DELETE /identity/v3/projects/4da8b0a081964e2191d0e5e3e9eac26f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:18.058862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb483e69-043b-47fa-a789-13450d76b4cc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.060479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb483e69-043b-47fa-a789-13450d76b4cc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.060920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb483e69-043b-47fa-a789-13450d76b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.091755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bb483e69-043b-47fa-a789-13450d76b4cc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:18.092989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bb483e69-043b-47fa-a789-13450d76b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:18.113686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.116142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.116142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.175600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] MFA Rules not processed for user `708c339746d34f61b3f1d5338002db2a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:18.177349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:18.215249 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1377/2750] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:18.223257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28383c-abab-4e89-9574-f091457b2acc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.223742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28383c-abab-4e89-9574-f091457b2acc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.224236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28383c-abab-4e89-9574-f091457b2acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.287856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-af28383c-abab-4e89-9574-f091457b2acc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:18.295201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-af28383c-abab-4e89-9574-f091457b2acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:18.316971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1378/2751] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:18.320072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28383c-abab-4e89-9574-f091457b2acc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:18.362356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28383c-abab-4e89-9574-f091457b2acc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:18.376037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:18.377917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.385489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.385489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.385489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:53:18.385489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:18.389595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:18.423597 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1379/2752] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:53:18.426025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:18.431693 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1374/2753] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:53:18.441030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:18.442371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:18.462932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80937c-dd3a-4a5a-a94f-1219997de4d0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:18.478537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:18.479625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.480452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.480727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.483811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:18.490295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:18.572424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bd34c-971b-4275-ab48-e784ae00ffcb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:18.577488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:18.578466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.578906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.579395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.590923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:18.593361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:18.615476 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1375/2754] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:18.637806 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1380/2755] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:18 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:18.640284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:18.659277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff22af4-bbf4-4702-81fb-0e1631288b58 service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:18.820671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:18.824034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:18.825868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:18.826388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:18.827299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:18.830657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:19.136754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:19.148158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1376/2756] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:18 2022] POST /identity/v3/users => generated 290 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:19.151299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9a1d9-e509-4c13-a182-4622e39447af admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:19.158928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:19.160627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:19.161162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:19.161816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:19.165812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:19.165812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:19.184697 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1381/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:53:19.186655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:19.200859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105594a-901f-419c-bd48-57851c15003f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:19.217039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579a71a-bead-4a18-95ea-507846e9ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:19.218076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a71a-bead-4a18-95ea-507846e9ea1a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:19.218598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a71a-bead-4a18-95ea-507846e9ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:19.219121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579a71a-bead-4a18-95ea-507846e9ea1a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:19.221261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579a71a-bead-4a18-95ea-507846e9ea1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:19.227154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579a71a-bead-4a18-95ea-507846e9ea1a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:19.267068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:19.279619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1377/2758] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:19.282648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab88d-e357-4ca4-834c-5b08011deb6c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:19.315157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:19.316750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:19.317407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:19.317924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] PATH_INFO: `/v3/projects/f8234a52ac594926bc194b3554a49d21/users/fa27a9163a6b4aa9af74ddd81eaafd24/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:19.382176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8234a52ac594926bc194b3554a49d21, user_id=fa27a9163a6b4aa9af74ddd81eaafd24, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:19.387911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:19.447251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:19.484275 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1382/2759] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:19 2022] PUT /identity/v3/projects/f8234a52ac594926bc194b3554a49d21/users/fa27a9163a6b4aa9af74ddd81eaafd24/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:19.572736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:19.573397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:19.574039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:19.636191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] MFA Rules not processed for user `fa27a9163a6b4aa9af74ddd81eaafd24`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:19.638699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:19.771176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:19.772566 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1378/2760] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:19.950886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e493-8e80-41b4-ad1c-953e8f9f1dfe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:19.955431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:19.958279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:19.967163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:19.968059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:19.968484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:19.968923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:19.969713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:19.971819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:20.032910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:20.131315 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1383/2761] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:19 2022] POST /identity/v3/projects => generated 379 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:20.140093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:20.325873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87ae02-9b12-4bdc-ae9e-de3dc5116268 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:20.347716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb25e8-585a-4765-9679-bfd9bd78437b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:20.368716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:20.369362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:20.369643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:20.370052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:20.373842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:20.373842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:20.484369 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1384/2762] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:20 2022] POST /identity/v3/users => generated 296 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:20.485583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:20.515215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b968a6e-19ac-493d-a50f-3cb7b29c1ecf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:20.539744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:20.540369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:20.540649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:20.540920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:20.542124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:20.547842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:20.588016 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1385/2763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:20.589613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:20.657110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5168a-a9dc-467e-9efe-5c8241a64ca4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:20.668042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:20.670620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:20.671655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:20.672278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:20.677729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:20.678461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:20.687752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:20.688044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:20.688319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] PATH_INFO: `/v3/projects/ff0d766ef5a149e285eaf7925b74a2a4/users/e22a7e028d61439db6671b8e25d51133/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:20.719884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:20.738224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:20.748988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0d766ef5a149e285eaf7925b74a2a4, user_id=e22a7e028d61439db6671b8e25d51133, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:20.752316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:20.774206 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1379/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:53:20.862972 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1386/2765] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:20 2022] PUT /identity/v3/projects/ff0d766ef5a149e285eaf7925b74a2a4/users/e22a7e028d61439db6671b8e25d51133/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:20.865467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:20.894357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f3edc-88f0-413b-92f5-b74b801b1222 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:21.077022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8446-c0a4-47ed-9fe9-239f60281142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:21.077676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8446-c0a4-47ed-9fe9-239f60281142 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:21.077955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8446-c0a4-47ed-9fe9-239f60281142 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:21.078228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8446-c0a4-47ed-9fe9-239f60281142 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:21.078986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8446-c0a4-47ed-9fe9-239f60281142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:21.080731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8446-c0a4-47ed-9fe9-239f60281142 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:21.112515 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1380/2766] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:21.116609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:21.133142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45d96-9d15-42fd-bf13-3f343a500103 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:21.147216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:21.148048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:21.148422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:21.148707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] PATH_INFO: `/v3/projects/ff0d766ef5a149e285eaf7925b74a2a4/users/e22a7e028d61439db6671b8e25d51133/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:21.153662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0d766ef5a149e285eaf7925b74a2a4, user_id=e22a7e028d61439db6671b8e25d51133, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:21.156591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:21.186056 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1387/2767] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:21 2022] PUT /identity/v3/projects/ff0d766ef5a149e285eaf7925b74a2a4/users/e22a7e028d61439db6671b8e25d51133/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:21.200008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:21.200963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:21.201913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:21.304843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] MFA Rules not processed for user `e22a7e028d61439db6671b8e25d51133`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:21.308203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:21.334289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:21.663354 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1381/2768] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:21.765787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:21.953726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:22.481986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:22.487312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:22.795757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d1bac-3aec-46ed-8411-647cdd19933e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:22.826998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6435-a814-44ef-ac21-af800a5dbc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:22.829393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6435-a814-44ef-ac21-af800a5dbc63 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:22.831787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6435-a814-44ef-ac21-af800a5dbc63 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:22.832756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6435-a814-44ef-ac21-af800a5dbc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:22.845988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:22.884053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6435-a814-44ef-ac21-af800a5dbc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:22.890098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6435-a814-44ef-ac21-af800a5dbc63 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:22.933964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1388/2769] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:24.140487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:24.333980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0192e-d042-42ca-a83b-dc808c0c141d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:24.349187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:24.350698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:24.351539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:24.352033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] PATH_INFO: `/v3/users/fa27a9163a6b4aa9af74ddd81eaafd24` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:24.357534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa27a9163a6b4aa9af74ddd81eaafd24)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:24.360094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:24.367312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:24.621359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa27a9163a6b4aa9af74ddd81eaafd24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:24.643054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa27a9163a6b4aa9af74ddd81eaafd24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:24.645365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa27a9163a6b4aa9af74ddd81eaafd24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:24.679315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa27a9163a6b4aa9af74ddd81eaafd24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:24.680108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa27a9163a6b4aa9af74ddd81eaafd24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:24.797779 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1382/2770] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:24 2022] DELETE /identity/v3/users/fa27a9163a6b4aa9af74ddd81eaafd24 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:24.809023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4a203-4d69-47df-a7eb-3c46c72a1e50 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:24.809646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4a203-4d69-47df-a7eb-3c46c72a1e50 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:24.813701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4a203-4d69-47df-a7eb-3c46c72a1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:24.872870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6ce4a203-4d69-47df-a7eb-3c46c72a1e50 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:24.874311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6ce4a203-4d69-47df-a7eb-3c46c72a1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:25.063715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1389/2771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:25.157893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:25.160060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:25.328665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d7a9c-17e8-4871-8c85-b4b6ee8c010d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:25.353707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:25.355824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:25.356670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:25.357272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:25.357737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:25.364075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:25.367337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:25.367337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:25.392901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:25.401892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:25.403659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:25.418437 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1383/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:25.422944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] MFA Rules not processed for user `42a1b77561bd4df3a751dea07b1c6cda`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:25.429430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:25.572730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:25.613555 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1390/2773] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:25.862237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:26.453452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:27.164653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:27.327952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:27.329929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:27.348548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15662d-4d8f-4328-94b1-9f83a99de180 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:27.365427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:27.366220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:27.366508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:27.366790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] PATH_INFO: `/v3/projects/f8234a52ac594926bc194b3554a49d21` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:27.368948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8234a52ac594926bc194b3554a49d21)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:27.371863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:27.545318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8234a52ac594926bc194b3554a49d21', 'request_id': 'req-5cb7875f-d6e8-471c-9f49-d1241efa6328'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:27.560414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8234a52ac594926bc194b3554a49d21', 'request_id': 'req-5cb7875f-d6e8-471c-9f49-d1241efa6328'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:27.575430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8234a52ac594926bc194b3554a49d21', 'request_id': 'req-5cb7875f-d6e8-471c-9f49-d1241efa6328'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:27.798770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] The token cache is being invalidate because project f8234a52ac594926bc194b3554a49d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:27.799155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:27.802582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:27.807064 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1384/2774] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:27 2022] DELETE /identity/v3/projects/f8234a52ac594926bc194b3554a49d21 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:27.809830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:27.834144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d99af-ad77-4f05-a551-206592da7512 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:27.917311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:27.922444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:27.923165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:27.923680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] PATH_INFO: `/v3/users/e22a7e028d61439db6671b8e25d51133` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:27.925327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22a7e028d61439db6671b8e25d51133)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:27.928813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:28.095366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:28.191586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22a7e028d61439db6671b8e25d51133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:28.203099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22a7e028d61439db6671b8e25d51133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:28.203866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22a7e028d61439db6671b8e25d51133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:28.204476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22a7e028d61439db6671b8e25d51133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:28.227291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bc265721-8626-410f-9f8f-e9f5c2a34ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22a7e028d61439db6671b8e25d51133'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:28.333409 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1391/2775] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:27 2022] DELETE /identity/v3/users/e22a7e028d61439db6671b8e25d51133 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:28.439534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:29.602517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:29.986308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:29.988976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:30.022289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7875f-d6e8-471c-9f49-d1241efa6328 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:30.152920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:30.153964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:30.154508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:30.154980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] PATH_INFO: `/v3/projects/ff0d766ef5a149e285eaf7925b74a2a4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:30.156644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0d766ef5a149e285eaf7925b74a2a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:30.159644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:30.380504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0d766ef5a149e285eaf7925b74a2a4', 'request_id': 'req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:30.391725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0d766ef5a149e285eaf7925b74a2a4', 'request_id': 'req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:30.421603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0d766ef5a149e285eaf7925b74a2a4', 'request_id': 'req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:30.544245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] The token cache is being invalidate because project ff0d766ef5a149e285eaf7925b74a2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:30.544577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:30.550788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3779e11-e907-4c3f-9d9c-cbf80ba4b44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:30.555527 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1385/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:29 2022] DELETE /identity/v3/projects/ff0d766ef5a149e285eaf7925b74a2a4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:30.560631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:30.562213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:30.562713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:30.631704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:30.636752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:30.738161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:30.743818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27d17-2513-468e-b832-df3122559783 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:30.745525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27d17-2513-468e-b832-df3122559783 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:30.745525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27d17-2513-468e-b832-df3122559783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:30.754812 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1392/2777] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:30.794399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-48a27d17-2513-468e-b832-df3122559783 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:30.799295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48a27d17-2513-468e-b832-df3122559783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:30.843541 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1386/2778] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:30.845323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:30.864045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fba1b1-3506-4898-9a17-f94ee6ff4917 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:30.876677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:30.877696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:30.878211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:30.878718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:30.879669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:53:30.880167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:30.882142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:30.898089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1393/2779] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:53:30.902963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27d17-2513-468e-b832-df3122559783 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:30.918644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27d17-2513-468e-b832-df3122559783 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:30.934632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:30.935533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:30.936037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:30.938359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:30.939245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:30.941425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:31.050565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:31.051436 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1387/2780] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:30 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:53:31.061181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3132d-cd10-49e5-9db5-13ad6a33b380 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:31.070030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:31.167985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:31.168624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:31.168912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:31.169193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:31.169823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:31.172039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:31.263866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1394/2781] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:31 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:31.268213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:31.282804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35276604-93b9-4f94-ac90-dcf76c26bd2f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:31.296871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:31.297711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:31.298157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:31.298592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:31.299437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:31.302484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:31.330410 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1388/2782] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:31.334510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:31.351855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ef3f-0176-4c76-8f24-73495335c2dc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:31.357577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e557a-5090-469c-b5a4-d924f2b3be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:31.358200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e557a-5090-469c-b5a4-d924f2b3be53 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:31.358486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e557a-5090-469c-b5a4-d924f2b3be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:31.358763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e557a-5090-469c-b5a4-d924f2b3be53 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:31.359510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e557a-5090-469c-b5a4-d924f2b3be53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:31.361900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e557a-5090-469c-b5a4-d924f2b3be53 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:31.405482 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1395/2783] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:31.406971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:31.429424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3530f9b-fc33-4224-bc0c-21eff4cd0e88 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:31.455824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:31.456786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:31.457347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:31.457859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] PATH_INFO: `/v3/projects/8e366a81621942378f03c2206baa8030/users/16536d4ce7d249d9867a342d4f5ffd59/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:31.495288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e366a81621942378f03c2206baa8030, user_id=16536d4ce7d249d9867a342d4f5ffd59, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:31.499452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:31.629576 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1389/2784] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:31 2022] PUT /identity/v3/projects/8e366a81621942378f03c2206baa8030/users/16536d4ce7d249d9867a342d4f5ffd59/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:31.639621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:31.640118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:31.640118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:31.720196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] MFA Rules not processed for user `16536d4ce7d249d9867a342d4f5ffd59`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:31.721454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:31.885307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:31.891213 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1396/2785] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:32.051443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0ec9-bca5-4ffb-baa6-cf1d99e80b0f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:32.057541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:32.061937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:32.061937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:32.061937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:32.061937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:32.062644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:32.230190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:32.240287 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1390/2786] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:31 2022] POST /identity/v3/projects => generated 393 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:32.244099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:32.255728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fc5d1-ee12-4718-a5e0-ee66c4a477b6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:32.323984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:32.325715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:32.326214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:32.327219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:32.327359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:32.329380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:32.481878 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1397/2787] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:32 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:32.485004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:32.515079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b34b-32c1-46d2-985d-824d541e3422 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:32.524178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:32.525220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:32.525732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:32.526826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:32.528949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:32.533135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:32.562297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1391/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:32.566632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:32.594505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb058e-623b-4b32-81e4-7adc64e8f3ac admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:32.607837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:32.608530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:32.608816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:32.609090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] PATH_INFO: `/v3/projects/2268f96cc3de417d957e145fc0dfb0fa/users/f88a466a769b4c718c6c352b92d116ee/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:32.637270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2268f96cc3de417d957e145fc0dfb0fa, user_id=f88a466a769b4c718c6c352b92d116ee, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:32.639974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:32.754303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1398/2789] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:32 2022] PUT /identity/v3/projects/2268f96cc3de417d957e145fc0dfb0fa/users/f88a466a769b4c718c6c352b92d116ee/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:32.761559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:32.777428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fccb-6a8b-4d77-9f7f-b66b265f8b28 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:32.985713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c4629-6682-4942-bdc4-5d7ccf617a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:32.986452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4629-6682-4942-bdc4-5d7ccf617a8c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:32.986452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4629-6682-4942-bdc4-5d7ccf617a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:32.986452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4629-6682-4942-bdc4-5d7ccf617a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:32.993466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c4629-6682-4942-bdc4-5d7ccf617a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:33.010439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c4629-6682-4942-bdc4-5d7ccf617a8c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:33.025691 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1392/2790] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:33.028044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:33.039309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f06318-8703-4c0a-8615-6c22a50c8431 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:33.044574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc922-7785-4a65-b14f-d297f033958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:33.046825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc922-7785-4a65-b14f-d297f033958e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:33.046825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc922-7785-4a65-b14f-d297f033958e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:33.046825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc922-7785-4a65-b14f-d297f033958e admin admin] PATH_INFO: `/v3/projects/2268f96cc3de417d957e145fc0dfb0fa/users/f88a466a769b4c718c6c352b92d116ee/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:33.049176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fc922-7785-4a65-b14f-d297f033958e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2268f96cc3de417d957e145fc0dfb0fa, user_id=f88a466a769b4c718c6c352b92d116ee, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:33.052696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fc922-7785-4a65-b14f-d297f033958e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:33.102881 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1399/2791] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:33 2022] PUT /identity/v3/projects/2268f96cc3de417d957e145fc0dfb0fa/users/f88a466a769b4c718c6c352b92d116ee/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:33.106694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:33.106977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:33.107340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:33.169691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:33.170204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:33.170675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:33.181069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] MFA Rules not processed for user `f88a466a769b4c718c6c352b92d116ee`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:33.184188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:33.194228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:33.197590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:33.318298 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1400/2792] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:53:33.366932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1393/2793] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:33.394080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:33.399086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:33.473526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddd27d-3589-49e8-adc1-25a1cf2887fb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:33.497858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:33.498156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:33.498444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:33.498708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:33.519944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:33.521606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:33.532428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:33.534248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:33.549902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1401/2794] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:53:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 10:53:33.653401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d430f6-2655-4641-bafc-eb05dc68f448 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:33.661114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:33.661891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:33.662531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:33.662531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:33.679285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:33.683206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:33.701054 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1394/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:53:33.706469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:34.289930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:34.294893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:34.337857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86b692-f68b-442c-be45-bbb4d4a2746b service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:34.351760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce239a5-5d30-4c3c-90fb-bdb1ce9afc7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:34.371826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce239a5-5d30-4c3c-90fb-bdb1ce9afc7e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:34.372122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce239a5-5d30-4c3c-90fb-bdb1ce9afc7e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:34.372401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce239a5-5d30-4c3c-90fb-bdb1ce9afc7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:34.526493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce239a5-5d30-4c3c-90fb-bdb1ce9afc7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:34.537514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce239a5-5d30-4c3c-90fb-bdb1ce9afc7e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:34.548289 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1402/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:34.591880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:34.709674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28598c7-5560-4050-84dd-557a2a59ed9d service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:34.716186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:34.717127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:34.717961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:34.718753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] PATH_INFO: `/v3/users/16536d4ce7d249d9867a342d4f5ffd59` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:34.720563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16536d4ce7d249d9867a342d4f5ffd59)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:34.722875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:34.732484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:35.025323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16536d4ce7d249d9867a342d4f5ffd59'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:35.053025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16536d4ce7d249d9867a342d4f5ffd59'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:35.059543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16536d4ce7d249d9867a342d4f5ffd59'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:35.117235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16536d4ce7d249d9867a342d4f5ffd59'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:35.118140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16536d4ce7d249d9867a342d4f5ffd59'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:35.132291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:35.237763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1395/2797] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:34 2022] DELETE /identity/v3/users/16536d4ce7d249d9867a342d4f5ffd59 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:35.242843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ee4d-4a82-4bc2-8480-0aee499eb30e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:35.245328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ee4d-4a82-4bc2-8480-0aee499eb30e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:35.246300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ee4d-4a82-4bc2-8480-0aee499eb30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:35.305553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-93c3ee4d-4a82-4bc2-8480-0aee499eb30e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:35.312751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93c3ee4d-4a82-4bc2-8480-0aee499eb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:35.561984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1403/2798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:35.621365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:35.623634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:35.955224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515738f-82f3-4d37-9735-5ce9b57d3000 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:35.969839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:35.971051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:35.974351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:35.974351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:35.995751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:36.000965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:36.036151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1396/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:36.056645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:37.082010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:37.880102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:38.258861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:38.910284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:38.910764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:38.910924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:38.964793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] MFA Rules not processed for user `d9f88a4c72854cff9bba7ed2920f55b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:38.966488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:38.968537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:38.970304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:38.995232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f401e5-4e50-4ae7-b052-40028cc41096 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:39.013016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:39.016266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:39.018164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:39.018673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] PATH_INFO: `/v3/projects/8e366a81621942378f03c2206baa8030` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:39.023445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e366a81621942378f03c2206baa8030)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:39.034493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:39.125257 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1404/2800] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:39.262928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e366a81621942378f03c2206baa8030', 'request_id': 'req-733941a7-3681-4b39-b089-3a3ce4e22111'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.271884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e366a81621942378f03c2206baa8030', 'request_id': 'req-733941a7-3681-4b39-b089-3a3ce4e22111'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.285161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e366a81621942378f03c2206baa8030', 'request_id': 'req-733941a7-3681-4b39-b089-3a3ce4e22111'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.377228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] The token cache is being invalidate because project 8e366a81621942378f03c2206baa8030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:39.377228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.378272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-733941a7-3681-4b39-b089-3a3ce4e22111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.382518 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1397/2801] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:38 2022] DELETE /identity/v3/projects/8e366a81621942378f03c2206baa8030 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:39.386697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:39.400183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b3504-0d72-4bd8-a96d-d8b88e8f8296 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:39.487318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:39.514200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:39.515162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:39.515681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:39.516715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] PATH_INFO: `/v3/users/f88a466a769b4c718c6c352b92d116ee` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:39.518220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88a466a769b4c718c6c352b92d116ee)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:39.520520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:39.576988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:39.594986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ec692-6e37-46d7-b613-c8ecec4efdb4 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:39.595347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ec692-6e37-46d7-b613-c8ecec4efdb4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:39.595596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ec692-6e37-46d7-b613-c8ecec4efdb4 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:39.597318 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1398/2802] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 10:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 10:53:39.614965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:39.615300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:39.615587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:39.657248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:39.660928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:39.781654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88a466a769b4c718c6c352b92d116ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.815716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88a466a769b4c718c6c352b92d116ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.819180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88a466a769b4c718c6c352b92d116ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.822397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88a466a769b4c718c6c352b92d116ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.845566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88a466a769b4c718c6c352b92d116ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:39.858051 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1399/2803] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:39.893388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:39.894996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:39.934381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a86dd2-b3c3-488a-bca6-8814ed4a86e4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:39.939211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1405/2804] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:39 2022] DELETE /identity/v3/users/f88a466a769b4c718c6c352b92d116ee => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:39.953792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87a724-29de-4a19-9e9e-ae229dccfc18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:39.953792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a724-29de-4a19-9e9e-ae229dccfc18 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:39.955445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a724-29de-4a19-9e9e-ae229dccfc18 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:39.955445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a724-29de-4a19-9e9e-ae229dccfc18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:39.968175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a724-29de-4a19-9e9e-ae229dccfc18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:39.970124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a724-29de-4a19-9e9e-ae229dccfc18 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:39.982481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1400/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:40.782222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:41.441796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:41.579480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:41.581649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:41.690058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a5466-6ded-499f-92ff-7f0c32a73dcb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:41.700380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:41.701904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:41.702341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:41.702923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] PATH_INFO: `/v3/projects/2268f96cc3de417d957e145fc0dfb0fa` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:41.706356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2268f96cc3de417d957e145fc0dfb0fa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:41.710647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:41.889770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2268f96cc3de417d957e145fc0dfb0fa', 'request_id': 'req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:41.900269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2268f96cc3de417d957e145fc0dfb0fa', 'request_id': 'req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:41.922081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2268f96cc3de417d957e145fc0dfb0fa', 'request_id': 'req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:42.035550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] The token cache is being invalidate because project 2268f96cc3de417d957e145fc0dfb0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:42.036118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:42.037476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b6c7ce1-6962-4f5e-9916-b17e90d34b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:42.039746 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1406/2806] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:41 2022] DELETE /identity/v3/projects/2268f96cc3de417d957e145fc0dfb0fa => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:42.046768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:42.048059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:42.048532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:42.083558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:42.085223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:42.219175 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1401/2807] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:42.225326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:42.226171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:42.226614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:42.274007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:42.278109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:42.308107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:42.320197 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1407/2808] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:42.327776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac4d38-95bc-4e57-84b1-70cb784791f3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:42.333528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:42.334554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:42.335032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:42.335490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:42.336357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:53:42.336824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:42.340679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:42.395763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1402/2809] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:53:42.398457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:42.408848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c7951-c93e-4772-b7e3-0dd26636432b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:42.423433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b34343-2541-4a8c-96ef-da1f6de5ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:42.425547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34343-2541-4a8c-96ef-da1f6de5ba21 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:42.426877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34343-2541-4a8c-96ef-da1f6de5ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:42.427972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b34343-2541-4a8c-96ef-da1f6de5ba21 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:42.430800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b34343-2541-4a8c-96ef-da1f6de5ba21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:42.434022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b34343-2541-4a8c-96ef-da1f6de5ba21 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:42.599211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1408/2810] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:42 2022] POST /identity/v3/projects => generated 395 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:42.600134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:42.613434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a21277-950f-4376-804e-a4144df49efb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:42.743667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:42.744648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:42.745194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:42.745632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:42.746463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:42.751077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:42.814840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:42.815667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:42.816105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:42.883465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] MFA Rules not processed for user `c4e1ac1b40e94dbc80548a1f45919b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:42.884720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:42.928359 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1403/2811] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:42 2022] POST /identity/v3/users => generated 298 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:53:42.933125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:42.993675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ccd3-afe9-470e-ad28-931768845067 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:43.013362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:43.013989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:43.014376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:43.014546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:43.015217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:43.016839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:43.046853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:43.116120 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1404/2812] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:43.117612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:43.171502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db0f4-94e6-44c7-a7de-55739c6ad456 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:43.207510 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1409/2813] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:53:43.208741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045a470-5cf8-41fb-8eb5-faa9fd05afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:43.209659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045a470-5cf8-41fb-8eb5-faa9fd05afbe admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:43.210872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045a470-5cf8-41fb-8eb5-faa9fd05afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:43.211417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045a470-5cf8-41fb-8eb5-faa9fd05afbe admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:43.215512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045a470-5cf8-41fb-8eb5-faa9fd05afbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:43.215828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045a470-5cf8-41fb-8eb5-faa9fd05afbe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:43.222015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:43.248130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:43.255209 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1405/2814] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:43.264063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faed1fc-07f3-4f70-a438-b5694d12bf3b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:43.278878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:43.279808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:43.280247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:43.280680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] PATH_INFO: `/v3/projects/aa352b4d4810484688d325ca4bb25193/users/24d86f8c8ece4257adc548304465f191/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:43.305365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa352b4d4810484688d325ca4bb25193, user_id=24d86f8c8ece4257adc548304465f191, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:43.310372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:43.443484 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1410/2815] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:43 2022] PUT /identity/v3/projects/aa352b4d4810484688d325ca4bb25193/users/24d86f8c8ece4257adc548304465f191/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:43.448734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685afd30-a92e-4895-b2e7-d625b6f702bf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:43.449065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685afd30-a92e-4895-b2e7-d625b6f702bf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:43.449345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685afd30-a92e-4895-b2e7-d625b6f702bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:43.500491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-685afd30-a92e-4895-b2e7-d625b6f702bf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:43.515901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-685afd30-a92e-4895-b2e7-d625b6f702bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:43.771505 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1406/2816] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:43.791266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:43.793711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:43.981101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce8179-d2e5-431c-81a0-6e396b51796c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:43.989880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:43.990902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:43.991372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:43.991802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:44.021420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:44.022882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:44.042724 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1411/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:44.479475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:45.483484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:45.620774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:45.621368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:45.621954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:45.693032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] MFA Rules not processed for user `117e12084c60416aabce823ebae4f214`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:45.695594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:45.841577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:45.861054 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1407/2818] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:53:47.715724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:48.130860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:49.426764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:49.431361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:49.452549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cdb3b-9acd-43e9-b0d5-7a107956e1ec service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:49.459449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:49.460339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:49.460783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:49.461218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] PATH_INFO: `/v3/users/6f59260019b34b0b8c4c8792afe8b317` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:49.462570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f59260019b34b0b8c4c8792afe8b317)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:49.466062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:49.705111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f59260019b34b0b8c4c8792afe8b317'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:49.728828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f59260019b34b0b8c4c8792afe8b317'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:49.733790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:49.735409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f59260019b34b0b8c4c8792afe8b317'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:49.745391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f59260019b34b0b8c4c8792afe8b317'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:49.797090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f59260019b34b0b8c4c8792afe8b317'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:49.922910 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1412/2819] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:49 2022] DELETE /identity/v3/users/6f59260019b34b0b8c4c8792afe8b317 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:50.242654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:50.991998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:51.016372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb11c5-77db-4c22-ba9d-715150f503c7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:51.191499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:51.192213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:51.192504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:51.192783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] PATH_INFO: `/v3/projects/c2078a32d1694ba3b1393762add00729` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:51.196542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2078a32d1694ba3b1393762add00729)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:51.200933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:51.444191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2078a32d1694ba3b1393762add00729', 'request_id': 'req-6e673f8c-9010-46a7-bb8a-6b25cb09165a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:51.458841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2078a32d1694ba3b1393762add00729', 'request_id': 'req-6e673f8c-9010-46a7-bb8a-6b25cb09165a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:51.476191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2078a32d1694ba3b1393762add00729', 'request_id': 'req-6e673f8c-9010-46a7-bb8a-6b25cb09165a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:51.576691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] The token cache is being invalidate because project c2078a32d1694ba3b1393762add00729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:51.577275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:51.578117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e673f8c-9010-46a7-bb8a-6b25cb09165a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:51.580218 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1408/2820] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:50 2022] DELETE /identity/v3/projects/c2078a32d1694ba3b1393762add00729 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:51.584549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:51.586033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:51.614847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529076c-2172-4eec-8921-b611c647bb82 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:51.747532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:51.849406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:51.850041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:51.850583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:51.854417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:51.855151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:51.857788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:51.857788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] PATH_INFO: `/v3/users/039f9584f5f44d779f709d56dc3ebd3d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:51.857788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=039f9584f5f44d779f709d56dc3ebd3d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:51.865573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:51.883743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:51.885980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:51.993311 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1409/2821] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:53:52.033698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:52.035221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:52.124214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:52.151590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039f9584f5f44d779f709d56dc3ebd3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:52.168559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039f9584f5f44d779f709d56dc3ebd3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:52.170447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039f9584f5f44d779f709d56dc3ebd3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:52.171517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039f9584f5f44d779f709d56dc3ebd3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:52.191403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec684-746c-4bf6-9d5d-f11110eaee9b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:52.204996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:52.205624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:52.207469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039f9584f5f44d779f709d56dc3ebd3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:52.209159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:52.209532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:52.212529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:52.238221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:52.238221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:52.243747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1410/2822] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:53:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 10:53:52.312875 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1413/2823] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:53:51 2022] DELETE /identity/v3/users/039f9584f5f44d779f709d56dc3ebd3d => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:52.538794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:52.732902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:52.813065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:52.814603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:53.101685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a27c-a585-4743-927d-8b76b4e61913 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:53.325299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:53.325926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:53.326389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:53.326821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:53.328837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:53.469735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:53.540123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:53.542628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49f1cc-5eb2-481b-ae3d-512b32503b89 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:53.598315 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1411/2824] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:54.039869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:54.098904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:54.136609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:54.221002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffafdb3-9d3d-4bdd-95ac-5c811ce560bc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:54.247120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:54.248294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:54.248882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:54.249945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] PATH_INFO: `/v3/projects/965ebea2660546ef8361b78215321dbb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:54.252930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965ebea2660546ef8361b78215321dbb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:54.255138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:54.325144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:54.428054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965ebea2660546ef8361b78215321dbb', 'request_id': 'req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:54.444790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965ebea2660546ef8361b78215321dbb', 'request_id': 'req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:54.474247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965ebea2660546ef8361b78215321dbb', 'request_id': 'req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:54.598494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] The token cache is being invalidate because project 965ebea2660546ef8361b78215321dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:53:54.599073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:54.600991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-425d5cf9-9fb6-44ed-9b6c-5f17d9e34d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:53:54.603584 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1414/2825] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:53:54 2022] DELETE /identity/v3/projects/965ebea2660546ef8361b78215321dbb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:54.608888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:54.609731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:54.610161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:54.658682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:54.676579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:54.800897 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1412/2826] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:53:54.809107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:54.809604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:54.810041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:54.876840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:54.878035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:54.933489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:54.936508 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1415/2827] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:54.950824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c527939-5d97-4c26-b18b-15fda263cbc4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:54.965547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:54.965884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:54.966218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:54.966499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:54.967195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:53:54.979344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:54.982945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:55.001385 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1413/2828] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:53:55.002794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:55.019438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d08fc-0389-4200-a8bb-c290309e56fc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:55.023985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:55.042012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:55.042706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:55.042911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:55.043229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:55.043865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:55.045832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:55.159705 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1416/2829] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:55 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:55.165147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:55.183513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9748c3-8e4e-4db6-a0c8-d29bb0e6021f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:55.331907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:55.332530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:55.332826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:55.333113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:55.334174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:55.336157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:55.396501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:55.517529 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1414/2830] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:55 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:55.518705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:55.538273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61bfb-c1d0-4501-8e34-00f1bac65ac2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:55.555531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:55.556171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:55.556452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:55.556723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:55.557409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:55.559125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:55.583238 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1417/2831] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:55.616948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:55.616948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa11e-25ba-401e-8044-b538697855e0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:55.616948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f2743-5199-4de9-b7b4-7f5b8754bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:55.616948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2743-5199-4de9-b7b4-7f5b8754bf7d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:55.628760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2743-5199-4de9-b7b4-7f5b8754bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:55.631172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2743-5199-4de9-b7b4-7f5b8754bf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:55.632081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f2743-5199-4de9-b7b4-7f5b8754bf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:55.639176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f2743-5199-4de9-b7b4-7f5b8754bf7d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:55.671362 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1415/2832] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:55.674869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:55.704426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa48666-ab47-43b0-8523-d8ba6f56fb14 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:55.718879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:55.719939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:55.721110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:55.721701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] PATH_INFO: `/v3/projects/3f02d8ddd39f4d8b93a44ee6295dc7f8/users/8affa67bb57f451b94d1eded04b1782a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:55.783911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f02d8ddd39f4d8b93a44ee6295dc7f8, user_id=8affa67bb57f451b94d1eded04b1782a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:55.786836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:55.881236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1418/2833] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:55 2022] PUT /identity/v3/projects/3f02d8ddd39f4d8b93a44ee6295dc7f8/users/8affa67bb57f451b94d1eded04b1782a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:53:55.897201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:55.897826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:55.898320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:55.984751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] MFA Rules not processed for user `8affa67bb57f451b94d1eded04b1782a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:55.986448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:56.128652 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1416/2834] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:56.134347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:56.187699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:56.278847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925873c-2d31-4355-a3b1-7e79584cf07c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:56.291400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:56.292442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:56.292946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:56.293457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:56.294358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:56.296710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:56.584686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1419/2835] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:53:56 2022] POST /identity/v3/projects => generated 385 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:56.592429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:56.618669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c5fd6-e9e8-4a09-9b32-e6907ea2eeac None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:56.736466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:56.737278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:56.737691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:56.738188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:56.738947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:56.741312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:57.192401 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1417/2836] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:53:56 2022] POST /identity/v3/users => generated 299 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:53:57.196586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:57.211787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220883fc-8238-47d9-aa52-75ad6ec717c1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:57.227590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:57.229981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:57.230515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:57.230911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:57.235633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:57.240865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:57.272749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1420/2837] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:57.276671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:57.293142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b1b5e-cfae-48ad-9ddd-6c7853136355 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:57.304929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:57.305647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:57.305923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:57.307649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] PATH_INFO: `/v3/projects/7c467640a0b74919878e4113df83ada7/users/99afe908353d421f9a144506425bc1ca/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:57.348704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c467640a0b74919878e4113df83ada7, user_id=99afe908353d421f9a144506425bc1ca, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:57.355064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:57.446351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1418/2838] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:57 2022] PUT /identity/v3/projects/7c467640a0b74919878e4113df83ada7/users/99afe908353d421f9a144506425bc1ca/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:53:57.451213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:57.466660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7db7-042c-4c70-9a7f-e90163d5d167 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:57.629451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a042136-d9f7-46fc-988e-74bf5ff2b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:57.631564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a042136-d9f7-46fc-988e-74bf5ff2b7be admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:57.632097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a042136-d9f7-46fc-988e-74bf5ff2b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:57.632537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a042136-d9f7-46fc-988e-74bf5ff2b7be admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:57.633372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a042136-d9f7-46fc-988e-74bf5ff2b7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:57.648758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a042136-d9f7-46fc-988e-74bf5ff2b7be admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:57.668793 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1421/2839] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:53:57.669005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:57.687968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f3823-5876-4e93-a171-b7a199a0c679 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:57.702848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1227f9e-0ec3-40f1-bf01-b529dd2ae7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:57.703879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227f9e-0ec3-40f1-bf01-b529dd2ae7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:57.704342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227f9e-0ec3-40f1-bf01-b529dd2ae7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:57.704782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227f9e-0ec3-40f1-bf01-b529dd2ae7aa admin admin] PATH_INFO: `/v3/projects/7c467640a0b74919878e4113df83ada7/users/99afe908353d421f9a144506425bc1ca/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:57.710870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1227f9e-0ec3-40f1-bf01-b529dd2ae7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c467640a0b74919878e4113df83ada7, user_id=99afe908353d421f9a144506425bc1ca, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:57.715646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1227f9e-0ec3-40f1-bf01-b529dd2ae7aa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:57.742915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:57.770991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:57.771752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:57.772198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:57.776280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1419/2840] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:53:57 2022] PUT /identity/v3/projects/7c467640a0b74919878e4113df83ada7/users/99afe908353d421f9a144506425bc1ca/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:53:57.846263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] MFA Rules not processed for user `99afe908353d421f9a144506425bc1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:57.849799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:58.118781 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1422/2841] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:58.131597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:58.132062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:58.132430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:58.166154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] MFA Rules not processed for user `8affa67bb57f451b94d1eded04b1782a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:53:58.169616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:58.279572 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1420/2842] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:53:58.712745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:53:58.714869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:53:58.788977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20abb6-635f-4080-94f9-eacfd29f65ac None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:53:58.794643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6767e4-a71f-47ef-a2d9-a04575a2afba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:53:58.795357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6767e4-a71f-47ef-a2d9-a04575a2afba service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:53:58.795639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6767e4-a71f-47ef-a2d9-a04575a2afba service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:53:58.795911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6767e4-a71f-47ef-a2d9-a04575a2afba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:53:58.803701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6767e4-a71f-47ef-a2d9-a04575a2afba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:53:58.805268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6767e4-a71f-47ef-a2d9-a04575a2afba service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:53:58.814549 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1423/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:53:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:53:59.476302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:53:59.977948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:00.302918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:00.304585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:00.344757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdcf4-b8a5-42de-ba10-003a2a7f44fc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:00.369395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:00.372129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:00.372129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:00.372129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:00.376599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:00.486695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:00.591416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:00.599249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654b92-a4ec-40d4-a4a2-d0113d70d318 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:00.651790 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1421/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:00.984893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:00.985902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:00.986349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:01.079062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] MFA Rules not processed for user `24d86f8c8ece4257adc548304465f191`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:01.080639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:01.313079 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1424/2845] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:01.324867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4078e-54a0-49b9-a914-c44afcec97b7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:01.325931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4078e-54a0-49b9-a914-c44afcec97b7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:01.326222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4078e-54a0-49b9-a914-c44afcec97b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:01.385472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7ef4078e-54a0-49b9-a914-c44afcec97b7 None None] MFA Rules not processed for user `24d86f8c8ece4257adc548304465f191`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:01.387025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ef4078e-54a0-49b9-a914-c44afcec97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:01.406302 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1422/2846] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:01.606390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:01.680197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:01.779774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:01.794473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee2009-586a-4a11-a722-2c91f64a67d3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:01.807486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea93a-9f23-49dc-8bc2-bf55f875a98d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:01.808138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea93a-9f23-49dc-8bc2-bf55f875a98d service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:01.808410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea93a-9f23-49dc-8bc2-bf55f875a98d service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:01.808686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea93a-9f23-49dc-8bc2-bf55f875a98d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:01.834075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea93a-9f23-49dc-8bc2-bf55f875a98d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:01.836063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea93a-9f23-49dc-8bc2-bf55f875a98d service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:01.867383 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1425/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:02.891888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:03.927052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:05.190120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:06.609589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:06.610707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:06.611239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:06.648359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] MFA Rules not processed for user `6559ac446c4640218ce700687045bb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:06.653050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:06.673411 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1423/2848] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:06.764503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:07.515430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:09.269999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:09.330801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:11.321236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:11.570592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:13.321467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:13.883471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:15.061869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:15.090696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:15.491878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528901-7abc-49b9-8cf1-966b69be411a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:15.492171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528901-7abc-49b9-8cf1-966b69be411a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:15.492455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528901-7abc-49b9-8cf1-966b69be411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:15.513902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-32528901-7abc-49b9-8cf1-966b69be411a None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:15.515289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-32528901-7abc-49b9-8cf1-966b69be411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:15.580504 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1426/2849] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:15.596828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:15.598345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:15.750659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e21f8-e0ec-41ec-8939-7cd1799cd3a4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:15.757395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:15.758012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:15.758288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:15.758557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:15.767778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:15.769552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:15.777691 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1424/2850] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:54:16.016165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:16.254849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:16.532227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03313d-c6d1-462d-b730-888af8c020da None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:16.534145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03313d-c6d1-462d-b730-888af8c020da None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:16.534715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03313d-c6d1-462d-b730-888af8c020da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:16.570791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-df03313d-c6d1-462d-b730-888af8c020da None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:16.572278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-df03313d-c6d1-462d-b730-888af8c020da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:16.589549 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1427/2851] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:16.605475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:16.620287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ace443-38b7-44a0-a351-619217765d87 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:16.629211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc4b0-8771-466e-ad54-92c9e518132b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:16.630088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc4b0-8771-466e-ad54-92c9e518132b service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:16.630378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc4b0-8771-466e-ad54-92c9e518132b service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:16.630661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc4b0-8771-466e-ad54-92c9e518132b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:16.644284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bc4b0-8771-466e-ad54-92c9e518132b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:16.645482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bc4b0-8771-466e-ad54-92c9e518132b service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:16.660494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1425/2852] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:54:17.382464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:17.755490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:17.760567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:17.765393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:17.765393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:17.785352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] MFA Rules not processed for user `d79046739b2d4572b0aedef59e621ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:17.786878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:17.946136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1428/2853] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:18.218815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:18.800635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:19.117046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:19.673653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:19.930645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:20.123160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:20.928523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:21.732551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:22.097738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:22.870337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:23.040571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:23.355717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:23.808146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:24.069630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:24.793403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:24.961187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bd410-5b9d-4198-bd1a-d28c20ece9fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:24.962334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bd410-5b9d-4198-bd1a-d28c20ece9fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:24.962698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bd410-5b9d-4198-bd1a-d28c20ece9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:24.984271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e60bd410-5b9d-4198-bd1a-d28c20ece9fb None None] MFA Rules not processed for user `24d86f8c8ece4257adc548304465f191`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:24.985726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e60bd410-5b9d-4198-bd1a-d28c20ece9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:24.995332 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1426/2854] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:25.132732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:25.160934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:25.653231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:26.052282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:26.223783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:26.245948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3cb02-ed08-4533-8268-ab9f6850395e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:26.262508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:26.263626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:26.264108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:26.264527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:26.316188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:26.317820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:26.333774 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1429/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:26.711718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:26.711999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:26.712306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:26.731671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] MFA Rules not processed for user `8affa67bb57f451b94d1eded04b1782a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:26.733059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:26.740407 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1427/2856] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:27.435037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:28.501261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:29.239906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:29.507450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:29.964949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:30.207397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:30.480989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:31.360805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:31.555324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:33.634143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:34.138550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:35.744680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:35.943848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:36.253630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:37.368681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:37.370658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:37.446885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05923-7aa7-4501-9f91-0a0da1f1c632 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:37.452260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:37.452893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:37.453172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:37.453452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] PATH_INFO: `/v3/users/117e12084c60416aabce823ebae4f214` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:37.454585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117e12084c60416aabce823ebae4f214)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:37.456728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:37.590185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:37.722527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117e12084c60416aabce823ebae4f214'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:37.729360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117e12084c60416aabce823ebae4f214'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:37.730115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117e12084c60416aabce823ebae4f214'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:37.735729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117e12084c60416aabce823ebae4f214'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:37.742723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d35f7740-a33b-449e-8453-440700d8e413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117e12084c60416aabce823ebae4f214'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:37.759670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:37.846391 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1430/2857] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:54:37 2022] DELETE /identity/v3/users/117e12084c60416aabce823ebae4f214 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:54:38.133741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:38.144685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e780693-c7f2-4b7a-83ba-a4f5b3ea4c37 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:38.208191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:38.208821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:38.209104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:38.209378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] PATH_INFO: `/v3/projects/52177b94887d409f9034b3cee40237dd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:38.210509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=52177b94887d409f9034b3cee40237dd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:38.212499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:38.338185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52177b94887d409f9034b3cee40237dd', 'request_id': 'req-5ff508c2-0270-44da-80a8-4ade59fde7be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:38.345094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52177b94887d409f9034b3cee40237dd', 'request_id': 'req-5ff508c2-0270-44da-80a8-4ade59fde7be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:38.350710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52177b94887d409f9034b3cee40237dd', 'request_id': 'req-5ff508c2-0270-44da-80a8-4ade59fde7be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:38.421080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] The token cache is being invalidate because project 52177b94887d409f9034b3cee40237dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:54:38.421376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:38.422023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5ff508c2-0270-44da-80a8-4ade59fde7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:38.423525 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1428/2858] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:38 2022] DELETE /identity/v3/projects/52177b94887d409f9034b3cee40237dd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:54:38.428346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:38.428839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:38.428959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:38.448582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:38.449803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:38.511764 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1431/2859] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:38.584917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:38.585189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:38.585655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:38.618343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:38.619623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:38.636442 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1429/2860] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:38.636578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:38.646808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4885-5c36-45b6-95e5-c3d3384eecd3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:38.661441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:38.665000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:38.665000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:38.665000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:38.665000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:54:38.665000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:38.667354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:38.681974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1432/2861] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:54:38.686523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:38.696240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb079-f6b3-4f8d-8281-d7cf6e6fe301 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:38.701762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:38.702697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:38.703091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:38.704050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:38.704774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:38.706900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:38.735905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:38.800274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1430/2862] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:54:38.805050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:38.817137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120f673-cd9b-4ba0-bb10-cac66c751627 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:38.819681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:38.882794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:38.884749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:38.885122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:38.885470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:38.886226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:38.888266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:39.023942 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1433/2863] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:54:38 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:54:39.026806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:39.037161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bba94-c836-4d84-8f4a-9a3aa5556b23 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:39.043255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:39.043919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:39.044451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:39.044897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:39.045615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:39.048028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:39.059964 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1431/2864] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:54:39.064189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:39.076866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534179d5-9e00-40b0-8df8-1e67f6fa4009 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:39.083942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e846fe-35cf-4ab9-a3a0-704a965aecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:39.084579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e846fe-35cf-4ab9-a3a0-704a965aecde admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:39.084911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e846fe-35cf-4ab9-a3a0-704a965aecde admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:39.085181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e846fe-35cf-4ab9-a3a0-704a965aecde admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:39.085818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e846fe-35cf-4ab9-a3a0-704a965aecde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:39.087503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e846fe-35cf-4ab9-a3a0-704a965aecde admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:39.098567 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1434/2865] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:54:39.104049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:39.113361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88c00-7d2a-485a-903f-f948d4797b4c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:39.118703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:39.119439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:39.119703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:39.120124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] PATH_INFO: `/v3/projects/68fa0f9865c04cf686e2036dae8c1284/users/c4998ac001564850a12782a5107147da/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:39.135740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fa0f9865c04cf686e2036dae8c1284, user_id=c4998ac001564850a12782a5107147da, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:39.138413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:39.251473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1432/2866] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:54:39 2022] PUT /identity/v3/projects/68fa0f9865c04cf686e2036dae8c1284/users/c4998ac001564850a12782a5107147da/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:54:39.262347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:39.262637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:39.262914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:39.291378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] MFA Rules not processed for user `c4998ac001564850a12782a5107147da`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:39.292599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:39.361460 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1435/2867] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:39.375304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:39.377028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:39.395304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:39.454186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82fe17-6f12-4344-8f7b-7091763779e1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:39.460006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7602f-fc50-40a0-a827-6cba5754a491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:39.460607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7602f-fc50-40a0-a827-6cba5754a491 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:39.460883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7602f-fc50-40a0-a827-6cba5754a491 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:39.461154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7602f-fc50-40a0-a827-6cba5754a491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:39.470388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7602f-fc50-40a0-a827-6cba5754a491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:39.471996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7602f-fc50-40a0-a827-6cba5754a491 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:39.481994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1433/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:41.662050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:41.705938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:41.792128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76079-24ab-4d47-8bfc-c68e3843134c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:41.796914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:41.797604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:41.797887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:41.798165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] PATH_INFO: `/v3/users/c4998ac001564850a12782a5107147da` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:41.799916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4998ac001564850a12782a5107147da)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:41.801971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:42.019207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4998ac001564850a12782a5107147da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:42.029992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4998ac001564850a12782a5107147da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:42.030788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4998ac001564850a12782a5107147da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:42.031419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4998ac001564850a12782a5107147da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:42.046770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4998ac001564850a12782a5107147da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:42.127871 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1436/2869] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:54:41 2022] DELETE /identity/v3/users/c4998ac001564850a12782a5107147da => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:54:42.132211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:42.132703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:42.132946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:42.193613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:42.194885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:42.218627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:42.271327 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1434/2870] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:54:42.287095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:42.287095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:42.401868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fbc6c-a2a4-4fdc-8fd6-6671077adfbb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:42.405562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1260ecf-ca79-4297-be11-70e4530ca21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:42.407040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260ecf-ca79-4297-be11-70e4530ca21e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:42.407040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260ecf-ca79-4297-be11-70e4530ca21e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:42.407040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260ecf-ca79-4297-be11-70e4530ca21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:42.421057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1260ecf-ca79-4297-be11-70e4530ca21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:42.422544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1260ecf-ca79-4297-be11-70e4530ca21e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:42.434323 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1437/2871] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:42.907432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:42.907432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:42.916980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad94e-d475-4b47-b857-496c5633ce53 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:42.924176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:42.924927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:42.926088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:42.926382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] PATH_INFO: `/v3/projects/68fa0f9865c04cf686e2036dae8c1284` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:42.927692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fa0f9865c04cf686e2036dae8c1284)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:42.929868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:43.190609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fa0f9865c04cf686e2036dae8c1284', 'request_id': 'req-991abf36-2fda-4b85-9c9c-4b25dfff2eee'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:43.197537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fa0f9865c04cf686e2036dae8c1284', 'request_id': 'req-991abf36-2fda-4b85-9c9c-4b25dfff2eee'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:43.203187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fa0f9865c04cf686e2036dae8c1284', 'request_id': 'req-991abf36-2fda-4b85-9c9c-4b25dfff2eee'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:43.284024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] The token cache is being invalidate because project 68fa0f9865c04cf686e2036dae8c1284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:54:43.284322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:43.285014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-991abf36-2fda-4b85-9c9c-4b25dfff2eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:54:43.286560 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1435/2872] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:54:42 2022] DELETE /identity/v3/projects/68fa0f9865c04cf686e2036dae8c1284 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:54:43.291653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.292565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.293170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.298574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:43.376257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:43.378069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:43.452819 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1438/2873] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:43.460714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.461085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.461432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.483332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:43.484596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:43.493836 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1436/2874] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:43.498187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:43.509079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb279af7-280d-4571-9998-88b92a33c3eb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:43.513890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:43.527835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.527835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.527835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.527835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:54:43.527835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:43.527835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:43.530492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1439/2875] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:54:43.534912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:43.550129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddaf0b-1863-4826-bab9-0682f2268f0a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:43.556541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:43.557158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.557446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.557750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.558387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:43.560350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:43.653274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1437/2876] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:54:43 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:54:43.657493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:43.669053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b9a32-003a-4a9c-a838-463a85b97423 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:43.725842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:43.726457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.726743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.727042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.728282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:43.730206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:43.844220 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1440/2877] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:54:43 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:54:43.848192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:43.858771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af71833-75d5-4b68-af92-1c8b67cffb51 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:43.863358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:43.863947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.864229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.864499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.865139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:43.866710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:43.877142 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1438/2878] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:54:43.884973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:43.895335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cef083-783d-4b70-b3d6-3993df7cdb6a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:43.900169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e477fd6-679b-4738-be99-9e6d1d01bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:43.900752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477fd6-679b-4738-be99-9e6d1d01bedb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.901031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477fd6-679b-4738-be99-9e6d1d01bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.901331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477fd6-679b-4738-be99-9e6d1d01bedb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.903939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e477fd6-679b-4738-be99-9e6d1d01bedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:43.905597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e477fd6-679b-4738-be99-9e6d1d01bedb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:43.916925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1441/2879] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:54:43.921128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:43.931805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a8dcb-8a56-4167-a626-a2b9093fa655 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:43.936383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:43.939781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:43.939781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:43.939781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] PATH_INFO: `/v3/projects/2ce648f86e3e4a3c9e8712bb087b8769/users/de579d631e9d4010887077567bbe5fd6/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:43.953126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce648f86e3e4a3c9e8712bb087b8769, user_id=de579d631e9d4010887077567bbe5fd6, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:43.955834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:44.052145 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1439/2880] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:54:43 2022] PUT /identity/v3/projects/2ce648f86e3e4a3c9e8712bb087b8769/users/de579d631e9d4010887077567bbe5fd6/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:54:44.057646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995d315-42f4-4927-a375-65b94d346480 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:44.057934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995d315-42f4-4927-a375-65b94d346480 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:44.058219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995d315-42f4-4927-a375-65b94d346480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:44.077646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6995d315-42f4-4927-a375-65b94d346480 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:44.078840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6995d315-42f4-4927-a375-65b94d346480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:44.119486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:44.138434 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1442/2881] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:44.148353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:44.150190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:44.191341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:44.236495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912ff1-5fca-4ba1-a6f9-55d39647fae1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:44.240443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a36eaf-7247-4eb0-95be-78a2c2bce8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:44.241050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a36eaf-7247-4eb0-95be-78a2c2bce8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:44.245702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a36eaf-7247-4eb0-95be-78a2c2bce8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:44.245702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a36eaf-7247-4eb0-95be-78a2c2bce8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:44.251528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a36eaf-7247-4eb0-95be-78a2c2bce8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:44.253225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a36eaf-7247-4eb0-95be-78a2c2bce8f3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:44.263842 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1440/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:45.969741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85306-f35d-4e48-b4e9-fcfc93c3c7de None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:45.970539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85306-f35d-4e48-b4e9-fcfc93c3c7de None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:45.970878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85306-f35d-4e48-b4e9-fcfc93c3c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:46.008132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cea85306-f35d-4e48-b4e9-fcfc93c3c7de None None] MFA Rules not processed for user `de579d631e9d4010887077567bbe5fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:46.009729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cea85306-f35d-4e48-b4e9-fcfc93c3c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:46.102191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1443/2883] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:46.112412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:46.112993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:46.113281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:46.164440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] MFA Rules not processed for user `de579d631e9d4010887077567bbe5fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:46.167271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:46.186843 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1441/2884] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:46.189278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d128f6-9f12-45b7-8958-7641f11df993 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:46.189718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d128f6-9f12-45b7-8958-7641f11df993 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:46.190087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d128f6-9f12-45b7-8958-7641f11df993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:46.213815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-75d128f6-9f12-45b7-8958-7641f11df993 None None] MFA Rules not processed for user `de579d631e9d4010887077567bbe5fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:46.215204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-75d128f6-9f12-45b7-8958-7641f11df993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:46.226746 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1444/2885] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:46.495126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:54:46.496562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:46.586291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64a599-3fb7-41cf-a714-6b98c2a2c755 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:54:46.593113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f5298-109a-4c5f-9303-07caced517ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:54:46.593736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5298-109a-4c5f-9303-07caced517ca service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:46.594020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5298-109a-4c5f-9303-07caced517ca service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:46.594294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5298-109a-4c5f-9303-07caced517ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:46.604599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f5298-109a-4c5f-9303-07caced517ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:54:46.606191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f5298-109a-4c5f-9303-07caced517ca service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:54:46.616463 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1442/2886] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:54:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:54:47.498878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:47.499506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:47.499506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:47.537604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] MFA Rules not processed for user `de579d631e9d4010887077567bbe5fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:47.538781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:47.573086 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1445/2887] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:48.586101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4a8e-f02c-4407-bbb6-4b7a6cbe6a50 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:54:48.587613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4a8e-f02c-4407-bbb6-4b7a6cbe6a50 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:54:48.588125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a4a8e-f02c-4407-bbb6-4b7a6cbe6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:54:48.637738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-501a4a8e-f02c-4407-bbb6-4b7a6cbe6a50 None None] MFA Rules not processed for user `de579d631e9d4010887077567bbe5fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:54:48.638992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-501a4a8e-f02c-4407-bbb6-4b7a6cbe6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:54:48.656685 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1443/2888] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:54:57.516447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=45 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:54:58.618990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=60 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:19.935487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:19.939522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:19.966217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0976a-e25e-4c5e-ae1e-48258c2dd1d9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:19.972270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:19.973280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:19.973413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:19.973925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] PATH_INFO: `/v3/users/8affa67bb57f451b94d1eded04b1782a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:19.975411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8affa67bb57f451b94d1eded04b1782a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:19.977750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:20.257867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8affa67bb57f451b94d1eded04b1782a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:20.269141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8affa67bb57f451b94d1eded04b1782a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:20.270651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8affa67bb57f451b94d1eded04b1782a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:20.271994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8affa67bb57f451b94d1eded04b1782a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:20.295744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8affa67bb57f451b94d1eded04b1782a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:20.370687 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1446/2889] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:55:19 2022] DELETE /identity/v3/users/8affa67bb57f451b94d1eded04b1782a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:20.375259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:20.375742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:20.376005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:20.396601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:20.399045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:20.460449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1444/2890] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:55:20.470299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:20.471924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:20.531605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc2cf7-0744-46dd-acff-df239928d093 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:20.535276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:20.536008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:20.536330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:20.536609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:20.546069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:20.547563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:20.558099 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1447/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:21.025186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:21.026926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:21.039237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f382e-2464-4c75-b94c-4c39ac42781a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:21.058934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:21.058934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:21.058934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:21.058934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] PATH_INFO: `/v3/projects/3f02d8ddd39f4d8b93a44ee6295dc7f8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:21.059610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f02d8ddd39f4d8b93a44ee6295dc7f8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:21.063241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:21.134834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:21.137078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:21.151257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4d821-44da-4168-a52a-3c61635a1e7a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:21.154938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:21.155886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:21.159339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:21.159339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:21.159339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:21.177136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'request_id': 'req-7bf6f596-3989-4731-9a28-6b38118cdbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.184210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'request_id': 'req-7bf6f596-3989-4731-9a28-6b38118cdbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.190284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f02d8ddd39f4d8b93a44ee6295dc7f8', 'request_id': 'req-7bf6f596-3989-4731-9a28-6b38118cdbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.236999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:21.238436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:21.244751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:21.250128 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1448/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:55:21.274142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] The token cache is being invalidate because project 3f02d8ddd39f4d8b93a44ee6295dc7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:55:21.275197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.275366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.280458 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1445/2893] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:21 2022] DELETE /identity/v3/projects/3f02d8ddd39f4d8b93a44ee6295dc7f8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:55:21.281626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:21.295492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819bf64-ef17-4abe-9ddd-69c4a770fa02 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:21.367407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:21.367977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:21.368251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:21.368533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] PATH_INFO: `/v3/users/99afe908353d421f9a144506425bc1ca` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:21.369970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99afe908353d421f9a144506425bc1ca)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:21.371861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:21.594751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99afe908353d421f9a144506425bc1ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.603697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99afe908353d421f9a144506425bc1ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.605120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99afe908353d421f9a144506425bc1ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.605741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99afe908353d421f9a144506425bc1ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.619206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6dadeb25-ff11-4d50-bb93-b3c9e6c63f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99afe908353d421f9a144506425bc1ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:21.748762 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1449/2894] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:55:21 2022] DELETE /identity/v3/users/99afe908353d421f9a144506425bc1ca => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:22.431592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:22.434203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:22.469037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6f596-3989-4731-9a28-6b38118cdbd4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:22.561684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:22.563440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:22.563884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:22.564314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] PATH_INFO: `/v3/projects/7c467640a0b74919878e4113df83ada7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:22.565751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c467640a0b74919878e4113df83ada7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:22.567931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:22.736028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:22.771091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c467640a0b74919878e4113df83ada7', 'request_id': 'req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:22.779454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c467640a0b74919878e4113df83ada7', 'request_id': 'req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:22.788379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c467640a0b74919878e4113df83ada7', 'request_id': 'req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:22.876847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] The token cache is being invalidate because project 7c467640a0b74919878e4113df83ada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:55:22.877152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:22.884942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-897e0a00-f731-4e4c-9d23-9884fbb2c9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:22.889965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1446/2895] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:22 2022] DELETE /identity/v3/projects/7c467640a0b74919878e4113df83ada7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:22.892253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:22.893049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:22.896440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:22.931189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:22.932889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:23.010558 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1450/2896] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:23.018917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.019398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.019710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.058546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:23.061006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:23.098009 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1447/2897] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:23.098563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.118995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d6234-7a5a-4bed-b31e-34b9106a44b7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.124939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.125797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.126256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.126690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.127583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:55:23.128073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:23.130990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:23.149142 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1451/2898] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:55:23.164690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.181156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ebbb-1052-4256-81f9-6f380099b6bf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.193289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.193289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.193289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.193289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.193828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:23.194185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:23.316961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1448/2899] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:55:23 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:23.323852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.351932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def191f7-0a78-4e10-abe6-16a7c14ffd4d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.361305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:23.428840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.431037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.431525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.431807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.432833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:23.437184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:23.547777 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1452/2900] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:55:23 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:23.551669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.564405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e919599-92db-4038-8592-ffc913261382 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.572270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.573133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.573657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.574113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.574932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:23.577245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:23.591560 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1449/2901] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:55:23.595145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.607661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022c29-7e7e-4b02-8956-9926eed281da admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.613164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876625fe-2cf7-475c-b85f-ea60cbc98631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.613873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876625fe-2cf7-475c-b85f-ea60cbc98631 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.614154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876625fe-2cf7-475c-b85f-ea60cbc98631 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.614423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876625fe-2cf7-475c-b85f-ea60cbc98631 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.615093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876625fe-2cf7-475c-b85f-ea60cbc98631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:23.616726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876625fe-2cf7-475c-b85f-ea60cbc98631 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:23.634156 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1453/2902] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:55:23.635429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.645689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3526-c73c-4cc3-b2ef-f52eb0a12a35 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.651172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.651880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.652162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.652456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] PATH_INFO: `/v3/projects/0c261994fe8c4d0a8b4ff35f26896dcc/users/3803365807284dee8e89eae93945fc9b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.668672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c261994fe8c4d0a8b4ff35f26896dcc, user_id=3803365807284dee8e89eae93945fc9b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:23.671399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:23.780073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1450/2903] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:55:23 2022] PUT /identity/v3/projects/0c261994fe8c4d0a8b4ff35f26896dcc/users/3803365807284dee8e89eae93945fc9b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:23.790520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.790835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.791153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.820644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] MFA Rules not processed for user `3803365807284dee8e89eae93945fc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:23.821875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:23.912932 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1454/2904] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:55:23.917703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:23.989039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f93605-36f5-44a7-9634-a46ae61187ba admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:23.995264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:23.996199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:23.996699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:23.997733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:23.998525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.001113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.149368 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1451/2905] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:55:23 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:24.153421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:24.165159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623241a7-ef80-47b3-a1da-6c4a509ac814 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:24.232668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:24.233311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.233590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.233866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.234496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.236442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.396417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1455/2906] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:55:24 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:24.401236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:24.416562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5d4a-01a4-41ce-a4bb-51104e00a4ca admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:24.422486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:24.423200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.423486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.424747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.425297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.427118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.441921 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1452/2907] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:55:24.446916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:24.456575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:24.460992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e396-c477-463e-b6fc-25d7f5643764 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:24.465821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:24.466483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.466935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.467253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] PATH_INFO: `/v3/projects/1ecba9fe7a734c02a4ba559a205607c1/users/f0c486f5a2c14bbe8aab8dd0d418192d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.483282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecba9fe7a734c02a4ba559a205607c1, user_id=f0c486f5a2c14bbe8aab8dd0d418192d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.486327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.573176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:24.575768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:24.609367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:24.619207 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1456/2908] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:55:24 2022] PUT /identity/v3/projects/1ecba9fe7a734c02a4ba559a205607c1/users/f0c486f5a2c14bbe8aab8dd0d418192d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:24.623153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:24.660542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5820a-d724-4ce8-8cb4-544c705ab82f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:24.723030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:24.723743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.723956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257365f-5a64-4173-ae30-3902c77b6698 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:24.724053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.724287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.726854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:24.731544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:24.732377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.732713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.733184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.733983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.735797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.747386 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1457/2909] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:55:24.752527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:24.763325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1c75-9547-4f23-a23b-94a9bd7649a3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:24.769569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d71be-a390-4644-b5bd-ffe0aab3e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:24.770261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d71be-a390-4644-b5bd-ffe0aab3e182 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.770551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d71be-a390-4644-b5bd-ffe0aab3e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.770826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d71be-a390-4644-b5bd-ffe0aab3e182 admin admin] PATH_INFO: `/v3/projects/1ecba9fe7a734c02a4ba559a205607c1/users/f0c486f5a2c14bbe8aab8dd0d418192d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.772883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d71be-a390-4644-b5bd-ffe0aab3e182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecba9fe7a734c02a4ba559a205607c1, user_id=f0c486f5a2c14bbe8aab8dd0d418192d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.775571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d71be-a390-4644-b5bd-ffe0aab3e182 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.797591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1458/2910] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:55:24 2022] PUT /identity/v3/projects/1ecba9fe7a734c02a4ba559a205607c1/users/f0c486f5a2c14bbe8aab8dd0d418192d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:24.799714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c979-6324-429f-852a-a377afe3ce7e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.799821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c979-6324-429f-852a-a377afe3ce7e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.800176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c979-6324-429f-852a-a377afe3ce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.829033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:24.831496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e50d56-a8b7-42d3-b98d-5c171cd61a25 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:24.836510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6897c979-6324-429f-852a-a377afe3ce7e None None] MFA Rules not processed for user `f0c486f5a2c14bbe8aab8dd0d418192d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:24.837788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6897c979-6324-429f-852a-a377afe3ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:24.844283 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1453/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:24.926010 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1459/2912] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:24.937611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:24.938059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:24.938667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:24.970447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] MFA Rules not processed for user `3803365807284dee8e89eae93945fc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:24.972921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:25.011238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:25.011529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:25.011808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:25.047454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:25.048721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:25.069114 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1454/2913] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:55:25.092058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:25.113850 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1460/2914] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:55:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:55:25.159654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:25.161312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:25.203370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:25.250101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd95e41-d377-4ea3-844d-cb872b224467 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:25.255691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:25.256573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:25.256859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:25.257144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:25.269572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:25.271225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:25.281814 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1455/2915] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:25.626052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:25.627804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:25.767323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c352-3b0d-43e6-9bb3-797df8613e7c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:25.776482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:25.777202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:25.777487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:25.777810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:25.787534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:25.789398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:25.799994 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1461/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:26.304457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:26.307910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:26.432458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659491e6-b887-42db-bcea-5112df34b228 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:26.440394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:26.441304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:26.442497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:26.442801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:26.444757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:26.463860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:26.465974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:26.483670 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1456/2917] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:34.052104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:34.054595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:34.092945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:34.094376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:34.151466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8427d08-5baf-4019-9b6a-7ecba2a2a92b service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:34.155933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:34.156532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:34.162924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:34.162924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:34.162924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:34.175178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:34.177094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:34.188200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1462/2918] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:34.220005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3161-6bad-49f0-aa77-c97eadf3f065 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:34.229850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:34.230813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:34.231289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:34.232655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] PATH_INFO: `/v3/users/24d86f8c8ece4257adc548304465f191` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:34.234154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d86f8c8ece4257adc548304465f191)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:34.236359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:34.469827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d86f8c8ece4257adc548304465f191'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:34.494784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:34.494784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d86f8c8ece4257adc548304465f191'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:34.494784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d86f8c8ece4257adc548304465f191'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:34.512754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d86f8c8ece4257adc548304465f191'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:34.513536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c78ddb73-7350-4865-a4a9-a09a77676031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d86f8c8ece4257adc548304465f191'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:34.624649 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1457/2919] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:55:34 2022] DELETE /identity/v3/users/24d86f8c8ece4257adc548304465f191 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:35.313911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:35.365247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f0ad-bdd7-4e6b-92ed-5bfaf4104f89 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:35.479821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:35.480886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:35.481335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:35.481824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] PATH_INFO: `/v3/projects/aa352b4d4810484688d325ca4bb25193` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:35.484360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa352b4d4810484688d325ca4bb25193)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:35.487957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:35.511490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:35.713440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa352b4d4810484688d325ca4bb25193', 'request_id': 'req-604b4ab0-d663-4959-8a47-fc67a05204ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:35.723541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa352b4d4810484688d325ca4bb25193', 'request_id': 'req-604b4ab0-d663-4959-8a47-fc67a05204ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:35.748055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa352b4d4810484688d325ca4bb25193', 'request_id': 'req-604b4ab0-d663-4959-8a47-fc67a05204ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:36.291931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] The token cache is being invalidate because project aa352b4d4810484688d325ca4bb25193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:55:36.292191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:36.295504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-604b4ab0-d663-4959-8a47-fc67a05204ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:36.298469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1463/2920] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:35 2022] DELETE /identity/v3/projects/aa352b4d4810484688d325ca4bb25193 => generated 0 bytes in 987 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:36.302853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:36.303389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:36.303647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:36.327986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:36.329257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:36.482653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:36.486580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:36.486580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:36.487336 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1458/2921] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:36.536906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:36.538215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:36.582886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:36.585474 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1464/2922] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:36.601546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537aa67-5b8a-4ee8-a88d-e584deeab6e9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:36.637854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:36.641185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:36.644822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:36.646094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:36.649413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:55:36.655376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:36.661852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:36.684520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:36.689953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:36.701931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1459/2923] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:55:36.702873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:36.728143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a41b52-2d7c-4d4f-abdd-b738c8218978 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:36.746808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:36.746808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:36.746808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:36.747315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:36.747713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:36.749820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:36.869060 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1460/2924] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:55:36 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:36.869983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:36.933979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c047d84-e82a-4a6d-9d1e-52c604bbc694 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:37.073014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb329c2-fd23-460b-9b29-547b963da8d5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:37.089278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:37.094013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:37.094896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:37.094896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:37.095789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:37.104734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:37.160219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:37.163449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:37.163449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:37.163449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:37.168447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:37.223231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:37.235659 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1461/2925] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:55:36 2022] POST /identity/v3/users => generated 295 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:37.236907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:37.239336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:37.275408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671db44-8409-4a84-85b6-75ec06081a4f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:37.286291 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1465/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:55:37.290430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:37.293454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:37.293920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:37.295054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:37.295988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:37.299308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:37.330480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:37.339439 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1462/2927] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:55:37.359142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110167b0-de53-48db-b342-dc5188b6dd52 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:37.364839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99916943-4e22-4d42-8727-3b957c4cdf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:37.365445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916943-4e22-4d42-8727-3b957c4cdf29 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:37.365726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916943-4e22-4d42-8727-3b957c4cdf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:37.365995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99916943-4e22-4d42-8727-3b957c4cdf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:37.366779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99916943-4e22-4d42-8727-3b957c4cdf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:37.378893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99916943-4e22-4d42-8727-3b957c4cdf29 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:37.414361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:37.424593 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1466/2928] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:55:37.428168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5a43-d361-4ea1-84b5-bdba23b23eb4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:37.448116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:37.448804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:37.449086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:37.449366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] PATH_INFO: `/v3/projects/768fb9d0e19e40039f8471dcf9ce1016/users/bbcfd83bc53042f2a6cf7f42e9d6b81e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:37.457241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:37.542278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=768fb9d0e19e40039f8471dcf9ce1016, user_id=bbcfd83bc53042f2a6cf7f42e9d6b81e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:37.545022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:37.727865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1463/2929] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:55:37 2022] PUT /identity/v3/projects/768fb9d0e19e40039f8471dcf9ce1016/users/bbcfd83bc53042f2a6cf7f42e9d6b81e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:55:37.736370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884f6b-4434-4de5-8a23-fb2f32f6674e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:37.736370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884f6b-4434-4de5-8a23-fb2f32f6674e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:37.736370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b884f6b-4434-4de5-8a23-fb2f32f6674e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:37.804756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9b884f6b-4434-4de5-8a23-fb2f32f6674e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:37.808214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b884f6b-4434-4de5-8a23-fb2f32f6674e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:37.820671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:38.041375 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1467/2930] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:38.050186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:38.052184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:38.186270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcd4a-9ee3-48c8-888a-753764645c8b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:38.198113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66962fc-31c8-4bbc-954b-f20699fb07c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:38.198976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66962fc-31c8-4bbc-954b-f20699fb07c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:38.199286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66962fc-31c8-4bbc-954b-f20699fb07c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:38.199593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66962fc-31c8-4bbc-954b-f20699fb07c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:38.212584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66962fc-31c8-4bbc-954b-f20699fb07c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:38.214522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66962fc-31c8-4bbc-954b-f20699fb07c0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:38.227190 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1464/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:41.852345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:41.853167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:41.853167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:41.896400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] MFA Rules not processed for user `d9f88a4c72854cff9bba7ed2920f55b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:41.897934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:41.985678 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1468/2932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:42.707306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5c497-a319-433a-ab2e-a3da4ab8479f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:42.708149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5c497-a319-433a-ab2e-a3da4ab8479f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:42.708661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5c497-a319-433a-ab2e-a3da4ab8479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:42.751755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8ad5c497-a319-433a-ab2e-a3da4ab8479f None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:42.756142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ad5c497-a319-433a-ab2e-a3da4ab8479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:42.950184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1465/2933] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:55:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:42.974685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:42.978863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:43.131137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaf63b-4fd6-4861-9735-f39cf71005a4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:43.138134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:43.138768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:43.139084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:43.139490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:43.156596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:43.159225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:43.175324 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1469/2934] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:55:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:43.748603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c23-f01f-4995-973b-a4a4eef676c4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:43.749064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c23-f01f-4995-973b-a4a4eef676c4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:43.752969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c23-f01f-4995-973b-a4a4eef676c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:43.806741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2b509c23-f01f-4995-973b-a4a4eef676c4 None None] MFA Rules not processed for user `c4e1ac1b40e94dbc80548a1f45919b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:43.808868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2b509c23-f01f-4995-973b-a4a4eef676c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:43.937294 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1466/2935] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:44.138955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:44.252454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:44.291798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983a198-6598-4dc8-b529-55e9a04d1376 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:44.299402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:44.300155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:44.300608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:44.309332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:44.321618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:44.356560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:44.362101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:44.391088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1470/2936] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:45.146589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:45.147795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:45.148099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:45.192263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:45.193855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:45.216199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1467/2937] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:55:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:45.224788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:45.245359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6af937-0391-487a-89f1-d62657a89304 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:45.254133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b94468-8c07-4a74-a550-347328bae1a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:45.262179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94468-8c07-4a74-a550-347328bae1a4 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:45.262179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94468-8c07-4a74-a550-347328bae1a4 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:45.262179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b94468-8c07-4a74-a550-347328bae1a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:45.281401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94468-8c07-4a74-a550-347328bae1a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:45.285022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b94468-8c07-4a74-a550-347328bae1a4 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:45.319931 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1471/2938] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:55:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:55:45.954998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:45.956996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:45.990215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410ce10-eaf8-4eb2-938f-f176ffbc7678 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:45.996150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:45.997355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:45.997888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:45.998360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] PATH_INFO: `/v3/users/42a1b77561bd4df3a751dea07b1c6cda` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:46.004165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a1b77561bd4df3a751dea07b1c6cda)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:46.006337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:46.134451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:46.277707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a1b77561bd4df3a751dea07b1c6cda'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:46.287624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a1b77561bd4df3a751dea07b1c6cda'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:46.289465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a1b77561bd4df3a751dea07b1c6cda'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:46.310345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a1b77561bd4df3a751dea07b1c6cda'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:46.311402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a1b77561bd4df3a751dea07b1c6cda'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:46.458557 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1468/2939] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:55:45 2022] DELETE /identity/v3/users/42a1b77561bd4df3a751dea07b1c6cda => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:46.463401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280d24-65fb-4439-a445-c85323f1fa08 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:46.463911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280d24-65fb-4439-a445-c85323f1fa08 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:46.464115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280d24-65fb-4439-a445-c85323f1fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:46.486765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8e280d24-65fb-4439-a445-c85323f1fa08 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:46.488037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8e280d24-65fb-4439-a445-c85323f1fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:46.690991 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1472/2940] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:46.707884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:46.710603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:46.814187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4d11-0b6c-4546-8f77-bcf3af31ab5e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:46.818506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:46.819856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:46.820221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:46.820614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:46.855287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:46.856911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:46.882512 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1469/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:47.159796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:47.160554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:47.161079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:47.206781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] MFA Rules not processed for user `d79046739b2d4572b0aedef59e621ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:47.215034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:47.378223 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1473/2942] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:47.510108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:47.512436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:47.545536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339c101-eba4-4d81-9d34-824d08cae485 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:47.558191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:47.560339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:47.560619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:47.560889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] PATH_INFO: `/v3/projects/37509f3214ec4a83a0db84a1c5377690` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:47.567410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=37509f3214ec4a83a0db84a1c5377690)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:47.570219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:47.805465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37509f3214ec4a83a0db84a1c5377690', 'request_id': 'req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:47.820245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37509f3214ec4a83a0db84a1c5377690', 'request_id': 'req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:47.832682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37509f3214ec4a83a0db84a1c5377690', 'request_id': 'req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:47.959553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] The token cache is being invalidate because project 37509f3214ec4a83a0db84a1c5377690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:55:47.960885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:47.962079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ba31aa3e-19b9-405b-b518-5f9a2fabb1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:47.964632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1470/2943] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:47 2022] DELETE /identity/v3/projects/37509f3214ec4a83a0db84a1c5377690 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:47.968755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:47.984447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc175f69-3e96-46a9-8e9c-5e199e31a096 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:48.140297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:48.143119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:48.146327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:48.146669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] PATH_INFO: `/v3/users/16805afaab38461cb3bf8363782ce07e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:48.162156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16805afaab38461cb3bf8363782ce07e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:48.187581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:48.199304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:48.472983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16805afaab38461cb3bf8363782ce07e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:48.497293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16805afaab38461cb3bf8363782ce07e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:48.498066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16805afaab38461cb3bf8363782ce07e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:48.498685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16805afaab38461cb3bf8363782ce07e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:48.537187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16805afaab38461cb3bf8363782ce07e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:48.613182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1474/2944] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:55:47 2022] DELETE /identity/v3/users/16805afaab38461cb3bf8363782ce07e => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:55:48.907036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:48.907553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:48.907664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:48.967067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] MFA Rules not processed for user `bbcfd83bc53042f2a6cf7f42e9d6b81e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:48.968814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:49.013047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:49.145749 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1471/2945] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:49.224512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:49.226332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:49.314644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:49.316481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:49.450566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fb405-6d3d-4bbe-abcc-b45cf0d9028a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:49.462618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:49.463563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:49.464003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:49.464452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:49.478841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:49.481831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:49.506198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1475/2946] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:49.572046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34307b6-59e2-485f-9c14-1e478743d7db None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:49.593520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:49.594835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:49.596602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:49.597054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] PATH_INFO: `/v3/projects/c848bf30ab3948549504d01b5bc5af06` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:49.603410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c848bf30ab3948549504d01b5bc5af06)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:49.604774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:49.609481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:49.629771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1088-cc1f-419f-bfbd-8263916c1ee5 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:49.665817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:49.666865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:49.669690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:49.670335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:49.675192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:49.696213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:49.698059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e291b60-8e18-4e7f-a98a-7819e9eb5281 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:49.713531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1476/2947] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:55:49.862952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c848bf30ab3948549504d01b5bc5af06', 'request_id': 'req-e1d54af7-8c56-4343-b546-5a59ea9b6d56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:49.870510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c848bf30ab3948549504d01b5bc5af06', 'request_id': 'req-e1d54af7-8c56-4343-b546-5a59ea9b6d56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:49.886042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c848bf30ab3948549504d01b5bc5af06', 'request_id': 'req-e1d54af7-8c56-4343-b546-5a59ea9b6d56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:49.966823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] The token cache is being invalidate because project c848bf30ab3948549504d01b5bc5af06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:55:49.967544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:49.968035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1d54af7-8c56-4343-b546-5a59ea9b6d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:55:49.969570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1472/2948] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:55:49 2022] DELETE /identity/v3/projects/c848bf30ab3948549504d01b5bc5af06 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:49.977186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:49.977470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:49.978330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:50.001752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:50.002969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:50.247915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:50.278186 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1477/2949] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:50.283501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:50.283501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:50.283501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:50.313177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:50.314596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:50.325234 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1473/2950] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:55:50.330277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:50.342501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23babde1-449d-41cf-8f0a-88b8a0a0239d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:50.349639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:50.351310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:50.352574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:50.352574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:50.353073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:55:50.353665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:50.356501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:50.398144 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1478/2951] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:55:50.402529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:50.417240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc687324-e322-40d8-8d7a-035907f1d545 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:50.435110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:50.436354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:50.445112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:50.446378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:50.448614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:50.463219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:50.665331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1474/2952] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:55:50 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:50.670477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:50.685215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f521cc8-551e-434f-b1c3-a7b6cfe5ae3c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:50.782488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:50.783635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:50.784119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:50.785239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:50.786561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:50.793465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:51.025619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:51.028976 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1479/2953] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:55:50 2022] POST /identity/v3/users => generated 292 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:55:51.045726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf239a0b-7044-4740-b3e7-cdcd577f8a40 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:51.055889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:51.061697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:51.061697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:51.061697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:51.061697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:51.061697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:51.079101 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1475/2954] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:55:51.083442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:51.097138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04145fc-bc1d-4c9e-9678-6aa9fc78e620 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:51.118892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08f17b-282e-4e25-8cf4-c49f8b847a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:51.119631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08f17b-282e-4e25-8cf4-c49f8b847a2f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:51.119895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08f17b-282e-4e25-8cf4-c49f8b847a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:51.120172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08f17b-282e-4e25-8cf4-c49f8b847a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:51.120840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08f17b-282e-4e25-8cf4-c49f8b847a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:51.136594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08f17b-282e-4e25-8cf4-c49f8b847a2f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:51.159050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1480/2955] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:55:51.160838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:51.176205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6005-5b5d-4ee1-a8a9-09dc54138c5c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:51.200539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:51.201568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:51.202290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:51.202902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] PATH_INFO: `/v3/projects/740286d1464549609e6d4b3280aa50ce/users/6c557446cb39475dba1fc800d061b9e1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:51.212392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:55:51.244732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=740286d1464549609e6d4b3280aa50ce, user_id=6c557446cb39475dba1fc800d061b9e1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:51.248919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:51.347549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1476/2956] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:55:51 2022] PUT /identity/v3/projects/740286d1464549609e6d4b3280aa50ce/users/6c557446cb39475dba1fc800d061b9e1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:55:51.353500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:51.353500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:51.354099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:51.392223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:55:51.393517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:51.541265 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1481/2957] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:55:51.635862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:55:51.637736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:55:51.754708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf326-0739-4196-be3a-38734d52e2be admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:55:51.765451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:55:51.767677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:55:51.769164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:55:51.770906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:55:51.795344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:55:51.801336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:55:51.830985 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1477/2958] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:00.935196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:00.936679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:00.960896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e166-5a30-48af-9a57-e11e48aa2a75 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:00.972994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:00.974032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:00.975952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:00.975952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] PATH_INFO: `/v3/users/bbcfd83bc53042f2a6cf7f42e9d6b81e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:00.978766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbcfd83bc53042f2a6cf7f42e9d6b81e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:00.987456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:01.317300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbcfd83bc53042f2a6cf7f42e9d6b81e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:01.336007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:01.337831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbcfd83bc53042f2a6cf7f42e9d6b81e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:01.340188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbcfd83bc53042f2a6cf7f42e9d6b81e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:01.341105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbcfd83bc53042f2a6cf7f42e9d6b81e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:01.400575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7a7a83f0-16c7-4bac-973b-9db426f0b918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbcfd83bc53042f2a6cf7f42e9d6b81e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:01.490295 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1482/2959] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:00 2022] DELETE /identity/v3/users/bbcfd83bc53042f2a6cf7f42e9d6b81e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:01.897515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:02.089792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:02.101726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955966f9-55be-4f8b-a21e-4501d71e516b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:02.283665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:02.284336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:02.284626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:02.284909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] PATH_INFO: `/v3/projects/768fb9d0e19e40039f8471dcf9ce1016` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:02.290902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] RBAC: Authorizing `identity:delete_project(project_id=768fb9d0e19e40039f8471dcf9ce1016)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:02.296757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:02.451173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768fb9d0e19e40039f8471dcf9ce1016', 'request_id': 'req-efe68b49-f336-428d-9c7f-d0ccf391879c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:02.460132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768fb9d0e19e40039f8471dcf9ce1016', 'request_id': 'req-efe68b49-f336-428d-9c7f-d0ccf391879c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:02.466934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768fb9d0e19e40039f8471dcf9ce1016', 'request_id': 'req-efe68b49-f336-428d-9c7f-d0ccf391879c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:02.543415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] The token cache is being invalidate because project 768fb9d0e19e40039f8471dcf9ce1016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:02.543415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:02.543415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-efe68b49-f336-428d-9c7f-d0ccf391879c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:02.543415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1478/2960] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:02 2022] DELETE /identity/v3/projects/768fb9d0e19e40039f8471dcf9ce1016 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:02.546773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:02.547827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:02.548351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:02.586800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:02.588623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:02.776903 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1483/2961] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:02.786013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:02.786287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:02.786713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:02.827354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:02.830603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:02.848344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:02.852188 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1479/2962] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:02.870961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c4f9-946c-4ea5-85a3-9c667823ff28 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:02.887329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:02.890462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:02.891373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:02.892215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:02.893908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:02.895242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:02.902704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:02.946398 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1484/2963] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:02.950607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:02.963606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2943dbf-5db8-40da-a38b-f52b254ae64b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:02.971330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:02.972525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:02.974091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:02.975360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:02.976636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:02.986627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:03.122696 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1480/2964] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:02 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:03.139155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:03.146131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bbbbc-995c-4a8d-adff-3f1a818d9827 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:03.265964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:03.266608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:03.267531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:03.267531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:03.272278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:03.272278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:03.418892 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1485/2965] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:03 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:03.423245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:03.441468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a304a7-cbf7-444e-8c40-3be368437f1b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:03.451481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:03.451481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:03.451481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:03.451481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:03.452025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:03.454171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:03.481871 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1481/2966] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:03.485542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:03.499724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d810c54-a4db-44f7-9629-216080eb621d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:03.508267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0480-be61-4e86-8fe7-6d24d2852f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:03.514564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0480-be61-4e86-8fe7-6d24d2852f02 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:03.514564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0480-be61-4e86-8fe7-6d24d2852f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:03.514564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0480-be61-4e86-8fe7-6d24d2852f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:03.514564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e0480-be61-4e86-8fe7-6d24d2852f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:03.514564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e0480-be61-4e86-8fe7-6d24d2852f02 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:03.543996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1486/2967] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:03.547903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:03.571589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb01a-e485-4246-866f-6bfa877c24f8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:03.577302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:03.578001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:03.578274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:03.578551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] PATH_INFO: `/v3/projects/f1717a28e96f4fbf91edd4d1f622d002/users/d06b802ec7ca45ba956aeddccfd6ba56/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:03.652224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1717a28e96f4fbf91edd4d1f622d002, user_id=d06b802ec7ca45ba956aeddccfd6ba56, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:03.652224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:03.760722 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1482/2968] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:03 2022] PUT /identity/v3/projects/f1717a28e96f4fbf91edd4d1f622d002/users/d06b802ec7ca45ba956aeddccfd6ba56/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:03.765969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30c59-921a-4a26-9ee7-c3252d0652d5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:03.766777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30c59-921a-4a26-9ee7-c3252d0652d5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:03.767285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e30c59-921a-4a26-9ee7-c3252d0652d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:03.834698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-20e30c59-921a-4a26-9ee7-c3252d0652d5 None None] MFA Rules not processed for user `d06b802ec7ca45ba956aeddccfd6ba56`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:03.843329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20e30c59-921a-4a26-9ee7-c3252d0652d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:03.921524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:04.004550 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1487/2969] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:04.017710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:04.019919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:04.065866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:04.106834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bb38a-8b46-4009-ae89-4901720c657a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:04.111135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:04.111926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:04.112459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:04.112950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:04.124013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:04.126108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:04.155444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1483/2970] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:04.616669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e5c09-e681-47aa-986a-e249bbff12e2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:04.616669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e5c09-e681-47aa-986a-e249bbff12e2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:04.616669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e5c09-e681-47aa-986a-e249bbff12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:04.677352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-620e5c09-e681-47aa-986a-e249bbff12e2 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:04.679730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-620e5c09-e681-47aa-986a-e249bbff12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:04.854955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1488/2971] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:04.868039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:04.869749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:05.072630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84753e8-c789-41c9-a6ac-762e9a4d2968 service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:05.083344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:05.084009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:05.084299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:05.084580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:05.101845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:05.104934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:05.124956 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1484/2972] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:56:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:05.653539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:05.655912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:05.655912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:05.738918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] MFA Rules not processed for user `6c557446cb39475dba1fc800d061b9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:05.740913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:06.016281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1489/2973] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:06.020596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:06.022696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:06.257218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f18fb-2800-44a5-b173-9322c3dde60c service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:06.305213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:06.308068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:06.309224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:06.311373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:06.314169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:06.321044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:06.496498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:06.500377 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1485/2974] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:06 2022] POST /identity/v3/projects => generated 383 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:06.512610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450bfe4-80a0-4763-ae28-46935c727965 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:06.734537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:06.735225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:06.735967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:06.736975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:06.738761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:06.748552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:06.791505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:06.914699 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1490/2975] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:06 2022] POST /identity/v3/users => generated 298 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:06.925286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:06.951927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961214-0772-4b70-bb50-c05c4d06efa4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:06.985948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:06.986617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:06.986852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:06.991441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:06.997791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:07.009730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:07.062774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1486/2976] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:07.067188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:07.101550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8ec0-14b4-4ef0-bdab-b1470c3f7b31 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:07.113596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:07.114632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:07.115160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:07.116093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] PATH_INFO: `/v3/projects/ff5ee808788043528fdeadc86f89b84d/users/6a18cb9df0834bf7a271f48f4075ca58/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:07.156390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5ee808788043528fdeadc86f89b84d, user_id=6a18cb9df0834bf7a271f48f4075ca58, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:07.168912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:07.265288 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1491/2977] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:07 2022] PUT /identity/v3/projects/ff5ee808788043528fdeadc86f89b84d/users/6a18cb9df0834bf7a271f48f4075ca58/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:07.269567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:07.281502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae630d7b-33d0-46f1-951f-2e4c27254435 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:07.361601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:07.451872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:07.452517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:07.452881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:07.453153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:07.453811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:07.455542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:07.472856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1487/2978] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:07.477220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:07.493862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407c515-8dcd-4a7d-b370-9664610cf8e5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:07.527972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:07.528746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:07.529406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:07.533474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] PATH_INFO: `/v3/projects/ff5ee808788043528fdeadc86f89b84d/users/6a18cb9df0834bf7a271f48f4075ca58/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:07.545189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5ee808788043528fdeadc86f89b84d, user_id=6a18cb9df0834bf7a271f48f4075ca58, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:07.571100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:07.606848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1492/2979] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:07 2022] PUT /identity/v3/projects/ff5ee808788043528fdeadc86f89b84d/users/6a18cb9df0834bf7a271f48f4075ca58/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:08.424959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:08.426825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:08.658527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc28b-1208-44b6-8205-1a32ffdd1b04 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:08.658527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:08.658527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:08.658527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:08.659430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:08.659430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:08.659430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:08.659430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:08.659430 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1488/2980] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:10.506765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:10.509342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:10.667655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028f72-3661-4859-8139-592b51cefa00 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:10.675912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:10.678613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:10.679057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:10.679425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] PATH_INFO: `/v3/users/6559ac446c4640218ce700687045bb0d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:10.680991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6559ac446c4640218ce700687045bb0d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:10.684304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:10.986928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6559ac446c4640218ce700687045bb0d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:11.000029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6559ac446c4640218ce700687045bb0d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:11.000955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6559ac446c4640218ce700687045bb0d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:11.001691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6559ac446c4640218ce700687045bb0d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:11.030477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6559ac446c4640218ce700687045bb0d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:11.161062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1493/2981] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:10 2022] DELETE /identity/v3/users/6559ac446c4640218ce700687045bb0d => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:11.671408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:11.673068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:11.942749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dc67f-1659-437a-85ea-57c78e6d7654 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:12.008270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:12.111720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:12.112699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:12.120442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:12.120442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:12.121286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:12.199871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:12.201104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:12.212885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1489/2982] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:12.280361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:12.284464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:12.417964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:12.528028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69495-e29a-46a1-b6f7-4899bab2eba4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:12.538827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:12.540353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:12.540695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:12.543069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] PATH_INFO: `/v3/projects/c75bc66c9c9b4fc4b76380e47b40b0b5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:12.547442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75bc66c9c9b4fc4b76380e47b40b0b5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:12.549388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:12.819645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'request_id': 'req-498d29fa-8184-4014-ae17-9f47324c39d3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:12.844005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'request_id': 'req-498d29fa-8184-4014-ae17-9f47324c39d3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:12.869079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75bc66c9c9b4fc4b76380e47b40b0b5', 'request_id': 'req-498d29fa-8184-4014-ae17-9f47324c39d3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.037997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] The token cache is being invalidate because project c75bc66c9c9b4fc4b76380e47b40b0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:13.038215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.039368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-498d29fa-8184-4014-ae17-9f47324c39d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.041779 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1494/2983] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:12 2022] DELETE /identity/v3/projects/c75bc66c9c9b4fc4b76380e47b40b0b5 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:13.046255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:13.071570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b817d4-9c5b-421e-900a-4353c56a97b6 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:13.353348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:13.355542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:13.356285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:13.374182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] PATH_INFO: `/v3/users/708c339746d34f61b3f1d5338002db2a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:13.379872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708c339746d34f61b3f1d5338002db2a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:13.397857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:13.675769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708c339746d34f61b3f1d5338002db2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.694004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708c339746d34f61b3f1d5338002db2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.696926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708c339746d34f61b3f1d5338002db2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.715505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:13.727755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708c339746d34f61b3f1d5338002db2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.728343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708c339746d34f61b3f1d5338002db2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:13.854370 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1490/2984] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:13 2022] DELETE /identity/v3/users/708c339746d34f61b3f1d5338002db2a => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:15.000205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:15.000730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:15.003201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:15.030865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:15.034058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:15.113425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1495/2985] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:15.131516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:15.133562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:15.164735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:15.166759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:15.262391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde4716-45d7-4d6b-bbcd-d05416f91184 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:15.275585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c967a-f5ce-4a1a-b7fa-06d9f3ea3806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:15.282640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c967a-f5ce-4a1a-b7fa-06d9f3ea3806 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:15.282640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c967a-f5ce-4a1a-b7fa-06d9f3ea3806 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:15.282640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c967a-f5ce-4a1a-b7fa-06d9f3ea3806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:15.298088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c967a-f5ce-4a1a-b7fa-06d9f3ea3806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:15.300063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c967a-f5ce-4a1a-b7fa-06d9f3ea3806 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:15.317935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1491/2986] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:15.380108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3038-c338-4c69-bb1e-07bc45d34d36 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:15.386238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:15.387623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:15.390139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:15.390282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] PATH_INFO: `/v3/projects/69b39ad3919a435287317512fdf3fb31` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:15.391702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b39ad3919a435287317512fdf3fb31)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:15.399055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:15.424154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:15.573047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b39ad3919a435287317512fdf3fb31', 'request_id': 'req-6a173251-ead7-4fe5-adbf-afa3abb3f39f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:15.579400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b39ad3919a435287317512fdf3fb31', 'request_id': 'req-6a173251-ead7-4fe5-adbf-afa3abb3f39f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:15.591407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b39ad3919a435287317512fdf3fb31', 'request_id': 'req-6a173251-ead7-4fe5-adbf-afa3abb3f39f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:15.817921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] The token cache is being invalidate because project 69b39ad3919a435287317512fdf3fb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:15.820520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:15.826655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a173251-ead7-4fe5-adbf-afa3abb3f39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:15.839088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1496/2987] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:15 2022] DELETE /identity/v3/projects/69b39ad3919a435287317512fdf3fb31 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:15.840170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:15.840471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:15.840779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:15.900232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:15.902420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:15.995608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1492/2988] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:16.006251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:16.006738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:16.006850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:16.030939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:16.033238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:16.050481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:16.051750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:16.053644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846aaa4-e634-4730-87b5-66e5c75ed962 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:16.062527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:16.063213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:16.063498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:16.063773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] PATH_INFO: `/v3/users/d06b802ec7ca45ba956aeddccfd6ba56` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:16.069221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06b802ec7ca45ba956aeddccfd6ba56)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:16.074537 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1497/2989] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:16.078655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:16.079785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:16.100731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a14464-54de-43a1-a4f6-bfef766e1cf1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:16.113369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:16.114361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:16.117955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:16.117955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:16.117955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:16.117955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:16.119500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:16.147124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1498/2990] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:16.151187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:16.162769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d24316-c474-4b9e-90c3-c26b08dc64ab admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:16.175216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:16.176058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:16.176790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:16.177085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:16.181752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:16.187284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:16.292004 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1499/2991] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:16.292987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:16.335623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06b802ec7ca45ba956aeddccfd6ba56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:16.351977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06b802ec7ca45ba956aeddccfd6ba56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:16.354940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06b802ec7ca45ba956aeddccfd6ba56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:16.382426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:16.419467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06b802ec7ca45ba956aeddccfd6ba56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:16.424098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fb532d00-947a-4407-8289-1557f2908edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06b802ec7ca45ba956aeddccfd6ba56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:16.524757 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1493/2992] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:16 2022] DELETE /identity/v3/users/d06b802ec7ca45ba956aeddccfd6ba56 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:16.528566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:16.529081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:16.529507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:16.537257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c3b2-aa44-4deb-a9d7-223f7a596c1e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:16.578486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:16.579929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:16.732614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:16.732614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:16.732614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:16.732614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:16.733037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:16.743336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:16.782451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:16.796980 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1494/2993] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:16.807893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:16.809901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:16.927271 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1500/2994] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:16 2022] POST /identity/v3/users => generated 289 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:16.932449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:16.934951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:16.973879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c350c-0e41-478c-a4f1-afe8028f08ee None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:16.977001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bae8d0-f285-4e09-a307-396aaeb0b52f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:16.984146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:16.996366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.000920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.001338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.002246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:17.015266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.015266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.015266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.015266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:17.015266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:17.028303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:17.028303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:17.034378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1501/2995] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:17.035771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:17.053226 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1495/2996] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:56:17.059861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aab87a-78c5-4c8a-80f7-2f2b5b708659 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:17.068876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baf716-3e62-4c58-8a43-73d8f0720be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:17.069657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf716-3e62-4c58-8a43-73d8f0720be3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.070012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf716-3e62-4c58-8a43-73d8f0720be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.070485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf716-3e62-4c58-8a43-73d8f0720be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.071783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baf716-3e62-4c58-8a43-73d8f0720be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:17.073857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baf716-3e62-4c58-8a43-73d8f0720be3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:17.091203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1502/2997] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:17.092473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:17.108292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c2989-8305-4445-a8c6-a86962a85a0e service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:17.113825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:17.114570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.116792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.117149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] PATH_INFO: `/v3/projects/644d0aaa477d4b139d628ca3e419eda4/users/645bdbe132bf4389ba7b1cffdce9a517/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.137502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=644d0aaa477d4b139d628ca3e419eda4, user_id=645bdbe132bf4389ba7b1cffdce9a517, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:17.141568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:17.199139 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1496/2998] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:17 2022] PUT /identity/v3/projects/644d0aaa477d4b139d628ca3e419eda4/users/645bdbe132bf4389ba7b1cffdce9a517/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:17.210593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.218312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.218688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.271722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] MFA Rules not processed for user `645bdbe132bf4389ba7b1cffdce9a517`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:17.279381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:17.450612 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1503/2999] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:17.455330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:17.458285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:17.464374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:17.466932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:17.604138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e8f0-0ed3-4dad-9072-7dc0400a7e1f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:17.610182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:17.611130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.611598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.612093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] PATH_INFO: `/v3/users/de579d631e9d4010887077567bbe5fd6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.613421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de579d631e9d4010887077567bbe5fd6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:17.615591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:17.656978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28116f1-7e13-4e07-84bc-a4483ea63948 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:17.664430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:17.665290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:17.665743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:17.666426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:17.679275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:17.681599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:17.695468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1504/3000] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:17.746494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:17.853054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de579d631e9d4010887077567bbe5fd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:17.862370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de579d631e9d4010887077567bbe5fd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:17.863881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de579d631e9d4010887077567bbe5fd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:17.899358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de579d631e9d4010887077567bbe5fd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:17.901763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79f1f788-3811-408b-8e10-8c0b72886320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de579d631e9d4010887077567bbe5fd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:17.972731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:17.974697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:17.992300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2a73-2740-48ea-9978-cdf3faf84d74 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:17.998014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:18.019237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.019237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.019237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] PATH_INFO: `/v3/projects/f1717a28e96f4fbf91edd4d1f622d002` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.019237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1717a28e96f4fbf91edd4d1f622d002)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:18.019237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:18.066286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1497/3001] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:17 2022] DELETE /identity/v3/users/de579d631e9d4010887077567bbe5fd6 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:18.221130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:18.248205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1717a28e96f4fbf91edd4d1f622d002', 'request_id': 'req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:18.285590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1717a28e96f4fbf91edd4d1f622d002', 'request_id': 'req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:18.301467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1717a28e96f4fbf91edd4d1f622d002', 'request_id': 'req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:18.333383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1124-f617-4c26-95e2-9d87106b7375 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.333745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1124-f617-4c26-95e2-9d87106b7375 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.334035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea1124-f617-4c26-95e2-9d87106b7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.374439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a5ea1124-f617-4c26-95e2-9d87106b7375 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:18.381920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a5ea1124-f617-4c26-95e2-9d87106b7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.448869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] The token cache is being invalidate because project f1717a28e96f4fbf91edd4d1f622d002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:18.449505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:18.450906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5e91c0-ce42-40ed-b8ac-dc62eb04940e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:18.453311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1505/3002] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:17 2022] DELETE /identity/v3/projects/f1717a28e96f4fbf91edd4d1f622d002 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:18.458043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.459191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.459689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.513875 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1498/3003] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:18.515334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67102-e6f5-4dc2-804a-be5f3236f03b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.515715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:18.515872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67102-e6f5-4dc2-804a-be5f3236f03b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.516126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d67102-e6f5-4dc2-804a-be5f3236f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.517488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.584730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-62d67102-e6f5-4dc2-804a-be5f3236f03b None None] MFA Rules not processed for user `6a18cb9df0834bf7a271f48f4075ca58`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:18.586155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-62d67102-e6f5-4dc2-804a-be5f3236f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.663141 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1506/3004] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:18.663141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:18.669830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.684740 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1499/3005] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:18.695062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.695620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.696118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.723428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:18.725354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.739569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1500/3006] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:18.739569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:18.742453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.769922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eec9cd-16f2-4384-a1dc-5e237c8fdae4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:18.777201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:18.778156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.778662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.779216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] PATH_INFO: `/v3/projects/2ce648f86e3e4a3c9e8712bb087b8769` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.780664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce648f86e3e4a3c9e8712bb087b8769)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:18.783267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:18.791944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbddf67-1563-4b8c-9273-42da208530c8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:18.798643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:18.799341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.799625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.800103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.811593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:18.813470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:18.826546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1507/3007] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:18.827429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:18.829113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.919115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f59f-2100-4e3e-88d2-be4646474c0e service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:18.925700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:18.926330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:18.926608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:18.927077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:18.938953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:18.990625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce648f86e3e4a3c9e8712bb087b8769', 'request_id': 'req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:18.998959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce648f86e3e4a3c9e8712bb087b8769', 'request_id': 'req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:19.009056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce648f86e3e4a3c9e8712bb087b8769', 'request_id': 'req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:19.020444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.022140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.034625 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1508/3008] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:19.035645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.046645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d467c-59b1-46f3-9259-747ee35c06a7 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.114434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] The token cache is being invalidate because project 2ce648f86e3e4a3c9e8712bb087b8769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:19.115640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.115980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.116291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.116542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.116934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:19.117245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:19.117556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.119246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.129648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5a90e3c3-6e1e-4d1a-a318-7ca2dc7afc50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:19.132167 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1509/3009] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:19.136973 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1501/3010] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:18 2022] DELETE /identity/v3/projects/2ce648f86e3e4a3c9e8712bb087b8769 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:19.137183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.145190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf95a7-9167-419a-8366-33e4924e07b7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.145487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf95a7-9167-419a-8366-33e4924e07b7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.151878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:19.158383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf95a7-9167-419a-8366-33e4924e07b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.204577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8686-2742-4b8e-b6a8-f79865bb625d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.220132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25206c-19c9-4044-9d09-59f28681ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.221167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25206c-19c9-4044-9d09-59f28681ce77 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.222656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25206c-19c9-4044-9d09-59f28681ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.223358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25206c-19c9-4044-9d09-59f28681ce77 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.224780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25206c-19c9-4044-9d09-59f28681ce77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.226446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1ddf95a7-9167-419a-8366-33e4924e07b7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:19.228650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25206c-19c9-4044-9d09-59f28681ce77 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.246479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:19.247035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ddf95a7-9167-419a-8366-33e4924e07b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:19.263989 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1502/3011] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:19.270554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.270840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.275206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.310002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:19.312835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:19.323056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1503/3012] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:19.327427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.365653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3ede-e759-404c-a68d-fa565033f5a6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.377471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.381723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.384129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.384742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.386171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:19.388649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.390755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.411674 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1510/3013] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/projects => generated 399 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:19.411674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.411674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.412253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.412713 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1504/3014] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:56:19.413995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.427071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d361ad-1e01-462f-b4d6-a3c3e449f708 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.458422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] MFA Rules not processed for user `645bdbe132bf4389ba7b1cffdce9a517`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:19.460399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:19.486706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:19.517890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.519650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.520101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.520540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.521920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.524067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.583398 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1511/3015] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:19.585239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.608327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e470348-da13-497c-86f3-bd6652bc5c7e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.613835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.615421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.624795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.630163 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1505/3016] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:19.632139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.633281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.634860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.638282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.754405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e745e-49d1-45a4-a14e-643c4eb608e8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.760239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.761046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.761430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.761938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.762703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.765905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.775079 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1512/3017] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:19.775834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.792170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763539-4c06-44da-b7b8-bdc3b115f251 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.797169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.797843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.798082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.798371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.799032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.801145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.821848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1513/3018] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:19.823764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.843496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ece5a-6ea6-4e4a-8ca1-b864683e7028 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.849234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.852336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.852336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.852336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.852336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.853653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.867188 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1514/3019] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:19.879975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.889140 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1506/3020] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:19 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:19.892674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:19.902454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614275-daae-4307-84f8-2cbf74d70eae admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.915786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1db72-c216-4240-99ec-d49c805ac035 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:19.918209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88286abe-da40-400e-85da-0da0fd734df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.918209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88286abe-da40-400e-85da-0da0fd734df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.918717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88286abe-da40-400e-85da-0da0fd734df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.919223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88286abe-da40-400e-85da-0da0fd734df6 admin admin] PATH_INFO: `/v3/projects/9116231b96d24d88b975085b957ba6d8/users/c8f738c8f855414e8b9d40a8b4c4d19a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.931215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:19.936402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:19.936717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:19.938329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:19.939204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.942731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.945848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88286abe-da40-400e-85da-0da0fd734df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9116231b96d24d88b975085b957ba6d8, user_id=c8f738c8f855414e8b9d40a8b4c4d19a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:19.948743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88286abe-da40-400e-85da-0da0fd734df6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:19.955802 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1507/3021] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:19.967622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:20.010400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff2439-d12a-442b-a579-98a731ab008c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:20.028960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:20.029828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.030276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.030701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.031599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:20.033773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:20.066575 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1515/3022] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:19 2022] PUT /identity/v3/projects/9116231b96d24d88b975085b957ba6d8/users/c8f738c8f855414e8b9d40a8b4c4d19a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:20.069338 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1508/3023] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:20.069797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115dd9-e196-4a02-830b-9fc9ec728aff None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.070086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115dd9-e196-4a02-830b-9fc9ec728aff None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.070290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:20.070425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115dd9-e196-4a02-830b-9fc9ec728aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.101948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f24fb-de03-4fe8-9ba2-6f851303f7ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:20.112431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a7115dd9-e196-4a02-830b-9fc9ec728aff None None] MFA Rules not processed for user `c8f738c8f855414e8b9d40a8b4c4d19a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:20.113342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a7115dd9-e196-4a02-830b-9fc9ec728aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:20.136919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:20.220154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:20.225441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.225441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.225441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] PATH_INFO: `/v3/projects/6426072a16f94ccab950cd671b99d037/users/26d3ff201f924305aa89f37bffb5af09/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.244520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6426072a16f94ccab950cd671b99d037, user_id=26d3ff201f924305aa89f37bffb5af09, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:20.247256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:20.262983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:20.273035 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1516/3024] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:20.273035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.273035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.273035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.310665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:20.311938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:20.373060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1517/3025] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:20.373848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:20.375608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:20.407781 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1509/3026] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:20 2022] PUT /identity/v3/projects/6426072a16f94ccab950cd671b99d037/users/26d3ff201f924305aa89f37bffb5af09/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:20.407781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:20.407781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:20.499084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e9f9-2b00-4adb-9961-8648a295fbe5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:20.513318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de0aea-f9f7-47a0-9d5e-55d1a8146067 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:20.519508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b569-0bd9-49eb-84f4-9ec7b040f502 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:20.520967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b569-0bd9-49eb-84f4-9ec7b040f502 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.521403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b569-0bd9-49eb-84f4-9ec7b040f502 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.521989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b569-0bd9-49eb-84f4-9ec7b040f502 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.642653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:20.643643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.644206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.644666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.654254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b569-0bd9-49eb-84f4-9ec7b040f502 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:20.661749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2b569-0bd9-49eb-84f4-9ec7b040f502 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:20.672649 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1510/3027] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:20.674302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:20.675976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:20.676616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:20.748132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:20.753629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] MFA Rules not processed for user `26d3ff201f924305aa89f37bffb5af09`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:20.756326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:20.799250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:20.799250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:20.826578 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1518/3028] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:20.899234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:20.958437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:20.987003 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1511/3029] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:21.009461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:21.030520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcde3b3-2bc3-4981-8687-cd0d4f2bbafd service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:21.032985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262fc57-d317-45b0-a736-a75d264928cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:21.040353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:21.041416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:21.041708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:21.041981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] PATH_INFO: `/v3/users/c8f738c8f855414e8b9d40a8b4c4d19a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:21.042110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:21.042801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:21.043219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:21.043501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:21.054427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:21.055288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f738c8f855414e8b9d40a8b4c4d19a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:21.056232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:21.060167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:21.068372 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1512/3030] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:56:21.263644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:21.265099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:21.292363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce37ea-96e6-4337-b095-a6514f4826bb service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:21.304167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:21.304824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:21.305113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:21.305391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] PATH_INFO: `/v3/users/645bdbe132bf4389ba7b1cffdce9a517` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:21.306660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] RBAC: Authorizing `identity:delete_user(user_id=645bdbe132bf4389ba7b1cffdce9a517)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:21.308893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:21.309933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:21.340533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f738c8f855414e8b9d40a8b4c4d19a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.359851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f738c8f855414e8b9d40a8b4c4d19a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.377782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f738c8f855414e8b9d40a8b4c4d19a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.378911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f738c8f855414e8b9d40a8b4c4d19a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.408235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f738c8f855414e8b9d40a8b4c4d19a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.499651 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1519/3031] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:20 2022] DELETE /identity/v3/users/c8f738c8f855414e8b9d40a8b4c4d19a => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:21.500954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:21.503642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:21.579417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645bdbe132bf4389ba7b1cffdce9a517'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.589490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645bdbe132bf4389ba7b1cffdce9a517'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.590992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645bdbe132bf4389ba7b1cffdce9a517'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.623665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22454f-be8b-41a4-b4ab-90efbdc8a74d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:21.625161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645bdbe132bf4389ba7b1cffdce9a517'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.626020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84cbdde2-f359-43f9-a29b-e3db7306357a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645bdbe132bf4389ba7b1cffdce9a517'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.651175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:21.652416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:21.652926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:21.653501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] PATH_INFO: `/v3/users/26d3ff201f924305aa89f37bffb5af09` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:21.655432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d3ff201f924305aa89f37bffb5af09)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:21.662919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:21.714999 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1513/3032] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:21 2022] DELETE /identity/v3/users/645bdbe132bf4389ba7b1cffdce9a517 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:21.714999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a215-252c-46a0-84c2-4b6b057c7bee None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:21.714999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a215-252c-46a0-84c2-4b6b057c7bee None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:21.714999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4a215-252c-46a0-84c2-4b6b057c7bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:21.756822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fdc4a215-252c-46a0-84c2-4b6b057c7bee None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:21.758095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fdc4a215-252c-46a0-84c2-4b6b057c7bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:21.789415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:21.834666 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1514/3033] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:21.836493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1536-e9b0-4b3d-841e-d33bbc36c3f9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:21.836992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1536-e9b0-4b3d-841e-d33bbc36c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:21.837247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1536-e9b0-4b3d-841e-d33bbc36c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:21.893887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-addd1536-e9b0-4b3d-841e-d33bbc36c3f9 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:21.895829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-addd1536-e9b0-4b3d-841e-d33bbc36c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:21.948088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d3ff201f924305aa89f37bffb5af09'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.981044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d3ff201f924305aa89f37bffb5af09'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.984436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d3ff201f924305aa89f37bffb5af09'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:21.986694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d3ff201f924305aa89f37bffb5af09'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:22.045906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d3ff201f924305aa89f37bffb5af09'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:22.055563 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1515/3034] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:56:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:22.059586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:22.059898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:22.069349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:22.126747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:22.128150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:22.150807 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1520/3035] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:21 2022] DELETE /identity/v3/users/26d3ff201f924305aa89f37bffb5af09 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:22.155247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:22.168023 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1516/3036] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:22.168441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:22.168562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:22.175217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:22.217526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:22.269409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a85e52-1c03-4afb-902e-d9bd172371d5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:22.277803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:22.278448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:22.283115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:22.283115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:22.283115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:22.325930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfcd29-0b9b-42de-9c65-db1f4721ee31 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:22.400498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:22.405944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e56792-e513-4904-b093-cd7427d29f05 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:22.426678 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1521/3037] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:22.439728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:22.440003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:22.440285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:22.464916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359cf31-4126-4e6e-98bb-0f78914fc250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:22.465553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cf31-4126-4e6e-98bb-0f78914fc250 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:22.465833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cf31-4126-4e6e-98bb-0f78914fc250 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:22.466106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cf31-4126-4e6e-98bb-0f78914fc250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:22.503957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:22.507634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:22.512278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:22.542322 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1522/3038] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:22.544765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:22.576713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650772-cc2d-4426-bf56-2b17dbcbb7b0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:22.587116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:22.591860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:22.591860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:22.591860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:22.623783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:22.629103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:22.639975 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1523/3039] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:22.640975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:22.642527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:22.660490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46d38-1a8d-4be9-a058-1cf037b9fcbe service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:22.671388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:22.671388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:22.671388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:22.671388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:22.684238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359cf31-4126-4e6e-98bb-0f78914fc250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:22.689680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359cf31-4126-4e6e-98bb-0f78914fc250 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:22.694842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:22.699519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:22.715316 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1517/3040] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:22.724663 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1524/3041] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:24.150430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:24.153084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:24.154098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:24.156004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:24.156478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:24.207607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aeec6-476d-4b5b-9fb6-ae96f40b26a6 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:24.222983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:24.224980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] MFA Rules not processed for user `6c557446cb39475dba1fc800d061b9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:24.225324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:24.225676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:24.226021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] PATH_INFO: `/v3/projects/9116231b96d24d88b975085b957ba6d8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:24.228050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:24.229031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9116231b96d24d88b975085b957ba6d8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:24.233614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:24.372795 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1518/3042] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:24.374364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:24.377509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:24.428189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24322c1b-029c-454c-b01b-418c6ae2ac9c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:24.447315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:24.448933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:24.450533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:24.450817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] PATH_INFO: `/v3/projects/644d0aaa477d4b139d628ca3e419eda4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:24.455432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644d0aaa477d4b139d628ca3e419eda4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:24.462789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:24.464285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9116231b96d24d88b975085b957ba6d8', 'request_id': 'req-8feb74d6-3433-414d-8f92-9467c8148701'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.497299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9116231b96d24d88b975085b957ba6d8', 'request_id': 'req-8feb74d6-3433-414d-8f92-9467c8148701'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.518030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9116231b96d24d88b975085b957ba6d8', 'request_id': 'req-8feb74d6-3433-414d-8f92-9467c8148701'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.619575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] The token cache is being invalidate because project 9116231b96d24d88b975085b957ba6d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:24.619874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.624571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.626276 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1525/3043] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:24 2022] DELETE /identity/v3/projects/9116231b96d24d88b975085b957ba6d8 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:24.630382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:24.632054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:24.671297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644d0aaa477d4b139d628ca3e419eda4', 'request_id': 'req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.699033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644d0aaa477d4b139d628ca3e419eda4', 'request_id': 'req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.707198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644d0aaa477d4b139d628ca3e419eda4', 'request_id': 'req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.715584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:24.800470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] The token cache is being invalidate because project 644d0aaa477d4b139d628ca3e419eda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:24.800771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.801436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6470d8-3999-4c3a-bf3d-91b9342a8e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:24.804719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1519/3044] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:24 2022] DELETE /identity/v3/projects/644d0aaa477d4b139d628ca3e419eda4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:24.805557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb74d6-3433-414d-8f92-9467c8148701 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:24.807850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884040-5c16-4b07-9182-fc330401d71b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:24.812134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884040-5c16-4b07-9182-fc330401d71b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:24.812134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884040-5c16-4b07-9182-fc330401d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:24.892184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d7884040-5c16-4b07-9182-fc330401d71b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:24.893535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7884040-5c16-4b07-9182-fc330401d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:24.956952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:24.957606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:24.957889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:24.958164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] PATH_INFO: `/v3/projects/6426072a16f94ccab950cd671b99d037` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:24.960929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6426072a16f94ccab950cd671b99d037)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:24.979669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:24.988242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:25.092392 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1520/3045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:25.102764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebbbb-7571-4863-bcdf-94219c0cce9d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:25.108767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebbbb-7571-4863-bcdf-94219c0cce9d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:25.109318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebbbb-7571-4863-bcdf-94219c0cce9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:25.170548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-54bebbbb-7571-4863-bcdf-94219c0cce9d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:25.175214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54bebbbb-7571-4863-bcdf-94219c0cce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:25.198221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1521/3046] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:25.199921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ead0f-0aff-4380-a03b-0ab8d39ba3ef None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:25.200284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ead0f-0aff-4380-a03b-0ab8d39ba3ef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:25.200638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ead0f-0aff-4380-a03b-0ab8d39ba3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:25.227407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9e9ead0f-0aff-4380-a03b-0ab8d39ba3ef None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:25.228793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9e9ead0f-0aff-4380-a03b-0ab8d39ba3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:25.254992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1522/3047] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:25.254992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:25.254992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:25.254992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:25.276725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:25.281286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:25.291653 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1523/3048] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:25.292833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:25.322095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1346da-896d-4bbc-b28b-2a7091772c4c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:25.337327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:25.337958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:25.338240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:25.338566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:25.339253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:25.343289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:25.349534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:25.393582 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1524/3049] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:25.395432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:25.413460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef6963-b741-479b-a7fa-a89d7f4ad0f5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:25.418643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:25.419549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:25.420007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:25.420451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:25.421364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:25.422334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:25.424601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:25.439393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1525/3050] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:25.440693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:25.453092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b50d1-1c88-4e22-a946-07a926d894f4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:25.470476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:25.471426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:25.471938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:25.472400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:25.473218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:25.475608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:25.990808 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1526/3051] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:25 2022] POST /identity/v3/projects => generated 373 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:25.994946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.003097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6426072a16f94ccab950cd671b99d037', 'request_id': 'req-9acddc7c-919d-4538-a10e-dac7bcd09456'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:26.025453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6426072a16f94ccab950cd671b99d037', 'request_id': 'req-9acddc7c-919d-4538-a10e-dac7bcd09456'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:26.048187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6426072a16f94ccab950cd671b99d037', 'request_id': 'req-9acddc7c-919d-4538-a10e-dac7bcd09456'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:26.169744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] The token cache is being invalidate because project 6426072a16f94ccab950cd671b99d037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:26.169744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:26.170503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:26.182063 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1526/3052] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:24 2022] DELETE /identity/v3/projects/6426072a16f94ccab950cd671b99d037 => generated 0 bytes in 1552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:26.189711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.189711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:26.194025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f360df-f92c-4c60-9c9b-635c303ec795 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.217021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445db26-61a4-4a84-ab0c-4770533fee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.219624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445db26-61a4-4a84-ab0c-4770533fee14 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.219624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445db26-61a4-4a84-ab0c-4770533fee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.225192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445db26-61a4-4a84-ab0c-4770533fee14 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.226584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445db26-61a4-4a84-ab0c-4770533fee14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.229353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445db26-61a4-4a84-ab0c-4770533fee14 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.361685 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1527/3053] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:25 2022] POST /identity/v3/projects => generated 413 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:26.364030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.365241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.366122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.395184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acddc7c-919d-4538-a10e-dac7bcd09456 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.396536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:26.400263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:26.484273 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1528/3054] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:26.485350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.500090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81729ff4-bfb3-4d77-b5cd-254f8a61d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.505890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81729ff4-bfb3-4d77-b5cd-254f8a61d658 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.505890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81729ff4-bfb3-4d77-b5cd-254f8a61d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.505890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81729ff4-bfb3-4d77-b5cd-254f8a61d658 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.505890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81729ff4-bfb3-4d77-b5cd-254f8a61d658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.506376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:26.506494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81729ff4-bfb3-4d77-b5cd-254f8a61d658 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.545178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1af0d-ca11-43bc-aaa3-1e0720b32375 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.547069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.547893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.548767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.549220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.550158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.555441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.637071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1527/3055] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:26 2022] POST /identity/v3/users => generated 287 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:26.641542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.641542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.641542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.670440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:26.676023 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1529/3056] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:26 2022] POST /identity/v3/users => generated 307 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:26.676173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:26.676297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.687261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e5ffe-1240-4047-9007-c510d8adb650 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.690440 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1528/3057] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:26.691994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.703989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.718443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.718443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.718684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956a5c2-639f-4464-a16c-7b3930785b21 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.718778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.718778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.718778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.719068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.719068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.719068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.719068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.719407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.719407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.726385 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1530/3058] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:26.727339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.738795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecce49-e51c-424d-9338-c5fb0d275443 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.746284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.750272 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1529/3059] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:26.750687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.750687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.751191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.751455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.751455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:26.751455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.759706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.778634 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1531/3060] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:26.780044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.781914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ddf62-a4d5-4f1c-b092-a93aebe170b8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.793083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.793832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76188665-dfde-4cf9-857d-c6c1301b0f16 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.793983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.794185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.794697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.795656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.797889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.801583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.812078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.812450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.812733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.816524 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1530/3061] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:26.816700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.816700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.817547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.836549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e3951-1fba-448c-9d32-1d0b85be9821 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.848670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.848670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.848670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.848670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.859321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.861888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:26.864185 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1532/3062] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:26.865896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:26.889090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69637d10-273b-4eaa-b78a-ef1b32c047a2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:26.900304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:26.901425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:26.901711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:26.902381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] PATH_INFO: `/v3/projects/7cac31aec7f344608d2dcb2b9d392a88/users/6eae9e913f944ed4af0e4b95ff7fc8f7/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:26.947958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cac31aec7f344608d2dcb2b9d392a88, user_id=6eae9e913f944ed4af0e4b95ff7fc8f7, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:26.952005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.041782 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1531/3063] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:26 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:27.041782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.063162 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1533/3064] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:26 2022] PUT /identity/v3/projects/7cac31aec7f344608d2dcb2b9d392a88/users/6eae9e913f944ed4af0e4b95ff7fc8f7/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:27.064152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.189664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:27.210626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117fa3-389b-444d-be03-eee6d2f0adea admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.223649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.224253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9da5f-dcb9-479e-acf8-3210d970192a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.224753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.224753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.224964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] PATH_INFO: `/v3/projects/0bce1bf271594425ad60e24f40b3b60d/users/2d0621ebe85c47c383137b4db0814279/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.232051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41096-4a23-4949-be4e-1f211c400e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.233150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41096-4a23-4949-be4e-1f211c400e86 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.233461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41096-4a23-4949-be4e-1f211c400e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.233840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41096-4a23-4949-be4e-1f211c400e86 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.234879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad41096-4a23-4949-be4e-1f211c400e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:27.237420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad41096-4a23-4949-be4e-1f211c400e86 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.281936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bce1bf271594425ad60e24f40b3b60d, user_id=2d0621ebe85c47c383137b4db0814279, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:27.284444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.324652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:27.382351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1534/3065] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:27 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:27.382351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.382629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.382716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.426306 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1532/3066] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:27 2022] PUT /identity/v3/projects/0bce1bf271594425ad60e24f40b3b60d/users/2d0621ebe85c47c383137b4db0814279/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:27.428091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.479366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] MFA Rules not processed for user `6eae9e913f944ed4af0e4b95ff7fc8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:27.480621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:27.560906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5674214-fea4-4a53-a6e3-f45c730a2155 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.568885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd658f29-614f-4cee-8431-c270faf94f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.569509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658f29-614f-4cee-8431-c270faf94f05 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.571266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658f29-614f-4cee-8431-c270faf94f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.571266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd658f29-614f-4cee-8431-c270faf94f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.571663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658f29-614f-4cee-8431-c270faf94f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:27.573289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd658f29-614f-4cee-8431-c270faf94f05 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.589036 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1533/3067] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:27.590998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.591314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.591587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.597177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1535/3068] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:27.598356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.616725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031a83-ec64-4e31-b035-a3c4eed507a8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.622788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.623434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.623718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.623994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.624961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:27.626911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.631074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:27.636941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:27.638355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:27.642015 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1536/3069] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:27.644045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.646390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:27.660404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1534/3070] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:27.662023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.672612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cd07e-12b6-4c61-bb8a-a0c8f062a01e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.679242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee77da9-341c-4287-aa2d-29c290688ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.680048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77da9-341c-4287-aa2d-29c290688ada admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.680449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77da9-341c-4287-aa2d-29c290688ada admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.680826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77da9-341c-4287-aa2d-29c290688ada admin admin] PATH_INFO: `/v3/projects/3c59921d81e2460882f0f8e5f3c31420/users/587ede0cf3124d19b42e58e1ae8dbf2b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.701123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:27.704878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee77da9-341c-4287-aa2d-29c290688ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c59921d81e2460882f0f8e5f3c31420, user_id=587ede0cf3124d19b42e58e1ae8dbf2b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:27.709512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee77da9-341c-4287-aa2d-29c290688ada admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.758019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed673993-c2a4-445a-92ac-da13eb93c130 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.765752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.766399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.766685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.766965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.776600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:27.779863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:27.791485 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1537/3071] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:27.792643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:27.793989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:27.835996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1535/3072] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:27 2022] PUT /identity/v3/projects/3c59921d81e2460882f0f8e5f3c31420/users/587ede0cf3124d19b42e58e1ae8dbf2b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:27.846726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105057f-abde-4733-84d8-727706ed025c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.860140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105057f-abde-4733-84d8-727706ed025c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.860140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105057f-abde-4733-84d8-727706ed025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:27.874685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd8e90-f310-45a8-b7e5-c283f463a6ae service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:27.927706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f105057f-abde-4733-84d8-727706ed025c None None] MFA Rules not processed for user `587ede0cf3124d19b42e58e1ae8dbf2b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:27.928983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f105057f-abde-4733-84d8-727706ed025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:27.938677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:27.939329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:27.939611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:27.940316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:28.022751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:28.024473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:28.045082 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1536/3073] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:28.049107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105057f-abde-4733-84d8-727706ed025c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:28.053931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1538/3074] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:28.099385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105057f-abde-4733-84d8-727706ed025c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:28.117279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:28.118301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:28.118763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:28.119317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:28.122031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:28.125118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:28.132184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:28.546085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1537/3075] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:28 2022] POST /identity/v3/projects => generated 375 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:28.551348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:28.563905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e97995-afe3-471d-ab00-994746e84713 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:28.654869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:28.655537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:28.655837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:28.656098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:28.656892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:28.658845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:28.764428 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1539/3076] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:28 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:28.765832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:28.779877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a583-78af-4b65-8ea9-10ade3f18d7a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:28.787309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:28.788151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:28.788365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:28.788720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:28.789448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:28.792028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:28.822330 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1538/3077] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:28.825087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:28.837374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60dcc-8389-4783-8529-72d3f1ff9754 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:28.842937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:28.848190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:28.848190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:28.848190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] PATH_INFO: `/v3/projects/ce16afffc2a84817ba56f3da30e787c8/users/f3367134c1a34d78a3bd046b93ffb86d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:28.867713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce16afffc2a84817ba56f3da30e787c8, user_id=f3367134c1a34d78a3bd046b93ffb86d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:28.871080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:28.998763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1540/3078] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:28 2022] PUT /identity/v3/projects/ce16afffc2a84817ba56f3da30e787c8/users/f3367134c1a34d78a3bd046b93ffb86d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:29.000666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:29.023971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f742372-cfe4-481b-b776-40a08da5116b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:29.093127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:29.150825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa16813-d6cb-4714-b5c3-ff764d8a5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:29.152718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16813-d6cb-4714-b5c3-ff764d8a5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:29.153677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16813-d6cb-4714-b5c3-ff764d8a5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:29.154466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa16813-d6cb-4714-b5c3-ff764d8a5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:29.155982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16813-d6cb-4714-b5c3-ff764d8a5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:29.162765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa16813-d6cb-4714-b5c3-ff764d8a5b5f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:29.192773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:29.199922 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1539/3079] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:29.207154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961d430-885e-4aab-af40-14bbd0f8ff6e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:29.218624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:29.219889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:29.220762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:29.225588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] PATH_INFO: `/v3/projects/ce16afffc2a84817ba56f3da30e787c8/users/f3367134c1a34d78a3bd046b93ffb86d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:29.229055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce16afffc2a84817ba56f3da30e787c8, user_id=f3367134c1a34d78a3bd046b93ffb86d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:29.233459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:29.257644 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1541/3080] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:29 2022] PUT /identity/v3/projects/ce16afffc2a84817ba56f3da30e787c8/users/f3367134c1a34d78a3bd046b93ffb86d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:29.269880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:29.270174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:29.270455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:29.310061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] MFA Rules not processed for user `f3367134c1a34d78a3bd046b93ffb86d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:29.311334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:29.473523 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1540/3081] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:29.480575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:29.493117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9041a-140f-4900-8466-35c3b48a3240 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:29.499267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:29.499968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:29.500502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:29.500862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:29.501614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:29.502797 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:29.502797 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:29.502797 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:29.504105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:29.654740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:29.655788 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1542/3082] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 10:56:29 2022] POST /identity/v3/domains => generated 245 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:29.672062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885896f-31b5-434c-8cc8-c7f49b134f24 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:29.808816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:29.810188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:29.810580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:29.811117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:29.811863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:29.813991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:30.039216 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1541/3083] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:29 2022] POST /identity/v3/projects => generated 408 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:30.041562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:30.058177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699296c-ada6-4ef1-8555-396e792ced53 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:30.196694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:30.197622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:30.203866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:30.204422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:30.205282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:30.207730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:30.364975 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1543/3084] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:30 2022] POST /identity/v3/users => generated 347 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:30.369343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:30.381630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc87f7a-fce6-4038-ab46-d7a9843f4e68 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:30.390154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e059d-6832-44a7-9276-3c063f339811 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:30.390883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e059d-6832-44a7-9276-3c063f339811 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:30.394126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e059d-6832-44a7-9276-3c063f339811 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:30.394485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e059d-6832-44a7-9276-3c063f339811 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:30.397223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e059d-6832-44a7-9276-3c063f339811 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:30.402575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e059d-6832-44a7-9276-3c063f339811 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:30.419305 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1542/3085] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:30.420864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:30.429798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:30.433945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfe7ca-64a1-499a-a011-fc9b9ba5cd48 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:30.450528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55361e-640b-41ba-adb3-a90fb3e274bb tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:30.451514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55361e-640b-41ba-adb3-a90fb3e274bb tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:30.451835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55361e-640b-41ba-adb3-a90fb3e274bb tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:30.453017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55361e-640b-41ba-adb3-a90fb3e274bb tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/projects/c4f2a454b2bc4ceb932102a2a32bd581/users/6d60d58e7ffd4292bab6644de7e5179b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:30.509416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55361e-640b-41ba-adb3-a90fb3e274bb tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4f2a454b2bc4ceb932102a2a32bd581, user_id=6d60d58e7ffd4292bab6644de7e5179b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:30.512176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55361e-640b-41ba-adb3-a90fb3e274bb tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:32.794305 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1544/3086] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:30 2022] PUT /identity/v3/projects/c4f2a454b2bc4ceb932102a2a32bd581/users/6d60d58e7ffd4292bab6644de7e5179b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 2375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:32.799140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:32.799607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:32.799780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:32.878182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:33.006990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] MFA Rules not processed for user `6d60d58e7ffd4292bab6644de7e5179b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:33.008263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:33.051832 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1543/3087] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:32 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:33.053992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:33.054283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:33.054640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:33.121804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] MFA Rules not processed for user `6d60d58e7ffd4292bab6644de7e5179b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:33.124595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:33.155822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1545/3088] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:33 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:33.159122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:33.175479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac54a-25b3-40d7-afea-d5314c1ea0cf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:33.194123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d60d58e7ffd4292bab6644de7e5179b', 'user_domain_id': '85d8e7ad9d494d48af3a46190fe54c70', 'system_scope': None, 'project_id': 'c4f2a454b2bc4ceb932102a2a32bd581', 'project_domain_id': '85d8e7ad9d494d48af3a46190fe54c70', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:33.195673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:33.196137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:33.196582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:33.218859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:33.219875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:33.248700 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1544/3089] 10.222.0.20 () {56 vars in 1284 bytes} [Tue Sep 6 10:56:33 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:33.250461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:33.359103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393819-8b2b-49d1-a547-21486fa5574c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:33.364897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:33.366838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:33.366838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:33.367251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/users/6d60d58e7ffd4292bab6644de7e5179b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:33.369371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6d60d58e7ffd4292bab6644de7e5179b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:33.371157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:33.639234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d60d58e7ffd4292bab6644de7e5179b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:33.665956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d60d58e7ffd4292bab6644de7e5179b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:33.668906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d60d58e7ffd4292bab6644de7e5179b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:33.701087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d60d58e7ffd4292bab6644de7e5179b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:33.701833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d60d58e7ffd4292bab6644de7e5179b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:33.827238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1546/3090] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:33 2022] DELETE /identity/v3/users/6d60d58e7ffd4292bab6644de7e5179b => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:33.829380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:33.861058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06818cde-16ef-49b5-bb8e-ac01d05e5524 tempest-test_project-957064421 tempest-user-840152565] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:34.105191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:34.105874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:34.106164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:34.106445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/projects/c4f2a454b2bc4ceb932102a2a32bd581` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:34.107702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c4f2a454b2bc4ceb932102a2a32bd581)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:34.109671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:34.331202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f2a454b2bc4ceb932102a2a32bd581', 'request_id': 'req-81841829-052c-439e-859e-ca7b5e474711'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.346885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f2a454b2bc4ceb932102a2a32bd581', 'request_id': 'req-81841829-052c-439e-859e-ca7b5e474711'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.366307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f2a454b2bc4ceb932102a2a32bd581', 'request_id': 'req-81841829-052c-439e-859e-ca7b5e474711'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.553081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] The token cache is being invalidate because project c4f2a454b2bc4ceb932102a2a32bd581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:34.553669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.555369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.558093 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1545/3091] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:33 2022] DELETE /identity/v3/projects/c4f2a454b2bc4ceb932102a2a32bd581 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:34.562587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:34.564230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:34.589734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d5fe0-8f7d-4d37-ba5d-2865a4dc5577 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:34.748783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:34.771888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:34.772526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:34.773032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:34.773315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/domains/85d8e7ad9d494d48af3a46190fe54c70` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:34.774968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=85d8e7ad9d494d48af3a46190fe54c70)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:34.776047 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:34.776047 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:34.776047 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:34.780726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:34.815058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.815840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.834251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:34.836285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:34.878113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:34.961230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81841829-052c-439e-859e-ca7b5e474711 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:34.980570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.982484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:34.993527 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1547/3092] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:56:34 2022] PATCH /identity/v3/domains/85d8e7ad9d494d48af3a46190fe54c70 => generated 246 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:35.001414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:35.007699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:35.135180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:35.135882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:35.136512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:35.137105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] PATH_INFO: `/v3/users/6eae9e913f944ed4af0e4b95ff7fc8f7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:35.138613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eae9e913f944ed4af0e4b95ff7fc8f7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:35.141261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:35.303353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3f1f-da49-4986-85b5-9dcdcb5f0faf tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:35.309554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3367134c1a34d78a3bd046b93ffb86d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce16afffc2a84817ba56f3da30e787c8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:35.310206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:35.310491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:35.310764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] PATH_INFO: `/v3/domains/85d8e7ad9d494d48af3a46190fe54c70` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:35.330777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=85d8e7ad9d494d48af3a46190fe54c70)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:35.333803 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:35.333803 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:35.333803 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:35.334735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:35.421563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.453966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eae9e913f944ed4af0e4b95ff7fc8f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.485261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eae9e913f944ed4af0e4b95ff7fc8f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.486400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eae9e913f944ed4af0e4b95ff7fc8f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.487307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eae9e913f944ed4af0e4b95ff7fc8f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.516743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.523754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0665fe0b-42c4-4670-9b58-c3126078f4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eae9e913f944ed4af0e4b95ff7fc8f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.621939 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1546/3093] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:34 2022] DELETE /identity/v3/users/6eae9e913f944ed4af0e4b95ff7fc8f7 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:35.626927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:35.627488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:35.628512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:35.658365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:35.659864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:35.685567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70', 'request_id': 'req-0e893be1-bc74-4c3b-81e2-ea87353ece56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.698509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70', 'request_id': 'req-0e893be1-bc74-4c3b-81e2-ea87353ece56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.706545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70', 'request_id': 'req-0e893be1-bc74-4c3b-81e2-ea87353ece56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.835030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1547/3094] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:35.846017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:35.847839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:35.948484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] The token cache is being invalidate because project 85d8e7ad9d494d48af3a46190fe54c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:35.948484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.949135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:35.950090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40d8ce-f620-45dc-b659-9af94dda28e2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:35.968994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:35.969972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:35.970868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:35.971433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:35.979275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:35.999857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70', 'request_id': 'req-0e893be1-bc74-4c3b-81e2-ea87353ece56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.001306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70', 'request_id': 'req-0e893be1-bc74-4c3b-81e2-ea87353ece56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.006661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:36.009064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '85d8e7ad9d494d48af3a46190fe54c70', 'request_id': 'req-0e893be1-bc74-4c3b-81e2-ea87353ece56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.009475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f784b-7fb6-4724-a17a-3aca110e8284 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:36.033358 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1548/3095] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:56:34 2022] DELETE /identity/v3/domains/85d8e7ad9d494d48af3a46190fe54c70 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:36.034818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:36.044672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:36.051328 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1548/3096] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:36.110246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e893be1-bc74-4c3b-81e2-ea87353ece56 tempest-TestDefaultProjectId-273864650 tempest-TestDefaultProjectId-273864650-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:36.128674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:36.130131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:36.131224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:36.131681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] PATH_INFO: `/v3/users/587ede0cf3124d19b42e58e1ae8dbf2b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:36.133755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587ede0cf3124d19b42e58e1ae8dbf2b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:36.138153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:36.414216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587ede0cf3124d19b42e58e1ae8dbf2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.423432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587ede0cf3124d19b42e58e1ae8dbf2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.424631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587ede0cf3124d19b42e58e1ae8dbf2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.448359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587ede0cf3124d19b42e58e1ae8dbf2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.449207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587ede0cf3124d19b42e58e1ae8dbf2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:36.568341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1549/3097] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:36 2022] DELETE /identity/v3/users/587ede0cf3124d19b42e58e1ae8dbf2b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:36.582901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:36.582901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:36.582901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:36.647302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:36.647566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:36.810151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1549/3098] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:36.851914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:36.853405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:36.940023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:37.037199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e9c4-751d-4cdf-a030-77ec833104d8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:37.043622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990611f8-d46f-4173-a526-d144e9b8058d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:37.044269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990611f8-d46f-4173-a526-d144e9b8058d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:37.045154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990611f8-d46f-4173-a526-d144e9b8058d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:37.045617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990611f8-d46f-4173-a526-d144e9b8058d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:37.061671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990611f8-d46f-4173-a526-d144e9b8058d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:37.063760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990611f8-d46f-4173-a526-d144e9b8058d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:37.087345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1550/3099] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:37.596233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:37.721093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:37.722580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:37.746945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545f15-30e2-4e7a-824a-cf6f1c5e03e9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:37.765826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:37.767380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:37.774776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:37.774776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] PATH_INFO: `/v3/projects/7cac31aec7f344608d2dcb2b9d392a88` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:37.774776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cac31aec7f344608d2dcb2b9d392a88)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:37.777651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:37.995629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cac31aec7f344608d2dcb2b9d392a88', 'request_id': 'req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.006629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cac31aec7f344608d2dcb2b9d392a88', 'request_id': 'req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.016404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cac31aec7f344608d2dcb2b9d392a88', 'request_id': 'req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.169998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] The token cache is being invalidate because project 7cac31aec7f344608d2dcb2b9d392a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:38.170741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.173352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8a809a14-be6b-4e27-a2f7-ffbe9bfec685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.175519 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1550/3100] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:37 2022] DELETE /identity/v3/projects/7cac31aec7f344608d2dcb2b9d392a88 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:38.181208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:38.183361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:38.183903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:38.242812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:38.244085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:38.364699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:38.365451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:38.370465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:38.392107 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1551/3101] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:38.416552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:38.419927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:38.435755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:38.441580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1551/3102] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:38.448360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c0330-62ee-4dc4-8bd0-6e9b8eaaa030 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:38.453736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:38.455474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:38.455921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:38.456464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:38.457300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:38.457900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:38.461003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:38.485608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:38.490750 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1552/3103] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:38.508882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40bdc6-b153-4b8c-b038-4d653cd461cf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:38.524047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:38.524901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:38.525346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:38.525771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:38.526578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:38.529670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:38.543633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:38.545787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:38.573689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33dd03-6194-4975-8c94-91819da490e5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:38.597516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:38.599949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:38.602447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:38.602956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] PATH_INFO: `/v3/projects/3c59921d81e2460882f0f8e5f3c31420` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:38.606708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c59921d81e2460882f0f8e5f3c31420)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:38.608599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:38.685637 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1552/3104] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:38 2022] POST /identity/v3/projects => generated 395 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:38.692050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:38.872253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec825-9870-4bd9-a7d0-096534921498 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:38.900959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:38.902943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:38.913947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:38.914709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:38.916189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:38.922988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:38.936079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c59921d81e2460882f0f8e5f3c31420', 'request_id': 'req-09840a9d-b03e-41d3-b012-963ff0c67d25'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.954400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c59921d81e2460882f0f8e5f3c31420', 'request_id': 'req-09840a9d-b03e-41d3-b012-963ff0c67d25'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:38.963824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c59921d81e2460882f0f8e5f3c31420', 'request_id': 'req-09840a9d-b03e-41d3-b012-963ff0c67d25'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.054733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1553/3105] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:38 2022] POST /identity/v3/users => generated 298 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:39.059859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:39.075575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] The token cache is being invalidate because project 3c59921d81e2460882f0f8e5f3c31420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:39.084295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.088388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.093194 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1553/3106] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:38 2022] DELETE /identity/v3/projects/3c59921d81e2460882f0f8e5f3c31420 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:39.098284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:39.100246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:39.106242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fc853-1d9c-4f88-8197-a858bd2d2113 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:39.327819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09840a9d-b03e-41d3-b012-963ff0c67d25 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:39.329131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:39.330183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:39.330627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:39.331108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:39.331930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:39.334284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:39.345264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:39.346343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:39.346998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:39.347502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] PATH_INFO: `/v3/users/f3367134c1a34d78a3bd046b93ffb86d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:39.350623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3367134c1a34d78a3bd046b93ffb86d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:39.353000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:39.367614 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1554/3107] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:39.371590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:39.384401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:39.418125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847243de-c371-45df-9bfa-098fa6a1ca04 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:39.436039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:39.437601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:39.438094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:39.438582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:39.439468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:39.441284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:39.468194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1555/3108] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:39.469576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:39.494583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b03dec-7cc3-4a56-a6b7-12ad32042fc6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:39.513271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca71b5-05dc-4004-93d1-281178eea3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:39.513271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca71b5-05dc-4004-93d1-281178eea3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:39.513271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca71b5-05dc-4004-93d1-281178eea3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:39.513271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca71b5-05dc-4004-93d1-281178eea3d3 admin admin] PATH_INFO: `/v3/projects/51221f48f93c438e917c85eeb8b38905/users/f9e3d28d181b4097a4c98ecdeb55dba1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:39.549072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca71b5-05dc-4004-93d1-281178eea3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51221f48f93c438e917c85eeb8b38905, user_id=f9e3d28d181b4097a4c98ecdeb55dba1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:39.553117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca71b5-05dc-4004-93d1-281178eea3d3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:39.631983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3367134c1a34d78a3bd046b93ffb86d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.641762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3367134c1a34d78a3bd046b93ffb86d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.642852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3367134c1a34d78a3bd046b93ffb86d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.658004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3367134c1a34d78a3bd046b93ffb86d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.659085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3367134c1a34d78a3bd046b93ffb86d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:39.703694 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1556/3109] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:39 2022] PUT /identity/v3/projects/51221f48f93c438e917c85eeb8b38905/users/f9e3d28d181b4097a4c98ecdeb55dba1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:39.717389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff29a1-4aa8-43e0-ba7f-ff023b18a31d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:39.717686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff29a1-4aa8-43e0-ba7f-ff023b18a31d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:39.717968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff29a1-4aa8-43e0-ba7f-ff023b18a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:39.767602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e8ff29a1-4aa8-43e0-ba7f-ff023b18a31d None None] MFA Rules not processed for user `f9e3d28d181b4097a4c98ecdeb55dba1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:39.769002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e8ff29a1-4aa8-43e0-ba7f-ff023b18a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:39.827052 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1554/3110] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:39 2022] DELETE /identity/v3/users/f3367134c1a34d78a3bd046b93ffb86d => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:39.878127 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1557/3111] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:39.887118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:39.893606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:40.079289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59e5c0-ee1f-4106-82fe-67518bbfe0eb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:40.089393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:40.090052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:40.090344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:40.090631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:40.207587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:40.209647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:40.311416 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1555/3112] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:40.416201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:40.416464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:40.416670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:40.461142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] MFA Rules not processed for user `f9e3d28d181b4097a4c98ecdeb55dba1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:40.463985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:40.472922 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1558/3113] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:40.776581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:40.778320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:40.924172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e788f-5672-48d5-a65e-0290244bb0b9 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:40.932572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:40.933037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:40.933425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:40.933782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] PATH_INFO: `/v3/projects/ce16afffc2a84817ba56f3da30e787c8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:40.935045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce16afffc2a84817ba56f3da30e787c8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:40.937070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:41.037607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:41.042449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:41.075238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95613917-4684-4d28-acb2-e8c0e3bedba5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:41.083302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:41.088100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:41.088100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:41.088100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] PATH_INFO: `/v3/users/f9e3d28d181b4097a4c98ecdeb55dba1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:41.088100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e3d28d181b4097a4c98ecdeb55dba1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:41.089563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:41.145692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce16afffc2a84817ba56f3da30e787c8', 'request_id': 'req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.157928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce16afffc2a84817ba56f3da30e787c8', 'request_id': 'req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.168803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce16afffc2a84817ba56f3da30e787c8', 'request_id': 'req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.299509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] The token cache is being invalidate because project ce16afffc2a84817ba56f3da30e787c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:41.300280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.301442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c17a37a4-e19d-49f6-bfd3-04b92c7da5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.305731 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1556/3114] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:40 2022] DELETE /identity/v3/projects/ce16afffc2a84817ba56f3da30e787c8 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:41.310490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34611bb-51f7-4836-82ae-f9e78635f71e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:41.311175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34611bb-51f7-4836-82ae-f9e78635f71e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:41.311891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34611bb-51f7-4836-82ae-f9e78635f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:41.365389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d34611bb-51f7-4836-82ae-f9e78635f71e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:41.409333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d34611bb-51f7-4836-82ae-f9e78635f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:41.428441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e3d28d181b4097a4c98ecdeb55dba1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.522648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:41.528254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e3d28d181b4097a4c98ecdeb55dba1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.528254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e3d28d181b4097a4c98ecdeb55dba1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.529585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e3d28d181b4097a4c98ecdeb55dba1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.607947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:41.608878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5afa09d8-1bd7-4743-83e5-15cd3073acd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e3d28d181b4097a4c98ecdeb55dba1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:41.706148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1557/3115] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:41.725357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1308c-5d4d-48a5-9598-3e2c975f2ac8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:41.725686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1308c-5d4d-48a5-9598-3e2c975f2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:41.726650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1308c-5d4d-48a5-9598-3e2c975f2ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:41.769580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1559/3116] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:41 2022] DELETE /identity/v3/users/f9e3d28d181b4097a4c98ecdeb55dba1 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:41.769580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:41.769580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:41.769580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:41.795099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-50b1308c-5d4d-48a5-9598-3e2c975f2ac8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:41.796644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-50b1308c-5d4d-48a5-9598-3e2c975f2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:41.825376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:41.828708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:41.926390 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1558/3117] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:41.928041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:41.928351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:41.928622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:41.957722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1560/3118] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:41.957722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:41.977158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] MFA Rules not processed for user `2d0621ebe85c47c383137b4db0814279`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:41.978545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:41.981619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c405bec-25c9-4624-bfac-f374d2b71059 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:41.991170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:41.992241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:41.992851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:41.993702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:41.994538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:41.995047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:41.998159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.020244 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1561/3119] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:42.022119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.026191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:42.095160 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1559/3120] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:42.096641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.135655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d0dce-9a91-41e3-ae2b-fd023d1565d5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.169438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.171394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.171394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.171394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.171394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.173250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.179863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036526-8fdc-4aa8-a8a5-5fb88a0c62c6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.184774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c929-b02f-4e5b-a944-de1f13f5ac3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.192480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c929-b02f-4e5b-a944-de1f13f5ac3e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.192480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c929-b02f-4e5b-a944-de1f13f5ac3e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.192480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c929-b02f-4e5b-a944-de1f13f5ac3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.201109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c929-b02f-4e5b-a944-de1f13f5ac3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.204013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c929-b02f-4e5b-a944-de1f13f5ac3e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.236322 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1562/3121] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:42.237795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.238061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.238523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.272382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] MFA Rules not processed for user `2d0621ebe85c47c383137b4db0814279`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:42.273620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:42.282889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1563/3122] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:42.299458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.301206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:42.352178 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1560/3123] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:42 2022] POST /identity/v3/projects => generated 387 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:42.358841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.422794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f736d6-4f4c-4f4b-a041-b4145e79d697 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.514168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e9f1-6640-4c85-b750-ed27de264b11 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.523602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.523602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.523602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.523602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.524476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.525350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.573426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.574061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.574352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.579795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.666402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.668207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.678078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1564/3124] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:42.697383 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1561/3125] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:42 2022] POST /identity/v3/users => generated 294 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:42.700542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.719195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc14c-cc4e-4c14-954e-23009f51fd0b service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.730922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.731819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.732319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.732800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.733640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.735644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.751296 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1565/3126] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:42.756286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.782389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85881a93-c72f-44c3-a08c-709c5d110159 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.788137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.788800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.789612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.789612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.790000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.791830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.804406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1562/3127] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:42.808640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.821162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6b37b-cf7a-4bea-8718-4a0a73db2d56 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.828507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.829231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.829511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.829841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] PATH_INFO: `/v3/projects/bd7c9ce5c4b640c8b1e4faa27a5c3ae1/users/8c29f14008ea464da6972482f2496ab1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.861333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7c9ce5c4b640c8b1e4faa27a5c3ae1, user_id=8c29f14008ea464da6972482f2496ab1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.864170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:42.892104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:42.895153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:42.934730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c048b-6147-41d9-8770-9fc4e41b1ce9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:42.945133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:42.946090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:42.946582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:42.947611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] PATH_INFO: `/v3/projects/51221f48f93c438e917c85eeb8b38905` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:42.949313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51221f48f93c438e917c85eeb8b38905)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:42.952525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:43.055256 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1566/3128] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:42 2022] PUT /identity/v3/projects/bd7c9ce5c4b640c8b1e4faa27a5c3ae1/users/8c29f14008ea464da6972482f2496ab1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:43.056972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:43.123280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51221f48f93c438e917c85eeb8b38905', 'request_id': 'req-90151eec-b78f-45f6-b860-85455684aab4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:43.127423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344a719-8c3b-4687-b920-30d30df95d41 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:43.134529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51221f48f93c438e917c85eeb8b38905', 'request_id': 'req-90151eec-b78f-45f6-b860-85455684aab4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:43.140811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51221f48f93c438e917c85eeb8b38905', 'request_id': 'req-90151eec-b78f-45f6-b860-85455684aab4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:43.205063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:43.206558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.206846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.207285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.209885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:43.223736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:43.226236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942c0b9-af18-4b4b-8ba1-2f5fc8ab9798 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:43.235637 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1567/3129] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:43.236859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.237161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.237442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.282064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] MFA Rules not processed for user `8c29f14008ea464da6972482f2496ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:43.283427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:43.357789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1568/3130] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:43.370407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:43.377503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] The token cache is being invalidate because project 51221f48f93c438e917c85eeb8b38905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:43.378044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:43.379884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-90151eec-b78f-45f6-b860-85455684aab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:43.386624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1563/3131] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:42 2022] DELETE /identity/v3/projects/51221f48f93c438e917c85eeb8b38905 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:43.390682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646cb03-6627-4955-a019-cb6bbc508582 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.392141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646cb03-6627-4955-a019-cb6bbc508582 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.395516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646cb03-6627-4955-a019-cb6bbc508582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.428621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d646cb03-6627-4955-a019-cb6bbc508582 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:43.430573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d646cb03-6627-4955-a019-cb6bbc508582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:43.519142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773f2f-868f-4ea8-bc57-a05d300e0465 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:43.527263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639962-ebab-4398-9b86-9fd97b204791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:43.528612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639962-ebab-4398-9b86-9fd97b204791 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.529215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639962-ebab-4398-9b86-9fd97b204791 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.530119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639962-ebab-4398-9b86-9fd97b204791 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.531940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639962-ebab-4398-9b86-9fd97b204791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:43.534585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639962-ebab-4398-9b86-9fd97b204791 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:43.587404 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1564/3132] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:43.591397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.592247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.592761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.636963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:43.638286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:43.659063 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1565/3133] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:43.662144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:43.675631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6e56c-fdd3-4d4e-964f-dd19dbaa47d6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:43.681383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:43.681998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.682283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.682559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.684357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:43.684357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:43.685481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:43.705098 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1566/3134] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:43.709756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:43.729455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1569/3135] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/projects => generated 387 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:43.730908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.731251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.731528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.733229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5621-016e-43d2-9541-8c8b3bf491d8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:43.764541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:43.766198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:43.814527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:43.814527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.817528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.817528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.817528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:43.819334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:43.863498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1570/3136] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:43.864491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:43.872885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:43.911255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f47b-7e03-4c93-a973-691f64da81a6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:43.918751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:43.919346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:43.919631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:43.919950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:43.920581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:43.922703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.021594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1567/3137] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/projects => generated 403 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:44.033123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.038700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:44.063673 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1571/3138] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:43 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:44.079393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.089592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc58e9-831b-4479-9550-796f4e7db1e0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.184534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.185812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.185812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.186043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.187731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.190969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.232851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579596df-5a8e-42b0-959e-520714407f8a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.258940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.259626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.263137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.263137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.351800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.353277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.362304 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1568/3139] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:56:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:56:44.364413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.364858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1572/3140] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:44 2022] POST /identity/v3/users => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:44.369061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.374476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29922-96ad-478e-acce-c1b388c4bdb8 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.382961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.383975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.384134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc200a32-577a-4f7a-8a30-a64abf373002 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.384692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.385250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.386260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.388356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.392100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.393001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.393691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.394191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.395449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.398670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.404276 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1569/3141] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:44.410607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.418467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1573/3142] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:44.424957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.429568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a8e2-a60d-4165-8931-734d4be8e32d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.434267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.435046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.435326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.435599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] PATH_INFO: `/v3/projects/217afb00f7084d1fa6ed153ace50acd9/users/f78c5a3a35444195b3737387d46633eb/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.439069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1587f0a-2b8b-41e0-bbfd-9e750b22d720 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.444665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.445272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.445556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.445833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.446472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.448147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.454659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217afb00f7084d1fa6ed153ace50acd9, user_id=f78c5a3a35444195b3737387d46633eb, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.457525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.460027 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1574/3143] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:44.463801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.474746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe5e6-860d-404e-bdae-87385c84a799 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.479571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656d636-82ae-4abd-a216-8b2fa69d84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.480225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d636-82ae-4abd-a216-8b2fa69d84ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.480643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d636-82ae-4abd-a216-8b2fa69d84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.480937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d636-82ae-4abd-a216-8b2fa69d84ff admin admin] PATH_INFO: `/v3/projects/c79ebbb3d4ce4d65ae47fb0afb9e7855/users/d267ab5434dc4119b770fb853f199112/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.484585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:44.499614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656d636-82ae-4abd-a216-8b2fa69d84ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79ebbb3d4ce4d65ae47fb0afb9e7855, user_id=d267ab5434dc4119b770fb853f199112, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.502339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656d636-82ae-4abd-a216-8b2fa69d84ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.574198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:44.583180 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1570/3144] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:44 2022] PUT /identity/v3/projects/217afb00f7084d1fa6ed153ace50acd9/users/f78c5a3a35444195b3737387d46633eb/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:44.583948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.660225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117f1db-939f-42af-95f2-1d25bd25c790 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.665350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.665967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.666253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.666530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.667206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.673490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.686272 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1571/3145] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:44.690529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.703373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450dbaa-13b2-49b7-a7b8-132a0703a8a6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:44.708791 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1575/3146] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:44 2022] PUT /identity/v3/projects/c79ebbb3d4ce4d65ae47fb0afb9e7855/users/d267ab5434dc4119b770fb853f199112/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:44.713540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.713942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.714161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.736655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:44.738361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:44.814105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2755c-2e3d-47dc-889a-1b27bc2b1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:44.814916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2755c-2e3d-47dc-889a-1b27bc2b1f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.815490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2755c-2e3d-47dc-889a-1b27bc2b1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.815779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2755c-2e3d-47dc-889a-1b27bc2b1f54 admin admin] PATH_INFO: `/v3/projects/217afb00f7084d1fa6ed153ace50acd9/users/f78c5a3a35444195b3737387d46633eb/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.819564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2755c-2e3d-47dc-889a-1b27bc2b1f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217afb00f7084d1fa6ed153ace50acd9, user_id=f78c5a3a35444195b3737387d46633eb, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:44.822879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2755c-2e3d-47dc-889a-1b27bc2b1f54 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:44.827609 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1576/3147] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:44.837703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1572/3148] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:44 2022] PUT /identity/v3/projects/217afb00f7084d1fa6ed153ace50acd9/users/f78c5a3a35444195b3737387d46633eb/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:44.837970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:44.839408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:44.848185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:44.848475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:44.848754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:44.885390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] MFA Rules not processed for user `f78c5a3a35444195b3737387d46633eb`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:44.887321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:44.920755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9808166-8919-4abd-ad6b-78fd5c5e9b54 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.013416 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1573/3149] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:45.017809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.025210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.025986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.026564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.026854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.027692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96010b13-5bcb-4cb3-8d63-ad2659f4b76b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.032544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.033100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.033383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.033662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.034724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.035401 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:45.035401 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:45.035401 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:45.036412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.110160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.111649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.125917 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1577/3150] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:56:45.147273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.147661 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1574/3151] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:45 2022] POST /identity/v3/services => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:45.168220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c292-1be5-47d9-8597-4a72dbbb5046 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.192555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.198405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.198405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.198405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.198405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.198972 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:45.198972 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:45.198972 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:45.198972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: On instance['enabled']: Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: On instance['enabled']: Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: 'False' Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise error Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'False' Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.254897 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 10:56:45.257304 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'False' Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.258745 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1578/3152] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:45 2022] POST /identity/v3/endpoints => generated 283 bytes in 111 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 10:56:45.261857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.275023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c0d31-74ad-47fd-afdb-618f2228d652 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.280693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.281297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.281583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.281859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.282613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.283591 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:45.283591 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:45.283591 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:45.284556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: On instance['enabled']: Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: On instance['enabled']: Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: 'True' Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise error Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application 'True' Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.296648 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 10:56:45.298270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application 'True' Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:56:45.300063 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1575/3153] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:45 2022] POST /identity/v3/endpoints => generated 281 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 06 10:56:45.301095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.313283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4114-1cbb-4550-aa81-b65625987276 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.319082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.319821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.323534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.323534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.323534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.323534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.503029 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1071957136. To ensure interoperability, identifiers should be a valid uuid. Sep 06 10:56:45.503029 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 10:56:45.503029 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:45.714276 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1579/3154] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:45 2022] POST /identity/v3/endpoints => generated 361 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:45.718635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.731788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5949-a4e4-4fb8-9f90-8320327c22d4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.754903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.755630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.755915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.756532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/regions/tempest-region-1071957136` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.757169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1071957136)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.758264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.763395 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1576/3155] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 10:56:45 2022] GET /identity/v3/regions/tempest-region-1071957136 => generated 180 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:45.764883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.788775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f64e1b-34d8-47ad-8664-d0c9cf62990b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.805272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.805931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.806219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.806555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints/18ba77c82444489ebe72cf00a73c84b1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.813876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=18ba77c82444489ebe72cf00a73c84b1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.814973 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:45.814973 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:45.814973 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:45.815930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: On instance['enabled']: Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: On instance['enabled']: Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: 'False' Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise error Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'False' Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.824388 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 10:56:45.826264 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'False' Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:45.827465 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1580/3156] 10.222.0.20 () {60 vars in 1255 bytes} [Tue Sep 6 10:56:45 2022] PATCH /identity/v3/endpoints/18ba77c82444489ebe72cf00a73c84b1 => generated 283 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 06 10:56:45.829926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:45.857841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fc2f-16d3-47d9-af85-54d98a3a3250 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:45.863354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:45.864440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:45.864840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:45.865138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints/18ba77c82444489ebe72cf00a73c84b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:45.866490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=18ba77c82444489ebe72cf00a73c84b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:45.867617 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:45.867617 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:45.867617 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:45.871489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:46.038905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '18ba77c82444489ebe72cf00a73c84b1', 'request_id': 'req-b57c6168-7890-4848-9723-5a36cc3a7684'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:46.056249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1577/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:45 2022] DELETE /identity/v3/endpoints/18ba77c82444489ebe72cf00a73c84b1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:46.062479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:46.078631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a3a2-6c5d-42da-a906-b053bf766248 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:46.093851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:46.094673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.094952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.095256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/regions/tempest-region-1071957136` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.095831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1071957136)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:46.096832 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:46.096832 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:46.096832 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:46.097785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:46.200764 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1581/3158] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 10:56:46 2022] DELETE /identity/v3/regions/tempest-region-1071957136 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:46.201795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:46.214184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c6168-7890-4848-9723-5a36cc3a7684 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:46.235238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:46.236395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.237307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.237782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.238647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:46.241111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:46.377937 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-73cddb8e-4ec7-485e-8c51-e365715ff2e4 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-208540391. To ensure interoperability, identifiers should be a valid uuid. Sep 06 10:56:46.377937 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 10:56:46.377937 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:46.535454 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1578/3159] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 10:56:46 2022] POST /identity/v3/endpoints => generated 357 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:46.539362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:46.559984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:46.560184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.560184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.568412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.581293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04cb20-899a-47f9-a367-728d4a1d1185 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:46.630183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] MFA Rules not processed for user `d79046739b2d4572b0aedef59e621ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:46.634854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:46.635884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.636393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.636749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:46.637245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/regions/tempest-region-208540391` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.638042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-208540391)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:46.640202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:46.650105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1582/3160] 10.222.0.20 () {58 vars in 1203 bytes} [Tue Sep 6 10:56:46 2022] GET /identity/v3/regions/tempest-region-208540391 => generated 178 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:46.652038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:46.664518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8b9db-49d2-40b2-831b-17e2ddd1a6ab tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:46.670085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:46.670924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.671896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.672517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints/937a85782d744d31ad02ba8ab11457e8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.680757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=937a85782d744d31ad02ba8ab11457e8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:46.695547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: On instance['enabled']: Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: On instance['enabled']: Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: 'True' Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise error Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'True' Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.709979 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 10:56:46.712035 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['enabled']: Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'True' Sep 06 10:56:46.713889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:56:46.716455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1583/3161] 10.222.0.20 () {60 vars in 1255 bytes} [Tue Sep 6 10:56:46 2022] PATCH /identity/v3/endpoints/937a85782d744d31ad02ba8ab11457e8 => generated 281 bytes in 65 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 10:56:46.717446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:46.742581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b406f-3454-43dd-8107-9d8d40ea097c tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:46.748871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:46.749510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.749794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.750071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/endpoints/937a85782d744d31ad02ba8ab11457e8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.751439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=937a85782d744d31ad02ba8ab11457e8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:46.752463 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:46.752463 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:46.752463 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:46.762974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:46.766900 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1579/3162] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:46 2022] POST /identity/v3/auth/tokens => generated 3553 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:46.873873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '937a85782d744d31ad02ba8ab11457e8', 'request_id': 'req-921584e6-5e37-4211-8f11-c7cc75776e09'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:46.889715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1584/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 10:56:46 2022] DELETE /identity/v3/endpoints/937a85782d744d31ad02ba8ab11457e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:46.893559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:46.924190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761eaca-1caf-45ec-be0e-f8f1d387bf74 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:46.982547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:46.983234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:46.988667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:46.988667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/regions/tempest-region-208540391` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:46.988667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-208540391)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:46.998127 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:46.998127 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:46.998127 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:46.999600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:47.199632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1580/3164] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 10:56:46 2022] DELETE /identity/v3/regions/tempest-region-208540391 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:47.200929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:47.218653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921584e6-5e37-4211-8f11-c7cc75776e09 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:47.307214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f78c5a3a35444195b3737387d46633eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217afb00f7084d1fa6ed153ace50acd9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:47.308419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:47.308810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:47.312592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] PATH_INFO: `/v3/services/63d53697992a4e0cb375bba3c4c9be88` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:47.312592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorizing `identity:delete_service(service_id=63d53697992a4e0cb375bba3c4c9be88)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:47.312592 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:47.312592 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:47.312592 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:47.318881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:47.457502 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1585/3165] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:47 2022] DELETE /identity/v3/services/63d53697992a4e0cb375bba3c4c9be88 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:47.459841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:47.501575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:47.504194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:47.508479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec5601-7023-4e4c-beec-51448c10446b tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:47.553658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:47.554584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:47.555059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:47.556508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] PATH_INFO: `/v3/users/8c29f14008ea464da6972482f2496ab1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:47.560509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c29f14008ea464da6972482f2496ab1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:47.564358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:47.726078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121a2c-f386-4c68-baa7-155ba706e229 tempest-EndpointsNegativeTestJSON-1570131865 tempest-EndpointsNegativeTestJSON-1570131865-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:47.746686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:47.746686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:47.746686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:47.746686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:47.748000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:47.806144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:47.914485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c29f14008ea464da6972482f2496ab1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:47.940273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:47.946308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c29f14008ea464da6972482f2496ab1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:47.947595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c29f14008ea464da6972482f2496ab1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:47.955705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb3dcb-50a9-49df-9289-004a457be8db service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:47.986334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c29f14008ea464da6972482f2496ab1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:47.988448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c29f14008ea464da6972482f2496ab1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:48.029324 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1586/3166] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:48.218402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1581/3167] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:47 2022] DELETE /identity/v3/users/8c29f14008ea464da6972482f2496ab1 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:48.223135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:48.223429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:48.223795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:48.263524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:48.264826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:48.427832 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1587/3168] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:48.947910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:48.949721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:49.070004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e3d8-ebb8-451b-af42-f2de194b3748 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:49.079155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2a7a2-8b43-4d0f-9433-412d5015ea1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:49.080050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a7a2-8b43-4d0f-9433-412d5015ea1e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:49.087712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a7a2-8b43-4d0f-9433-412d5015ea1e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:49.087712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a7a2-8b43-4d0f-9433-412d5015ea1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:49.120556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a7a2-8b43-4d0f-9433-412d5015ea1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:49.123280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a7a2-8b43-4d0f-9433-412d5015ea1e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:49.174606 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1582/3169] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:56:49.653900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:49.655454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:49.668868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a182993-ef78-4008-a425-97ad3abef6e4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:49.674152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:49.674850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:49.675178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:49.675463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] PATH_INFO: `/v3/users/3803365807284dee8e89eae93945fc9b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:49.676599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3803365807284dee8e89eae93945fc9b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:49.679361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:49.877266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:49.904525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3803365807284dee8e89eae93945fc9b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:49.925937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3803365807284dee8e89eae93945fc9b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:49.927602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3803365807284dee8e89eae93945fc9b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:49.928396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3803365807284dee8e89eae93945fc9b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:49.977777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3803365807284dee8e89eae93945fc9b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:50.074851 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1588/3170] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:49 2022] DELETE /identity/v3/users/3803365807284dee8e89eae93945fc9b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:50.079467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:50.080445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:50.080917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:50.129820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:50.131683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:50.197360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:50.306931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1583/3171] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:50.321671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:50.324532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:50.383648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:50.385356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:50.418295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf32b3-6d1f-4783-a2da-4f451223837a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:50.434976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:50.436582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:50.437078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:50.437528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] PATH_INFO: `/v3/projects/bd7c9ce5c4b640c8b1e4faa27a5c3ae1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:50.439440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7c9ce5c4b640c8b1e4faa27a5c3ae1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:50.444131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:50.498252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb91514-a3a1-4be2-9401-a04bb2d4c3f7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:50.507681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:50.508328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:50.508607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:50.508903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:50.523932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:50.525407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:50.537711 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1589/3172] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:50.654924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7c9ce5c4b640c8b1e4faa27a5c3ae1', 'request_id': 'req-55a35b2e-0b4e-4608-bc15-48a87e1c5429'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:50.683824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7c9ce5c4b640c8b1e4faa27a5c3ae1', 'request_id': 'req-55a35b2e-0b4e-4608-bc15-48a87e1c5429'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:50.694231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7c9ce5c4b640c8b1e4faa27a5c3ae1', 'request_id': 'req-55a35b2e-0b4e-4608-bc15-48a87e1c5429'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:50.793178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] The token cache is being invalidate because project bd7c9ce5c4b640c8b1e4faa27a5c3ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:50.793482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:50.794699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:50.802084 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1584/3173] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:50 2022] DELETE /identity/v3/projects/bd7c9ce5c4b640c8b1e4faa27a5c3ae1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:50.804083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:50.824744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a285-b5ad-42d0-a900-b00f250340ca service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:50.937019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:50.979867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:50.981003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:50.982706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:50.983850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] PATH_INFO: `/v3/users/f78c5a3a35444195b3737387d46633eb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:50.985922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78c5a3a35444195b3737387d46633eb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:50.988940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:51.404115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:51.405753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:51.445167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35b2e-0b4e-4608-bc15-48a87e1c5429 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:51.470786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78c5a3a35444195b3737387d46633eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.483465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:51.484115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:51.484403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:51.484680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] PATH_INFO: `/v3/projects/0c261994fe8c4d0a8b4ff35f26896dcc` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:51.487748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78c5a3a35444195b3737387d46633eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.488704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78c5a3a35444195b3737387d46633eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.490057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78c5a3a35444195b3737387d46633eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.499918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c261994fe8c4d0a8b4ff35f26896dcc)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:51.502005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:51.542911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78c5a3a35444195b3737387d46633eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.696958 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1590/3174] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:50 2022] DELETE /identity/v3/users/f78c5a3a35444195b3737387d46633eb => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:51.767307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c261994fe8c4d0a8b4ff35f26896dcc', 'request_id': 'req-d54da37d-cc0d-43f2-ab08-7b6e4635c430'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.793523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c261994fe8c4d0a8b4ff35f26896dcc', 'request_id': 'req-d54da37d-cc0d-43f2-ab08-7b6e4635c430'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:51.825597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c261994fe8c4d0a8b4ff35f26896dcc', 'request_id': 'req-d54da37d-cc0d-43f2-ab08-7b6e4635c430'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.006278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] The token cache is being invalidate because project 0c261994fe8c4d0a8b4ff35f26896dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:52.007725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.007725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.009462 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1585/3175] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:51 2022] DELETE /identity/v3/projects/0c261994fe8c4d0a8b4ff35f26896dcc => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:52.013672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:52.015973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:52.135526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb23c-e9d0-49d0-8ade-967b6f0a0e12 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:52.226416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:52.227244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:52.227529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:52.227808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] PATH_INFO: `/v3/users/f0c486f5a2c14bbe8aab8dd0d418192d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:52.229139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c486f5a2c14bbe8aab8dd0d418192d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:52.235931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:52.524181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c486f5a2c14bbe8aab8dd0d418192d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.537350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c486f5a2c14bbe8aab8dd0d418192d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.537350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c486f5a2c14bbe8aab8dd0d418192d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.537350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c486f5a2c14bbe8aab8dd0d418192d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.553520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c486f5a2c14bbe8aab8dd0d418192d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:52.735643 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1591/3176] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:52 2022] DELETE /identity/v3/users/f0c486f5a2c14bbe8aab8dd0d418192d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:53.110891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:53.110891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:53.123544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54da37d-cc0d-43f2-ab08-7b6e4635c430 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:53.219973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:53.220700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.221168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.221563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] PATH_INFO: `/v3/projects/217afb00f7084d1fa6ed153ace50acd9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.222771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217afb00f7084d1fa6ed153ace50acd9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:53.225373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:53.354027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:53.355680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:53.375317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7399ef7-33ba-4f08-81a6-07ec10e0c1d4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:53.380834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:53.381588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.381972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.382348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] PATH_INFO: `/v3/projects/1ecba9fe7a734c02a4ba559a205607c1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.383621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecba9fe7a734c02a4ba559a205607c1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:53.386927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:53.405119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217afb00f7084d1fa6ed153ace50acd9', 'request_id': 'req-24d8811e-d8cd-4a84-8791-2f6d80e51c94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.415411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217afb00f7084d1fa6ed153ace50acd9', 'request_id': 'req-24d8811e-d8cd-4a84-8791-2f6d80e51c94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.429822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217afb00f7084d1fa6ed153ace50acd9', 'request_id': 'req-24d8811e-d8cd-4a84-8791-2f6d80e51c94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.535364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] The token cache is being invalidate because project 217afb00f7084d1fa6ed153ace50acd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:53.536295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.538252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-24d8811e-d8cd-4a84-8791-2f6d80e51c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.541153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1586/3177] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:53 2022] DELETE /identity/v3/projects/217afb00f7084d1fa6ed153ace50acd9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:53.546312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469af2-9f0d-439a-b9e9-04a6d4f31823 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.546781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469af2-9f0d-439a-b9e9-04a6d4f31823 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.547250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469af2-9f0d-439a-b9e9-04a6d4f31823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.587283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecba9fe7a734c02a4ba559a205607c1', 'request_id': 'req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.604082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecba9fe7a734c02a4ba559a205607c1', 'request_id': 'req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.609064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b6469af2-9f0d-439a-b9e9-04a6d4f31823 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:53.611325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b6469af2-9f0d-439a-b9e9-04a6d4f31823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:53.619533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecba9fe7a734c02a4ba559a205607c1', 'request_id': 'req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.650972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:53.720477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1587/3178] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:53.728930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.730227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.730828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.742634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] The token cache is being invalidate because project 1ecba9fe7a734c02a4ba559a205607c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:53.743092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.745883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d05ce54c-2356-4781-828d-9c1ab9f8ce4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:53.752037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1592/3179] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:53 2022] DELETE /identity/v3/projects/1ecba9fe7a734c02a4ba559a205607c1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:53.753411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a358b6-db03-4ebd-bb3d-af1d86785742 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.753794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a358b6-db03-4ebd-bb3d-af1d86785742 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.754162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a358b6-db03-4ebd-bb3d-af1d86785742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.776801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:53.778867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:53.789767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b0a358b6-db03-4ebd-bb3d-af1d86785742 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:53.791828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0a358b6-db03-4ebd-bb3d-af1d86785742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:53.799492 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1588/3180] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:53.800830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:53.813508 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1593/3181] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:53.818013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.818013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.818013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.836543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067aa6e-7ffa-4ad7-8e49-88dcf0092453 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:53.852342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:53.853104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:53.853242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.853589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.854392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.855122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:53.855527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:53.855758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:53.857326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:53.875794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1594/3182] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:53.885254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:53.901219 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1589/3183] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:53.907375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:53.918065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1d5c6-393d-4e0f-b00a-e6f2e6aa3f7b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:53.941997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efc540-8295-45d5-a881-d0df62f04b06 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:53.942120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:53.942120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.942120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.942120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.942771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:53.942771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:53.944421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:53.945285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:53.946208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:53.946768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:53.947327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:53.948187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:53.950810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:53.986039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1595/3184] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:56:53.987424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.002925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a2267-37a4-410e-a2ad-fc40838aceb3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.010374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.010988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.011343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.011622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.012250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.014199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.063158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1590/3185] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:53 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:54.076463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.170866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed479ac-1523-45c5-9f9e-f05b39876762 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.190112 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1596/3186] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:53 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:54.198248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.198423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.198423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.198423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.198423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.198791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.202235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.312378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805ca0c-0be0-4e7c-a183-6f48e8294112 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.318082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.318878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.319194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.319470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.320082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.321986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.329420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:54.340994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1591/3187] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:54 2022] POST /identity/v3/users => generated 284 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:54.345174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.373739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2246f-1933-453a-91fb-0aa2bc8603b3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.382054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.382957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.383560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.384185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.385077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.391498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.410394 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1592/3188] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:56:54.411735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.431934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e2faa-f451-4794-a84f-859193894598 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.438524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.439564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.441984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.443743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.444743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.450180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.470177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1593/3189] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:54.474604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.493240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc39ad-f660-421c-8fbf-0d80c3b97620 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.500890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb31d85-d335-4c9a-b1b3-bd2b516b4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.502636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb31d85-d335-4c9a-b1b3-bd2b516b4ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.503668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb31d85-d335-4c9a-b1b3-bd2b516b4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.504122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb31d85-d335-4c9a-b1b3-bd2b516b4ab2 admin admin] PATH_INFO: `/v3/projects/94d9901ccdee4b4eb2b00872ceeb1af2/users/9813d1c6babc438a9688828fffb7a070/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.524838 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1597/3190] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:54 2022] POST /identity/v3/users => generated 285 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:54.526001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.534068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb31d85-d335-4c9a-b1b3-bd2b516b4ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d9901ccdee4b4eb2b00872ceeb1af2, user_id=9813d1c6babc438a9688828fffb7a070, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.539151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb31d85-d335-4c9a-b1b3-bd2b516b4ab2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.550781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95fbf-8cb5-4ede-9e74-212e4a72c212 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.557788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.559593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.560174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.560641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.561536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.564609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.581314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1598/3191] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:54.586622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.632304 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1594/3192] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:54 2022] PUT /identity/v3/projects/94d9901ccdee4b4eb2b00872ceeb1af2/users/9813d1c6babc438a9688828fffb7a070/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:54.637604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf4d1-ceec-4b84-aa4a-b8d9434e68ef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.652571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.653083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.653438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.722269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] MFA Rules not processed for user `9813d1c6babc438a9688828fffb7a070`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:54.726260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:54.839538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.840301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.840687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.841060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.841811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.846896 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1595/3193] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:56:54.848824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.863615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.883810 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1599/3194] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:54.886360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:54.904197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bd920-d3e0-4d52-8cd0-8542f80b0555 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.906358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbbdfd-b066-4eb2-8637-4294aafbc6e6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:54.915895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6474c-d5fd-4b64-9636-683b8fa7d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.917168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6474c-d5fd-4b64-9636-683b8fa7d9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.917168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6474c-d5fd-4b64-9636-683b8fa7d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.917429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6474c-d5fd-4b64-9636-683b8fa7d9b7 admin admin] PATH_INFO: `/v3/projects/cab7d8c7418941c998e142c7217fadc1/users/e2940a30839e4f39a8fb807afa71231b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.920107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:54.930655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:54.930655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:54.930655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:54.930655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.936152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:54.936370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6474c-d5fd-4b64-9636-683b8fa7d9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab7d8c7418941c998e142c7217fadc1, user_id=e2940a30839e4f39a8fb807afa71231b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:54.939227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6474c-d5fd-4b64-9636-683b8fa7d9b7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:55.064565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1600/3195] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:54 2022] PUT /identity/v3/projects/cab7d8c7418941c998e142c7217fadc1/users/e2940a30839e4f39a8fb807afa71231b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:55.076934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:55.077456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:55.077930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:55.106040 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1596/3196] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:54 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:55.107311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:55.152349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] MFA Rules not processed for user `e2940a30839e4f39a8fb807afa71231b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:55.153849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:55.300169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df7249-e96c-4e93-8334-f74e1aee2f73 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:55.306528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:55.307271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:55.307637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:55.308018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:55.309806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:55.312209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:55.336941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1601/3197] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:55.433694 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1597/3198] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:55 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:55.437835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:55.450786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75091d-1512-4ea2-86bf-7d944fb68883 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:55.456060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:55.456805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:55.456931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:55.457209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:55.457860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:55.460523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:55.460831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:55.467555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:55.482738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1602/3199] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:55.486778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:55.500593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b75c5-8faf-4644-95b0-784dfa0296ab admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:55.517263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:55.517958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:55.518226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:55.518566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] PATH_INFO: `/v3/projects/9ab068a9a3834d70aaf7b8180494347a/users/2fe97f8e985c496b87ee314b699ec16e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:55.555150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab068a9a3834d70aaf7b8180494347a, user_id=2fe97f8e985c496b87ee314b699ec16e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:55.558078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:55.622017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b91d4-2747-4df0-add9-3c0d1311a1fe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:55.628800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:55.629561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:55.630498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:55.630903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:55.640625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:55.649833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:55.686000 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1598/3200] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:55.840942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:55.845990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:55.846152 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1603/3201] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:55 2022] PUT /identity/v3/projects/9ab068a9a3834d70aaf7b8180494347a/users/2fe97f8e985c496b87ee314b699ec16e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:55.847073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:55.962478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:56.016203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475f39-2d5b-41d4-a1d1-e2c9e57e4e94 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:56.035524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877df747-750c-4790-83ac-d6fc6a462f1d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:56.083379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:56.084028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:56.084309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:56.084584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:56.085243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:56.099340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:56.124712 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1604/3202] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:56.128628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:56.153189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3749c-93db-4ff2-b295-4346c7db4afd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:56.153378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:56.153812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:56.154789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:56.155800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:56.165165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:56.174485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2afc8-1630-4b0a-a446-a62f1461524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:56.180405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2afc8-1630-4b0a-a446-a62f1461524a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:56.180405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2afc8-1630-4b0a-a446-a62f1461524a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:56.180405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2afc8-1630-4b0a-a446-a62f1461524a admin admin] PATH_INFO: `/v3/projects/9ab068a9a3834d70aaf7b8180494347a/users/2fe97f8e985c496b87ee314b699ec16e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:56.181254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2afc8-1630-4b0a-a446-a62f1461524a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab068a9a3834d70aaf7b8180494347a, user_id=2fe97f8e985c496b87ee314b699ec16e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:56.184683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2afc8-1630-4b0a-a446-a62f1461524a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:56.199053 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1605/3203] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:56:56 2022] PUT /identity/v3/projects/9ab068a9a3834d70aaf7b8180494347a/users/2fe97f8e985c496b87ee314b699ec16e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:56.217552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:56.218310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:56.218965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:56.268473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] MFA Rules not processed for user `2fe97f8e985c496b87ee314b699ec16e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:56.270151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:56.346241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:56.349993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:56.382995 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1599/3204] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:56.439608 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1606/3205] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:56.444303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:56.634717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0e9a-41fc-4086-a9f6-4c6e13ee4183 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:56.645597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:56.645597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:56.645597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:56.645920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:56.647739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:56.651973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:56.736562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:56.775220 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1600/3206] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 10:56:56 2022] POST /identity/v3/domains => generated 277 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:56.777831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:56.844225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e641769-3184-4cf1-a9ef-5f2b416ac3dd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:56.998244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2f7d-1dc9-4370-90de-3350bb5ebd6c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.009881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.011264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.011950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.012384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] PATH_INFO: `/v3/users/e2940a30839e4f39a8fb807afa71231b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.015275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2940a30839e4f39a8fb807afa71231b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.021303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.026228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.055035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.055035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.055035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.055035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.055575 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:57.055575 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:57.055575 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:57.055575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e012b-d900-4657-bf0b-0458d17470a5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.153149 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1601/3207] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:56:56 2022] POST /identity/v3/groups => generated 281 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:57.157028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.157324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.157773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.208140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] MFA Rules not processed for user `d267ab5434dc4119b770fb853f199112`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:57.209775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:57.320067 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1602/3208] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:57.321374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:57.339157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abb7b5-e774-4a39-b91e-6b57c1d7cfb4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.355150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.355150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.355150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.355941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/81c8a158ec414450b96185071635ad0e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.366024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2940a30839e4f39a8fb807afa71231b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:57.372282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:update_group(group_id=81c8a158ec414450b96185071635ad0e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.373412 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:57.373412 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:57.373412 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:57.374640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.374981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2940a30839e4f39a8fb807afa71231b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:57.375737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2940a30839e4f39a8fb807afa71231b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:57.376905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2940a30839e4f39a8fb807afa71231b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:57.396926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2940a30839e4f39a8fb807afa71231b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:57.511818 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1607/3209] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:56 2022] DELETE /identity/v3/users/e2940a30839e4f39a8fb807afa71231b => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:57.515067 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1603/3210] 10.222.0.20 () {60 vars in 1247 bytes} [Tue Sep 6 10:56:57 2022] PATCH /identity/v3/groups/81c8a158ec414450b96185071635ad0e => generated 291 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:57.515067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:57.517000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:57.517244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:57.518775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:57.531305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:57.628422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e49f6-6886-45b0-816e-053956fb17ef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.633341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.634001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.634294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.634572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/81c8a158ec414450b96185071635ad0e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.641071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:get_group(group_id=81c8a158ec414450b96185071635ad0e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.642103 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:57.642103 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:57.642103 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:57.643613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f54c4-d547-46fb-a672-273e02733c45 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.643751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d211ea-633a-41c8-bb95-8478025d0e3f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.645402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1608/3211] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:56:57 2022] GET /identity/v3/groups/81c8a158ec414450b96185071635ad0e => generated 291 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:57.646443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.646763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.647080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.666513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:57.667775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:57.710165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.710696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.710982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.711726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.713265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:57.729868 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1609/3212] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:57.730700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:57.744930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c6b94-5b60-4a29-a311-5e5b6ea5e808 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.749808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.750467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.750778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.751087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/81c8a158ec414450b96185071635ad0e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.752337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:update_group(group_id=81c8a158ec414450b96185071635ad0e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.753411 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:57.753411 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:57.753411 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:57.754610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.773319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.774983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.784547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1604/3213] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:57 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:57.785398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:57.787457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:57.858322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e506-b864-4109-98a0-5169a328b572 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.862391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.863038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.863330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.863611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.873471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.881521 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1610/3214] 10.222.0.20 () {60 vars in 1246 bytes} [Tue Sep 6 10:56:57 2022] PATCH /identity/v3/groups/81c8a158ec414450b96185071635ad0e => generated 307 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:57.881681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:57.881804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:57.886282 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1605/3215] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:56:57.889269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188da37-b7e3-4a14-9cc9-95e7f30f571d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:57.894129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:57.894757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:57.895096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:57.895431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/81c8a158ec414450b96185071635ad0e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:57.902130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=81c8a158ec414450b96185071635ad0e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:57.903280 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:57.903280 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:56:57.903280 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:56:57.904577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:58.044953 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1611/3216] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:56:57 2022] DELETE /identity/v3/groups/81c8a158ec414450b96185071635ad0e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:58.050211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:58.062599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016fd0-59cc-4072-bfaa-7668af3a1e23 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:58.128187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:58.128803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:58.129089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:58.129368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:58.130894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:58.132926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:58.269391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1606/3217] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:56:58 2022] POST /identity/v3/groups => generated 326 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:58.271521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:58.284559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4895-fa23-477a-8e8b-ff01dc20c63e tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:58.291672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:58.292292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:58.292572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:58.293067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:58.293704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:58.296674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:58.301489 ncdv-master-1 devstack@keystone.service[92878]: WARNING keystone.server.flask.common [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 10:56:58.325253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:56:58.440641 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1612/3218] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:58 2022] POST /identity/v3/users => generated 321 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:58.445333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:58.464871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac01c-6dfd-4864-a526-e82912f9f09a tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:58.471255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:58.472259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:58.472779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:58.473238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/e51549dde7c044b997979cd399afff24` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:58.496907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=e51549dde7c044b997979cd399afff24)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:58.498304 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:58.498304 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:58.498304 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:58.500140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:58.531287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:58.535079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:58.625377 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1607/3219] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 10:56:58 2022] PUT /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/e51549dde7c044b997979cd399afff24 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:58.629526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:58.676258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010bcf4-e44e-49ed-8c0b-445ab0f46d25 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:58.740391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcbce3-cf32-4346-b1fc-6de3d2433744 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:58.745866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:58.746647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:58.747004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:58.747526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:58.748235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:58.750158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:58.780078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:58.780717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:58.781045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:58.781324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] PATH_INFO: `/v3/projects/cab7d8c7418941c998e142c7217fadc1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:58.782468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab7d8c7418941c998e142c7217fadc1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:58.790131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:58.930640 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1608/3220] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:58 2022] POST /identity/v3/users => generated 323 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:56:58.934716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:58.954225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301670f8-592d-4479-9b99-8ee514921142 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:58.986370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab7d8c7418941c998e142c7217fadc1', 'request_id': 'req-baa040ce-0458-4a6d-b9be-8a0f56a564e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:58.997401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab7d8c7418941c998e142c7217fadc1', 'request_id': 'req-baa040ce-0458-4a6d-b9be-8a0f56a564e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:59.011281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab7d8c7418941c998e142c7217fadc1', 'request_id': 'req-baa040ce-0458-4a6d-b9be-8a0f56a564e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:59.063121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.064701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.064701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.064701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/95e56489270449abb695ec3645bc136e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.084372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=95e56489270449abb695ec3645bc136e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.086749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.160578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] The token cache is being invalidate because project cab7d8c7418941c998e142c7217fadc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:56:59.160578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:59.161383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-baa040ce-0458-4a6d-b9be-8a0f56a564e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:56:59.166406 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1613/3221] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:56:58 2022] DELETE /identity/v3/projects/cab7d8c7418941c998e142c7217fadc1 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:59.168623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25eb7b-d8b0-4357-b82c-39a26bd179a8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.169282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25eb7b-d8b0-4357-b82c-39a26bd179a8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.169566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25eb7b-d8b0-4357-b82c-39a26bd179a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.194428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4e25eb7b-d8b0-4357-b82c-39a26bd179a8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:59.195720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4e25eb7b-d8b0-4357-b82c-39a26bd179a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:59.271774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1609/3222] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 10:56:58 2022] PUT /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/95e56489270449abb695ec3645bc136e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:59.273324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.289813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:59.315394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1614/3223] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:59.315394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.315394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.315394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.353612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:56:59.354891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:56:59.441535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1615/3224] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:56:59.446990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.450741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba5e0-ae2e-4619-a504-3e81a1f435e3 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.457044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.459055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.459197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee133f12-1b6f-4be7-9d21-fc782a34d7b0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.459684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.460328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.460883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.463672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.468054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.469669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.470172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.470954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.471885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:56:59.472733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.475512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.489726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1616/3225] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:56:59.493911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.511520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9096f-0ac1-4360-91e6-cda2060ed756 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.516852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.517473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.517786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.518063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.518825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.520820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.594646 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1610/3226] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:59 2022] POST /identity/v3/users => generated 323 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:59.596905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.611337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cefa43-c6a3-4b62-9ff5-3fd76b70358d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.616890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.617958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.618460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.618908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/11b4411aa6e643848ace0ef13bc22d6e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.638223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=11b4411aa6e643848ace0ef13bc22d6e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.640944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.664553 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1617/3227] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:56:59 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:56:59.668191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.771920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1611/3228] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 10:56:59 2022] PUT /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/11b4411aa6e643848ace0ef13bc22d6e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:56:59.775882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.808663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f264f-e0b6-42db-b083-5f13e58ad939 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.892888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1c05-8ec1-4203-a04d-5ff7aeacda34 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.899274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.899778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.900146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.900551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.900936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.901992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.902483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.902635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.903558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.903884 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:59.903884 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:59.903884 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:59.904963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.905614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.908028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.937196 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1612/3229] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:56:59 2022] GET /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users => generated 1083 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:56:59.941333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:56:59.952759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afccc04-60d1-4add-93b8-96a7a6cedfa5 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:56:59.958568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:56:59.959471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:56:59.959859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:56:59.960278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/e51549dde7c044b997979cd399afff24` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:56:59.962255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=e51549dde7c044b997979cd399afff24)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:56:59.963518 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:56:59.963518 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:56:59.963518 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:56:59.964999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:56:59.985395 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1613/3230] 10.222.0.20 () {58 vars in 1342 bytes} [Tue Sep 6 10:56:59 2022] HEAD /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/e51549dde7c044b997979cd399afff24 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:56:59.989558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.008935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ababdbd-bfd5-472a-826a-6b822b5082d7 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.023387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1618/3231] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:56:59 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:00.024482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.025476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.026062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.026361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/e51549dde7c044b997979cd399afff24` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.028876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=e51549dde7c044b997979cd399afff24)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.030135 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:00.030135 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:00.030135 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:00.031551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.041076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.053204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa055e-89ed-4c0a-9a61-e946cd4ad879 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.059306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.060350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.060350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.064465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.064465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.064465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.079221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1619/3232] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:00.080909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.093587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de4e2d-ae97-4980-8286-337f4774c98e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.099302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.099936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.100374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.100666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.101333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.102941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.115068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1620/3233] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:00.119283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.128497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e51549dde7c044b997979cd399afff24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:00.130813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fcb05-a34e-4600-b19d-9b0abd3d241b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.136065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e859a-aa25-4e12-9501-d860d7b0a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.136731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e859a-aa25-4e12-9501-d860d7b0a572 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.137920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e859a-aa25-4e12-9501-d860d7b0a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.137920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e859a-aa25-4e12-9501-d860d7b0a572 admin admin] PATH_INFO: `/v3/projects/ea18ad9969aa4157a6c66af6d94ccc3e/users/32f3202af5744d13983968b116ea9fd4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.154281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e859a-aa25-4e12-9501-d860d7b0a572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea18ad9969aa4157a6c66af6d94ccc3e, user_id=32f3202af5744d13983968b116ea9fd4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.157057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e859a-aa25-4e12-9501-d860d7b0a572 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.257644 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1614/3234] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 10:56:59 2022] DELETE /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/e51549dde7c044b997979cd399afff24 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:00.261747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.315789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1621/3235] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:00 2022] PUT /identity/v3/projects/ea18ad9969aa4157a6c66af6d94ccc3e/users/32f3202af5744d13983968b116ea9fd4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:00.330002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.330657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.331318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.375319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cef7c8-ec6b-4aeb-926a-72837799b33c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.385467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:00.399635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:00.496518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.497548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.497548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.497794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/95e56489270449abb695ec3645bc136e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.500720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=95e56489270449abb695ec3645bc136e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.502745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.519515 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1615/3236] 10.222.0.20 () {58 vars in 1342 bytes} [Tue Sep 6 10:57:00 2022] HEAD /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/95e56489270449abb695ec3645bc136e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:00.525095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.528669 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1622/3237] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:00.540394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.545472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:00.559092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186adc5-632d-491d-b9b8-e66b18360102 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.572048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.575392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.575761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.576115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/95e56489270449abb695ec3645bc136e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.579720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=95e56489270449abb695ec3645bc136e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.583641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.605543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:00.624186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c466-80f9-4761-a929-b7fd6d4356bd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.628347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:00.628759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:00.629042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:00.629320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:00.639939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:00.641382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:00.652381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1623/3238] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:00.712913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '95e56489270449abb695ec3645bc136e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:00.830535 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1616/3239] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 10:57:00 2022] DELETE /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/95e56489270449abb695ec3645bc136e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:00.834764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:00.864224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742818c6-af69-4d52-aa72-1a0be41faf91 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:00.999243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:01.000040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:01.000426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:01.000802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/11b4411aa6e643848ace0ef13bc22d6e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:01.003409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=11b4411aa6e643848ace0ef13bc22d6e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:01.004600 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:01.004600 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:01.004600 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:01.007690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:01.028200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1624/3240] 10.222.0.20 () {58 vars in 1342 bytes} [Tue Sep 6 10:57:00 2022] HEAD /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/11b4411aa6e643848ace0ef13bc22d6e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:01.032108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:01.045064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b72b25-9607-4f9f-866d-e18e52436d0c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:01.048852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:01.050037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:01.050509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:01.050803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/11b4411aa6e643848ace0ef13bc22d6e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:01.053243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a, user_id=11b4411aa6e643848ace0ef13bc22d6e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:01.055490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:01.249934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '11b4411aa6e643848ace0ef13bc22d6e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:01.400270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1617/3241] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 10:57:01 2022] DELETE /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users/11b4411aa6e643848ace0ef13bc22d6e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:01.404564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:01.415102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83aa63-e67d-4639-bc72-4e3c9a9c7481 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:01.537463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:01.538129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:01.538411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:01.538877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:01.541779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:01.543053 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:01.543053 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:01.543053 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:01.544624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:01.565626 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1625/3242] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:57:01 2022] GET /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a/users => generated 145 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:01.570002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:01.586052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c7c2a-8f22-4b40-9241-18199cbc37ec tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:01.594993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:01.596476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:01.596772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:01.597061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users/11b4411aa6e643848ace0ef13bc22d6e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:01.598239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_user(user_id=11b4411aa6e643848ace0ef13bc22d6e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:01.601062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:01.743917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b4411aa6e643848ace0ef13bc22d6e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:01.752161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b4411aa6e643848ace0ef13bc22d6e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:01.754573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b4411aa6e643848ace0ef13bc22d6e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:01.765902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b4411aa6e643848ace0ef13bc22d6e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:01.766778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b4411aa6e643848ace0ef13bc22d6e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:01.861737 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1618/3243] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:01 2022] DELETE /identity/v3/users/11b4411aa6e643848ace0ef13bc22d6e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:01.866122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:01.868472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:01.888423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b338-ba96-42a1-b15b-1340f1c18ad6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:02.032682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:02.033355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:02.033642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:02.033924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users/95e56489270449abb695ec3645bc136e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:02.035195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_user(user_id=95e56489270449abb695ec3645bc136e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:02.038128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:02.214771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e56489270449abb695ec3645bc136e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.222502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e56489270449abb695ec3645bc136e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.224085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e56489270449abb695ec3645bc136e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.225009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e56489270449abb695ec3645bc136e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.243326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e56489270449abb695ec3645bc136e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.390856 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1626/3244] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:01 2022] DELETE /identity/v3/users/95e56489270449abb695ec3645bc136e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:02.395072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:02.420547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bae4dd-111e-42b8-b7e1-e1097f2e9e48 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:02.494881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:02.495573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:02.495860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:02.496138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users/e51549dde7c044b997979cd399afff24` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:02.497300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e51549dde7c044b997979cd399afff24)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:02.499629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:02.643233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51549dde7c044b997979cd399afff24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.658357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51549dde7c044b997979cd399afff24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.660579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51549dde7c044b997979cd399afff24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.678323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51549dde7c044b997979cd399afff24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.696065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51549dde7c044b997979cd399afff24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:02.752598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:02.784926 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1619/3245] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:02 2022] DELETE /identity/v3/users/e51549dde7c044b997979cd399afff24 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:02.789500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:02.790933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:02.806789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bffbac-fda8-4ca9-a90e-4fc69347febe tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:02.882675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:02.884035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:02.884660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:02.885120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:02.886931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=15d7e16c5b2244c898ce661a32cc5d8a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:02.889604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:03.031528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1627/3246] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:02 2022] DELETE /identity/v3/groups/15d7e16c5b2244c898ce661a32cc5d8a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:03.036314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:03.038072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:03.052041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6a6d8-b7d5-42e5-bb44-953960c46c24 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:03.161718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:03.164213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:03.169535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:03.169535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:03.169535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:03.171643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:03.325771 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1620/3247] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:03 2022] POST /identity/v3/groups => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:03.330353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:03.344146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fde8df-c6da-4a0d-9848-9c968237a829 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:03.352929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:03.355344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:03.355344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:03.355344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:03.355849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:03.355972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:03.357071 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:03.357071 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:03.357071 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:03.358978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:03.454143 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1628/3248] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:03 2022] POST /identity/v3/groups => generated 325 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:03.455865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:03.468212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409df9d-44a7-4526-94ff-45232c9f263d tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:03.475047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:03.475810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:03.476199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:03.476763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:03.477581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:03.479801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:03.614647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1621/3249] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:03 2022] POST /identity/v3/groups => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:03.616060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:03.632318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fef517-543f-452d-afa7-0754c594482f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:03.650015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:03.650659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:03.650949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:03.651341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:03.652312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:03.653368 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:03.653368 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:03.653368 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:03.654516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:03.680987 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1629/3250] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 10:57:03 2022] GET /identity/v3/groups => generated 1487 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:03.682525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:03.693903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e57428-77e3-4535-ac8f-742784eb9f64 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:03.704370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:03.705380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:03.707832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:03.708221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/eed2fc438e8f43f4a11369f64a421a40` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:03.718139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=eed2fc438e8f43f4a11369f64a421a40)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:03.719369 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:03.719369 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:03.719369 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:03.720970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:03.985058 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1622/3251] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:03 2022] DELETE /identity/v3/groups/eed2fc438e8f43f4a11369f64a421a40 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:03.989534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:04.007905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e39e5-f0da-422c-929b-16d6ed55eb27 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:04.144062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:04.144960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:04.145888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:04.146245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/bb41054bd5bd423d95fecefd51b20d51` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:04.152439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bb41054bd5bd423d95fecefd51b20d51)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:04.154378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:04.315114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1630/3252] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:03 2022] DELETE /identity/v3/groups/bb41054bd5bd423d95fecefd51b20d51 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:04.319982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:04.332698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b4785-6cf9-42b1-b203-2c9562804a13 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:04.418847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:04.420062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:04.420432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:04.420982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/e7cbea1ba7aa45e7b8cd5dc1b55676d7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:04.428762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e7cbea1ba7aa45e7b8cd5dc1b55676d7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:04.431372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:04.599609 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1623/3253] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:04 2022] DELETE /identity/v3/groups/e7cbea1ba7aa45e7b8cd5dc1b55676d7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:04.604499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:04.618386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09dc20-7256-40a3-b83d-395a45c0dee1 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:04.712775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:04.714111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:04.714957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:04.715431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:04.716283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:04.722169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:04.853205 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1631/3254] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:04 2022] POST /identity/v3/users => generated 323 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:04.857196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:04.870235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def175-a0ca-44b8-99d5-12ea08801cde tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:04.897511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:04.899706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:04.902326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:04.902838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:04.903637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:04.908459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:04.938647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:05.008987 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1624/3255] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:04 2022] POST /identity/v3/groups => generated 326 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:05.010352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:05.030598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3297-8bdc-4a40-80b7-5ca01c593507 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:05.049477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:05.050304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:05.050785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:05.051182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/8c6d5509365047b1a3efffefcf6f2fb5/users/49ba9bd9b7c84fbbad244668773249a2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:05.105099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8c6d5509365047b1a3efffefcf6f2fb5, user_id=49ba9bd9b7c84fbbad244668773249a2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:05.107613 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:05.107613 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:05.107613 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:05.109488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:05.224987 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1632/3256] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 10:57:05 2022] PUT /identity/v3/groups/8c6d5509365047b1a3efffefcf6f2fb5/users/49ba9bd9b7c84fbbad244668773249a2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:05.230645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:05.250787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbef8f-2b25-43b4-a95b-79cbc25081b6 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:05.419910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:05.421040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:05.421040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:05.421248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:05.422636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:05.424348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:05.583582 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1625/3257] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:05 2022] POST /identity/v3/groups => generated 326 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:05.586823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:05.601777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d070d4-e7c2-4ef0-a3c8-905882b57d44 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:05.615564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:05.616280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:05.616576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:05.616857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/c1c420e9584448c7aba0d2f74eb3080c/users/49ba9bd9b7c84fbbad244668773249a2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:05.627046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c1c420e9584448c7aba0d2f74eb3080c, user_id=49ba9bd9b7c84fbbad244668773249a2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:05.629524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:05.746104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1633/3258] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 10:57:05 2022] PUT /identity/v3/groups/c1c420e9584448c7aba0d2f74eb3080c/users/49ba9bd9b7c84fbbad244668773249a2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:05.747505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:05.770274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac346-b8d6-4540-9ef1-10fa82029a52 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:05.878367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:05.880803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:05.891550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:05.892227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users/49ba9bd9b7c84fbbad244668773249a2/groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:05.894033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=49ba9bd9b7c84fbbad244668773249a2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:05.897019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:05.924265 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1626/3259] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 10:57:05 2022] GET /identity/v3/users/49ba9bd9b7c84fbbad244668773249a2/groups => generated 838 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:05.928246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:05.950342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a19245-ab61-4161-b6c2-33b296d0d584 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:05.974320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:05.974320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:05.974320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:05.974654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/c1c420e9584448c7aba0d2f74eb3080c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:05.974755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c1c420e9584448c7aba0d2f74eb3080c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:05.976761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:06.023241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:06.158485 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1634/3260] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:05 2022] DELETE /identity/v3/groups/c1c420e9584448c7aba0d2f74eb3080c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:06.162777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:06.181153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472da52-8074-4057-b91d-d47ae6f35f7f tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:06.280134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:06.280825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:06.281115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:06.281393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/groups/8c6d5509365047b1a3efffefcf6f2fb5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:06.283975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8c6d5509365047b1a3efffefcf6f2fb5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:06.286924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:06.463832 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1627/3261] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:06 2022] DELETE /identity/v3/groups/8c6d5509365047b1a3efffefcf6f2fb5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:06.468218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:06.482163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badf598-fcc6-497f-90be-1d819ce678ef tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:06.575519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:06.576484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:06.577582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:06.578058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/users/49ba9bd9b7c84fbbad244668773249a2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:06.582759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49ba9bd9b7c84fbbad244668773249a2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:06.588410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:06.736047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ba9bd9b7c84fbbad244668773249a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:06.744457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ba9bd9b7c84fbbad244668773249a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:06.745342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ba9bd9b7c84fbbad244668773249a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:06.746073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ba9bd9b7c84fbbad244668773249a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:06.758325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ba9bd9b7c84fbbad244668773249a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:06.940878 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1635/3262] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:06 2022] DELETE /identity/v3/users/49ba9bd9b7c84fbbad244668773249a2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:06.946914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:06.949092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:06.972328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512df17-afa9-4dc8-ab7d-0de9aa024629 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:07.106773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:07.107942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:07.108391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:07.108871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/domains/3503feabfa7e4fc0922aa0ba776add71` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:07.111971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3503feabfa7e4fc0922aa0ba776add71)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:07.114799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:07.146239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.147285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.262661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.264366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.269413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1628/3263] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:57:06 2022] PATCH /identity/v3/domains/3503feabfa7e4fc0922aa0ba776add71 => generated 278 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:07.273609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:07.284177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15476-3fb8-49cc-adb2-89d08587ce70 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:07.347725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fe97f8e985c496b87ee314b699ec16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ab068a9a3834d70aaf7b8180494347a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:07.348805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:07.349389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:07.349909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] PATH_INFO: `/v3/domains/3503feabfa7e4fc0922aa0ba776add71` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:07.360281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:07.372332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3503feabfa7e4fc0922aa0ba776add71)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:07.372332 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:07.372332 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:07.372332 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:07.372332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:07.398955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.405494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.616544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71', 'request_id': 'req-a45a269b-47df-48cf-915e-bffaa792022c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.630310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71', 'request_id': 'req-a45a269b-47df-48cf-915e-bffaa792022c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.640205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71', 'request_id': 'req-a45a269b-47df-48cf-915e-bffaa792022c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.786888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] The token cache is being invalidate because project 3503feabfa7e4fc0922aa0ba776add71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:07.791969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.794514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.819861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71', 'request_id': 'req-a45a269b-47df-48cf-915e-bffaa792022c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.821454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71', 'request_id': 'req-a45a269b-47df-48cf-915e-bffaa792022c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.833519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a45a269b-47df-48cf-915e-bffaa792022c tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3503feabfa7e4fc0922aa0ba776add71', 'request_id': 'req-a45a269b-47df-48cf-915e-bffaa792022c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:07.844012 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1636/3264] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:57:07 2022] DELETE /identity/v3/domains/3503feabfa7e4fc0922aa0ba776add71 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:07.849311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:07.852474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:08.080149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7529c-da5b-4ef1-a62d-033c83d82df2 tempest-GroupsV3TestJSON-1049835557 tempest-GroupsV3TestJSON-1049835557-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:08.215623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:08.215623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:08.215623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:08.215623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] PATH_INFO: `/v3/users/9813d1c6babc438a9688828fffb7a070` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:08.217791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9813d1c6babc438a9688828fffb7a070)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:08.219619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:08.720252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:08.806824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9813d1c6babc438a9688828fffb7a070'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:08.823867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9813d1c6babc438a9688828fffb7a070'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:08.825089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9813d1c6babc438a9688828fffb7a070'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:08.877067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9813d1c6babc438a9688828fffb7a070'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:08.884059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9813d1c6babc438a9688828fffb7a070'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:08.975816 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1629/3265] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:07 2022] DELETE /identity/v3/users/9813d1c6babc438a9688828fffb7a070 => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:08.980505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:08.985417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:08.986019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:09.024078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:09.024078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:09.124900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1637/3266] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:09.266916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:09.268446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:09.396183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2d71-e7c0-40fe-98aa-3a6207bfceda admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:09.401121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7ad8-f6e3-4d19-a4a6-d248c6c7d5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:09.402436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7ad8-f6e3-4d19-a4a6-d248c6c7d5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:09.402724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7ad8-f6e3-4d19-a4a6-d248c6c7d5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:09.402995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7ad8-f6e3-4d19-a4a6-d248c6c7d5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:09.414848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d7ad8-f6e3-4d19-a4a6-d248c6c7d5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:09.422131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d7ad8-f6e3-4d19-a4a6-d248c6c7d5d2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:09.445466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1630/3267] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:09.501091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:10.564751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:10.609728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:10.611244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:10.624648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc71b9-d7bf-45cf-b5d0-2de6b1bbd5d1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:10.652093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:10.653004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:10.653469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:10.653918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] PATH_INFO: `/v3/projects/94d9901ccdee4b4eb2b00872ceeb1af2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:10.655153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:10.655573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:10.655995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:10.656709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d9901ccdee4b4eb2b00872ceeb1af2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:10.660404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:10.728094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] MFA Rules not processed for user `32f3202af5744d13983968b116ea9fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:10.730735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:10.880855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d9901ccdee4b4eb2b00872ceeb1af2', 'request_id': 'req-dafbca7e-0296-4db5-8c9c-09159be1c410'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:10.886326 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1631/3268] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:10.899723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d9901ccdee4b4eb2b00872ceeb1af2', 'request_id': 'req-dafbca7e-0296-4db5-8c9c-09159be1c410'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:10.919381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d9901ccdee4b4eb2b00872ceeb1af2', 'request_id': 'req-dafbca7e-0296-4db5-8c9c-09159be1c410'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.077139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] The token cache is being invalidate because project 94d9901ccdee4b4eb2b00872ceeb1af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:11.077434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.079757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.081204 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1638/3269] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:10 2022] DELETE /identity/v3/projects/94d9901ccdee4b4eb2b00872ceeb1af2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:11.085868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:11.107000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4961ba3-4db5-4dfd-9475-23891c4cd739 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:11.236773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:11.237872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:11.238404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:11.238963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] PATH_INFO: `/v3/users/2fe97f8e985c496b87ee314b699ec16e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:11.240479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe97f8e985c496b87ee314b699ec16e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:11.243116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:11.360924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:11.505306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe97f8e985c496b87ee314b699ec16e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.512869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe97f8e985c496b87ee314b699ec16e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.513631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe97f8e985c496b87ee314b699ec16e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.526748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe97f8e985c496b87ee314b699ec16e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.527809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe97f8e985c496b87ee314b699ec16e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:11.589087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:11.590971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:11.661830 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1632/3270] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:11 2022] DELETE /identity/v3/users/2fe97f8e985c496b87ee314b699ec16e => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:11.713159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbca7e-0296-4db5-8c9c-09159be1c410 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:11.804266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:11.804654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:11.805185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:11.805661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:11.807888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:11.889902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:11.891835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71b99-aa00-4b4e-a158-6fe4e422e014 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:11.921581 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1639/3271] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:12.521479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:12.524031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:12.644039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa2e8-d6d2-4c76-9155-3cf999bc4c6f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:12.651552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:12.659762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:12.660013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:12.661209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:12.663585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] PATH_INFO: `/v3/projects/9ab068a9a3834d70aaf7b8180494347a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:12.667771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab068a9a3834d70aaf7b8180494347a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:12.672311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:12.813087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab068a9a3834d70aaf7b8180494347a', 'request_id': 'req-af65e733-71e2-4ca6-a403-f5300726f722'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:12.829617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab068a9a3834d70aaf7b8180494347a', 'request_id': 'req-af65e733-71e2-4ca6-a403-f5300726f722'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:12.843722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab068a9a3834d70aaf7b8180494347a', 'request_id': 'req-af65e733-71e2-4ca6-a403-f5300726f722'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:12.943810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] The token cache is being invalidate because project 9ab068a9a3834d70aaf7b8180494347a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:12.944366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:12.945304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af65e733-71e2-4ca6-a403-f5300726f722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:12.948137 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1633/3272] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:12 2022] DELETE /identity/v3/projects/9ab068a9a3834d70aaf7b8180494347a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:12.953923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:12.955133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:12.955878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:12.972198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:12.993108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:12.994382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:13.111429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1640/3273] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:13.119506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.119800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.120278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.143583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:13.145214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:13.161997 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1634/3274] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:13.167470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.179370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bdf39-9a95-4119-86d1-7cc325b13246 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.185747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.186696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.187021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.187312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.187965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:13.188400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.190136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.210497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1641/3275] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:13.215653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.227241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a21a1-a93c-4815-bc02-9d7667fff985 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.233542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.234466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.234757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.235059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.235721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.237938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.427728 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1635/3276] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:13 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:13.428935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.440597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebbe76-a400-4ce6-85b9-04f4895ad041 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.554141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.555179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.555683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.556157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.557086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.559246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.675360 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1642/3277] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:13 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:13.681008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.690935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3016c9-4c73-42a4-8368-3a5a75b8847b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.703059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.704006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.704538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.704887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.705676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.707988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.720202 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1636/3278] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:13.725277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.742020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372189b-8a4e-4597-84c3-b62cd1764085 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.746765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.747424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.747704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.748031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.748677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.750282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.763888 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1643/3279] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:13.766899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.779795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b0378-333b-4adc-a33b-d27c18ed0ab4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.786969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.788011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.788565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.789073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] PATH_INFO: `/v3/projects/0d394e6682774c8a998b44ebe31155ca/users/00f0dcc6f95f4f6d94b713ac0565c278/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.812514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d394e6682774c8a998b44ebe31155ca, user_id=00f0dcc6f95f4f6d94b713ac0565c278, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.815959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:13.816487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.818582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:13.935469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a67fb8-28a1-41d0-b1bc-aa7dcaa2edb7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:13.940909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:13.941544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.944886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.944886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:13.944886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:13.957217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:13.958845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f8ef6-cc94-48d9-b910-d1985e308092 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:13.971036 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1637/3280] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:13 2022] PUT /identity/v3/projects/0d394e6682774c8a998b44ebe31155ca/users/00f0dcc6f95f4f6d94b713ac0565c278/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:13.975192 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1644/3281] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:13.982122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:13.982445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:13.982812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:14.019839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] MFA Rules not processed for user `00f0dcc6f95f4f6d94b713ac0565c278`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:14.019839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:14.037309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.045880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:14.114642 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1645/3282] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:14.119206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.196965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0c827-1239-4b91-b587-e616628d6cfc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:14.203454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:14.204108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:14.206683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:14.206683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] PATH_INFO: `/v3/users/d267ab5434dc4119b770fb853f199112` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:14.206683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d267ab5434dc4119b770fb853f199112)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:14.208478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:14.216145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56abcf-d85c-4a4a-b515-abb7b6a01516 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:14.223821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:14.225679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:14.226127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:14.226500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:14.227415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:14.236440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:14.344523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:14.390118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1646/3283] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:14 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:14.393299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.460752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fd49-3faf-4610-aba8-e915a7a0f14a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:14.466201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:14.466851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:14.467161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:14.468030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:14.468252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:14.470040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:14.531557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd267ab5434dc4119b770fb853f199112'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:14.541157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd267ab5434dc4119b770fb853f199112'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:14.541936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd267ab5434dc4119b770fb853f199112'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:14.555569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd267ab5434dc4119b770fb853f199112'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:14.556380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd267ab5434dc4119b770fb853f199112'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:14.605399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1647/3284] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:14 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:14.605399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.605771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:14.618469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b21bcf-cdc3-40d2-ab93-9c2f1461a2a9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:14.625290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:14.626007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:14.626348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:14.626651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:14.627468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1638/3285] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:14 2022] DELETE /identity/v3/users/d267ab5434dc4119b770fb853f199112 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:14.627691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:14.629723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:14.648217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1648/3286] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:14.658223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.764883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c378c-15de-456a-a7d4-ba58dd44c09e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:14.774945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:14.775689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:14.776188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:14.776505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] PATH_INFO: `/v3/projects/e64ca2e54da446cfa340496ee5e4a510/users/7d047fe1ac5947ffa26bec42dab330e4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:14.800934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64ca2e54da446cfa340496ee5e4a510, user_id=7d047fe1ac5947ffa26bec42dab330e4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:14.804957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:14.885922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:14.897567 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1639/3287] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:14 2022] PUT /identity/v3/projects/e64ca2e54da446cfa340496ee5e4a510/users/7d047fe1ac5947ffa26bec42dab330e4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:14.897983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.909614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59f8b-9c08-4c84-84ef-054740a98b52 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:14.959473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:14.961980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:15.049676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.050360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.050651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.051925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.053276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.054475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.077559 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1649/3288] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:15.078483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:15.090258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875032-bada-41c3-b9a3-b93bd54584da admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.100096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.101364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.105049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.105049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] PATH_INFO: `/v3/projects/c79ebbb3d4ce4d65ae47fb0afb9e7855` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.105049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79ebbb3d4ce4d65ae47fb0afb9e7855)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.105605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92e0b5-abd9-4e3a-939c-4e60afde62e7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.108194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.123624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01319df3-08ca-45ce-ba01-e85596d62ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.124454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01319df3-08ca-45ce-ba01-e85596d62ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.124752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01319df3-08ca-45ce-ba01-e85596d62ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.125027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01319df3-08ca-45ce-ba01-e85596d62ea5 admin admin] PATH_INFO: `/v3/projects/e64ca2e54da446cfa340496ee5e4a510/users/7d047fe1ac5947ffa26bec42dab330e4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.129151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01319df3-08ca-45ce-ba01-e85596d62ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64ca2e54da446cfa340496ee5e4a510, user_id=7d047fe1ac5947ffa26bec42dab330e4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.132748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01319df3-08ca-45ce-ba01-e85596d62ea5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.147536 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1650/3289] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:15 2022] PUT /identity/v3/projects/e64ca2e54da446cfa340496ee5e4a510/users/7d047fe1ac5947ffa26bec42dab330e4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:15.163573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217385-135c-47de-9f55-114e204e282b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.163911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217385-135c-47de-9f55-114e204e282b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.164368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217385-135c-47de-9f55-114e204e282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.196393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f8217385-135c-47de-9f55-114e204e282b None None] MFA Rules not processed for user `7d047fe1ac5947ffa26bec42dab330e4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:15.198008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f8217385-135c-47de-9f55-114e204e282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:15.288507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79ebbb3d4ce4d65ae47fb0afb9e7855', 'request_id': 'req-6a79f581-be97-48e9-bc40-4f917caaaaf7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:15.294695 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1651/3290] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:15.295859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217385-135c-47de-9f55-114e204e282b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:15.296344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79ebbb3d4ce4d65ae47fb0afb9e7855', 'request_id': 'req-6a79f581-be97-48e9-bc40-4f917caaaaf7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:15.302729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79ebbb3d4ce4d65ae47fb0afb9e7855', 'request_id': 'req-6a79f581-be97-48e9-bc40-4f917caaaaf7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:15.307360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217385-135c-47de-9f55-114e204e282b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.366503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.374867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.374867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.374867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.374867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.376108 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:15.376108 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:15.376108 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:15.376108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.421454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] The token cache is being invalidate because project c79ebbb3d4ce4d65ae47fb0afb9e7855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:15.421848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:15.422453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a79f581-be97-48e9-bc40-4f917caaaaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:15.424402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1640/3291] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:14 2022] DELETE /identity/v3/projects/c79ebbb3d4ce4d65ae47fb0afb9e7855 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:15.430542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd704-93b3-4de7-9aee-d5477439245d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.431196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd704-93b3-4de7-9aee-d5477439245d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.431699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd704-93b3-4de7-9aee-d5477439245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.455179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a31cd704-93b3-4de7-9aee-d5477439245d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:15.456433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a31cd704-93b3-4de7-9aee-d5477439245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:15.489051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1652/3292] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/domains => generated 276 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:15.492881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:15.496025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:15.526701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1641/3293] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:57:15.534684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.534979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.535852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.564297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:15.566133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:15.572915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c484f5-d1da-456d-9ce6-e421242e0ece tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.578875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.579870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.580342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.580799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.581617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.584074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.676756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1642/3294] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:57:15.681018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:15.692242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c449a-c8fd-4fe7-81d1-51b4064bf96c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.698466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.700385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.700385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.700385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.700798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:15.700948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.702650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.719210 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1643/3295] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:15.720973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:15.731323 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1653/3296] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/projects => generated 401 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:15.737841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:15.749958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeb677-8354-413f-a0f6-948a787a14fa admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.882280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90a0e-767d-42c6-b5bc-7364bc25d478 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:15.893966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.897280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.897280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.897280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.898013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.902504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:15.912848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:15.913472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:15.913756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:15.914086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:15.914740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:15.916734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.028890 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1654/3297] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/groups => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:16.028890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.042412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c7bc-34a5-40e9-8591-be1f5eba0f03 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.046652 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1644/3298] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:15 2022] POST /identity/v3/projects => generated 379 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:16.055664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.057575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.058858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.059449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.059730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.060390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.062326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.175546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3b2-80e5-49c8-8f65-0124181ef1c5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.181396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.181976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.182260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.183631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.184374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.186363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.221713 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1655/3299] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:16 2022] POST /identity/v3/users => generated 442 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:16.226416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.236752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c379f-73fa-48dd-ab58-13ee86d86e24 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.301741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.302290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.302575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.302856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.303567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.304651 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:16.304651 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:16.304651 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:16.305551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.339570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:16.349887 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1645/3300] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:16 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:16.352393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.365315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db0b0-e033-442f-836f-0af87e166b14 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.370609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728efe8-62ce-4557-bbe2-f74eab2b9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.371410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728efe8-62ce-4557-bbe2-f74eab2b9b94 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.371714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728efe8-62ce-4557-bbe2-f74eab2b9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.372986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728efe8-62ce-4557-bbe2-f74eab2b9b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.372986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728efe8-62ce-4557-bbe2-f74eab2b9b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.374341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728efe8-62ce-4557-bbe2-f74eab2b9b94 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.385236 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1646/3301] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:16.386415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.386710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.386992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.406874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:16.408126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:16.431441 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1656/3302] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 10:57:16 2022] POST /identity/v3/roles => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:16.431441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.441940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1449093-0a70-4979-b4f6-d062bdd1d841 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.446933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.447631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.447995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.448626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.448960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.450560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.462062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1657/3303] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:16 2022] GET /identity/v3/roles => generated 1651 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:16.462916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.474400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6beb-c98d-49e8-8d2e-946d0c542c39 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.476337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1647/3304] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:57:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:16.479225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.479910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.480054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.480422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.480742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/groups/5f7431fb9b194c00a205fade76aa4b58/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.491921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, group_id=5f7431fb9b194c00a205fade76aa4b58, role_id=100f351a35fc4ce8b2cb5d8e3aad9f2f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.496687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db411b63-4097-43c3-94fd-22053aa4951c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.502382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.503415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.503551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.503847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.504223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] PATH_INFO: `/v3/projects/4061aad7f45b4c6192c02f3179d13687/users/e19903666a1243e3a66411e30babe299/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.523797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4061aad7f45b4c6192c02f3179d13687, user_id=e19903666a1243e3a66411e30babe299, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.526660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.631044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1658/3305] 10.222.0.20 () {60 vars in 1585 bytes} [Tue Sep 6 10:57:16 2022] PUT /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/groups/5f7431fb9b194c00a205fade76aa4b58/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f/inherited_to_projects => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:16.631375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.638600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:16.655477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1648/3306] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:16 2022] PUT /identity/v3/projects/4061aad7f45b4c6192c02f3179d13687/users/e19903666a1243e3a66411e30babe299/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:16.659760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.737010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aadaf-c36d-4493-8cd3-ede7dd9f6b60 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.749840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5bed1-d8d3-4d05-944b-91c28dbb2570 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.759990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.760797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.762251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.762251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/groups/5f7431fb9b194c00a205fade76aa4b58/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.764592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, group_id=5f7431fb9b194c00a205fade76aa4b58, role_id=100f351a35fc4ce8b2cb5d8e3aad9f2f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.765864 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:16.765864 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:16.765864 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:16.768428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca7bd-7b2d-4cd3-ae70-62a7a558026b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.784024 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1649/3307] 10.222.0.20 () {58 vars in 1567 bytes} [Tue Sep 6 10:57:16 2022] HEAD /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/groups/5f7431fb9b194c00a205fade76aa4b58/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f/inherited_to_projects => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:16.785797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.786101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.791062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.805395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.806067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.806356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.806635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.808113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:16.809516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:16.880996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.883101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.889326 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1650/3308] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:16.890521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.905163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1659/3309] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:57:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:57:16.906108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:16.909780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:16.915438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fb9d6-5c6d-4b30-8c03-d490d4d3f0be None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.920572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.921718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.922011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.922293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/groups/5f7431fb9b194c00a205fade76aa4b58/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.924696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, group_id=5f7431fb9b194c00a205fade76aa4b58, role_id=100f351a35fc4ce8b2cb5d8e3aad9f2f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:16.925730 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:16.925730 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:16.925730 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:16.928322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:16.935079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 100f351a35fc4ce8b2cb5d8e3aad9f2f was removed from group 5f7431fb9b194c00a205fade76aa4b58 on project d9e71b96182c49c59b610d26f2a107d3. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:16.935423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:16.936116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:16.992566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bb17-ee98-489a-a9fa-335d56973d78 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:16.996668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:16.997282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:16.997569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:16.997877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:16.999759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:17.024035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:17.026723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:17.033157 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1651/3310] 10.222.0.20 () {58 vars in 1569 bytes} [Tue Sep 6 10:57:16 2022] DELETE /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/groups/5f7431fb9b194c00a205fade76aa4b58/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f/inherited_to_projects => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:17.038143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:17.039744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:17.043168 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1660/3311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:17.152181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54fcc0-3f90-4da7-8ba5-013ac146a698 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:17.158985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:17.159838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:17.161012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:17.161525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:17.163169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=100f351a35fc4ce8b2cb5d8e3aad9f2f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:17.164532 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:17.164532 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:17.164532 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:17.166345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:17.387253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 100f351a35fc4ce8b2cb5d8e3aad9f2f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:17.387253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:17.387253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:17.395679 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1652/3312] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:17 2022] DELETE /identity/v3/roles/100f351a35fc4ce8b2cb5d8e3aad9f2f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:17.395908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:17.411375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe120b-b5bf-478c-b010-8854386f470d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:17.560537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:17.560537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:17.560537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:17.561142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:17.561142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:17.561142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:17.850418 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1661/3313] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 10:57:17 2022] POST /identity/v3/roles => generated 240 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:17.856039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:17.857600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:17.895736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d15610-68c7-4cac-be13-0b6d2238c8e2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:17.917838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:17.917838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:17.917838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:17.919789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/f33e5aac731246b2a8857ad8204329d4/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:17.985978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=f33e5aac731246b2a8857ad8204329d4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:18.006594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:18.106765 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1653/3314] 10.222.0.20 () {60 vars in 1582 bytes} [Tue Sep 6 10:57:17 2022] PUT /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/f33e5aac731246b2a8857ad8204329d4/inherited_to_projects => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:18.111099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:18.130304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6b882-65bf-47bf-bdb0-3f845429faf0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:18.222051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:18.223003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:18.223431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:18.223828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/f33e5aac731246b2a8857ad8204329d4/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:18.226240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=f33e5aac731246b2a8857ad8204329d4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:18.227557 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:18.227557 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:18.227557 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:18.230309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:18.241789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1662/3315] 10.222.0.20 () {58 vars in 1564 bytes} [Tue Sep 6 10:57:18 2022] HEAD /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/f33e5aac731246b2a8857ad8204329d4/inherited_to_projects => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:18.245889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:18.265743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bd87e-4cfd-4123-bb50-092060e9378d tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:18.283486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:18.284478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:18.284478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:18.284785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/f33e5aac731246b2a8857ad8204329d4/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:18.292491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=f33e5aac731246b2a8857ad8204329d4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:18.299579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:18.312614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role f33e5aac731246b2a8857ad8204329d4 was removed from user ec13591fd5b2402bbfccfa1922d5b639 on project d9e71b96182c49c59b610d26f2a107d3. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:18.312926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:18.318941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:18.476163 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1654/3316] 10.222.0.20 () {58 vars in 1566 bytes} [Tue Sep 6 10:57:18 2022] DELETE /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/f33e5aac731246b2a8857ad8204329d4/inherited_to_projects => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:18.480328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:18.484105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:18.518796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b09e5-ae2f-474b-8209-7c3141b42a93 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:18.537665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:18.671859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:18.673192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:18.673834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:18.674683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles/f33e5aac731246b2a8857ad8204329d4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:18.676492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f33e5aac731246b2a8857ad8204329d4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:18.677768 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:18.677768 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:18.677768 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:18.679188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:18.861193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role f33e5aac731246b2a8857ad8204329d4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:18.861474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:18.862266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:18.877506 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1663/3317] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:18 2022] DELETE /identity/v3/roles/f33e5aac731246b2a8857ad8204329d4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:18.882713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:18.906532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ace50-c515-42d0-9e16-ac9f132f657c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:18.954247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:18.985315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:18.986699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:18.987218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:18.987687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:18.989118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:18.990595 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:18.990595 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:18.990595 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:18.992093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:19.145804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:19.147045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1655/3318] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 10:57:18 2022] POST /identity/v3/roles => generated 240 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:19.147964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:19.172889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e357e-7c95-4531-9c5d-187d3d25d978 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:19.178122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:19.178855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:19.179201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:19.179535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/91f3943f64c046a3a9a1c9da205582af/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:19.183943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, group_id=5f7431fb9b194c00a205fade76aa4b58, role_id=91f3943f64c046a3a9a1c9da205582af)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:19.188375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:19.278465 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1664/3319] 10.222.0.20 () {60 vars in 1582 bytes} [Tue Sep 6 10:57:19 2022] PUT /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/91f3943f64c046a3a9a1c9da205582af/inherited_to_projects => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:19.284013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:19.299308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d589380-95d6-47f6-bdec-26e2939d77c0 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:19.420685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:19.423996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:19.425404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:19.427072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:19.432329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e22b47b1189b4dd4b2182bdd75073a70, group_id=5f7431fb9b194c00a205fade76aa4b58)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:19.434129 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:19.434129 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:19.434129 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:19.440365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:19.485522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1656/3320] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 6 10:57:19 2022] GET /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/inherited_to_projects => generated 448 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:19.485852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:19.499806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412e2fd-81e7-498c-ba58-9152e0cdd2ad tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:19.511708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:19.511708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:19.512320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:19.512850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/91f3943f64c046a3a9a1c9da205582af/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:19.515763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, group_id=5f7431fb9b194c00a205fade76aa4b58, role_id=91f3943f64c046a3a9a1c9da205582af)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:19.520747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:19.539750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:19.545809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1665/3321] 10.222.0.20 () {58 vars in 1564 bytes} [Tue Sep 6 10:57:19 2022] HEAD /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/91f3943f64c046a3a9a1c9da205582af/inherited_to_projects => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:19.552766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726017b-c3a0-4772-b19c-955cc37b2634 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:19.560043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:19.561002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:19.561368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:19.561706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/91f3943f64c046a3a9a1c9da205582af/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:19.564517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, group_id=5f7431fb9b194c00a205fade76aa4b58, role_id=91f3943f64c046a3a9a1c9da205582af)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:19.569482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:19.576848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 91f3943f64c046a3a9a1c9da205582af was removed from group 5f7431fb9b194c00a205fade76aa4b58 on domain e22b47b1189b4dd4b2182bdd75073a70. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:19.577252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:19.578142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:19.715383 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1657/3322] 10.222.0.20 () {58 vars in 1566 bytes} [Tue Sep 6 10:57:19 2022] DELETE /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/groups/5f7431fb9b194c00a205fade76aa4b58/roles/91f3943f64c046a3a9a1c9da205582af/inherited_to_projects => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:19.720235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:19.722274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:19.752109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f3763-46bc-4d19-8aa3-d9b7a0a9a995 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:19.830304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:19.831496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:19.831960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:19.833025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles/91f3943f64c046a3a9a1c9da205582af` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:19.835590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=91f3943f64c046a3a9a1c9da205582af)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:19.838202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:19.845092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:19.967538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 91f3943f64c046a3a9a1c9da205582af has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:19.967538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:19.967538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:19.969262 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1666/3323] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:19 2022] DELETE /identity/v3/roles/91f3943f64c046a3a9a1c9da205582af => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:19.974273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:20.000175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db9626-491f-40d8-87fa-f89992116c86 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:20.111738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:20.112544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:20.112933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:20.113897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:20.115146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:20.120701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:20.207114 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1658/3324] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 10:57:19 2022] POST /identity/v3/roles => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:20.212562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:20.214030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:20.230102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce32463-bfc4-468e-b2ea-5d98081dc1ac tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:20.242435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:20.243471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:20.243944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:20.244397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/a1445771ac7f48789f915517609b60e6/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:20.253266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=a1445771ac7f48789f915517609b60e6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:20.257251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:20.375141 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1667/3325] 10.222.0.20 () {60 vars in 1579 bytes} [Tue Sep 6 10:57:20 2022] PUT /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/a1445771ac7f48789f915517609b60e6/inherited_to_projects => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:20.379780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:20.395613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21820-453f-48f3-8d7a-327b8c2c833c tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:20.526145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:20.547929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:20.550609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:20.551775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:20.556101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e22b47b1189b4dd4b2182bdd75073a70, user_id=ec13591fd5b2402bbfccfa1922d5b639)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:20.571179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:20.610891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:20.613994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1659/3326] 10.222.0.20 () {58 vars in 1461 bytes} [Tue Sep 6 10:57:20 2022] GET /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/inherited_to_projects => generated 447 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:20.645935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5790b-ad6b-42ef-9ce9-ec45645251ae tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:20.661125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:20.663672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:20.664894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:20.665402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/a1445771ac7f48789f915517609b60e6/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:20.668945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=a1445771ac7f48789f915517609b60e6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:20.673875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:20.686552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1668/3327] 10.222.0.20 () {58 vars in 1561 bytes} [Tue Sep 6 10:57:20 2022] HEAD /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/a1445771ac7f48789f915517609b60e6/inherited_to_projects => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:20.690872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:20.702543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855309f-71e9-434b-801a-e19c23a796ea tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:20.709979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:20.710832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:20.711227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:20.711522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/a1445771ac7f48789f915517609b60e6/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:20.713766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=a1445771ac7f48789f915517609b60e6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:20.719720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:20.726717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role a1445771ac7f48789f915517609b60e6 was removed from user ec13591fd5b2402bbfccfa1922d5b639 on domain e22b47b1189b4dd4b2182bdd75073a70. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:20.729689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:20.729689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:20.820705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:20.821205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1660/3328] 10.222.0.20 () {58 vars in 1563 bytes} [Tue Sep 6 10:57:20 2022] DELETE /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/a1445771ac7f48789f915517609b60e6/inherited_to_projects => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:20.822543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:20.875789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f4e69-896e-4230-9abf-44e1538dc5da tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:20.889979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:21.029162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:21.029873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:21.030101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:21.030397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles/a1445771ac7f48789f915517609b60e6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:21.032321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a1445771ac7f48789f915517609b60e6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:21.033847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:21.172143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role a1445771ac7f48789f915517609b60e6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:21.174132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:21.174132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:21.177955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1669/3329] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:20 2022] DELETE /identity/v3/roles/a1445771ac7f48789f915517609b60e6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:21.183501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:21.204070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50645a6-a64f-4b00-9142-bf74e917c8fd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:21.278368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:21.367615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:21.368544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:21.369157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:21.369738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:21.370611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:21.373667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:21.480449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1661/3330] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 10:57:21 2022] POST /identity/v3/roles => generated 240 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:21.484598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:21.486374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:21.501493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103d97-1674-41a8-b420-4f678be91ab3 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:21.512093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:21.513133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:21.513886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:21.514876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:21.516246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:21.518817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:21.635602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1670/3331] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:21 2022] POST /identity/v3/projects => generated 408 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:21.637027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:21.658980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c79e76-15dd-4978-a39e-8679a201251f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:21.764715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:21.766738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:21.766738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:21.766738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/750c2d4bd3dd43b9a78acf81e41ff7dc/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:21.782289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=750c2d4bd3dd43b9a78acf81e41ff7dc)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:21.786184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:22.178898 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1662/3332] 10.222.0.20 () {60 vars in 1579 bytes} [Tue Sep 6 10:57:21 2022] PUT /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/750c2d4bd3dd43b9a78acf81e41ff7dc/inherited_to_projects => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:22.180316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:22.195944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0892-f006-4a3c-9b06-bcfffca59c56 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:22.304024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:22.304704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:22.304996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:22.305356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:22.306050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Adding query filter params (scope.project.id=d9e71b96182c49c59b610d26f2a107d3, user.id=ec13591fd5b2402bbfccfa1922d5b639) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:22.306355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:22.307410 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:22.307410 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:22.307410 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:22.310614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:22.385053 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1671/3333] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 10:57:22 2022] GET /identity/v3/role_assignments?scope.project.id=d9e71b96182c49c59b610d26f2a107d3&user.id=ec13591fd5b2402bbfccfa1922d5b639&effective => generated 648 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:22.389083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:22.410097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b4d0c-500d-4d7c-a639-e208f9306322 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:22.419410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:22.420368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:22.423118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:22.423767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:22.425038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Adding query filter params (scope.project.id=44788c16e60243bba948c6b814f05558, user.id=ec13591fd5b2402bbfccfa1922d5b639) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:22.426855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:22.429377 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:22.429377 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:22.429377 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:22.437664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:22.564582 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1663/3334] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 10:57:22 2022] GET /identity/v3/role_assignments?scope.project.id=44788c16e60243bba948c6b814f05558&user.id=ec13591fd5b2402bbfccfa1922d5b639&effective => generated 648 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:22.565804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:22.591693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb9101-675c-459f-88b6-ab96e6ce6853 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:22.607045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:22.609635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:22.610921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:22.611461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/750c2d4bd3dd43b9a78acf81e41ff7dc/inherited_to_projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:22.618083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e22b47b1189b4dd4b2182bdd75073a70, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=750c2d4bd3dd43b9a78acf81e41ff7dc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:22.634603 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:22.634603 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:22.634603 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:22.634603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:22.639640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 750c2d4bd3dd43b9a78acf81e41ff7dc was removed from user ec13591fd5b2402bbfccfa1922d5b639 on domain e22b47b1189b4dd4b2182bdd75073a70. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:22.640313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:22.640881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:22.795154 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1672/3335] 10.222.0.20 () {58 vars in 1563 bytes} [Tue Sep 6 10:57:22 2022] DELETE /identity/v3/OS-INHERIT/domains/e22b47b1189b4dd4b2182bdd75073a70/users/ec13591fd5b2402bbfccfa1922d5b639/roles/750c2d4bd3dd43b9a78acf81e41ff7dc/inherited_to_projects => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:22.799203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:22.802071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:22.807348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:22.840440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc6862-0379-4124-bdc0-924b5afe5c3b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:22.996431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:23.002409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:23.002908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:23.003241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:23.007587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Adding query filter params (scope.project.id=d9e71b96182c49c59b610d26f2a107d3, user.id=ec13591fd5b2402bbfccfa1922d5b639) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:23.007587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:23.007840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:23.007959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:23.130842 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1664/3336] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 10:57:22 2022] GET /identity/v3/role_assignments?scope.project.id=d9e71b96182c49c59b610d26f2a107d3&user.id=ec13591fd5b2402bbfccfa1922d5b639&effective => generated 228 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:23.131671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:23.148365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aa217-a1e1-48f3-a97f-ecde0c2e45bd tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:23.170639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:23.171296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:23.171602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:23.171857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:23.172587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Adding query filter params (scope.project.id=44788c16e60243bba948c6b814f05558, user.id=ec13591fd5b2402bbfccfa1922d5b639) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:23.172898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:23.174787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:23.309243 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1673/3337] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 10:57:23 2022] GET /identity/v3/role_assignments?scope.project.id=44788c16e60243bba948c6b814f05558&user.id=ec13591fd5b2402bbfccfa1922d5b639&effective => generated 228 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:23.311169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:23.325943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb249a-77f9-46f8-809f-4638673ea07b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:23.349209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:23.350247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:23.350705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:23.351201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/projects/44788c16e60243bba948c6b814f05558` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:23.354902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_project(project_id=44788c16e60243bba948c6b814f05558)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:23.358671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:23.574856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44788c16e60243bba948c6b814f05558', 'request_id': 'req-42f975f6-78b7-43f8-8709-0fe36e848f2f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:23.583532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44788c16e60243bba948c6b814f05558', 'request_id': 'req-42f975f6-78b7-43f8-8709-0fe36e848f2f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:23.599070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44788c16e60243bba948c6b814f05558', 'request_id': 'req-42f975f6-78b7-43f8-8709-0fe36e848f2f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:23.677877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] The token cache is being invalidate because project 44788c16e60243bba948c6b814f05558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:23.678784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:23.680055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:23.682708 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1665/3338] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:23 2022] DELETE /identity/v3/projects/44788c16e60243bba948c6b814f05558 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:23.686535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:23.688492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:23.717469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c719e8-0f9e-4717-a4f8-2f941094c218 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:23.820386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:23.822045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:23.822974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:23.823445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles/750c2d4bd3dd43b9a78acf81e41ff7dc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:23.829038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=750c2d4bd3dd43b9a78acf81e41ff7dc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:23.832180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:23.869462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:24.028025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 750c2d4bd3dd43b9a78acf81e41ff7dc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:24.028485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:24.030852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:24.037515 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1674/3339] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:23 2022] DELETE /identity/v3/roles/750c2d4bd3dd43b9a78acf81e41ff7dc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:24.038844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:24.070910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f975f6-78b7-43f8-8709-0fe36e848f2f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:24.238725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:24.239377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:24.239663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:24.239941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:24.240615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:24.242218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:24.438225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:24.440069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:24.444224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1666/3340] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 10:57:24 2022] POST /identity/v3/roles => generated 239 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:24.469070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379bfc3-7af1-4a60-84ed-9e9cf355d152 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:24.493858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:24.494891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:24.496939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:24.497869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:24.498568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:24.501656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:24.501848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:24.598605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:24.653052 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1675/3341] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:24 2022] POST /identity/v3/projects => generated 410 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:24.654401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:24.667431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15492e-dfe2-4d78-9c86-7f8a9961339b tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:24.783363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:24.784576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:24.785676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:24.786477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/24755cd9f3a5493bb94108612b8592a3/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:24.789842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=24755cd9f3a5493bb94108612b8592a3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:24.795690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:24.891374 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1667/3342] 10.222.0.20 () {60 vars in 1582 bytes} [Tue Sep 6 10:57:24 2022] PUT /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/24755cd9f3a5493bb94108612b8592a3/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:24.892868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:24.915537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138e0ad-39fc-400b-a7db-b7decb164a01 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:25.122349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:25.122879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:25.123445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:25.123984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:25.124840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Adding query filter params (scope.project.id=65055c3418a64ea2a418433952e7ff39, user.id=ec13591fd5b2402bbfccfa1922d5b639) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:25.126446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:25.129917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:25.313210 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1676/3343] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 10:57:24 2022] GET /identity/v3/role_assignments?scope.project.id=65055c3418a64ea2a418433952e7ff39&user.id=ec13591fd5b2402bbfccfa1922d5b639&effective => generated 649 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:25.317502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:25.336210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281348-06aa-471a-8930-1f58d8a5038e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:25.346558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:25.347288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:25.347616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:25.347925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/24755cd9f3a5493bb94108612b8592a3/inherited_to_projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:25.361439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d9e71b96182c49c59b610d26f2a107d3, user_id=ec13591fd5b2402bbfccfa1922d5b639, role_id=24755cd9f3a5493bb94108612b8592a3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:25.365287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:25.373970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 24755cd9f3a5493bb94108612b8592a3 was removed from user ec13591fd5b2402bbfccfa1922d5b639 on project d9e71b96182c49c59b610d26f2a107d3. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:25.374270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:25.375034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:25.461433 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1668/3344] 10.222.0.20 () {58 vars in 1566 bytes} [Tue Sep 6 10:57:25 2022] DELETE /identity/v3/OS-INHERIT/projects/d9e71b96182c49c59b610d26f2a107d3/users/ec13591fd5b2402bbfccfa1922d5b639/roles/24755cd9f3a5493bb94108612b8592a3/inherited_to_projects => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:25.466144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:25.467797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:25.495497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b053b-9504-46ac-8f18-96279571a487 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:25.652051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:25.652684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:25.652969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:25.653248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:25.653984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Adding query filter params (scope.project.id=65055c3418a64ea2a418433952e7ff39, user.id=ec13591fd5b2402bbfccfa1922d5b639) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:25.654290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:25.657347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:25.825159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1677/3345] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 10:57:25 2022] GET /identity/v3/role_assignments?scope.project.id=65055c3418a64ea2a418433952e7ff39&user.id=ec13591fd5b2402bbfccfa1922d5b639&effective => generated 228 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:25.831390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:25.861040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49830-77f2-406b-a8cd-ee6045dfa2d2 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:25.869362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:25.870346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:25.870908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:25.871399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/projects/65055c3418a64ea2a418433952e7ff39` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:25.873354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65055c3418a64ea2a418433952e7ff39)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:25.875521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:26.009003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:26.069115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65055c3418a64ea2a418433952e7ff39', 'request_id': 'req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.079092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65055c3418a64ea2a418433952e7ff39', 'request_id': 'req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.092308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65055c3418a64ea2a418433952e7ff39', 'request_id': 'req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.140303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:26.251198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] The token cache is being invalidate because project 65055c3418a64ea2a418433952e7ff39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:26.251464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.255535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.258669 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1669/3346] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:25 2022] DELETE /identity/v3/projects/65055c3418a64ea2a418433952e7ff39 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:26.259755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:26.261948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:26.279154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6443-1508-425e-8a22-91080d140d1f tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:26.430460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:26.433819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:26.433819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:26.433819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/roles/24755cd9f3a5493bb94108612b8592a3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:26.433819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_role(role_id=24755cd9f3a5493bb94108612b8592a3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:26.436061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:26.589975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invalidating the token cache because role 24755cd9f3a5493bb94108612b8592a3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:26.590628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.591544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:26.593963 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1678/3347] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:26 2022] DELETE /identity/v3/roles/24755cd9f3a5493bb94108612b8592a3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:26.604650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:26.624086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3ae70-32de-4ae0-bec7-b5ef9dbccc20 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:26.739156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:26.740863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:26.741324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:26.741767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/users/ec13591fd5b2402bbfccfa1922d5b639` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:26.743420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec13591fd5b2402bbfccfa1922d5b639)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:26.747273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:26.982560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec13591fd5b2402bbfccfa1922d5b639'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.012772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec13591fd5b2402bbfccfa1922d5b639'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.012772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec13591fd5b2402bbfccfa1922d5b639'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.037769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec13591fd5b2402bbfccfa1922d5b639'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.038823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec13591fd5b2402bbfccfa1922d5b639'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.133443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:27.135122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:27.136557 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1670/3348] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:26 2022] DELETE /identity/v3/users/ec13591fd5b2402bbfccfa1922d5b639 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:27.152574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bb4db-e7cb-4452-aced-b1dca768ff59 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:27.268796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:27.270023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:27.270295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:27.270857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/groups/5f7431fb9b194c00a205fade76aa4b58` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:27.291880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5f7431fb9b194c00a205fade76aa4b58)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:27.294376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:27.416181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:27.557731 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1679/3349] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 10:57:27 2022] DELETE /identity/v3/groups/5f7431fb9b194c00a205fade76aa4b58 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:27.565754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:27.565754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:27.587992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ff88a-c7fc-479e-bc85-000cac53899e tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:27.686400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:27.687618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:27.688133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:27.688650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/projects/d9e71b96182c49c59b610d26f2a107d3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:27.690196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9e71b96182c49c59b610d26f2a107d3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:27.692949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:27.854500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e71b96182c49c59b610d26f2a107d3', 'request_id': 'req-47f886dc-973c-4f15-a807-82f105103695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.867443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e71b96182c49c59b610d26f2a107d3', 'request_id': 'req-47f886dc-973c-4f15-a807-82f105103695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:27.873958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e71b96182c49c59b610d26f2a107d3', 'request_id': 'req-47f886dc-973c-4f15-a807-82f105103695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.044702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=84,keystone:DELETE=14 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:28.057085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] The token cache is being invalidate because project d9e71b96182c49c59b610d26f2a107d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:28.058375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.058375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.060031 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1671/3350] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:27 2022] DELETE /identity/v3/projects/d9e71b96182c49c59b610d26f2a107d3 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:28.064321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:28.073030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:28.095353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98dee-610b-4c0a-a2de-a33eb649dbb6 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:28.240551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:28.241448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:28.242151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:28.242487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/domains/e22b47b1189b4dd4b2182bdd75073a70` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:28.245727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e22b47b1189b4dd4b2182bdd75073a70)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:28.248635 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:28.248635 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:28.248635 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:28.251177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:28.350379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.351670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.469806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.470886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c98500b6-281d-4e5c-b28b-4eadc9b00366 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.479556 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1680/3351] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:57:28 2022] PATCH /identity/v3/domains/e22b47b1189b4dd4b2182bdd75073a70 => generated 277 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:28.480355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:28.495422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f886dc-973c-4f15-a807-82f105103695 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:28.662505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d047fe1ac5947ffa26bec42dab330e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64ca2e54da446cfa340496ee5e4a510', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:28.663993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:28.664532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:28.665055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] PATH_INFO: `/v3/domains/e22b47b1189b4dd4b2182bdd75073a70` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:28.681082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e22b47b1189b4dd4b2182bdd75073a70)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:28.683919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:28.710767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.724914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.913420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70', 'request_id': 'req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.936798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70', 'request_id': 'req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:28.954891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70', 'request_id': 'req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.244108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82489dd-1a0b-42f1-b4da-76d40d9205b2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:29.244621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82489dd-1a0b-42f1-b4da-76d40d9205b2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:29.244741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82489dd-1a0b-42f1-b4da-76d40d9205b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:29.275871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b82489dd-1a0b-42f1-b4da-76d40d9205b2 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:29.277241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b82489dd-1a0b-42f1-b4da-76d40d9205b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:29.312185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] The token cache is being invalidate because project e22b47b1189b4dd4b2182bdd75073a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:29.312784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.313133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.322257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70', 'request_id': 'req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.322993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70', 'request_id': 'req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.326732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e22b47b1189b4dd4b2182bdd75073a70', 'request_id': 'req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.334417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1672/3352] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:57:28 2022] DELETE /identity/v3/domains/e22b47b1189b4dd4b2182bdd75073a70 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:29.338597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:29.340163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:29.369619 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1681/3353] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:29.378936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c374-2841-4c9c-a650-28fa9f5f8fc2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:29.379254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c374-2841-4c9c-a650-28fa9f5f8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:29.379793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c374-2841-4c9c-a650-28fa9f5f8fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:29.407374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-84d2c374-2841-4c9c-a650-28fa9f5f8fc2 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:29.408889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-84d2c374-2841-4c9c-a650-28fa9f5f8fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:29.418241 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1682/3354] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:29.458532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd161-0fbb-45ec-8dda-6153aed2dec8 tempest-InheritsV3TestJSON-135934875 tempest-InheritsV3TestJSON-135934875-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:29.465188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:29.465976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:29.466806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:29.466806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] PATH_INFO: `/v3/users/00f0dcc6f95f4f6d94b713ac0565c278` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:29.468421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f0dcc6f95f4f6d94b713ac0565c278)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:29.470203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:29.714448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f0dcc6f95f4f6d94b713ac0565c278'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.724022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f0dcc6f95f4f6d94b713ac0565c278'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.726896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f0dcc6f95f4f6d94b713ac0565c278'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.772672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f0dcc6f95f4f6d94b713ac0565c278'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.773839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f0dcc6f95f4f6d94b713ac0565c278'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:29.876033 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1673/3355] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:29 2022] DELETE /identity/v3/users/00f0dcc6f95f4f6d94b713ac0565c278 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:29.882345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:29.883170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:29.883740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:29.909435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:29.912416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:30.000843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1683/3356] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:30.021065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:30.026680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:30.057956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:30.061970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:30.125732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291c45-a6f4-4efa-a9f3-8857a54bc5ea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:30.131130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:30.131940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:30.132224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:30.132550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:30.161844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:30.164661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:30.174566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:30.200043 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1674/3357] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:30.305239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ea14a-f513-4340-8668-83a1adc3fb11 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:30.318423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:30.319092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:30.319367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:30.321620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:30.327066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:30.344082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:30.549712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:30.554549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:30.584974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1684/3358] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:31.223162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:31.224969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:31.255635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f950af-2a46-439a-a347-e2fe52e21772 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:31.288714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:31.292088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:31.292563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:31.293014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] PATH_INFO: `/v3/projects/0d394e6682774c8a998b44ebe31155ca` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:31.304645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d394e6682774c8a998b44ebe31155ca)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:31.304814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:31.304814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:31.305031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:31.321781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f147a43-3d71-4291-a06b-c1f0be9eb3b0 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:31.335768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:31.336756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:31.338859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:31.338859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:31.343963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:31.364681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:31.369571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:31.390417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1685/3359] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:31.572371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d394e6682774c8a998b44ebe31155ca', 'request_id': 'req-7d83bc8c-30f1-4f2f-8d73-a196bb577587'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:31.600073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d394e6682774c8a998b44ebe31155ca', 'request_id': 'req-7d83bc8c-30f1-4f2f-8d73-a196bb577587'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:31.626599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d394e6682774c8a998b44ebe31155ca', 'request_id': 'req-7d83bc8c-30f1-4f2f-8d73-a196bb577587'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:31.742238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] The token cache is being invalidate because project 0d394e6682774c8a998b44ebe31155ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:31.742544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:31.743219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:31.747623 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1675/3360] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:31 2022] DELETE /identity/v3/projects/0d394e6682774c8a998b44ebe31155ca => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:31.748925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:31.767510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a368a9-d6b2-4eaa-b5a3-3a566c28b15d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:31.896131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:31.902585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:31.913412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:31.913792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:31.914084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] PATH_INFO: `/v3/users/7d047fe1ac5947ffa26bec42dab330e4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:31.916389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d047fe1ac5947ffa26bec42dab330e4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:31.918631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:31.934689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:32.227171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d047fe1ac5947ffa26bec42dab330e4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:32.261429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d047fe1ac5947ffa26bec42dab330e4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:32.263763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d047fe1ac5947ffa26bec42dab330e4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:32.265648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d047fe1ac5947ffa26bec42dab330e4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:32.283356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ac4d3881-2178-4acc-83fa-c64d05dc5983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d047fe1ac5947ffa26bec42dab330e4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:32.391617 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1686/3361] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:31 2022] DELETE /identity/v3/users/7d047fe1ac5947ffa26bec42dab330e4 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:33.051637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:33.053788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:33.086325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83bc8c-30f1-4f2f-8d73-a196bb577587 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:33.272577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:33.273304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:33.273585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:33.274097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] PATH_INFO: `/v3/projects/e64ca2e54da446cfa340496ee5e4a510` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:33.276881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64ca2e54da446cfa340496ee5e4a510)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:33.281410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:33.521288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64ca2e54da446cfa340496ee5e4a510', 'request_id': 'req-23fbbeb4-e555-431f-8ef6-9a4df518363a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:33.539428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64ca2e54da446cfa340496ee5e4a510', 'request_id': 'req-23fbbeb4-e555-431f-8ef6-9a4df518363a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:33.566470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64ca2e54da446cfa340496ee5e4a510', 'request_id': 'req-23fbbeb4-e555-431f-8ef6-9a4df518363a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:33.704775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] The token cache is being invalidate because project e64ca2e54da446cfa340496ee5e4a510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:33.705105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:33.705826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23fbbeb4-e555-431f-8ef6-9a4df518363a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:33.707930 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1676/3362] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:33 2022] DELETE /identity/v3/projects/e64ca2e54da446cfa340496ee5e4a510 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:33.712776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:33.713343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:33.713343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:33.740497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:33.742087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:33.855220 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1687/3363] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:33.869535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:33.869535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:33.869535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:33.929649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:33.931105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:33.948113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:33.984701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1677/3364] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:33.988807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:34.002343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911c7e2-1fe5-4298-b22f-a7aef0acd169 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:34.010039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:34.010914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.011424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.011883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.012731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:34.013217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:34.015271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:34.031385 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1688/3365] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:34.036027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:34.061718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:34.066612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f9b1c-beba-4b73-98c8-31dd69f170f0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:34.071857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:34.074005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.074487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.075778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.080185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:34.088867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:34.219405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1678/3366] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:34 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:34.224424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:34.239500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a460f-ba35-4381-8da5-4c225ada33c0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:34.389454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:34.391820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.391820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.391820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.391820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:34.394966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:34.520005 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1689/3367] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:34 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:34.525711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:34.542889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91712885-2cde-449f-9716-671d0aef6872 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:34.555667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:34.556970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.557478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.558355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.559430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:34.561165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:34.583364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1679/3368] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:34.587352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:34.599983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da93a2-2280-476f-998a-6e06cb5251f5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:34.604699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766feada-740f-416e-a542-73adb008d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:34.605390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766feada-740f-416e-a542-73adb008d37c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.605824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766feada-740f-416e-a542-73adb008d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.606174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766feada-740f-416e-a542-73adb008d37c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.606963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766feada-740f-416e-a542-73adb008d37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:34.608696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766feada-740f-416e-a542-73adb008d37c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:34.636261 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1690/3369] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:34.642288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:34.676317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea3ac-af9b-43b5-b7b5-98f540f7902f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:34.692364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:34.693490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.694062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.694529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] PATH_INFO: `/v3/projects/2cdaa59d6edc48d8a91e9dba0a0af693/users/c0167d8f0fe94c06b7056787036dbe81/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.744374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdaa59d6edc48d8a91e9dba0a0af693, user_id=c0167d8f0fe94c06b7056787036dbe81, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:34.747928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:34.857392 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1680/3370] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:34 2022] PUT /identity/v3/projects/2cdaa59d6edc48d8a91e9dba0a0af693/users/c0167d8f0fe94c06b7056787036dbe81/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:34.871785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:34.872549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:34.872837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:34.995742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] MFA Rules not processed for user `c0167d8f0fe94c06b7056787036dbe81`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:35.002436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:35.153252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:35.203983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:35.264633 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1691/3371] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:35.269127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:35.422852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaeb508-0214-4389-b815-f4e80807829e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:35.437776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:35.438631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:35.439120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:35.439597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:35.440433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:35.443859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:35.595969 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1681/3372] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:35 2022] POST /identity/v3/projects => generated 375 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:35.600363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:35.623497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f8465-47c4-467a-835b-59eabdae832c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:35.751816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:35.754521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:35.754521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:35.754521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:35.754976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:35.757974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:35.906469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1692/3373] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:35 2022] POST /identity/v3/users => generated 294 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:35.910274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:35.928850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100947e-03be-4811-97d7-cabead1eccae admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:35.942009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:35.943329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:35.943329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:35.946428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:35.947345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:35.952073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:35.977465 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1682/3374] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:35.984345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:36.005551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92816b-ce5e-48f8-854c-114eb1960569 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:36.014330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:36.015065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.015666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.016137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] PATH_INFO: `/v3/projects/3555bd59409740bab2941e50bd77b9eb/users/d16864b577ea4b258795bb8a0f891109/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.048425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3555bd59409740bab2941e50bd77b9eb, user_id=d16864b577ea4b258795bb8a0f891109, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:36.051659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:36.176961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:36.185117 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1693/3375] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:35 2022] PUT /identity/v3/projects/3555bd59409740bab2941e50bd77b9eb/users/d16864b577ea4b258795bb8a0f891109/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:36.189252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:36.206051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd3ed7-7916-4a68-8a2f-4a53a0fb9288 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:36.328913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400505c5-fbb8-4002-b862-28b9891b4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:36.329785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400505c5-fbb8-4002-b862-28b9891b4272 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.330288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400505c5-fbb8-4002-b862-28b9891b4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.331784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400505c5-fbb8-4002-b862-28b9891b4272 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.332675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400505c5-fbb8-4002-b862-28b9891b4272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:36.336043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400505c5-fbb8-4002-b862-28b9891b4272 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:36.359245 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1683/3376] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:36.363299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:36.375095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd0d1-f959-4ff6-a4d2-820727006799 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:36.381165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:36.381831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.382120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.383278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] PATH_INFO: `/v3/projects/3555bd59409740bab2941e50bd77b9eb/users/d16864b577ea4b258795bb8a0f891109/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.385517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3555bd59409740bab2941e50bd77b9eb, user_id=d16864b577ea4b258795bb8a0f891109, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:36.389072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:36.400254 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1694/3377] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:36 2022] PUT /identity/v3/projects/3555bd59409740bab2941e50bd77b9eb/users/d16864b577ea4b258795bb8a0f891109/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:36.410527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03236f5-61e2-4be4-9436-9eb42e2981de None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.410817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03236f5-61e2-4be4-9436-9eb42e2981de None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.411114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03236f5-61e2-4be4-9436-9eb42e2981de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.458540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c03236f5-61e2-4be4-9436-9eb42e2981de None None] MFA Rules not processed for user `d16864b577ea4b258795bb8a0f891109`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:36.460568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c03236f5-61e2-4be4-9436-9eb42e2981de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:36.583157 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1684/3378] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:36.586119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:36.594253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.594550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.594837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.605913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c21db6-e745-4379-959e-ca27ceea4493 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:36.615057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:36.616142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.616675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.617116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.617946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:36.620127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:36.622694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:36.624281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:36.696328 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1685/3379] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:57:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:57:36.710754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:36.712691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:36.720915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1695/3380] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:36 2022] POST /identity/v3/projects => generated 334 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:36.726508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:36.807414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17210d01-492e-4da6-bbae-93f5a8cfe60c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:36.824610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b44425-ebf0-4e0b-9f0c-d979e7162242 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:36.830432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:36.831079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.831394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.832200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.833005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:36.834941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:36.907970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:36.908732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:36.909098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:36.910116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:36.962955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1696/3381] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 10:57:36 2022] POST /identity/v3/projects => generated 333 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:36.966687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:37.075727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:37.079654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:37.132678 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1686/3382] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 10:57:37.176274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712421f4-99e2-4a8b-adb9-f8079c090b31 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:37.191102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:37.191102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:37.193576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:37.193973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:37.195570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:37.203829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:37.261744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:37.353655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1697/3383] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:36 2022] POST /identity/v3/projects => generated 358 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:37.357977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:37.373040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb67e-1e02-481d-a1b6-a0fa7d937732 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:37.451425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:37.452136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:37.452525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:37.452906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:37.459090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:37.462737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:37.491313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1687/3384] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 10:57:37 2022] GET /identity/v3/projects => generated 7988 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:37.491876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:37.504023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54201584-34c7-423f-891f-243685a16e53 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:37.508875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:37.509518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:37.509802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:37.510075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:37.510864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:37.511219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:37.512413 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:37.512413 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:37.512413 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:37.513561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:37.534820 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1698/3385] 10.222.0.20 () {58 vars in 1158 bytes} [Tue Sep 6 10:57:37 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:37.542495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:37.553227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aea711-1068-4136-a903-95b79d91b8e2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:37.558346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:37.558949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:37.559266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:37.559545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:37.560209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Adding query filter params (parent_id=b941c0d2e5fa4653aa0e654f9dba23a6) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:37.560521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:37.562857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:37.587148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:37.591119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1688/3386] 10.222.0.20 () {58 vars in 1216 bytes} [Tue Sep 6 10:57:37 2022] GET /identity/v3/projects?parent_id=b941c0d2e5fa4653aa0e654f9dba23a6 => generated 498 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:37.602103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b964f-3fe0-40b4-846d-dfd80ffd8650 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:37.609622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:37.610375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:37.610798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:37.611228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects/f5c4aee42626438e974a2b32d398f8de` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:37.613317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5c4aee42626438e974a2b32d398f8de)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:37.615744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:37.618506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:37.798032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c4aee42626438e974a2b32d398f8de', 'request_id': 'req-d054866a-1a4e-4cb2-a065-b89b323c23f9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:37.809480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c4aee42626438e974a2b32d398f8de', 'request_id': 'req-d054866a-1a4e-4cb2-a065-b89b323c23f9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:37.828051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c4aee42626438e974a2b32d398f8de', 'request_id': 'req-d054866a-1a4e-4cb2-a065-b89b323c23f9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:37.908455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] The token cache is being invalidate because project f5c4aee42626438e974a2b32d398f8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:37.908838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:37.909951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:37.913668 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1699/3387] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:37 2022] DELETE /identity/v3/projects/f5c4aee42626438e974a2b32d398f8de => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:37.917624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:37.919517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:37.936521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aafa6a-2c2d-406b-ad27-093d84643cb2 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:38.025065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:38.025697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:38.025997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:38.026251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects/b941c0d2e5fa4653aa0e654f9dba23a6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:38.027588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b941c0d2e5fa4653aa0e654f9dba23a6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:38.029571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:38.076830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:38.089219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:38.170957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054866a-1a4e-4cb2-a065-b89b323c23f9 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:38.178236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:38.181327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:38.182106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:38.182603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:38.188792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:38.236638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b941c0d2e5fa4653aa0e654f9dba23a6', 'request_id': 'req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.238184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b941c0d2e5fa4653aa0e654f9dba23a6', 'request_id': 'req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.245039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b941c0d2e5fa4653aa0e654f9dba23a6', 'request_id': 'req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.299984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:38.302552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:38.337000 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1700/3388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:38.365349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] The token cache is being invalidate because project b941c0d2e5fa4653aa0e654f9dba23a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:38.365829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.367368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.370002 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1689/3389] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:37 2022] DELETE /identity/v3/projects/b941c0d2e5fa4653aa0e654f9dba23a6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:38.374367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:38.396997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a0df-5ee1-4245-94bf-b4606826ab2e service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:38.567197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16864b577ea4b258795bb8a0f891109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3555bd59409740bab2941e50bd77b9eb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:38.569110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:38.569110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:38.569110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] PATH_INFO: `/v3/projects/916341659bd74416a5fd30c82d342a3c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:38.570360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=916341659bd74416a5fd30c82d342a3c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:38.572807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:38.758623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916341659bd74416a5fd30c82d342a3c', 'request_id': 'req-a9165850-d38d-415c-b932-c9885cbab941'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.780485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916341659bd74416a5fd30c82d342a3c', 'request_id': 'req-a9165850-d38d-415c-b932-c9885cbab941'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.794048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916341659bd74416a5fd30c82d342a3c', 'request_id': 'req-a9165850-d38d-415c-b932-c9885cbab941'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.809768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:38.884511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] The token cache is being invalidate because project 916341659bd74416a5fd30c82d342a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:38.884835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.885553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a9165850-d38d-415c-b932-c9885cbab941 tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:38.890403 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1701/3390] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:38 2022] DELETE /identity/v3/projects/916341659bd74416a5fd30c82d342a3c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:38.891411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:38.893265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:38.975589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19fa10-fb4d-49e7-8bd4-287235a6c00f tempest-ListProjectsTestJSON-796736358 tempest-ListProjectsTestJSON-796736358-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:39.039947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:39.040598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:39.041151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:39.041608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] PATH_INFO: `/v3/users/c0167d8f0fe94c06b7056787036dbe81` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:39.043078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0167d8f0fe94c06b7056787036dbe81)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:39.051272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:39.070478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:39.305551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0167d8f0fe94c06b7056787036dbe81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:39.331070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0167d8f0fe94c06b7056787036dbe81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:39.335028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0167d8f0fe94c06b7056787036dbe81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:39.358775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0167d8f0fe94c06b7056787036dbe81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:39.359922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0167d8f0fe94c06b7056787036dbe81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:39.444022 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1690/3391] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:38 2022] DELETE /identity/v3/users/c0167d8f0fe94c06b7056787036dbe81 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:39.448735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:39.449236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:39.449348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:39.475965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:39.477522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:39.547128 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1702/3392] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:39.591121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:39.593021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:39.684030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9286ce-ad82-4c4d-bfad-dbd99c904142 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:39.688903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:39.689775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:39.690243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:39.691286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:39.707982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:39.710945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:39.742598 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1691/3393] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:39.805323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:40.456146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:40.707908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:40.852879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:40.854659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:40.893426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94d63-bd31-44de-ac85-ccde77b2bc77 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:40.895474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:40.896500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:40.896982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:40.897429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] PATH_INFO: `/v3/projects/2cdaa59d6edc48d8a91e9dba0a0af693` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:40.899049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdaa59d6edc48d8a91e9dba0a0af693)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:40.901281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:41.062062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdaa59d6edc48d8a91e9dba0a0af693', 'request_id': 'req-7540c904-b720-4fd0-8e68-1db1496cbfbf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.090645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdaa59d6edc48d8a91e9dba0a0af693', 'request_id': 'req-7540c904-b720-4fd0-8e68-1db1496cbfbf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.099820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdaa59d6edc48d8a91e9dba0a0af693', 'request_id': 'req-7540c904-b720-4fd0-8e68-1db1496cbfbf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.244660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] The token cache is being invalidate because project 2cdaa59d6edc48d8a91e9dba0a0af693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:41.245291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.246211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7540c904-b720-4fd0-8e68-1db1496cbfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.248714 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1703/3394] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:40 2022] DELETE /identity/v3/projects/2cdaa59d6edc48d8a91e9dba0a0af693 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:41.253052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:41.275170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de5a1-36e5-46f9-b69d-e6946bea3886 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:41.393629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:41.395706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:41.397111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:41.397598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] PATH_INFO: `/v3/users/d16864b577ea4b258795bb8a0f891109` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:41.400678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16864b577ea4b258795bb8a0f891109)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:41.407274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:41.450798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:41.813574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16864b577ea4b258795bb8a0f891109'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.824723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16864b577ea4b258795bb8a0f891109'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.825727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16864b577ea4b258795bb8a0f891109'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.839593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16864b577ea4b258795bb8a0f891109'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.840471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16864b577ea4b258795bb8a0f891109'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:41.965388 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1692/3395] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:41 2022] DELETE /identity/v3/users/d16864b577ea4b258795bb8a0f891109 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:42.690092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:42.928764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c5c72-429e-4484-9c95-0b837997ce5d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:42.929056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c5c72-429e-4484-9c95-0b837997ce5d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:42.929338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c5c72-429e-4484-9c95-0b837997ce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:42.978933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-401c5c72-429e-4484-9c95-0b837997ce5d None None] MFA Rules not processed for user `6c557446cb39475dba1fc800d061b9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:42.978933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-401c5c72-429e-4484-9c95-0b837997ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:43.134680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:43.136285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:43.225195 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1704/3396] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:43.264043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7179-f3fc-4d6d-a5a4-8ebb1b46ef53 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:43.270539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:43.271559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:43.272026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:43.272516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] PATH_INFO: `/v3/projects/3555bd59409740bab2941e50bd77b9eb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:43.274779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3555bd59409740bab2941e50bd77b9eb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:43.277091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:43.469610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3555bd59409740bab2941e50bd77b9eb', 'request_id': 'req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:43.480084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3555bd59409740bab2941e50bd77b9eb', 'request_id': 'req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:43.490580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3555bd59409740bab2941e50bd77b9eb', 'request_id': 'req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:43.556879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] The token cache is being invalidate because project 3555bd59409740bab2941e50bd77b9eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:43.557196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:43.557951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1b275030-63a2-4ca0-93a5-bebbe33f3c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:43.559546 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1693/3397] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:43 2022] DELETE /identity/v3/projects/3555bd59409740bab2941e50bd77b9eb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:43.564413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:43.564700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:43.564979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:43.588340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:43.590341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:43.669244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:43.669966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:43.670331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:43.676266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1705/3398] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:43.707120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:43.708914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:43.725789 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1694/3399] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:43.729950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:43.763695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c82f6-9524-4b7e-8744-a598e4633428 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:43.769294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:43.785820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:43.786463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:43.795294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:43.795294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:43.795294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:43.795294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:43.798527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:43.837502 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1706/3400] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:43.838871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:43.859732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47277f7-aedd-4962-9b1c-3b125fa72730 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:43.878918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:43.879933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:43.881465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:43.881942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:43.883800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:43.886318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:44.015923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1695/3401] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:43 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:44.017095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:44.027526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293426d-a603-487d-874f-a923a70a11a8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:44.135431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:44.136167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:44.136722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:44.137217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:44.138263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:44.140804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:44.261722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1707/3402] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:44 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:44.269715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:44.289759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bada4-beee-4f1d-b109-da854af34e76 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:44.301525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:44.302725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:44.303205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:44.303768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:44.308519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:44.308519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:44.328475 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1696/3403] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:44.331704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:44.353052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4b3a3-35de-4d24-8260-8734315b227a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:44.358362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858e2a1-d633-431e-ad98-bfaa581f309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:44.360200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e2a1-d633-431e-ad98-bfaa581f309d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:44.360200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e2a1-d633-431e-ad98-bfaa581f309d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:44.360200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e2a1-d633-431e-ad98-bfaa581f309d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:44.360615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858e2a1-d633-431e-ad98-bfaa581f309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:44.363081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858e2a1-d633-431e-ad98-bfaa581f309d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:44.383193 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1708/3404] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:44.384692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:44.397425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7968-af67-444e-bf43-46d265172ccd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:44.402668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:44.403358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:44.403646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:44.403928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] PATH_INFO: `/v3/projects/0aa9df6b35a54e70b0dd51b81a367d50/users/a5deccf4736d467a853df3fada576b1f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:44.424458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa9df6b35a54e70b0dd51b81a367d50, user_id=a5deccf4736d467a853df3fada576b1f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:44.428797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:44.510647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1697/3405] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:44 2022] PUT /identity/v3/projects/0aa9df6b35a54e70b0dd51b81a367d50/users/a5deccf4736d467a853df3fada576b1f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:44.520690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:44.520902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:44.521389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:44.558382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] MFA Rules not processed for user `a5deccf4736d467a853df3fada576b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:44.560094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:44.646634 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1709/3406] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:44.651575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:44.744633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18f19b-55fc-4989-b606-9c4253de765b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:44.749438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:44.750053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:44.750336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:44.750607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:44.751304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:44.753834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:44.880897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:44.900604 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1698/3407] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:44 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:44.906596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4a0fc-847f-4299-8976-fa5c3aabec43 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:45.127860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:45.129009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:45.129712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:45.132800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:45.133063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:45.138285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:45.275525 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1710/3408] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:44 2022] POST /identity/v3/users => generated 289 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:45.277677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:45.302531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11e11-2ff7-4e63-9323-fb5bc180543f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:45.313493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:45.314181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:45.314472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:45.314752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:45.315466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:45.317289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:45.362921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:45.372388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:45.372566 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1699/3409] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:45.403667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073951-6d96-419d-99d7-df95864f691e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:45.410862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:45.411922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:45.411922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:45.412336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] PATH_INFO: `/v3/projects/389b372ef1e34744a2decdf2d498faf0/users/eb0858494c8049eaa7da807232971a94/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:45.474586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389b372ef1e34744a2decdf2d498faf0, user_id=eb0858494c8049eaa7da807232971a94, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:45.479515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:45.583303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1711/3410] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:45 2022] PUT /identity/v3/projects/389b372ef1e34744a2decdf2d498faf0/users/eb0858494c8049eaa7da807232971a94/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:45.587531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:45.607686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22466-f1e2-4361-a338-5a33b95e0af1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:45.806975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da925dc6-3b26-4a69-89d3-ecb4fc196167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:45.807883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da925dc6-3b26-4a69-89d3-ecb4fc196167 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:45.808436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da925dc6-3b26-4a69-89d3-ecb4fc196167 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:45.816377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da925dc6-3b26-4a69-89d3-ecb4fc196167 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:45.817325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da925dc6-3b26-4a69-89d3-ecb4fc196167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:45.819179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da925dc6-3b26-4a69-89d3-ecb4fc196167 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:45.859445 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1700/3411] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:45.859550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:45.904373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c8e8-47ca-4153-8a56-51f666a61c87 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:45.929719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:45.930434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:45.930722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:45.931002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] PATH_INFO: `/v3/projects/389b372ef1e34744a2decdf2d498faf0/users/eb0858494c8049eaa7da807232971a94/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:45.936326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389b372ef1e34744a2decdf2d498faf0, user_id=eb0858494c8049eaa7da807232971a94, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:45.939031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:45.984199 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1712/3412] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:45 2022] PUT /identity/v3/projects/389b372ef1e34744a2decdf2d498faf0/users/eb0858494c8049eaa7da807232971a94/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:45.986112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:45.988562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:45.990569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:46.052086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] MFA Rules not processed for user `eb0858494c8049eaa7da807232971a94`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:46.056525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:46.250032 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1701/3413] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:46.252010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:46.274412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465cdf-44b8-44cc-9e86-54bdf533cc28 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:46.295455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:46.296464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:46.298386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:46.298846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:46.299760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:46.313506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:46.328334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:46.434053 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1713/3414] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 10:57:46 2022] POST /identity/v3/domains => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:46.438582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:46.458557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e0f41-38f3-4146-a602-aec9d682b5ef None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:46.584319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:46.584973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:46.585264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:46.585541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:46.586202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:46.588572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:46.769577 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1702/3415] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:46 2022] POST /identity/v3/users => generated 345 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:46.769802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:46.787037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b4d7-4b55-43d4-a8da-347f1c743330 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:46.808729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:46.811728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:46.814092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:46.814384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:46.815077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:46.824149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:46.974424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:46.981768 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1714/3416] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:46 2022] POST /identity/v3/users => generated 323 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:46.985161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.001913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936ad0d-fb98-4cfa-a701-0f76969f718e tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.013302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.015668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.019437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.019745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users/2ba9d1c2d378458e9a133e0895a1d6c6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.094831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:get_user(user_id=2ba9d1c2d378458e9a133e0895a1d6c6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.107747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.116335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.123302 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1703/3417] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:57:46 2022] GET /identity/v3/users/2ba9d1c2d378458e9a133e0895a1d6c6 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:47.138121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4b94-aaee-475a-b57d-7489fa8ca998 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.140089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.141496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:47.158087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.159602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.161364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.165919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.167433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Adding query filter params (domain_id=aba56c28ddcd4723b3835a82a9c8cf2e) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:47.168019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.171461 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:47.171461 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:57:47.171461 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:57:47.173670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.223447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1715/3418] 10.222.0.20 () {58 vars in 1207 bytes} [Tue Sep 6 10:57:47 2022] GET /identity/v3/users?domain_id=aba56c28ddcd4723b3835a82a9c8cf2e => generated 482 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:47.228637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.246632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f598a3-72f0-4257-a431-676bf6aa0e92 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.267319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.269563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.269563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.269563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.269563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.278427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.368282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ca23-5fb2-49a9-8aff-6f2a740b1384 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.384252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.388429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.388730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.389014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] PATH_INFO: `/v3/users/32f3202af5744d13983968b116ea9fd4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.390499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f3202af5744d13983968b116ea9fd4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.392604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.448601 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1716/3419] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:47 2022] GET /identity/v3/users => generated 9174 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:47.466684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.501755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8cda-65d2-4d38-bb88-c960521d5dfa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.509758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.510994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.511484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.511983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.512945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Adding query filter params (name=tempest-test_user-61554493) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:47.513413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.515574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.561468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1717/3420] 10.222.0.20 () {58 vars in 1185 bytes} [Tue Sep 6 10:57:47 2022] GET /identity/v3/users?name=tempest-test_user-61554493 => generated 471 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:47.571535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.609225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b813-3ca6-474d-8f9a-e164d2a16b79 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.619262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.620669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.621175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.621780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.622781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:47.625470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.633355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.701209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f3202af5744d13983968b116ea9fd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:47.708086 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1718/3421] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 10:57:47 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:47.713662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:47.725255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f3202af5744d13983968b116ea9fd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:47.726337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f3202af5744d13983968b116ea9fd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:47.760875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81755-3874-45ab-bc18-0a7346c05efa tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:47.771869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f3202af5744d13983968b116ea9fd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:47.773182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f3202af5744d13983968b116ea9fd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:47.774223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:47.779582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:47.779582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:47.779582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users/40b9ecf38a62464f950b2c5889853f10` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:47.827707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=40b9ecf38a62464f950b2c5889853f10)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:47.835446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:47.902758 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1704/3422] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:47 2022] DELETE /identity/v3/users/32f3202af5744d13983968b116ea9fd4 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:48.039917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:48.041452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:48.055644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b9ecf38a62464f950b2c5889853f10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.081521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b9ecf38a62464f950b2c5889853f10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.081521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b9ecf38a62464f950b2c5889853f10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.081521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b9ecf38a62464f950b2c5889853f10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.104218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b9ecf38a62464f950b2c5889853f10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.172314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d61b2-6bc9-4e98-906e-e6c69276ceea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:48.175954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:48.179929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:48.180686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:48.180976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:48.184549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] PATH_INFO: `/v3/users/2d0621ebe85c47c383137b4db0814279` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:48.184549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0621ebe85c47c383137b4db0814279)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:48.184761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:48.210902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1719/3423] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:47 2022] DELETE /identity/v3/users/40b9ecf38a62464f950b2c5889853f10 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:48.214981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:48.217587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:48.227383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:48.370979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3eec0-33d3-49c1-bdaf-94b7e98b482a tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:48.388309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:48.388309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:48.388309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:48.388745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/users/2ba9d1c2d378458e9a133e0895a1d6c6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:48.389647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2ba9d1c2d378458e9a133e0895a1d6c6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:48.391737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:48.474146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0621ebe85c47c383137b4db0814279'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.494172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0621ebe85c47c383137b4db0814279'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.494172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0621ebe85c47c383137b4db0814279'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.547803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0621ebe85c47c383137b4db0814279'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.547803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0621ebe85c47c383137b4db0814279'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.977997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba9d1c2d378458e9a133e0895a1d6c6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.984925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba9d1c2d378458e9a133e0895a1d6c6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.985722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba9d1c2d378458e9a133e0895a1d6c6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.986434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba9d1c2d378458e9a133e0895a1d6c6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:48.998279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba9d1c2d378458e9a133e0895a1d6c6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.017115 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1705/3424] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:48 2022] DELETE /identity/v3/users/2d0621ebe85c47c383137b4db0814279 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:49.018042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:49.021669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:49.127445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0f34-2fb8-4f83-8584-f59a6be83c2d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:49.132817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:49.133506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:49.134018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:49.134365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] PATH_INFO: `/v3/projects/ea18ad9969aa4157a6c66af6d94ccc3e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:49.136061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea18ad9969aa4157a6c66af6d94ccc3e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:49.140036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:49.201935 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1720/3425] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:48 2022] DELETE /identity/v3/users/2ba9d1c2d378458e9a133e0895a1d6c6 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:49.206914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:49.208650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:49.295278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea18ad9969aa4157a6c66af6d94ccc3e', 'request_id': 'req-1cefe53d-9bba-4488-950a-941e9f4a3065'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.305958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea18ad9969aa4157a6c66af6d94ccc3e', 'request_id': 'req-1cefe53d-9bba-4488-950a-941e9f4a3065'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.307549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0b804-2eed-4699-88dd-99deb9f01886 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:49.319550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea18ad9969aa4157a6c66af6d94ccc3e', 'request_id': 'req-1cefe53d-9bba-4488-950a-941e9f4a3065'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.377948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:49.378700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:49.379243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:49.387910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/domains/aba56c28ddcd4723b3835a82a9c8cf2e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:49.391786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aba56c28ddcd4723b3835a82a9c8cf2e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:49.393649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:49.422871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.423728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.441919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] The token cache is being invalidate because project ea18ad9969aa4157a6c66af6d94ccc3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:49.442327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.443031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.445608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1706/3426] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:49 2022] DELETE /identity/v3/projects/ea18ad9969aa4157a6c66af6d94ccc3e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:49.446543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:49.449927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:49.534906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefe53d-9bba-4488-950a-941e9f4a3065 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:49.575658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.576274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cc257b8-9900-4931-8543-c247d0df00d0 tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.592470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1721/3427] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:57:49 2022] PATCH /identity/v3/domains/aba56c28ddcd4723b3835a82a9c8cf2e => generated 277 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:57:49.594311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:49.594791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:49.595294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:49.625802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:49.626765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:49.627304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:49.627850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] PATH_INFO: `/v3/projects/0bce1bf271594425ad60e24f40b3b60d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:49.629273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bce1bf271594425ad60e24f40b3b60d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:49.632119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:49.633451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:49.634399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:49.646303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1722/3428] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:49.647280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:49.649258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:49.741614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aef183-f03c-47f8-aca9-10bd06603882 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:49.747181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb0858494c8049eaa7da807232971a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '389b372ef1e34744a2decdf2d498faf0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:49.747919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:49.748274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:49.748627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] PATH_INFO: `/v3/domains/aba56c28ddcd4723b3835a82a9c8cf2e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:49.761093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aba56c28ddcd4723b3835a82a9c8cf2e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:49.762905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:49.804098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bce1bf271594425ad60e24f40b3b60d', 'request_id': 'req-0a545377-db78-4ba6-b2f6-8c4f046a4333'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.814130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.817906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.818397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bce1bf271594425ad60e24f40b3b60d', 'request_id': 'req-0a545377-db78-4ba6-b2f6-8c4f046a4333'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.837375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bce1bf271594425ad60e24f40b3b60d', 'request_id': 'req-0a545377-db78-4ba6-b2f6-8c4f046a4333'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.952668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] The token cache is being invalidate because project 0bce1bf271594425ad60e24f40b3b60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:49.953349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.954226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a545377-db78-4ba6-b2f6-8c4f046a4333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.961102 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1707/3429] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:49 2022] DELETE /identity/v3/projects/0bce1bf271594425ad60e24f40b3b60d => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:49.963426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919571-f3e5-4be8-9776-a6d23d98ae5a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:49.963886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919571-f3e5-4be8-9776-a6d23d98ae5a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:49.964324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919571-f3e5-4be8-9776-a6d23d98ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:49.966252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e', 'request_id': 'req-962e58ae-1231-4c39-97dc-4c11d1f912cd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:49.991524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e', 'request_id': 'req-962e58ae-1231-4c39-97dc-4c11d1f912cd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.001068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e', 'request_id': 'req-962e58ae-1231-4c39-97dc-4c11d1f912cd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.007366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f3919571-f3e5-4be8-9776-a6d23d98ae5a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:50.009486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f3919571-f3e5-4be8-9776-a6d23d98ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.097248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1708/3430] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:50.099492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.100002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.100625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.113957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] The token cache is being invalidate because project aba56c28ddcd4723b3835a82a9c8cf2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:50.114385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.115345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.127493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e', 'request_id': 'req-962e58ae-1231-4c39-97dc-4c11d1f912cd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.128890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e', 'request_id': 'req-962e58ae-1231-4c39-97dc-4c11d1f912cd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.138265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aba56c28ddcd4723b3835a82a9c8cf2e', 'request_id': 'req-962e58ae-1231-4c39-97dc-4c11d1f912cd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.142942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:50.145563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.148918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1723/3431] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:57:49 2022] DELETE /identity/v3/domains/aba56c28ddcd4723b3835a82a9c8cf2e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:50.148918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.149187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.171796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e58ae-1231-4c39-97dc-4c11d1f912cd tempest-UsersV3TestJSON-945016890 tempest-UsersV3TestJSON-945016890-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.181400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1709/3432] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:50.182468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.184760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.194656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.194656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.194656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.194656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.195206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:50.195206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.196090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014e5d-da0f-4d17-b88f-ed9265e3ed35 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.199828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f992-2d83-4356-8927-e65dea50fc14 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.205415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.206716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.206999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.207348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] PATH_INFO: `/v3/users/a5deccf4736d467a853df3fada576b1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.208623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5deccf4736d467a853df3fada576b1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.210706 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1724/3433] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:50.212057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.212419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.212837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.214844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.259515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:50.260752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.279181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1725/3434] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:50.280642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.291591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82fac-e631-428b-9ec6-d410bf572bb9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.297389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.298266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.298794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.299371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.300259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.304948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.441422 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1726/3435] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:50 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:50.442852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.477804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5deccf4736d467a853df3fada576b1f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.485359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5deccf4736d467a853df3fada576b1f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.486146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5deccf4736d467a853df3fada576b1f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.503946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5deccf4736d467a853df3fada576b1f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.504715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5deccf4736d467a853df3fada576b1f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:50.530849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbac13c-7549-46c7-8a4c-d94e1439858b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.535992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.536734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.537022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.537301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.537962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:50.538270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.540374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.556791 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1727/3436] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:50.561538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.563518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.590882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38520b2-9fe0-4cb2-8cc5-cffd752fa8ca admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.590882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc5bf2-5bac-4af3-b6c2-c1eaf478d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.598123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5bf2-5bac-4af3-b6c2-c1eaf478d94e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.598123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5bf2-5bac-4af3-b6c2-c1eaf478d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.598123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc5bf2-5bac-4af3-b6c2-c1eaf478d94e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.598123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc5bf2-5bac-4af3-b6c2-c1eaf478d94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.598123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc5bf2-5bac-4af3-b6c2-c1eaf478d94e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.606444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1710/3437] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:50 2022] DELETE /identity/v3/users/a5deccf4736d467a853df3fada576b1f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:50.610815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.614274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.614446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:50.680889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:50.684167 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1728/3438] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:50 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:50.684167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.684167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.684167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.708284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:50.708562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.725610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e742f3-a917-4d63-a127-bd305da9e38a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.730758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.731414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.731701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.731981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.732627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.734550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.790234 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1729/3439] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:50.795097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.807399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addc799-515b-46c8-aa1f-717057476ca7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:50.812226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:50.812905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:50.813267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:50.813620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:50.814370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:50.816630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:50.831794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1730/3440] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:50.831794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.833513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:50.920198 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1711/3441] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:50 2022] POST /identity/v3/projects => generated 385 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:50.920198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:50.935873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae69bb-46fc-4704-8d90-7a345ff4b82d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.003282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.003783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.004103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.004477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.051815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fc6a3-34e3-4ab4-8021-4ef25110980f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.058095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.058989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.059425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.059813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.060559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.062528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.078351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1712/3442] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:51.079803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.094119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539929fe-e623-4255-a2ba-a013189dd542 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.097217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.099035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.100806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.102531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.103494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.103494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.104191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.106955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.111429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1731/3443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:51.112397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.123584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adab16-5d10-4087-84ae-7de0b293803e service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.132476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.132476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.132476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.132476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] PATH_INFO: `/v3/projects/97a345aba082431e913a57ea6837f2b9/users/d235aaaa2f3f44a7bb81de99ffa7dfde/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.153108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a345aba082431e913a57ea6837f2b9, user_id=d235aaaa2f3f44a7bb81de99ffa7dfde, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.158151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.241987 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1713/3444] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:51 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:51.243178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.254318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e9e7e-ff26-4d80-9d8d-0dc28255de06 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.259930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84ef2-2c46-4a4c-a4e3-17e6b129732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.260542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84ef2-2c46-4a4c-a4e3-17e6b129732a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.261572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84ef2-2c46-4a4c-a4e3-17e6b129732a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.261572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84ef2-2c46-4a4c-a4e3-17e6b129732a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.265099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84ef2-2c46-4a4c-a4e3-17e6b129732a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.266171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84ef2-2c46-4a4c-a4e3-17e6b129732a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.268371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1732/3445] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:51 2022] PUT /identity/v3/projects/97a345aba082431e913a57ea6837f2b9/users/d235aaaa2f3f44a7bb81de99ffa7dfde/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:51.280309 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1714/3446] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:57:51.286437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.344013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.344306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.344626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.375359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] MFA Rules not processed for user `d235aaaa2f3f44a7bb81de99ffa7dfde`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:51.376058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e4f17-7657-4b47-82c6-29f292d4bded admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.376677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:51.391814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.392439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.392721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.393930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.394396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.396314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.418306 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1733/3447] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:51.424200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.439563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1ceb2-da40-4fe5-8103-7799e9e51031 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.445610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10f84a-020b-435d-8832-2fc9912f9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.446278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f84a-020b-435d-8832-2fc9912f9c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.446561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f84a-020b-435d-8832-2fc9912f9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.446850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f84a-020b-435d-8832-2fc9912f9c00 admin admin] PATH_INFO: `/v3/projects/d437a54271e54aa69c5a6fb256f0cdd1/users/1aabaadd397349bdb8b02ca1821c55c4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.464519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10f84a-020b-435d-8832-2fc9912f9c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d437a54271e54aa69c5a6fb256f0cdd1, user_id=1aabaadd397349bdb8b02ca1821c55c4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.466899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10f84a-020b-435d-8832-2fc9912f9c00 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.476179 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1715/3448] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:57:51.488331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.490663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:51.577783 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1734/3449] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:51 2022] PUT /identity/v3/projects/d437a54271e54aa69c5a6fb256f0cdd1/users/1aabaadd397349bdb8b02ca1821c55c4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:51.600405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.600688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.600994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.651246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] MFA Rules not processed for user `1aabaadd397349bdb8b02ca1821c55c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:51.652747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:51.698517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751734a0-34be-4177-9683-ad8a4f5541fd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.765347 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1735/3450] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:51.775313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.777026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:51.828606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.829374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.829724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.830204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.890464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3427686-8d14-47a6-ac96-85677a909d46 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:51.904371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:51.905599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:51.906120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:51.907085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:51.912739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.919982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.920235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:51.922999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:51.934361 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1736/3451] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:51.944885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1716/3452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:51.948244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:51.958698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:52.083745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b439f05-889e-41d7-97bd-0af0096c4d7e service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:52.083745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:52.083745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:52.083745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:52.084306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] PATH_INFO: `/v3/projects/0aa9df6b35a54e70b0dd51b81a367d50` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:52.085872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa9df6b35a54e70b0dd51b81a367d50)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:52.096073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:52.245893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:52.253939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa9df6b35a54e70b0dd51b81a367d50', 'request_id': 'req-623a6981-1f2c-49be-b2b8-435849a05be4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.260278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa9df6b35a54e70b0dd51b81a367d50', 'request_id': 'req-623a6981-1f2c-49be-b2b8-435849a05be4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.266913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa9df6b35a54e70b0dd51b81a367d50', 'request_id': 'req-623a6981-1f2c-49be-b2b8-435849a05be4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.349985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] The token cache is being invalidate because project 0aa9df6b35a54e70b0dd51b81a367d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:52.350983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.352134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.356698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1737/3453] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:51 2022] DELETE /identity/v3/projects/0aa9df6b35a54e70b0dd51b81a367d50 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:52.365010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:52.378245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eedb8-f52a-47ec-acfe-dec0bd631e07 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:52.474502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:52.476029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:52.476315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:52.476711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] PATH_INFO: `/v3/users/eb0858494c8049eaa7da807232971a94` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:52.478997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0858494c8049eaa7da807232971a94)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:52.480865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:52.714217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:52.716872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:52.733918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6981-1f2c-49be-b2b8-435849a05be4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:52.739316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:52.739970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:52.740322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:52.740657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] PATH_INFO: `/v3/users/d235aaaa2f3f44a7bb81de99ffa7dfde` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:52.741879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d235aaaa2f3f44a7bb81de99ffa7dfde)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:52.744920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:52.779518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0858494c8049eaa7da807232971a94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.788291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0858494c8049eaa7da807232971a94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.789422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0858494c8049eaa7da807232971a94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.803608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0858494c8049eaa7da807232971a94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.804534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6bb2ccb-c3f8-40fd-9a70-55c5077abbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0858494c8049eaa7da807232971a94'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.838164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:52.866382 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1717/3454] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:52 2022] DELETE /identity/v3/users/eb0858494c8049eaa7da807232971a94 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:52.949923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd235aaaa2f3f44a7bb81de99ffa7dfde'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.962711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd235aaaa2f3f44a7bb81de99ffa7dfde'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.963928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd235aaaa2f3f44a7bb81de99ffa7dfde'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.964807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd235aaaa2f3f44a7bb81de99ffa7dfde'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:52.985623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd235aaaa2f3f44a7bb81de99ffa7dfde'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:53.068188 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1738/3455] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:52 2022] DELETE /identity/v3/users/d235aaaa2f3f44a7bb81de99ffa7dfde => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:53.072551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:53.072863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:53.073317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:53.096005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:53.098257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:53.163507 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1718/3456] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:53.246733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:53.282150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:53.283697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:53.374091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3ef2-3786-4995-9b26-37cb07860da5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:53.377959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55935-44d3-4649-9f50-85d79688dea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:53.378583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55935-44d3-4649-9f50-85d79688dea2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:53.378866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55935-44d3-4649-9f50-85d79688dea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:53.379219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55935-44d3-4649-9f50-85d79688dea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:53.389302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55935-44d3-4649-9f50-85d79688dea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:53.390769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55935-44d3-4649-9f50-85d79688dea2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:53.401410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1739/3457] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:57:53.456423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:53.456423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:53.474368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa353a7-4326-4b89-93ff-27fbd751223a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:53.479974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:53.480587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:53.480941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:53.481228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] PATH_INFO: `/v3/projects/389b372ef1e34744a2decdf2d498faf0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:53.482454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389b372ef1e34744a2decdf2d498faf0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:53.484408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:53.603427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389b372ef1e34744a2decdf2d498faf0', 'request_id': 'req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:53.609946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389b372ef1e34744a2decdf2d498faf0', 'request_id': 'req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:53.616276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389b372ef1e34744a2decdf2d498faf0', 'request_id': 'req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:53.744062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] The token cache is being invalidate because project 389b372ef1e34744a2decdf2d498faf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:53.744062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:53.744062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a75b90a7-d0af-4919-b4e8-a56a10fc9e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:53.744390 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1719/3458] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:53 2022] DELETE /identity/v3/projects/389b372ef1e34744a2decdf2d498faf0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:53.749000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:53.749376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:53.749632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:53.773987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:53.774582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:53.863624 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1740/3459] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:57:53.966050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:53.966050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:53.966050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:53.975139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:53.986364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:53.986364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1720/3460] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:53.989526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.001517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85317388-19f9-4e66-8439-24f7c2bca8f2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.025176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.026634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.027327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.028559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.029928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:54.031308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.037337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.057819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.064419 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1741/3461] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:54.069433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a0771-d616-450d-98bf-5e031eaad5c3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.075155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.076079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.076672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.077483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.078376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.081366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.160944 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1721/3462] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:54 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:54.164299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:54.165546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.177128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadb0f2-3c68-4968-aab9-26a8b6e8e51c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.242769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.243504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.243779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.244141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.244778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.247733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.347144 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1742/3463] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:54 2022] POST /identity/v3/users => generated 284 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:54.351277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.359299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:54.362747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f76e6-e80c-48c1-b1e0-e5d015966984 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.367706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.368414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.369017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.369343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.370063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.371711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.382548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1722/3464] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:54.386773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.401540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c110-c818-40e6-ba91-a55f1146a4a8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.407465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b381-a028-45fc-9918-e5af953f484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.408035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b381-a028-45fc-9918-e5af953f484c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.408529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b381-a028-45fc-9918-e5af953f484c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.409653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b381-a028-45fc-9918-e5af953f484c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.410932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0b381-a028-45fc-9918-e5af953f484c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.412898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0b381-a028-45fc-9918-e5af953f484c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.428529 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1743/3465] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:54.429618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.440726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bba34-7ee0-4948-b351-3edbfd1eb2ff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.447176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.448132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.448414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.448746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] PATH_INFO: `/v3/projects/a2fb37cc514943cca4608821748bdf09/users/1e3c109707964d1195a65bf7a58c4d22/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.464713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fb37cc514943cca4608821748bdf09, user_id=1e3c109707964d1195a65bf7a58c4d22, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.467406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.541514 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1723/3466] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:54 2022] PUT /identity/v3/projects/a2fb37cc514943cca4608821748bdf09/users/1e3c109707964d1195a65bf7a58c4d22/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:54.552641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.553068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.553634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.584023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] MFA Rules not processed for user `1e3c109707964d1195a65bf7a58c4d22`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:54.585385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:54.680763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1744/3467] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:54.683586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.764351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24334-7bdc-461e-969f-c608676f23c6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.771747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.772692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.773346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.773670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.774532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.788813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:54.844474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.846166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:54.879048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7a786-f5c9-400a-923f-e83c98152925 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:54.906128 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1724/3468] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:54 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:54.906685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:54.907847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:54.908364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:54.909108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] PATH_INFO: `/v3/users/1aabaadd397349bdb8b02ca1821c55c4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:54.910868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:54.918398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aabaadd397349bdb8b02ca1821c55c4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:54.922662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:55.037183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852eaaf1-5569-42a2-800e-314bb7be11e5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:55.044010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:55.045365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.045829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.046290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.047294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:55.057544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:55.152704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:55.222470 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1725/3469] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:54 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:55.226581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:55.264720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aabaadd397349bdb8b02ca1821c55c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.272584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743f868-9d56-47ab-aaf5-9174219370e6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:55.282323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aabaadd397349bdb8b02ca1821c55c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.285994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aabaadd397349bdb8b02ca1821c55c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.286942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aabaadd397349bdb8b02ca1821c55c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.289514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:55.291619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.293635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.294325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.297255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:55.301985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:55.322996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aabaadd397349bdb8b02ca1821c55c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.333600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1726/3470] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:55.335072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:55.339343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:55.340454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:55.372483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3ad3-c26d-42ac-8f12-c22bb67e7249 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:55.392032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:55.393219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.395622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.401418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] PATH_INFO: `/v3/projects/97a345aba082431e913a57ea6837f2b9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.401418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a345aba082431e913a57ea6837f2b9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:55.406862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:55.431157 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1745/3471] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:54 2022] DELETE /identity/v3/users/1aabaadd397349bdb8b02ca1821c55c4 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:55.432126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:55.434272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:55.579782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fc020-5269-427e-a05f-868baa1da836 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:55.585743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020a987-19b9-4e2c-abe7-167d2ddb1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:55.586432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a987-19b9-4e2c-abe7-167d2ddb1105 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.586720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a987-19b9-4e2c-abe7-167d2ddb1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.587001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a987-19b9-4e2c-abe7-167d2ddb1105 admin admin] PATH_INFO: `/v3/projects/d7fa6c9755e74124815cfc5e7698960f/users/a66a8ba2330a4530bf97c8570685ac07/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.608152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a987-19b9-4e2c-abe7-167d2ddb1105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa6c9755e74124815cfc5e7698960f, user_id=a66a8ba2330a4530bf97c8570685ac07, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:55.613357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a987-19b9-4e2c-abe7-167d2ddb1105 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:55.729526 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1746/3472] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:55 2022] PUT /identity/v3/projects/d7fa6c9755e74124815cfc5e7698960f/users/a66a8ba2330a4530bf97c8570685ac07/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:55.730922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e761e-2377-46f7-a861-f5175bace2e6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.731469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e761e-2377-46f7-a861-f5175bace2e6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.732274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e761e-2377-46f7-a861-f5175bace2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.741219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a345aba082431e913a57ea6837f2b9', 'request_id': 'req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.749350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a345aba082431e913a57ea6837f2b9', 'request_id': 'req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.759453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a345aba082431e913a57ea6837f2b9', 'request_id': 'req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.764702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f66e761e-2377-46f7-a861-f5175bace2e6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:55.766092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f66e761e-2377-46f7-a861-f5175bace2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:55.836353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] The token cache is being invalidate because project 97a345aba082431e913a57ea6837f2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:55.837050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.838359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:55.845358 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1727/3473] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:55 2022] DELETE /identity/v3/projects/97a345aba082431e913a57ea6837f2b9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:55.850044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:55.851315 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1747/3474] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:55.852287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:55.852785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.853218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.853661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.871297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa36c7-7d4f-40b5-87fe-0202ec8adefe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:55.877207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:55.878355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6ce6d-838d-42e8-abe7-fd508cad948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:55.878564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:55.879581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6ce6d-838d-42e8-abe7-fd508cad948c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.880845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6ce6d-838d-42e8-abe7-fd508cad948c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.881422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6ce6d-838d-42e8-abe7-fd508cad948c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:55.882381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6ce6d-838d-42e8-abe7-fd508cad948c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:55.904494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6ce6d-838d-42e8-abe7-fd508cad948c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:55.912843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1748/3475] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:55.913903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:55.917687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:55.946232 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1728/3476] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:55.953286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:55.956158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:55.961972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.022672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:56.023929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:56.032873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec72f81-9180-4c9a-8adb-e58140145448 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.070590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8319385-3e88-47d7-9583-fe436794040d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.071381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319385-3e88-47d7-9583-fe436794040d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.071650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319385-3e88-47d7-9583-fe436794040d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.071924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319385-3e88-47d7-9583-fe436794040d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.076913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1729/3477] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:56.076913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.097379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a61082-31f8-44ed-a691-3b4a61727e51 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.106054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.107161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319385-3e88-47d7-9583-fe436794040d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.107679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.108154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.108446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] PATH_INFO: `/v3/projects/d7fa6c9755e74124815cfc5e7698960f/users/a66a8ba2330a4530bf97c8570685ac07/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.109258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319385-3e88-47d7-9583-fe436794040d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.110654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa6c9755e74124815cfc5e7698960f, user_id=a66a8ba2330a4530bf97c8570685ac07, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.114973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.140039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1730/3478] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:56 2022] PUT /identity/v3/projects/d7fa6c9755e74124815cfc5e7698960f/users/a66a8ba2330a4530bf97c8570685ac07/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:56.141508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.146926 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1749/3479] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:56.152296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.152677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.153021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.223944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] MFA Rules not processed for user `a66a8ba2330a4530bf97c8570685ac07`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:56.225266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:56.260049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967689b-7117-4c32-aa92-a25a58315d63 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.267111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.267895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.268804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.269143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.269929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:56.270300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.272024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.288104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1731/3480] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:56.292387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.305696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d99c-8b01-4073-a2a6-3d369f62ec53 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.312975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.314244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.314827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.315860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.316572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.319448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.366446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:56.370442 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1750/3481] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:57:56.375589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.386431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6594342-ec40-4d18-914b-a376e46596e1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.391678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.393956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.393956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.393956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.394322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.396228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.423530 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1732/3482] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:56 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:56.428386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.513634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca485-f504-4e53-9484-0d0708ba5fe5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.520512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.521323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.521603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.521882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.522523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.525421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.552115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:56.566828 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1751/3483] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:56 2022] POST /identity/v3/projects => generated 360 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:56.568515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.650100 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1733/3484] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:56 2022] POST /identity/v3/users => generated 280 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:56.653196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.676167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc217c97-14e6-4390-afcb-95872c827545 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.699629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d73ef-51d2-47b7-83f9-071ead4ffc8d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.706511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.707832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.708229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.708514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.709445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.712705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.779982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.788774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.789167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.789460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.790315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.792458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.813878 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1734/3485] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:56.820275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.831604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbffc3-4a42-47ae-a919-b8ab8781f55a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.838021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.838722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.848981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.848981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.848981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.848981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.855460 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1735/3486] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:56.859350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.873224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea7ec1-5a93-4435-8433-d5d87fcdc917 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.883036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.883884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.884243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.884662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] PATH_INFO: `/v3/projects/2416a37cca9b472daf0ca03b59b30a1a/users/97051a365e464fa388ca13854119d6ea/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.898293 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1752/3487] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:56 2022] POST /identity/v3/users => generated 413 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:56.899639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:56.921372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d4d2-7195-4dff-a77f-4355553de1b6 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:56.922793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2416a37cca9b472daf0ca03b59b30a1a, user_id=97051a365e464fa388ca13854119d6ea, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:56.928650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:56.961736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7a43-65e5-4ea3-a18c-ed3acfc630d2 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:56.962999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7a43-65e5-4ea3-a18c-ed3acfc630d2 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:56.963462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7a43-65e5-4ea3-a18c-ed3acfc630d2 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:56.963742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7a43-65e5-4ea3-a18c-ed3acfc630d2 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/users/e1a4573ff0a948198daeab2b2987b0b2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:56.997911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b7a43-65e5-4ea3-a18c-ed3acfc630d2 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_user(user_id=e1a4573ff0a948198daeab2b2987b0b2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:57.030703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1736/3488] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:57:56 2022] PUT /identity/v3/projects/2416a37cca9b472daf0ca03b59b30a1a/users/97051a365e464fa388ca13854119d6ea/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:57:57.031314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b7a43-65e5-4ea3-a18c-ed3acfc630d2 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:57.031314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1753/3489] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 10:57:56 2022] GET /identity/v3/users/e1a4573ff0a948198daeab2b2987b0b2 => generated 413 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:57.031523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:57.039875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:57.040559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:57.040559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:57.140380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] MFA Rules not processed for user `97051a365e464fa388ca13854119d6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:57.144004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:57.216719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126358aa-641d-456f-833b-202d4306c19d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:57.249237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:57.249987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:57.250340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:57.250694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/users/e1a4573ff0a948198daeab2b2987b0b2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:57.252194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1a4573ff0a948198daeab2b2987b0b2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:57.256275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:57.311371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1754/3490] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:57.398254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a4573ff0a948198daeab2b2987b0b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.414915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a4573ff0a948198daeab2b2987b0b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.415927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a4573ff0a948198daeab2b2987b0b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.442791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a4573ff0a948198daeab2b2987b0b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.444447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a4573ff0a948198daeab2b2987b0b2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.585757 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1737/3491] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:57 2022] DELETE /identity/v3/users/e1a4573ff0a948198daeab2b2987b0b2 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:57.589624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:57.610231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaca953-6329-4575-8c20-88de662b7546 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:57.614895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:57.617889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:57.689680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:57.764968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:57.765779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:57.766092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:57.766339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/c86f4016f181445ab342ac6bd2d2d4e9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:57.770788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c86f4016f181445ab342ac6bd2d2d4e9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:57.772968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:57.794445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c326b98-3269-4899-b773-bc02ba035491 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:57.805640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:57.807373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:57.807373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:57.807373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:57.809153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:57.949866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86f4016f181445ab342ac6bd2d2d4e9', 'request_id': 'req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.950525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:57.955924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:57.966615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86f4016f181445ab342ac6bd2d2d4e9', 'request_id': 'req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.993264 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1738/3492] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:57.993943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86f4016f181445ab342ac6bd2d2d4e9', 'request_id': 'req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:57.995694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:58.000906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:58.094650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc925a5-8ba2-45fd-9d64-9f5664739feb service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:58.106807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project c86f4016f181445ab342ac6bd2d2d4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:58.114217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.114217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.114217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1755/3493] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:57 2022] DELETE /identity/v3/projects/c86f4016f181445ab342ac6bd2d2d4e9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:58.114217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:58.114629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:58.233980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f7c4-d0cf-48a4-8a6b-cae28b54e2ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:58.242137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:58.242999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:58.243434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:58.243656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:58.244126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] PATH_INFO: `/v3/users/97051a365e464fa388ca13854119d6ea` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:58.245261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97051a365e464fa388ca13854119d6ea)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:58.245903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:58.246643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:58.247877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] PATH_INFO: `/v3/projects/d437a54271e54aa69c5a6fb256f0cdd1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:58.251972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d437a54271e54aa69c5a6fb256f0cdd1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:58.254156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:58.254465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:58.447882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd437a54271e54aa69c5a6fb256f0cdd1', 'request_id': 'req-88c9921c-2d81-4791-bb31-390f1eeacdbc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.456109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd437a54271e54aa69c5a6fb256f0cdd1', 'request_id': 'req-88c9921c-2d81-4791-bb31-390f1eeacdbc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.468561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd437a54271e54aa69c5a6fb256f0cdd1', 'request_id': 'req-88c9921c-2d81-4791-bb31-390f1eeacdbc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.553531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] The token cache is being invalidate because project d437a54271e54aa69c5a6fb256f0cdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:57:58.553907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.554598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.556261 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1739/3494] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:57 2022] DELETE /identity/v3/projects/d437a54271e54aa69c5a6fb256f0cdd1 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:58.557208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:58.558554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:58.568979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97051a365e464fa388ca13854119d6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.576623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97051a365e464fa388ca13854119d6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.577318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97051a365e464fa388ca13854119d6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.577928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97051a365e464fa388ca13854119d6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.593419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97051a365e464fa388ca13854119d6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:58.629122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:58.636802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9921c-2d81-4791-bb31-390f1eeacdbc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:58.641106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f885e2-0943-454e-9a11-847facdbaec4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:58.642043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f885e2-0943-454e-9a11-847facdbaec4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:58.642535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f885e2-0943-454e-9a11-847facdbaec4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:58.642920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f885e2-0943-454e-9a11-847facdbaec4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:58.644293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f885e2-0943-454e-9a11-847facdbaec4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:58.646101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f885e2-0943-454e-9a11-847facdbaec4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:58.692996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1756/3495] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:58 2022] DELETE /identity/v3/users/97051a365e464fa388ca13854119d6ea => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:58.698105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:58.698105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:58.725760 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1740/3496] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:58 2022] POST /identity/v3/projects => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:57:58.727197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52835c4-cbc8-4e10-b467-704efa3ba382 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:58.727625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52835c4-cbc8-4e10-b467-704efa3ba382 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:58.727913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52835c4-cbc8-4e10-b467-704efa3ba382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:58.748821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a52835c4-cbc8-4e10-b467-704efa3ba382 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:58.750058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a52835c4-cbc8-4e10-b467-704efa3ba382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:58.777853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eb4c6-3057-49e4-84e2-6fb8379535d1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:58.851868 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1741/3497] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:58.854143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:58.854670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:58.855199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:58.862987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:58.863644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:58.864529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:58.865204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] PATH_INFO: `/v3/users/d79046739b2d4572b0aedef59e621ab8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:58.866692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79046739b2d4572b0aedef59e621ab8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:58.869976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:58.885300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:58.892656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:58.922256 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1742/3498] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:58.928063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:58.930028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.061087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420aa8-2a2e-4428-a56c-50493602107e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.067359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.067992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.068286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.068571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.069480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:59.069804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.071821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02d85-4771-4463-88ec-033581f9d01d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.097285 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1743/3499] 10.222.0.20 () {58 vars in 1160 bytes} [Tue Sep 6 10:57:58 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:57:59.098781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.099101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.099386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.107840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79046739b2d4572b0aedef59e621ab8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.123532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79046739b2d4572b0aedef59e621ab8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.125648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79046739b2d4572b0aedef59e621ab8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.126286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79046739b2d4572b0aedef59e621ab8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.134852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:57:59.136341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.145780 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1744/3500] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:57:59.146483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.149587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.149712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79046739b2d4572b0aedef59e621ab8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.211359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9992477-0b20-4e90-b1eb-0732c3b10d16 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.215323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.215952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.216239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.216520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.218368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.236683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.238952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.250276 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1745/3501] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:57:59.251195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.252632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.256907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1757/3502] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:57:58 2022] DELETE /identity/v3/users/d79046739b2d4572b0aedef59e621ab8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:57:59.258787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.270642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265a84a-01e3-4609-bb54-99f5f98e068b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.349189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357872d9-b855-4470-bf90-8c753bbc0b03 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.355981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.357367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.357916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.358435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.359399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:57:59.360321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.363503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.375041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.376593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.377674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.377914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.378718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.381859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.384653 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1758/3503] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:59.388178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.402513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1c9b8-b554-45da-b8cc-2b400f445831 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.405052 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1746/3504] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 10:57:59 2022] GET /identity/v3/domains => generated 830 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:59.410201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.410987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.411961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.412472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.412960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.413873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.416127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.429125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74b77e-fc52-4021-b27d-8340fb9a9282 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.438965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.438965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.439968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.441814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/5697e6b144c3401280abbca11398eb62` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.443286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:update_project(project_id=5697e6b144c3401280abbca11398eb62)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.444445 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:57:59.444445 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:57:59.444445 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:57:59.446204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.468833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5697e6b144c3401280abbca11398eb62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.469949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5697e6b144c3401280abbca11398eb62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.484829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:57:59.525959 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1759/3505] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:57:59 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:59.529785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.531772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.591496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5697e6b144c3401280abbca11398eb62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.592133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5697e6b144c3401280abbca11398eb62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.598938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1747/3506] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Sep 6 10:57:59 2022] PATCH /identity/v3/projects/5697e6b144c3401280abbca11398eb62 => generated 363 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:57:59.599954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.602002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.646715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dd37-e38b-4239-bd87-78fac86bf97a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.650976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.651578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.651863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.652200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.652999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.655114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.696290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb03a3-e48d-4adc-854b-86b030e0889f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.760853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1760/3507] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:57:59 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:57:59.765557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:57:59.767427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:57:59.781024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959201-92b1-4ff5-86f2-c897a057352d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:57:59.787126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537536e0-f83f-4676-921c-02384153930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.787713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537536e0-f83f-4676-921c-02384153930b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.788116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537536e0-f83f-4676-921c-02384153930b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.788423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537536e0-f83f-4676-921c-02384153930b admin admin] PATH_INFO: `/v3/projects/e047ab9362dc476c9a4b4aee7223d042` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.789755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537536e0-f83f-4676-921c-02384153930b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e047ab9362dc476c9a4b4aee7223d042)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.790313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:57:59.790809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:57:59.791142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:57:59.791430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/5697e6b144c3401280abbca11398eb62` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:57:59.791734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537536e0-f83f-4676-921c-02384153930b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.808999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5697e6b144c3401280abbca11398eb62)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:57:59.811038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:57:59.845170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5697e6b144c3401280abbca11398eb62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.860554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5697e6b144c3401280abbca11398eb62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.909650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e047ab9362dc476c9a4b4aee7223d042', 'request_id': 'req-537536e0-f83f-4676-921c-02384153930b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.916066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e047ab9362dc476c9a4b4aee7223d042', 'request_id': 'req-537536e0-f83f-4676-921c-02384153930b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:57:59.924471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e047ab9362dc476c9a4b4aee7223d042', 'request_id': 'req-537536e0-f83f-4676-921c-02384153930b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.009399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5697e6b144c3401280abbca11398eb62', 'request_id': 'req-7cf2c6ad-ff79-465d-b186-031e00173be3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.015984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-537536e0-f83f-4676-921c-02384153930b admin admin] The token cache is being invalidate because project e047ab9362dc476c9a4b4aee7223d042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:00.016729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.021463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.023292 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1761/3508] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:59 2022] DELETE /identity/v3/projects/e047ab9362dc476c9a4b4aee7223d042 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:00.025469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5697e6b144c3401280abbca11398eb62', 'request_id': 'req-7cf2c6ad-ff79-465d-b186-031e00173be3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.029029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.031269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.035468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5697e6b144c3401280abbca11398eb62', 'request_id': 'req-7cf2c6ad-ff79-465d-b186-031e00173be3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.106457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537536e0-f83f-4676-921c-02384153930b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.151716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 5697e6b144c3401280abbca11398eb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:00.152208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.152955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.167434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5697e6b144c3401280abbca11398eb62', 'request_id': 'req-7cf2c6ad-ff79-465d-b186-031e00173be3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.168710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5697e6b144c3401280abbca11398eb62', 'request_id': 'req-7cf2c6ad-ff79-465d-b186-031e00173be3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.173247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5697e6b144c3401280abbca11398eb62', 'request_id': 'req-7cf2c6ad-ff79-465d-b186-031e00173be3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.182608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1748/3509] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:57:59 2022] DELETE /identity/v3/projects/5697e6b144c3401280abbca11398eb62 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:00.183429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.183710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ce5cf-d443-40ff-b2f5-97f7daf2e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.184680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ce5cf-d443-40ff-b2f5-97f7daf2e1cd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.185113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.185823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ce5cf-d443-40ff-b2f5-97f7daf2e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.187233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ce5cf-d443-40ff-b2f5-97f7daf2e1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.188524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ce5cf-d443-40ff-b2f5-97f7daf2e1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.192599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ce5cf-d443-40ff-b2f5-97f7daf2e1cd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.206053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2c6ad-ff79-465d-b186-031e00173be3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.209194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1762/3510] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:00.210524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.210825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.211220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.215559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.219158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.219158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.219158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] PATH_INFO: `/v3/projects/2416a37cca9b472daf0ca03b59b30a1a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.219158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2416a37cca9b472daf0ca03b59b30a1a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.220802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.236150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:00.238020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.246374 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1763/3511] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:00.247291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.249074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.347643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0abc0e-9196-47fb-8597-bf4d2799c9ad None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.352881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2416a37cca9b472daf0ca03b59b30a1a', 'request_id': 'req-2e3e0990-7f39-4c75-a1ed-423eca868d89'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.365975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2416a37cca9b472daf0ca03b59b30a1a', 'request_id': 'req-2e3e0990-7f39-4c75-a1ed-423eca868d89'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.372855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2416a37cca9b472daf0ca03b59b30a1a', 'request_id': 'req-2e3e0990-7f39-4c75-a1ed-423eca868d89'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.428292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8b7a7-3c82-4619-a7f5-19a42a909bb4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.429063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8b7a7-3c82-4619-a7f5-19a42a909bb4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.429404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8b7a7-3c82-4619-a7f5-19a42a909bb4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.429751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8b7a7-3c82-4619-a7f5-19a42a909bb4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.430485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8b7a7-3c82-4619-a7f5-19a42a909bb4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.432797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8b7a7-3c82-4619-a7f5-19a42a909bb4 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.436757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] The token cache is being invalidate because project 2416a37cca9b472daf0ca03b59b30a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:00.436757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.436757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:00.436757 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1749/3512] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:00 2022] DELETE /identity/v3/projects/2416a37cca9b472daf0ca03b59b30a1a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:00.436757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.437476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.507809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0990-7f39-4c75-a1ed-423eca868d89 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.514383 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1764/3513] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/projects => generated 357 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:00.515883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.516177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.527829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.540278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:00.541825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.576365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a36fea-6158-4eb2-943f-cf67c90a9962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.576986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36fea-6158-4eb2-943f-cf67c90a9962 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.577270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36fea-6158-4eb2-943f-cf67c90a9962 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.577547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36fea-6158-4eb2-943f-cf67c90a9962 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.578195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a36fea-6158-4eb2-943f-cf67c90a9962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.579870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a36fea-6158-4eb2-943f-cf67c90a9962 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.589936 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1750/3514] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:00.591242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e364711-793b-46f7-83ad-9fdad6b0bd7b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.592085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e364711-793b-46f7-83ad-9fdad6b0bd7b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.592085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e364711-793b-46f7-83ad-9fdad6b0bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.612932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0e364711-793b-46f7-83ad-9fdad6b0bd7b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:00.613601 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1765/3515] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:00.614250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e364711-793b-46f7-83ad-9fdad6b0bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.614668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.616085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.624767 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1751/3516] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:00.626705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.626705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.626705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.647145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:00.648416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.655710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:00.687399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acdcb2-3a29-48ca-9cb9-b14d583e312a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.693127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.693905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.694194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.694468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/e3a96360df6f4f80bc1a21779658fd25` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.695647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=e3a96360df6f4f80bc1a21779658fd25)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.697867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.699899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1766/3517] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:00 2022] GET /identity/v3/projects/e3a96360df6f4f80bc1a21779658fd25 => generated 357 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:00.703446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.711590 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1752/3518] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:00.712466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.714543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eede-002d-4ef6-b73d-f23fb43953ee tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.720316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.721056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.721288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.721732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] PATH_INFO: `/v3/projects/0df100d31d294ce6858d12ea23adb2b4/users/5689d1981ee04c7b8dbcb4e9e1afd6cd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.728400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c4559-14fd-4416-97fa-d5b98e2875ea None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.735053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.735732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.736073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.736291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.737215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:00.737526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.739461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6033ee-b562-4fac-9a44-1b3e0c2ce6de admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.739832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df100d31d294ce6858d12ea23adb2b4, user_id=5689d1981ee04c7b8dbcb4e9e1afd6cd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.742921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.758547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1753/3519] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:00.758547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.758547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.758547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.781046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:00.782605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:00.788263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:00.794075 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1767/3520] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:00 2022] PUT /identity/v3/projects/0df100d31d294ce6858d12ea23adb2b4/users/5689d1981ee04c7b8dbcb4e9e1afd6cd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:00.795162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.860089 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1754/3521] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:00.860950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:00.864395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32822788-bf9e-496f-a598-40f9750e8ab2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.869491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.872210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.872576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.873048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/e3a96360df6f4f80bc1a21779658fd25` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.875283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e3a96360df6f4f80bc1a21779658fd25)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.877213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.879360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccfd37-6b9a-4c2c-9400-9d9720538469 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:00.892168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0417b-f118-4cd3-b516-350526f83752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:00.892388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0417b-f118-4cd3-b516-350526f83752 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:00.892690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0417b-f118-4cd3-b516-350526f83752 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:00.893850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0417b-f118-4cd3-b516-350526f83752 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:00.894508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0417b-f118-4cd3-b516-350526f83752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:00.897261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0417b-f118-4cd3-b516-350526f83752 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:00.999267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a96360df6f4f80bc1a21779658fd25', 'request_id': 'req-49be6aa7-02b4-4870-ba19-fff373c94894'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.006114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a96360df6f4f80bc1a21779658fd25', 'request_id': 'req-49be6aa7-02b4-4870-ba19-fff373c94894'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.012961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a96360df6f4f80bc1a21779658fd25', 'request_id': 'req-49be6aa7-02b4-4870-ba19-fff373c94894'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.032890 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1755/3522] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:00 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:01.032890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.032890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.032890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.057566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:01.058863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:01.096560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project e3a96360df6f4f80bc1a21779658fd25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:01.098653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.098653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.103752 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1768/3523] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:00 2022] DELETE /identity/v3/projects/e3a96360df6f4f80bc1a21779658fd25 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:01.103752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.104116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:01.148410 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1756/3524] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:01.149497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.151161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:01.164082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbf009-421f-4c77-8f4b-bcb08ababee4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.169696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.170357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.170910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.171175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.171887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.174805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.203709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:01.209056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be6aa7-02b4-4870-ba19-fff373c94894 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.214395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.215184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.215600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.215977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.216735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:01.217154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.218860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.235675 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1769/3525] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:01.235675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.237329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:01.262933 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1757/3526] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:01 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:01.263400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.265260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:01.317321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3908525-118f-4ddf-b463-e631e99b9d51 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.322491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.323998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.323998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.323998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.326249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.326945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.327562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a0328-d510-49df-9ff9-26ca74b37ea0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.332173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.332799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.333090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.333369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.345934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.348418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.358899 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1758/3527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:01.368056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.378548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a66bd-4876-447e-aba1-27268bc3c2bc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.385602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.386225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.386513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.386791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.387475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.389505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.418477 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1770/3528] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:01 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:01.418477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.466612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1759/3529] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:01 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:01.467688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.507627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2515b9-8b5f-4d52-91f9-9e918a675d32 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.582860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842c2a-efd9-4f0f-beda-31bbb09f4e4b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.588218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.589207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.589564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.589914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/9536f1e4ba5843ab8b9880675df05120` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.591179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=9536f1e4ba5843ab8b9880675df05120)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.593391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.594228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.595242 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1760/3530] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:01 2022] GET /identity/v3/projects/9536f1e4ba5843ab8b9880675df05120 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:01.595986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.599068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.599400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.604218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.604218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.604218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.615086 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1771/3531] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:01.616985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.627371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20adeb-3800-4481-a490-0c33b60eb119 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.631789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8722680-6e27-49f9-8521-21330432bd57 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.633927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.634669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.634984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.635412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.636128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.637775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.638207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.638928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.639088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.639444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/9536f1e4ba5843ab8b9880675df05120` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.640661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9536f1e4ba5843ab8b9880675df05120)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.642778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.756623 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1761/3532] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:01 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:01.758186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.805442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12da98-352d-468e-b96b-7167c1b26073 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.816066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9536f1e4ba5843ab8b9880675df05120', 'request_id': 'req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.825436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9536f1e4ba5843ab8b9880675df05120', 'request_id': 'req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.837522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9536f1e4ba5843ab8b9880675df05120', 'request_id': 'req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.929872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.930502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.930944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.931323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.931980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.933672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.945446 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1762/3533] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:01.948140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.960699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fabee-beea-4195-96b4-72387bd7f356 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:01.966101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 9536f1e4ba5843ab8b9880675df05120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:01.966689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.967193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:01.967888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:01.968111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:01.968526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:01.968905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:01.969756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:01.971618 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1772/3534] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:01 2022] DELETE /identity/v3/projects/9536f1e4ba5843ab8b9880675df05120 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:01.972381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:01.973648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.976518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:01.990201 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1763/3535] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:01.991285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:01.994024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:02.002083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6cb3-63dd-4e1b-9792-8a4e1af5311b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.009755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.010938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.011550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.011818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] PATH_INFO: `/v3/projects/d5e0ac401b45419795e5127ed1f667b9/users/5c02f8592a8842b8baf95d76c55a4d6e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.021922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:02.053589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e0ac401b45419795e5127ed1f667b9, user_id=5c02f8592a8842b8baf95d76c55a4d6e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.062559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.101687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6610107-9dbc-428c-828c-5f1770c6e3b0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.108132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ade75-1e98-4770-b4a6-f11a2f05a615 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.108748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ade75-1e98-4770-b4a6-f11a2f05a615 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.109362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ade75-1e98-4770-b4a6-f11a2f05a615 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.109905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ade75-1e98-4770-b4a6-f11a2f05a615 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.111151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ade75-1e98-4770-b4a6-f11a2f05a615 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.113502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ade75-1e98-4770-b4a6-f11a2f05a615 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.176535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1773/3536] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:01 2022] PUT /identity/v3/projects/d5e0ac401b45419795e5127ed1f667b9/users/5c02f8592a8842b8baf95d76c55a4d6e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:02.177402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:02.179373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:02.283573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0fd8-340b-4405-9a66-325e1340b446 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.287272 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1764/3537] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 10:58:01 2022] POST /identity/v3/projects => generated 347 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:02.292310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.292494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.303155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.350029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:02.352047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:02.387112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:02.400586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.401208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.401491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.401856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.402473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.404112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.421914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1774/3538] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:02.421914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:02.463420 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1765/3539] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:02.464407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:02.483122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfba50-f471-4ad8-aacb-30aa764488cb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.497089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.497777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.498104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.498321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] PATH_INFO: `/v3/projects/aa2ed3ceca87459d8b6db473a08b3464/users/a880494fb3144a58afd1fbfa8eff6cb4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.531037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2ed3ceca87459d8b6db473a08b3464, user_id=a880494fb3144a58afd1fbfa8eff6cb4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.535919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.549390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ec87c-4450-4829-aa57-40fb4ce57b6f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.554276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.554970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.555925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.555925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/58d349cc32d4404088c79deb05e56b88` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.556771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=58d349cc32d4404088c79deb05e56b88)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.558897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.560986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1775/3540] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:02 2022] GET /identity/v3/projects/58d349cc32d4404088c79deb05e56b88 => generated 347 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:02.561773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:02.565113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:02.645536 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1766/3541] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:02 2022] PUT /identity/v3/projects/aa2ed3ceca87459d8b6db473a08b3464/users/a880494fb3144a58afd1fbfa8eff6cb4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:02.647115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:02.666946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb701845-0b4c-4c8b-a43b-9bcf26ef3f3e tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.736591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2250684-0ea9-49ee-948b-309c9dd6f34f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:02.748948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.748948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.748948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.749481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/58d349cc32d4404088c79deb05e56b88` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.749481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58d349cc32d4404088c79deb05e56b88)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.749481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.779898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335631c-2bd6-4dd8-a3fc-63415134b978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:02.780526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335631c-2bd6-4dd8-a3fc-63415134b978 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.780810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335631c-2bd6-4dd8-a3fc-63415134b978 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.781093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335631c-2bd6-4dd8-a3fc-63415134b978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.866445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335631c-2bd6-4dd8-a3fc-63415134b978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:02.869741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335631c-2bd6-4dd8-a3fc-63415134b978 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:02.886059 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1776/3542] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:02.888167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:02.888555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:02.889686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:02.912045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:02.913555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:02.926230 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1777/3543] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:02.969366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d349cc32d4404088c79deb05e56b88', 'request_id': 'req-b136ca0a-36b1-42b5-a872-1b081c99539f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:02.995290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d349cc32d4404088c79deb05e56b88', 'request_id': 'req-b136ca0a-36b1-42b5-a872-1b081c99539f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:03.003119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d349cc32d4404088c79deb05e56b88', 'request_id': 'req-b136ca0a-36b1-42b5-a872-1b081c99539f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:03.011985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:03.026178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fef3a-788c-44ad-bb84-8f1f6b82f74e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:03.076691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:03.077465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:03.077827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:03.078178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:03.146380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 58d349cc32d4404088c79deb05e56b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:03.146856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:03.148075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:03.156417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1767/3544] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:02 2022] DELETE /identity/v3/projects/58d349cc32d4404088c79deb05e56b88 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:03.162206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:03.164754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:03.184405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:03.187930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:03.201652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1778/3545] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:03.269014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136ca0a-36b1-42b5-a872-1b081c99539f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:03.274555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:03.275553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:03.275812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:03.276142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:03.276842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:03.278609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:03.396210 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1768/3546] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 10:58:03 2022] POST /identity/v3/domains => generated 277 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:03.397663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:03.409392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f58a1-91a8-4647-968d-7b56ad4c192f service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:03.492464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:03.493411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:03.493411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:03.494332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:03.495067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:03.497018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:03.660224 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1779/3547] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:03 2022] POST /identity/v3/projects => generated 404 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:03.662694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:03.677811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ce52-1390-4929-933d-8d0e33a635f5 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:03.735969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:03.743104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:03.794112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:03.795485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:03.800646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:03.801912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/dfefc0259f0346dcb4c28789b5d10760` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:03.808540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=dfefc0259f0346dcb4c28789b5d10760)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:03.810928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:03.819303 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1769/3548] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:03 2022] GET /identity/v3/projects/dfefc0259f0346dcb4c28789b5d10760 => generated 404 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:03.823138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:03.848241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37ad03-9d47-4f98-a744-f28583d219c1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:03.853966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:03.854810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:03.855140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:03.855427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/dfefc0259f0346dcb4c28789b5d10760` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:03.856640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dfefc0259f0346dcb4c28789b5d10760)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:03.859364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:03.942702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351aadb-35b4-4aac-bcf4-880b19c65926 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:03.948459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:03.949098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:03.949454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:03.949940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:03.952088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:03.966467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:03.968353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:03.984954 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1780/3549] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:04.043680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfefc0259f0346dcb4c28789b5d10760', 'request_id': 'req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.083043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfefc0259f0346dcb4c28789b5d10760', 'request_id': 'req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.106906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfefc0259f0346dcb4c28789b5d10760', 'request_id': 'req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.301407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project dfefc0259f0346dcb4c28789b5d10760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:04.301812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.305164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.307049 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1770/3550] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:03 2022] DELETE /identity/v3/projects/dfefc0259f0346dcb4c28789b5d10760 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:04.311799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:04.329147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c023a-60f8-47ec-9331-f453b40ab7f6 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:04.419532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:04.421169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:04.538264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:04.539901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:04.542271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:04.542670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains/71cd45b34a564bbc838aa2ff7f320a27` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:04.546301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=71cd45b34a564bbc838aa2ff7f320a27)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:04.551691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:04.587044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e6c0-7a3f-4e9d-ad01-98ef874ae1c0 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:04.605580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:04.606534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:04.606983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:04.607329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.607725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:04.609969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.610188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:04.727536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:04.753577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:04.757317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:04.776354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.779913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:04.791225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1781/3551] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:58:04 2022] PATCH /identity/v3/domains/71cd45b34a564bbc838aa2ff7f320a27 => generated 278 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:04.791225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:04.794955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:04.798905 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1771/3552] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:04 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:05.047743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce246-ac1e-46d0-83e8-30b4ff1688ec tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:05.077357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:05.078465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:05.080565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:05.080865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains/71cd45b34a564bbc838aa2ff7f320a27` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:05.117797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=71cd45b34a564bbc838aa2ff7f320a27)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:05.119824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:05.154669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.163165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.178245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:05.329302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27', 'request_id': 'req-abb427a5-7823-43b7-83b2-cbccce1a7708'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.340243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27', 'request_id': 'req-abb427a5-7823-43b7-83b2-cbccce1a7708'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.354781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27', 'request_id': 'req-abb427a5-7823-43b7-83b2-cbccce1a7708'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.443460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 71cd45b34a564bbc838aa2ff7f320a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:05.443962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.446108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.468111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27', 'request_id': 'req-abb427a5-7823-43b7-83b2-cbccce1a7708'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.472092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27', 'request_id': 'req-abb427a5-7823-43b7-83b2-cbccce1a7708'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.482653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '71cd45b34a564bbc838aa2ff7f320a27', 'request_id': 'req-abb427a5-7823-43b7-83b2-cbccce1a7708'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:05.492261 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1782/3553] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:04 2022] DELETE /identity/v3/domains/71cd45b34a564bbc838aa2ff7f320a27 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:05.497952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:05.499701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:05.516286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d582-561a-46ed-a481-9d64bcb12a43 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:05.661527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:05.662566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:05.662867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:05.663340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:05.664312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:05.665973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:05.753288 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1772/3554] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 10:58:05 2022] POST /identity/v3/domains => generated 277 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:05.757632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:05.761593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:05.794140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb427a5-7823-43b7-83b2-cbccce1a7708 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:05.956114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:05.956747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:05.957091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:05.957375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:05.958104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:05.960239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:06.078884 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1783/3555] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:05 2022] POST /identity/v3/projects => generated 408 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:06.086998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:06.101277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0028299-0917-4dea-aca6-2e28ea69f86c tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:06.216272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:06.220051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:06.221200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:06.222440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:06.224922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:06.232074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:06.386648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1773/3556] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:06 2022] POST /identity/v3/projects => generated 405 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:06.389565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:06.429286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023eee4-1bae-4458-8698-ffa73f7ffa6d tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:06.535828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:06.538010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:06.538010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:06.538010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/752023936d7e461589123199442d8891` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:06.539222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=752023936d7e461589123199442d8891)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:06.542376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:06.749181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752023936d7e461589123199442d8891', 'request_id': 'req-8667634f-f56c-4c01-bb5b-51d1c3624557'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:06.750747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:06.753713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:06.768783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752023936d7e461589123199442d8891', 'request_id': 'req-8667634f-f56c-4c01-bb5b-51d1c3624557'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:06.780154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752023936d7e461589123199442d8891', 'request_id': 'req-8667634f-f56c-4c01-bb5b-51d1c3624557'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:06.901269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e7e4-fb10-41d9-bae5-d7ded510df08 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:06.915610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 752023936d7e461589123199442d8891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:06.916080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:06.917031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:06.922824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1784/3557] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:06 2022] DELETE /identity/v3/projects/752023936d7e461589123199442d8891 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:06.924625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:06.932229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:07.053705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:07.054401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:07.054690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:07.055033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:07.060831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:07.079900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:07.084035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:07.095462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667634f-f56c-4c01-bb5b-51d1c3624557 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:07.104270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1774/3558] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:07.115045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:07.115045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:07.115045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:07.115508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/a71b1c53863344a7bbc3241881dcbac2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:07.115508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a71b1c53863344a7bbc3241881dcbac2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:07.115508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:07.252887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71b1c53863344a7bbc3241881dcbac2', 'request_id': 'req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.271119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71b1c53863344a7bbc3241881dcbac2', 'request_id': 'req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.295111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71b1c53863344a7bbc3241881dcbac2', 'request_id': 'req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.432800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project a71b1c53863344a7bbc3241881dcbac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:07.433318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.435001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.437218 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1785/3559] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:06 2022] DELETE /identity/v3/projects/a71b1c53863344a7bbc3241881dcbac2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:07.442252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:07.459980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84c2e-b494-4664-9fe4-f296c3946610 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:07.572196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:07.572874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:07.573169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:07.573470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains/f9bce19512f74fc1868767274bd5bcf0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:07.575069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f9bce19512f74fc1868767274bd5bcf0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:07.576864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:07.638633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.639415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.795357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.797085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:07.800758 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1775/3560] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:58:07 2022] PATCH /identity/v3/domains/f9bce19512f74fc1868767274bd5bcf0 => generated 278 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:07.804162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:07.804541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:07.806059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:07.837688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0d1ae-f099-4b3a-8752-6cbdb001e14b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:07.991228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:07.992392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:07.993115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:07.993464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains/f9bce19512f74fc1868767274bd5bcf0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:08.023760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f9bce19512f74fc1868767274bd5bcf0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:08.026912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:08.071233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.079100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.260376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0', 'request_id': 'req-5ac8305b-7cca-42af-bea3-3d149d618f2f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.265960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0', 'request_id': 'req-5ac8305b-7cca-42af-bea3-3d149d618f2f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.274403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0', 'request_id': 'req-5ac8305b-7cca-42af-bea3-3d149d618f2f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.416551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project f9bce19512f74fc1868767274bd5bcf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:08.428827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.428827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.441856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0', 'request_id': 'req-5ac8305b-7cca-42af-bea3-3d149d618f2f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.443550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0', 'request_id': 'req-5ac8305b-7cca-42af-bea3-3d149d618f2f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.449645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f9bce19512f74fc1868767274bd5bcf0', 'request_id': 'req-5ac8305b-7cca-42af-bea3-3d149d618f2f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:08.467352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1786/3561] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:07 2022] DELETE /identity/v3/domains/f9bce19512f74fc1868767274bd5bcf0 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:08.473058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:08.474961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:08.537373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319a67-92dd-475c-8eb2-308182939c68 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:08.813308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:08.819063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:08.820997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:08.822914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:08.823986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:08.834726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:08.984649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:08.987440 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1776/3562] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:08 2022] POST /identity/v3/projects => generated 378 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:08.987622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:09.015713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8305b-7cca-42af-bea3-3d149d618f2f tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:09.168052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:09.169087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:09.169549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:09.170011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/b4d9ec46da3641fc955b1e76b3f3aa83` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:09.172619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4d9ec46da3641fc955b1e76b3f3aa83)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:09.176273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:09.178949 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1787/3563] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:08 2022] GET /identity/v3/projects/b4d9ec46da3641fc955b1e76b3f3aa83 => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:09.182846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:09.201888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688de56b-d95e-436e-b27a-93a4fc139e00 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:09.211244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:09.212394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:09.212861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:09.213367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:09.214485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:09.225212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:09.253394 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1777/3564] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 10:58:09 2022] GET /identity/v3/projects => generated 7317 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:09.258461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:09.271560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d384a40-5999-467e-8385-73d4ad735701 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:09.300762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:09.301584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:09.302392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:09.302392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/b4d9ec46da3641fc955b1e76b3f3aa83` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:09.303735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4d9ec46da3641fc955b1e76b3f3aa83)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:09.314359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:09.495758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d9ec46da3641fc955b1e76b3f3aa83', 'request_id': 'req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:09.509980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d9ec46da3641fc955b1e76b3f3aa83', 'request_id': 'req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:09.521987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d9ec46da3641fc955b1e76b3f3aa83', 'request_id': 'req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:09.633025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project b4d9ec46da3641fc955b1e76b3f3aa83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:09.633025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:09.634804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:09.636740 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1788/3565] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:09 2022] DELETE /identity/v3/projects/b4d9ec46da3641fc955b1e76b3f3aa83 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:09.641786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:09.644597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:09.668924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389cc4-145a-4fe0-bb43-fc478542a237 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:09.787668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:09.788580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:09.789040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:09.789490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:09.790429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:09.792442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:09.793546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:09.969598 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1778/3566] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 10:58:09 2022] POST /identity/v3/projects => generated 346 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:09.973557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:09.989557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf07e0-0f8f-465a-a0da-2e0469c3d204 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:10.197435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:10.198119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:10.198634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:10.213625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/ed4855ede4254141a24e285b90785068` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:10.216809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:update_project(project_id=ed4855ede4254141a24e285b90785068)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:10.218209 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:58:10.218209 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 10:58:10.218209 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 10:58:10.226549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:10.248862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:10.252993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:10.454030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1789/3567] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Sep 6 10:58:09 2022] PATCH /identity/v3/projects/ed4855ede4254141a24e285b90785068 => generated 360 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:10.458809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:10.475550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22162e-893a-4653-8b9b-a018e7ff216b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:10.484341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:10.489859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:10.489859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:10.489859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:10.490636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:10.501682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab595-fa5a-465e-b0b9-e20c2fb2bfc7 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:10.524979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:10.528797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:10.528797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:10.528797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/ed4855ede4254141a24e285b90785068` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:10.550963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=ed4855ede4254141a24e285b90785068)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:10.553890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:10.558864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1790/3568] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:10 2022] GET /identity/v3/projects/ed4855ede4254141a24e285b90785068 => generated 347 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:10.562239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:10.584449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea44a6-f49b-4797-96af-4110a5c412e3 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:10.591484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:10.593469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:10.593850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:10.594200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/ed4855ede4254141a24e285b90785068` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:10.595645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ed4855ede4254141a24e285b90785068)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:10.597813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:10.678714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:10.685355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:10.757172 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1779/3569] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:10.826254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:10.833117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4855ede4254141a24e285b90785068', 'request_id': 'req-55b4f7cf-b564-432a-9545-6241f668d1ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:10.848027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4855ede4254141a24e285b90785068', 'request_id': 'req-55b4f7cf-b564-432a-9545-6241f668d1ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:10.863715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4855ede4254141a24e285b90785068', 'request_id': 'req-55b4f7cf-b564-432a-9545-6241f668d1ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:10.978884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project ed4855ede4254141a24e285b90785068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:10.979660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:10.980542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:10.984825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1791/3570] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:10 2022] DELETE /identity/v3/projects/ed4855ede4254141a24e285b90785068 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:10.990795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:11.013203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa50a14-e39f-4cad-a043-fffe38f781c2 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:11.163672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:11.165457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:11.165908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:11.166374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:11.168256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:11.171479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:11.342477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1780/3571] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:10 2022] POST /identity/v3/projects => generated 360 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:11.348317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:11.352104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:11.383972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4f7cf-b564-432a-9545-6241f668d1ea tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:11.570961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:11.571761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:11.572245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:11.572725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/09b4080cbdb54dd2a179afbcd08d6f3f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:11.577032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:update_project(project_id=09b4080cbdb54dd2a179afbcd08d6f3f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:11.585426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:11.793151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1792/3572] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Sep 6 10:58:11 2022] PATCH /identity/v3/projects/09b4080cbdb54dd2a179afbcd08d6f3f => generated 372 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:11.801194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:11.820731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16693f-d5e7-4fd8-91a9-28c800f55929 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:11.837874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:11.851382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:11.852022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:11.855602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/09b4080cbdb54dd2a179afbcd08d6f3f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:11.890199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=09b4080cbdb54dd2a179afbcd08d6f3f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:11.907766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:11.907766 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1781/3573] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:11 2022] GET /identity/v3/projects/09b4080cbdb54dd2a179afbcd08d6f3f => generated 359 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:11.911530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:11.926413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4916-1317-42c7-8c71-c2bd6917f8ad tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:11.938866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:11.940647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:11.944557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:11.945840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/09b4080cbdb54dd2a179afbcd08d6f3f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:11.949285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09b4080cbdb54dd2a179afbcd08d6f3f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:11.951643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:12.174760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b4080cbdb54dd2a179afbcd08d6f3f', 'request_id': 'req-40934c7f-f6e8-4cab-8051-2583937bb836'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:12.215568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b4080cbdb54dd2a179afbcd08d6f3f', 'request_id': 'req-40934c7f-f6e8-4cab-8051-2583937bb836'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:12.237338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b4080cbdb54dd2a179afbcd08d6f3f', 'request_id': 'req-40934c7f-f6e8-4cab-8051-2583937bb836'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:12.244099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:12.335993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 09b4080cbdb54dd2a179afbcd08d6f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:12.336555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:12.346341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:12.346341 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1793/3574] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:11 2022] DELETE /identity/v3/projects/09b4080cbdb54dd2a179afbcd08d6f3f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:12.348258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:12.350875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:12.377969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7549e6-c7ea-445f-98be-0fd5fb576ef1 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:12.478056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:12.479128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:12.479488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:12.479837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:12.480605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:12.483158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:12.623174 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1782/3575] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:12 2022] POST /identity/v3/projects => generated 354 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:12.627445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:12.646096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40934c7f-f6e8-4cab-8051-2583937bb836 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:12.845519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:12.846966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:12.847288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:12.847574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/1ed5d73edfa843d3ab81a9eb325bbd1e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:12.855522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:update_project(project_id=1ed5d73edfa843d3ab81a9eb325bbd1e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:12.863439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:13.026290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:13.084217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1794/3576] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Sep 6 10:58:12 2022] PATCH /identity/v3/projects/1ed5d73edfa843d3ab81a9eb325bbd1e => generated 367 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:13.087405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:13.103861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460747b-dbdd-4bc2-95eb-5a7944fd8ccc tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:13.141872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:13.145030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:13.146795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:13.147382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/1ed5d73edfa843d3ab81a9eb325bbd1e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:13.211104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:get_project(project_id=1ed5d73edfa843d3ab81a9eb325bbd1e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:13.211104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:13.211104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1783/3577] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 10:58:13 2022] GET /identity/v3/projects/1ed5d73edfa843d3ab81a9eb325bbd1e => generated 354 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:13.215210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:13.251305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b95-5f31-4e64-bd12-ac377959bd43 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:13.264870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:13.265625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:13.266003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:13.269525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/projects/1ed5d73edfa843d3ab81a9eb325bbd1e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:13.271051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ed5d73edfa843d3ab81a9eb325bbd1e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:13.273098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:13.520804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:13.599513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed5d73edfa843d3ab81a9eb325bbd1e', 'request_id': 'req-91febb43-35ef-4b64-80ec-8f541056898b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:13.616364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed5d73edfa843d3ab81a9eb325bbd1e', 'request_id': 'req-91febb43-35ef-4b64-80ec-8f541056898b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:13.633068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed5d73edfa843d3ab81a9eb325bbd1e', 'request_id': 'req-91febb43-35ef-4b64-80ec-8f541056898b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:13.728692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] The token cache is being invalidate because project 1ed5d73edfa843d3ab81a9eb325bbd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:13.729028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:13.735032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:13.737626 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1795/3578] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:13 2022] DELETE /identity/v3/projects/1ed5d73edfa843d3ab81a9eb325bbd1e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:13.742686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:13.744678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:13.772505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf54c8-6837-420d-b414-893745cbad98 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:13.929451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:13.931872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:13.932674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:13.934313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains/f9bce19512f74fc1868767274bd5bcf0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:13.988038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Could not find domain: f9bce19512f74fc1868767274bd5bcf0.: keystone.exception.DomainNotFound: Could not find domain: f9bce19512f74fc1868767274bd5bcf0. Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9bce19512f74fc1868767274bd5bcf0. Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:58:14.007112 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:58:14.013588 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9bce19512f74fc1868767274bd5bcf0. Sep 06 10:58:14.014951 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:58:14.016415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1784/3579] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:58:13 2022] PATCH /identity/v3/domains/f9bce19512f74fc1868767274bd5bcf0 => generated 112 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 10:58:14.016515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:14.028475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91febb43-35ef-4b64-80ec-8f541056898b tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:14.044766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42aad4-c2bd-4ef3-9d4b-047a4ee03289 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a66a8ba2330a4530bf97c8570685ac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7fa6c9755e74124815cfc5e7698960f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:14.047851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42aad4-c2bd-4ef3-9d4b-047a4ee03289 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:14.048291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42aad4-c2bd-4ef3-9d4b-047a4ee03289 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:14.048581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42aad4-c2bd-4ef3-9d4b-047a4ee03289 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] PATH_INFO: `/v3/domains/71cd45b34a564bbc838aa2ff7f320a27` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:14.081548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42aad4-c2bd-4ef3-9d4b-047a4ee03289 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-4b42aad4-c2bd-4ef3-9d4b-047a4ee03289 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Could not find domain: 71cd45b34a564bbc838aa2ff7f320a27.: keystone.exception.DomainNotFound: Could not find domain: 71cd45b34a564bbc838aa2ff7f320a27. Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 71cd45b34a564bbc838aa2ff7f320a27. Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:58:14.093746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:58:14.095359 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 71cd45b34a564bbc838aa2ff7f320a27. Sep 06 10:58:14.097231 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 10:58:14.107398 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1796/3580] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 10:58:14 2022] PATCH /identity/v3/domains/71cd45b34a564bbc838aa2ff7f320a27 => generated 112 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 10:58:14.109111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:14.112812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:14.288420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8c18-5553-458a-a7eb-6a86fe360c58 tempest-ProjectsTestJSON-1253908664 tempest-ProjectsTestJSON-1253908664-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:14.297406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:14.298587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:14.300255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:14.301076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] PATH_INFO: `/v3/users/1e3c109707964d1195a65bf7a58c4d22` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:14.303121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3c109707964d1195a65bf7a58c4d22)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:14.305844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:14.557218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3c109707964d1195a65bf7a58c4d22'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:14.572674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3c109707964d1195a65bf7a58c4d22'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:14.575154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3c109707964d1195a65bf7a58c4d22'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:14.592075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3c109707964d1195a65bf7a58c4d22'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:14.593319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3c109707964d1195a65bf7a58c4d22'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:14.702802 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1785/3581] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:14 2022] DELETE /identity/v3/users/1e3c109707964d1195a65bf7a58c4d22 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:14.706359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:14.706851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:14.707209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:14.730528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:14.732983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:14.799420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:14.934870 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1797/3582] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:14.948506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:14.950495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:15.108678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92362f78-a045-435e-9e57-175fbf48a383 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:15.114422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30c96-6782-4ac9-b7c6-88fec6e35380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:15.115553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30c96-6782-4ac9-b7c6-88fec6e35380 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:15.118668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30c96-6782-4ac9-b7c6-88fec6e35380 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:15.119557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30c96-6782-4ac9-b7c6-88fec6e35380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:15.139086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30c96-6782-4ac9-b7c6-88fec6e35380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:15.141045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30c96-6782-4ac9-b7c6-88fec6e35380 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:15.165756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1786/3583] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:15.352127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:15.774559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:15.777050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:15.799364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88eaa-bc10-4896-8f94-36b7ef650e9d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:15.812179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:15.813049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:15.813531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:15.814184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:15.817242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:15.948998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:15.949987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:15.950617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:15.992240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:15.996338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:16.025257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] MFA Rules not processed for user `5689d1981ee04c7b8dbcb4e9e1afd6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:16.028553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:16.031337 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1798/3584] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:16.124448 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1787/3585] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:58:16.139417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:16.141226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:16.158038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cc079-298c-4c8e-a287-09ef6faad401 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:16.160124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:16.161770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:16.189827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:16.190989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:16.192925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:16.193397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:16.197208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0149c6-4f18-462b-b5e4-da509e37bc9e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:16.210223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:16.211236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:16.212067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:16.212786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] PATH_INFO: `/v3/projects/a2fb37cc514943cca4608821748bdf09` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:16.214520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:16.215555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fb37cc514943cca4608821748bdf09)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:16.218570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:16.220021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:16.243118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1799/3586] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:16.256668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:16.299758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2b85e-3338-49e8-8655-9db1ed219b02 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:16.315925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:16.315925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:16.315925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:16.315925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:16.317055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:16.340538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:16.344346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:16.355553 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1800/3587] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:16.453740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fb37cc514943cca4608821748bdf09', 'request_id': 'req-e0a0552a-788c-4891-8305-7f60465de98a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:16.465970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fb37cc514943cca4608821748bdf09', 'request_id': 'req-e0a0552a-788c-4891-8305-7f60465de98a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:16.477433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fb37cc514943cca4608821748bdf09', 'request_id': 'req-e0a0552a-788c-4891-8305-7f60465de98a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:16.615933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] The token cache is being invalidate because project a2fb37cc514943cca4608821748bdf09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:16.616063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:16.616710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e0a0552a-788c-4891-8305-7f60465de98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:16.619105 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1788/3588] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:16 2022] DELETE /identity/v3/projects/a2fb37cc514943cca4608821748bdf09 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:16.622737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:16.649316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fbbba-7844-4892-ba6a-c6d27cfd0183 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:16.745873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:16.746674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:16.749609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:16.750013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] PATH_INFO: `/v3/users/a66a8ba2330a4530bf97c8570685ac07` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:16.753475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66a8ba2330a4530bf97c8570685ac07)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:16.755887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:17.117814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66a8ba2330a4530bf97c8570685ac07'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:17.136229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66a8ba2330a4530bf97c8570685ac07'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:17.140626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66a8ba2330a4530bf97c8570685ac07'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:17.143662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66a8ba2330a4530bf97c8570685ac07'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:17.164741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66a8ba2330a4530bf97c8570685ac07'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:17.269750 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1801/3589] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:16 2022] DELETE /identity/v3/users/a66a8ba2330a4530bf97c8570685ac07 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:18.015037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:18.644046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:19.493217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d1c2-98f0-4c58-a9bd-58d5b84c4482 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:19.493951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d1c2-98f0-4c58-a9bd-58d5b84c4482 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:19.493951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d1c2-98f0-4c58-a9bd-58d5b84c4482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:19.543003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3656d1c2-98f0-4c58-a9bd-58d5b84c4482 None None] MFA Rules not processed for user `5689d1981ee04c7b8dbcb4e9e1afd6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:19.544684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3656d1c2-98f0-4c58-a9bd-58d5b84c4482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:19.619576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:19.619576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:19.684374 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1789/3590] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:19.739262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f3d2-6b86-4f65-88b0-5ee9758be96a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:19.759221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:19.760120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:19.760720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:19.761007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] PATH_INFO: `/v3/projects/d7fa6c9755e74124815cfc5e7698960f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:19.763634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fa6c9755e74124815cfc5e7698960f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:19.772857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:20.012561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fa6c9755e74124815cfc5e7698960f', 'request_id': 'req-dce72aa6-ed6a-43b1-b640-c0441156f47b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:20.057505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fa6c9755e74124815cfc5e7698960f', 'request_id': 'req-dce72aa6-ed6a-43b1-b640-c0441156f47b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:20.078137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fa6c9755e74124815cfc5e7698960f', 'request_id': 'req-dce72aa6-ed6a-43b1-b640-c0441156f47b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:20.188442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] The token cache is being invalidate because project d7fa6c9755e74124815cfc5e7698960f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:20.200809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:20.200809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dce72aa6-ed6a-43b1-b640-c0441156f47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:20.200809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1802/3591] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:19 2022] DELETE /identity/v3/projects/d7fa6c9755e74124815cfc5e7698960f => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:20.201329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:20.201329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:20.201329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:20.258140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:20.261218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:20.469131 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1790/3592] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:20.476474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:20.476939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:20.477328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:20.526794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:20.542826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:20.590374 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1803/3593] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:20.608143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:20.613945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e79a0-8ba5-4e6c-8c6f-177718c06534 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:20.664590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:20.664590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:20.670713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:20.671237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:20.672771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:20.673995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:20.677957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:20.702826 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1791/3594] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:20.707259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:20.719780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beac7ec-7abc-4564-9caf-b6bf53e7bba4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:20.728228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:20.729515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:20.730072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:20.731254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:20.732394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:20.735383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:20.843320 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1804/3595] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:20 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:20.848138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:20.869278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d564ae5-399d-436d-a0f6-adc226db54af admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:21.022728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:21.023481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:21.027327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:21.027327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:21.027327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:21.027792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:21.104152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:21.220196 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1792/3596] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:20 2022] POST /identity/v3/users => generated 286 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:21.221480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:21.239707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195e83-0f9a-4f45-9f78-cefbd933813c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:21.267361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:21.267987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:21.268259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:21.269034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:21.269172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:21.270908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:21.286514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:21.294215 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1805/3597] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:58:21.299895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:21.313636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5769b-5593-46dc-b704-981ac32d4df6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:21.323142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2656c-273f-4bbd-bd6b-85c2f137a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:21.324056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2656c-273f-4bbd-bd6b-85c2f137a58d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:21.324580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2656c-273f-4bbd-bd6b-85c2f137a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:21.325046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2656c-273f-4bbd-bd6b-85c2f137a58d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:21.325928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2656c-273f-4bbd-bd6b-85c2f137a58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:21.327826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2656c-273f-4bbd-bd6b-85c2f137a58d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:21.364221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1793/3598] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:21.373449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:21.400100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202ce9d-a3c5-43ff-8493-e64a98b19e1c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:21.412228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:21.413558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:21.414218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:21.414704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] PATH_INFO: `/v3/projects/af19b853c9154901bb1e4d342b31b441/users/fd6289cbb8eb4e2c9ea7a97c34cd419a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:21.460330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af19b853c9154901bb1e4d342b31b441, user_id=fd6289cbb8eb4e2c9ea7a97c34cd419a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:21.479463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:21.612754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:21.613668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:21.614437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:21.620980 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1806/3599] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:21 2022] PUT /identity/v3/projects/af19b853c9154901bb1e4d342b31b441/users/fd6289cbb8eb4e2c9ea7a97c34cd419a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:21.718831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] MFA Rules not processed for user `fd6289cbb8eb4e2c9ea7a97c34cd419a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:21.722652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:21.954193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:21.968227 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1794/3600] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:22.139361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026c42-2b0f-4245-9905-db51f90aeb94 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:22.152361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e00704-6f9f-4098-966d-9ad453dbd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:22.156541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e00704-6f9f-4098-966d-9ad453dbd1ef admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:22.156541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e00704-6f9f-4098-966d-9ad453dbd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:22.156541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e00704-6f9f-4098-966d-9ad453dbd1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:22.156541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e00704-6f9f-4098-966d-9ad453dbd1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:22.159211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e00704-6f9f-4098-966d-9ad453dbd1ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:22.331343 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1807/3601] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:21 2022] POST /identity/v3/projects => generated 369 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:22.334861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:22.354443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:22.354735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:22.357850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:22.365210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d50d8-6910-4438-8ede-cd9d44a29e9f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:22.500482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] MFA Rules not processed for user `5c02f8592a8842b8baf95d76c55a4d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:22.505318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:22.506155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:22.510553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:22.510927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:22.511312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:22.512508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:22.519718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:22.622435 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1795/3602] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:22 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:22.622435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:22.636694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843f23e-3ef0-49e7-964e-3982c750aea6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:22.648293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:22.651161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:22.651161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:22.651161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:22.653408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:22.655594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:22.687922 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1796/3603] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:58:22.708526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:22.709311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1808/3604] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:22.715121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:22.718168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef409-17e5-4316-944a-08239f2acba1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:22.719412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:22.738564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:22.741836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:22.742530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:22.748670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] PATH_INFO: `/v3/projects/c0713202d4a64aaaa557643f200efc9e/users/5bb5f78869414663a3eca1f34d00492b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:22.803894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0713202d4a64aaaa557643f200efc9e, user_id=5bb5f78869414663a3eca1f34d00492b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:22.816362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:22.924419 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1797/3605] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:22 2022] PUT /identity/v3/projects/c0713202d4a64aaaa557643f200efc9e/users/5bb5f78869414663a3eca1f34d00492b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:22.925604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:22.979670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3444c6-bcd0-4dc0-8593-1019c1f87a0a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:23.080640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:23.082768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.083519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.084127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.109777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fad59-d3d1-46ee-9290-c5f0308f3a83 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:23.130374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01d0f-702f-458d-9a3d-c25cabb9d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:23.131946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01d0f-702f-458d-9a3d-c25cabb9d68c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.131946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01d0f-702f-458d-9a3d-c25cabb9d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.134655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01d0f-702f-458d-9a3d-c25cabb9d68c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.135444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd01d0f-702f-458d-9a3d-c25cabb9d68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:23.141375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd01d0f-702f-458d-9a3d-c25cabb9d68c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:23.174734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1798/3606] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:23.176341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.176637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.176922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.196261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:23.200180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:23.213048 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1809/3607] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:23.218699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:23.233998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806caf2-c139-4209-8f20-e3a531348b7f service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:23.246799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] MFA Rules not processed for user `a880494fb3144a58afd1fbfa8eff6cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:23.248163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:23.252762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa7f81-054e-4b01-8c9a-f2a84ad885df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:23.253638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa7f81-054e-4b01-8c9a-f2a84ad885df admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.254176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa7f81-054e-4b01-8c9a-f2a84ad885df admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.254564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa7f81-054e-4b01-8c9a-f2a84ad885df admin admin] PATH_INFO: `/v3/projects/c0713202d4a64aaaa557643f200efc9e/users/5bb5f78869414663a3eca1f34d00492b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.259348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa7f81-054e-4b01-8c9a-f2a84ad885df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0713202d4a64aaaa557643f200efc9e, user_id=5bb5f78869414663a3eca1f34d00492b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:23.263722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa7f81-054e-4b01-8c9a-f2a84ad885df admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:23.286342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1810/3608] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:23 2022] PUT /identity/v3/projects/c0713202d4a64aaaa557643f200efc9e/users/5bb5f78869414663a3eca1f34d00492b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:23.297698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.298142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.307459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.396198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] MFA Rules not processed for user `5bb5f78869414663a3eca1f34d00492b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:23.396992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:23.424547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1799/3609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:23.539519 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1811/3610] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:23.544492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:23.585948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:23.671095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8ed6-cd69-490e-993c-b60e1d4e9d92 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:23.678801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:23.680836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.681529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.682798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.684608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:23.696570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:23.698318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:23.709118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:23.747166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:23.842951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05f8a5-bce8-4e55-9fbb-aae2ecf51cba None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:23.849409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:23.850199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:23.850587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:23.850965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:23.853062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:23.868578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:23.870772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:23.880967 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1800/3611] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:23 2022] POST /identity/v3/projects => generated 358 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:23.886497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:23.925075 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1812/3612] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:24.094590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37af76-3c60-4dbc-a773-e6f887cf9073 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:24.121276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:24.121927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:24.122218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:24.122504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:24.123198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:24.144532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:24.318548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1801/3613] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:23 2022] POST /identity/v3/users => generated 373 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:24.322879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:24.339725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a782b0-deff-48db-8ed5-6bccc458ab55 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:24.359970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:24.361762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:24.362053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:24.362336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:24.364786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:24.365099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:24.370544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:24.414544 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1813/3614] 10.222.0.20 () {58 vars in 1157 bytes} [Tue Sep 6 10:58:24 2022] GET /identity/v3/users?domain_id=default => generated 8592 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:24.419159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:24.444201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe4053-c788-4f67-924c-72b2207e952a tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:24.446773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:24.447505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:24.447794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:24.448073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/users/58d1e997226d482e906082c023e9ec81` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:24.469542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:update_user(user_id=58d1e997226d482e906082c023e9ec81)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:24.471561 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 10:58:24.471561 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 10:58:24.471561 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 10:58:24.473047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:24.644971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '58d1e997226d482e906082c023e9ec81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:24.692484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:24.750618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invalidating the token cache because user 58d1e997226d482e906082c023e9ec81 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:24.754737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:24.754737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-51fbd7aa-3ee3-4cfc-bf41-4881ab6665f6 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:24.754737 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1802/3615] 10.222.0.20 () {60 vars in 1244 bytes} [Tue Sep 6 10:58:24 2022] PATCH /identity/v3/users/58d1e997226d482e906082c023e9ec81 => generated 488 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:24.759209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:24.759499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:24.759782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:24.810130 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.auth.plugins.core [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] User is disabled: 58d1e997226d482e906082c023e9ec81: AssertionError: User is disabled: 58d1e997226d482e906082c023e9ec81 Sep 06 10:58:24.824251 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.server.flask.application [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 06 10:58:24.829304 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1803/3616] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:24 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 71 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 06 10:58:24.831452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:24.842389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:25.222534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564a0fe-23b7-420a-aa53-e6f62dc1d5fa None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:25.222534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:25.222534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:25.224043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:25.224043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/users/58d1e997226d482e906082c023e9ec81` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:25.224043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:delete_user(user_id=58d1e997226d482e906082c023e9ec81)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:25.224043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:25.225702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865b9dc-0277-4a27-87c2-d1da659866be tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:25.225702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:25.225702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:25.226177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:25.226177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:25.226177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:25.226177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:25.226177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:25.226721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d1e997226d482e906082c023e9ec81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.226721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d1e997226d482e906082c023e9ec81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.226721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d1e997226d482e906082c023e9ec81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.226996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1814/3617] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:25.235400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d1e997226d482e906082c023e9ec81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.237015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d1e997226d482e906082c023e9ec81'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.429601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1804/3618] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:24 2022] DELETE /identity/v3/users/58d1e997226d482e906082c023e9ec81 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:25.434825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:25.452875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857767a2-f493-407f-9463-0dcb149b28c2 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:25.633562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:25.634970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:25.635482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:25.635933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/projects/a0d29e2fef1b420a9f7064b1aaa892fc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:25.638301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0d29e2fef1b420a9f7064b1aaa892fc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:25.642843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:25.901289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d29e2fef1b420a9f7064b1aaa892fc', 'request_id': 'req-1bbab4f4-6a91-46e5-84ee-870261c86def'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.946300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d29e2fef1b420a9f7064b1aaa892fc', 'request_id': 'req-1bbab4f4-6a91-46e5-84ee-870261c86def'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:25.975734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d29e2fef1b420a9f7064b1aaa892fc', 'request_id': 'req-1bbab4f4-6a91-46e5-84ee-870261c86def'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.101053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] The token cache is being invalidate because project a0d29e2fef1b420a9f7064b1aaa892fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:26.101426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.103383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.105082 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1815/3619] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:25 2022] DELETE /identity/v3/projects/a0d29e2fef1b420a9f7064b1aaa892fc => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:26.111606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:26.114693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:26.139961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:26.145215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4202f0d-3627-47c0-bf36-671757626ba8 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:26.332361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb5f78869414663a3eca1f34d00492b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0713202d4a64aaaa557643f200efc9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:26.333597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:26.334406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:26.335354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:26.337961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:26.344161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-c40a7f4b-da0f-466c-be6c-c8a8064fb508 tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Could not find domain: 20258b74f2044b4a8851839582b1ccd1.: keystone.exception.DomainNotFound: Could not find domain: 20258b74f2044b4a8851839582b1ccd1. Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 20258b74f2044b4a8851839582b1ccd1. Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 10:58:26.396718 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Sep 06 10:58:26.404513 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 10:58:26.405384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 10:58:26.406261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 10:58:26.406261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 20258b74f2044b4a8851839582b1ccd1. Sep 06 10:58:26.406261 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 10:58:26.406493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:26.407459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1805/3620] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:26 2022] POST /identity/v3/users => generated 112 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 10:58:26.408626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:26.494808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbab4f4-6a91-46e5-84ee-870261c86def tempest-UsersNegativeTest-542925352 tempest-UsersNegativeTest-542925352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:26.501184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:26.502823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:26.503324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:26.503736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] PATH_INFO: `/v3/users/fd6289cbb8eb4e2c9ea7a97c34cd419a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:26.506299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6289cbb8eb4e2c9ea7a97c34cd419a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:26.508690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:26.685748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:26.766796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6289cbb8eb4e2c9ea7a97c34cd419a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.807385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6289cbb8eb4e2c9ea7a97c34cd419a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.808500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6289cbb8eb4e2c9ea7a97c34cd419a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.817659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6289cbb8eb4e2c9ea7a97c34cd419a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:26.883066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6289cbb8eb4e2c9ea7a97c34cd419a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:27.004520 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1816/3621] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:26 2022] DELETE /identity/v3/users/fd6289cbb8eb4e2c9ea7a97c34cd419a => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:27.009728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b996-8ccb-48b6-91ec-d6b2f55499a1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:27.009931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b996-8ccb-48b6-91ec-d6b2f55499a1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:27.010127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b996-8ccb-48b6-91ec-d6b2f55499a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:27.053074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c341b996-8ccb-48b6-91ec-d6b2f55499a1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:27.061822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c341b996-8ccb-48b6-91ec-d6b2f55499a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:27.197254 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1806/3622] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:27.217644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:27.218085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:27.319092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a5369-383b-4a2a-8d83-a410f9beb516 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:27.326572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:27.327961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:27.327961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:27.328450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:27.352274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:27.355404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:27.400891 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1817/3623] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:27.894726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:28.501157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:28.617190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:28.617767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:28.617767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:28.665669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] MFA Rules not processed for user `5c02f8592a8842b8baf95d76c55a4d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:28.669700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:28.774613 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1807/3624] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:29.052121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:29.053657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:29.073739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78dbd1-a762-4df7-abd3-0d09688f88c2 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:29.081299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:29.082810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:29.083364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:29.083825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] PATH_INFO: `/v3/projects/af19b853c9154901bb1e4d342b31b441` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:29.087420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af19b853c9154901bb1e4d342b31b441)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:29.090150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:29.262428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af19b853c9154901bb1e4d342b31b441', 'request_id': 'req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.283499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af19b853c9154901bb1e4d342b31b441', 'request_id': 'req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.295562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af19b853c9154901bb1e4d342b31b441', 'request_id': 'req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.408247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] The token cache is being invalidate because project af19b853c9154901bb1e4d342b31b441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:29.408499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.410753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ee49a6d-8bfb-4508-8b37-cdcf55484a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.413872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1818/3625] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:29 2022] DELETE /identity/v3/projects/af19b853c9154901bb1e4d342b31b441 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:29.414786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:29.433914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f37fa-f7fd-4fe6-a900-6e8ace7f0009 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:29.550273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:29.551051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:29.551384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:29.554017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] PATH_INFO: `/v3/users/5bb5f78869414663a3eca1f34d00492b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:29.554017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb5f78869414663a3eca1f34d00492b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:29.554987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:29.775218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb5f78869414663a3eca1f34d00492b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.789876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb5f78869414663a3eca1f34d00492b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.790867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb5f78869414663a3eca1f34d00492b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.807194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb5f78869414663a3eca1f34d00492b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.808701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb5f78869414663a3eca1f34d00492b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:29.917434 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1808/3626] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:29 2022] DELETE /identity/v3/users/5bb5f78869414663a3eca1f34d00492b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:58:30.180517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe886eb-b3dc-4eab-9994-a6842c6ca1f9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:30.180517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe886eb-b3dc-4eab-9994-a6842c6ca1f9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:30.180517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe886eb-b3dc-4eab-9994-a6842c6ca1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:30.210179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5fe886eb-b3dc-4eab-9994-a6842c6ca1f9 None None] MFA Rules not processed for user `a880494fb3144a58afd1fbfa8eff6cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:30.211764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5fe886eb-b3dc-4eab-9994-a6842c6ca1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:30.343715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1819/3627] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:30.699334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:30.700998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:30.804060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801f54-6f69-45c3-9578-114f465156ee admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:30.810983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:30.812022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:30.812521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:30.812950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] PATH_INFO: `/v3/projects/c0713202d4a64aaaa557643f200efc9e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:30.815117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0713202d4a64aaaa557643f200efc9e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:30.817825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:30.955544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0713202d4a64aaaa557643f200efc9e', 'request_id': 'req-86791c64-aaf9-41c8-871f-49e499f8b031'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:30.978307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0713202d4a64aaaa557643f200efc9e', 'request_id': 'req-86791c64-aaf9-41c8-871f-49e499f8b031'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:30.995140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0713202d4a64aaaa557643f200efc9e', 'request_id': 'req-86791c64-aaf9-41c8-871f-49e499f8b031'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:31.159654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] The token cache is being invalidate because project c0713202d4a64aaaa557643f200efc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:31.159654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:31.159654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86791c64-aaf9-41c8-871f-49e499f8b031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:31.159654 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1809/3628] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:30 2022] DELETE /identity/v3/projects/c0713202d4a64aaaa557643f200efc9e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:31.159960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:31.159960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:31.159960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:31.186805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:31.189590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:31.276082 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1820/3629] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:31.284573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:31.284863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:31.285146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:31.305944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:31.307241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:31.316467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1810/3630] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:31.321177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:31.333433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706e60a-f63e-401a-ba3b-78c382e13c89 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:31.338850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:31.339679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:31.339967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:31.340242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:31.340900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:31.341209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:31.343161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:31.346834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:31.359621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1821/3631] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:58:31.364097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:31.374816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995689eb-f8f7-4036-ad69-a0ae9aaf3e22 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:31.381076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:31.381800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:31.382223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:31.382742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:31.383429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:31.385909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:31.617078 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1811/3632] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:31 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:31.621188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:31.632513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659576-80ad-4592-93b8-3038727400cd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:31.727998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:31.728618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:31.728903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:31.729197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:31.729828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:31.731780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:31.945404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1822/3633] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:31 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:31.949544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:31.962800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40906-1893-4459-8b61-5d7fe7ffcb29 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:31.968681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:31.969544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:31.970201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:31.970662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:31.972124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:31.974476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:31.989701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1812/3634] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:58:31.991248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:32.002126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212b10f-3172-413b-8289-27c8ac6902a8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:32.007440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a3df-afee-45d1-8d3b-7a7dd1730e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:32.008135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a3df-afee-45d1-8d3b-7a7dd1730e43 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:32.008840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a3df-afee-45d1-8d3b-7a7dd1730e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:32.008949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a3df-afee-45d1-8d3b-7a7dd1730e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:32.009699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a3df-afee-45d1-8d3b-7a7dd1730e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:32.011441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a3df-afee-45d1-8d3b-7a7dd1730e43 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:32.027153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:32.028322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:32.029616 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1823/3635] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:32.039712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a06d7e-bc1a-484f-bae9-bcf29add6857 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:32.044884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:32.046166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:32.046454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:32.046737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] PATH_INFO: `/v3/projects/d5b29bce94804e679b1871f18eb0bb07/users/c781b17e957e47e1b3416a85fa451ee2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:32.068330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b29bce94804e679b1871f18eb0bb07, user_id=c781b17e957e47e1b3416a85fa451ee2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:32.071934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:32.188580 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1813/3636] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:32 2022] PUT /identity/v3/projects/d5b29bce94804e679b1871f18eb0bb07/users/c781b17e957e47e1b3416a85fa451ee2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:32.199173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc8d06-dcfd-48d0-a88b-54332737415d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:32.200455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc8d06-dcfd-48d0-a88b-54332737415d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:32.200881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc8d06-dcfd-48d0-a88b-54332737415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:32.265014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a7dc8d06-dcfd-48d0-a88b-54332737415d None None] MFA Rules not processed for user `c781b17e957e47e1b3416a85fa451ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:32.266873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a7dc8d06-dcfd-48d0-a88b-54332737415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:32.430574 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1824/3637] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:32.455590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:32.455590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:32.617979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb010a2-f605-4cb0-8457-4946df655b33 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:32.634420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:32.635232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:32.635757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:32.636101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:32.648647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:32.651436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:32.664569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1814/3638] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:33.357781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26b41-51a8-4849-9c05-38beca7ae6ca None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:33.358296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26b41-51a8-4849-9c05-38beca7ae6ca None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:33.358392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a26b41-51a8-4849-9c05-38beca7ae6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:33.379249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a6a26b41-51a8-4849-9c05-38beca7ae6ca None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:33.380472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a6a26b41-51a8-4849-9c05-38beca7ae6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:33.436151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1825/3639] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:33.458858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:33.460332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:33.543331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c110153-706f-42f7-982e-a9be758ebe4a service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:33.549334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:33.549972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:33.550424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:33.550705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:33.566153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:33.567906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:33.576848 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1815/3640] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:34.666834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01d28-3d5f-4b15-942b-e9ed5bf054e4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:34.667372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01d28-3d5f-4b15-942b-e9ed5bf054e4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:34.667476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01d28-3d5f-4b15-942b-e9ed5bf054e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:34.688764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ddf01d28-3d5f-4b15-942b-e9ed5bf054e4 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:34.690098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ddf01d28-3d5f-4b15-942b-e9ed5bf054e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:34.699332 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1826/3641] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:58:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:34.720774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:34.735975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60960cae-9b1c-4b29-99a0-26c6ef2aafb7 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:34.766166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:34.767225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:34.768032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:34.772299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:34.777748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:34.779426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:34.788001 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1816/3642] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 10:58:35.053700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:35.246481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:35.725028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160218-a471-4690-a9f7-7ef530610f74 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:35.726054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160218-a471-4690-a9f7-7ef530610f74 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:35.726578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160218-a471-4690-a9f7-7ef530610f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:35.784532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-72160218-a471-4690-a9f7-7ef530610f74 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:35.785928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72160218-a471-4690-a9f7-7ef530610f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:35.811782 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1827/3643] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:58:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:35.821263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:35.839161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab8a0-0910-4c74-8011-08aff1d8d84f service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:35.845706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:35.846319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:35.846760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:35.847208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:35.856720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:35.858129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:35.868279 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1817/3644] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:36.889691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb965c-f581-4a10-9096-ecad13e5d278 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:36.889691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb965c-f581-4a10-9096-ecad13e5d278 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:36.890320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb965c-f581-4a10-9096-ecad13e5d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:36.920980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1acb965c-f581-4a10-9096-ecad13e5d278 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:36.924126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1acb965c-f581-4a10-9096-ecad13e5d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:36.934396 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1828/3645] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:58:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:36.951307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:36.966448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366737ba-6563-47db-9f60-9d2d6a5abb8c service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:36.983113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:36.984035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:36.984339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:36.985023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:37.008958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:37.010682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:37.022416 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1818/3646] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:37.499137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:37.820503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:38.035003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b692f0-38c6-469c-bd36-fe437cdc6a78 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:38.035603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b692f0-38c6-469c-bd36-fe437cdc6a78 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:38.035603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b692f0-38c6-469c-bd36-fe437cdc6a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:38.061101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f3b692f0-38c6-469c-bd36-fe437cdc6a78 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:38.062494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f3b692f0-38c6-469c-bd36-fe437cdc6a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:38.071045 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1829/3647] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:58:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:38.091940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:38.110065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bb1b0-7596-439a-9e2e-d32f511cd310 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:38.134447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:38.135151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:38.135437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:38.139438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:38.153231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:38.154992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:38.175453 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1819/3648] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 10:58:39.110736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8731e-a60b-432d-8bdd-4500350cf55b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:39.111276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8731e-a60b-432d-8bdd-4500350cf55b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:39.111583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8731e-a60b-432d-8bdd-4500350cf55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:39.139089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-74d8731e-a60b-432d-8bdd-4500350cf55b None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:39.140426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74d8731e-a60b-432d-8bdd-4500350cf55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:39.140856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:39.149634 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1830/3649] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:39.162051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:39.173873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4bdfb-82b6-4f56-8a3d-69a7f86cec74 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:39.179857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:39.180466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:39.180906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:39.181194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:39.191782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:39.194575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:39.204707 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1820/3650] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:40.608742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:40.762090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358273-6354-4bb3-9a88-94f34719a240 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:40.762429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358273-6354-4bb3-9a88-94f34719a240 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:40.765837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358273-6354-4bb3-9a88-94f34719a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:40.792304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8b358273-6354-4bb3-9a88-94f34719a240 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:40.793068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b358273-6354-4bb3-9a88-94f34719a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:40.800400 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1831/3651] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:58:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:40.813862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:40.825382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308d75d-093a-43ec-8c2e-6cadf479cf3c service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:40.831169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:40.831780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:40.832427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:40.832427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:40.845922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:40.849784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:40.856173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1821/3652] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:41.450018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1938-2f90-42fb-ba2e-6a49e06794ae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:41.450018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1938-2f90-42fb-ba2e-6a49e06794ae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:41.450018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1938-2f90-42fb-ba2e-6a49e06794ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:41.469313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-834e1938-2f90-42fb-ba2e-6a49e06794ae None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:41.470931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-834e1938-2f90-42fb-ba2e-6a49e06794ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:41.478541 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1832/3653] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:58:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:41.490633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:41.501593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f448d09-6ef7-40d6-9719-0cdc13b97bd9 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:41.507082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:41.507724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:41.507959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:41.508237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:41.520938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:41.522528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:41.533710 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1822/3654] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:42.028229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604c335-08f3-43a8-961f-7cd6534f4ee4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:42.028704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604c335-08f3-43a8-961f-7cd6534f4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:42.028905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604c335-08f3-43a8-961f-7cd6534f4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:42.054197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8604c335-08f3-43a8-961f-7cd6534f4ee4 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:42.055453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8604c335-08f3-43a8-961f-7cd6534f4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:42.073364 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1833/3655] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:42.082270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:42.094757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd721a-7866-4875-b40a-00456fead443 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:42.100454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:42.101162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:42.101514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:42.101864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:42.110895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:42.112719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:42.122267 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1823/3656] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:42.237506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:42.584549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832464c7-c9db-48b9-8a52-ff9536dc36bb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:42.584838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832464c7-c9db-48b9-8a52-ff9536dc36bb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:42.585123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832464c7-c9db-48b9-8a52-ff9536dc36bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:42.608246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-832464c7-c9db-48b9-8a52-ff9536dc36bb None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:42.609495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-832464c7-c9db-48b9-8a52-ff9536dc36bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:42.618001 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1834/3657] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:42.631526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:42.642855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2a942-185f-4616-a180-a0a7ef30d08c service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:42.649011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:42.651994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:42.651994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:42.651994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:42.659977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:42.661709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:42.670986 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1824/3658] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 10:58:42.819324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:43.182963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c03ce4-c356-4832-9f6b-02f529b94d11 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:43.183933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c03ce4-c356-4832-9f6b-02f529b94d11 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:43.186962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c03ce4-c356-4832-9f6b-02f529b94d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:43.204727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a3c03ce4-c356-4832-9f6b-02f529b94d11 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:43.205960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3c03ce4-c356-4832-9f6b-02f529b94d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:43.213583 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1835/3659] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:43.231211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:43.245666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f083b8e-b49e-4383-8214-cc9931d702af service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:43.257939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:43.258955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:43.259999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:43.260575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:43.273145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:43.275926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:43.287744 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1825/3660] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:43.997121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:43.997815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:43.998512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:44.046694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:44.049042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:44.074003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1836/3661] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:44.089924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:44.104184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5314b7e-9532-491d-ac77-cf9fd7db8186 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:44.112679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3204d50-900c-4e5a-8c0f-30018047fb1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:44.114237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204d50-900c-4e5a-8c0f-30018047fb1c service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:44.114790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204d50-900c-4e5a-8c0f-30018047fb1c service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:44.115576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3204d50-900c-4e5a-8c0f-30018047fb1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:44.149586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204d50-900c-4e5a-8c0f-30018047fb1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:44.152354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3204d50-900c-4e5a-8c0f-30018047fb1c service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:44.165763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1826/3662] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 10:58:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 10:58:44.649133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:44.780098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:44.870240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2c06d-9c1d-4484-a6fb-a64c0e379273 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:44.881150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:44.882418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:44.883921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:44.884434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] PATH_INFO: `/v3/users/c781b17e957e47e1b3416a85fa451ee2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:44.887790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c781b17e957e47e1b3416a85fa451ee2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:44.894282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:45.122309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c781b17e957e47e1b3416a85fa451ee2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:45.150605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c781b17e957e47e1b3416a85fa451ee2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:45.152792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c781b17e957e47e1b3416a85fa451ee2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:45.156085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c781b17e957e47e1b3416a85fa451ee2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:45.199777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c781b17e957e47e1b3416a85fa451ee2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:45.318733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1837/3663] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:44 2022] DELETE /identity/v3/users/c781b17e957e47e1b3416a85fa451ee2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:45.323691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:45.323801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:45.324103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:45.357495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:45.359192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:45.479836 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1827/3664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:58:45.486822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:45.488465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:45.631901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eb62a-1a4c-42fd-8201-48e6f9b88ca1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:45.637908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f84bf-210e-4d8a-b488-49fded48e1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:45.638697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f84bf-210e-4d8a-b488-49fded48e1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:45.639447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f84bf-210e-4d8a-b488-49fded48e1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:45.640123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f84bf-210e-4d8a-b488-49fded48e1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:45.653070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f84bf-210e-4d8a-b488-49fded48e1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:45.655420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f84bf-210e-4d8a-b488-49fded48e1d1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:45.719360 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1838/3665] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:46.467277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:46.555086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:46.558285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:46.576110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e10f46-fe58-43f8-80eb-7c21216d278d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:46.595878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:46.597643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:46.598077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:46.598502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] PATH_INFO: `/v3/projects/d5b29bce94804e679b1871f18eb0bb07` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:46.600995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b29bce94804e679b1871f18eb0bb07)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:46.611397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:46.855805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b29bce94804e679b1871f18eb0bb07', 'request_id': 'req-1eb0335c-7280-4d1e-b7f7-b02ed0713913'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:46.865415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b29bce94804e679b1871f18eb0bb07', 'request_id': 'req-1eb0335c-7280-4d1e-b7f7-b02ed0713913'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:46.885984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b29bce94804e679b1871f18eb0bb07', 'request_id': 'req-1eb0335c-7280-4d1e-b7f7-b02ed0713913'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:46.990731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] The token cache is being invalidate because project d5b29bce94804e679b1871f18eb0bb07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:46.991699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:46.992414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1eb0335c-7280-4d1e-b7f7-b02ed0713913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:46.997890 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1828/3666] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:46 2022] DELETE /identity/v3/projects/d5b29bce94804e679b1871f18eb0bb07 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:47.003633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.004112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.004531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.046643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:47.048726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:47.152287 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1839/3667] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:47.157428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.157779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.158009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.189786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:47.191439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:47.229753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1829/3668] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:47.234080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:47.246306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6d849-f8cf-45c3-a6a2-340883b0220e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:47.255042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:47.255679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.256235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.257102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.257772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:47.258078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:47.259733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:47.274697 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1840/3669] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:47.278144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:47.293236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae93cca-25ad-48d1-8cdf-4cd1c2f42075 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:47.299853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:47.300528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.300823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.301157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.302249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:47.304393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:47.508433 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1830/3670] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:47 2022] POST /identity/v3/projects => generated 355 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:47.514178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:47.529223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c4d5-c486-4de3-9248-61d4c4eb5146 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:47.618033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:47.618692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.618976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.619329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.619986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:47.622163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:47.783069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1841/3671] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:47 2022] POST /identity/v3/users => generated 278 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:47.789268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:47.807490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef173-0d9a-40fa-8228-168dc33b9784 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:47.817675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:47.818419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.818940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.819466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.820188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:47.822027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:47.844061 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1831/3672] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:47.848439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:47.864093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593169ab-ccdc-4e71-9ec9-95356cb93681 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:47.890065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9168d-b2ca-4dcc-bc5e-d98791d9af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:47.893470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9168d-b2ca-4dcc-bc5e-d98791d9af49 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.893470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9168d-b2ca-4dcc-bc5e-d98791d9af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.893470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9168d-b2ca-4dcc-bc5e-d98791d9af49 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.907318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9168d-b2ca-4dcc-bc5e-d98791d9af49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:47.914589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9168d-b2ca-4dcc-bc5e-d98791d9af49 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:47.938754 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1842/3673] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:47.940169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:47.953326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc3703-440d-4bd2-b61d-ae1d004630f5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:47.960183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:47.961200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:47.961982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:47.962453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] PATH_INFO: `/v3/projects/efe859cbfb0541c6b1ba08e9d3f4c4a4/users/8f9ffe2976bf4682840f0da3d6778e15/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:47.984588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe859cbfb0541c6b1ba08e9d3f4c4a4, user_id=8f9ffe2976bf4682840f0da3d6778e15, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:47.986395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:48.108700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:48.108991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:48.109674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:48.115978 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1832/3674] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:47 2022] PUT /identity/v3/projects/efe859cbfb0541c6b1ba08e9d3f4c4a4/users/8f9ffe2976bf4682840f0da3d6778e15/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:48.169414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] MFA Rules not processed for user `8f9ffe2976bf4682840f0da3d6778e15`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:48.174313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:48.346190 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1843/3675] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:48.354837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:48.473745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f8f3-7dab-4614-9ceb-dcc7006579a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:48.480930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:48.481643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:48.481999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:48.483068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:48.483068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:48.486777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:48.652273 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1833/3676] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:48 2022] POST /identity/v3/projects => generated 353 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:48.658663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:48.676294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863869-6bb2-4e7b-8037-e4c9a96dfbf1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:48.804854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:48.805799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:48.806089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:48.806368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:48.807040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:48.809024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:48.946641 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1844/3677] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:48 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:48.948034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:48.965477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae791d-e187-45eb-bec0-64f895e601a7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:48.981604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:48.982248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:48.982534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:48.982815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:48.983512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:48.985186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.006160 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1834/3678] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:49.011075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:49.033877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f012a4-2b53-49ea-8fd9-85a74e8dd523 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:49.041068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:49.047228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.047228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.047228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] PATH_INFO: `/v3/projects/33c3a8526df44e51b1034ba172bd8e70/users/830adcaa7c4746c89453adfe4dfb8ee8/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.080781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c3a8526df44e51b1034ba172bd8e70, user_id=830adcaa7c4746c89453adfe4dfb8ee8, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:49.084593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.191113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1845/3679] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:49 2022] PUT /identity/v3/projects/33c3a8526df44e51b1034ba172bd8e70/users/830adcaa7c4746c89453adfe4dfb8ee8/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:49.195239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:49.211701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c8b36-107c-4336-835a-002b35b1e511 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:49.283569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:49.299107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4012b4-ef9c-483b-9a06-bad5361e291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:49.300041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4012b4-ef9c-483b-9a06-bad5361e291b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.300528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4012b4-ef9c-483b-9a06-bad5361e291b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.301286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4012b4-ef9c-483b-9a06-bad5361e291b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.302169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4012b4-ef9c-483b-9a06-bad5361e291b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:49.304220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4012b4-ef9c-483b-9a06-bad5361e291b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.317337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1835/3680] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:49.322062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:49.333979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4baa6e-03ff-4ce1-a539-d86b6b491bf8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:49.348527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:49.348527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.348698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.349005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] PATH_INFO: `/v3/projects/33c3a8526df44e51b1034ba172bd8e70/users/830adcaa7c4746c89453adfe4dfb8ee8/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.352950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c3a8526df44e51b1034ba172bd8e70, user_id=830adcaa7c4746c89453adfe4dfb8ee8, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:49.355671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.412532 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1846/3681] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:49 2022] PUT /identity/v3/projects/33c3a8526df44e51b1034ba172bd8e70/users/830adcaa7c4746c89453adfe4dfb8ee8/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:49.422762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.422762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.422762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.484343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] MFA Rules not processed for user `830adcaa7c4746c89453adfe4dfb8ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:49.485796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:49.626683 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1836/3682] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:49.631805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:49.643032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39e004-08d7-49ce-bffb-2c8c12b02701 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:49.647951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830adcaa7c4746c89453adfe4dfb8ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c3a8526df44e51b1034ba172bd8e70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:49.648573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.648850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.650329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.650996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:49.651340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:49.652980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.672034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1847/3683] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:49.674039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:49.685527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f0699-b281-4271-9452-99f514cf8717 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:49.694301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830adcaa7c4746c89453adfe4dfb8ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c3a8526df44e51b1034ba172bd8e70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:49.694853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.695190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.695627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.696291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:49.698378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.855204 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1837/3684] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:49 2022] POST /identity/v3/projects => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:49.856973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:49.871296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59950a1-fc24-4731-983f-b7158c812a67 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:49.955128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830adcaa7c4746c89453adfe4dfb8ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c3a8526df44e51b1034ba172bd8e70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:49.955977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:49.956699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:49.957066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:49.958023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:49.958449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:49.960888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2e010-b664-4ab1-be87-6752046e2af0 tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:49.985012 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1848/3685] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:50.000860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:50.002872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:50.093943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3478af-4ca0-4b44-940e-ccb82b1d8e1b tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:50.098417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:50.099517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:50.099993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:50.100658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:50.119575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:50.121325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:50.137946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:50.138387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:50.138961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:50.144756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1838/3686] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:50.174427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:50.175830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:50.283090 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1849/3687] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:58:50.834162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:50.849406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aab0b-fe44-423a-b390-15d1831894a5 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:50.863799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830adcaa7c4746c89453adfe4dfb8ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c3a8526df44e51b1034ba172bd8e70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:50.863799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:50.864163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:50.864523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] PATH_INFO: `/v3/projects/c9f965401df44e36afaaed44d49c9bca` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:50.866140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c9f965401df44e36afaaed44d49c9bca)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:50.868171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:51.003781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:51.091618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f965401df44e36afaaed44d49c9bca', 'request_id': 'req-13890b33-e1cb-4482-992a-2005365a8beb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.111760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f965401df44e36afaaed44d49c9bca', 'request_id': 'req-13890b33-e1cb-4482-992a-2005365a8beb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.117260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f965401df44e36afaaed44d49c9bca', 'request_id': 'req-13890b33-e1cb-4482-992a-2005365a8beb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.231409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] The token cache is being invalidate because project c9f965401df44e36afaaed44d49c9bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:51.231883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.233186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-13890b33-e1cb-4482-992a-2005365a8beb tempest-QuotasTest-62344776 tempest-QuotasTest-62344776-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.236623 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1839/3688] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:50 2022] DELETE /identity/v3/projects/c9f965401df44e36afaaed44d49c9bca => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:51.366741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:51.462318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6292cef-d668-408e-8a94-be707452f8f4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:51.529414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:51.530367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:51.530800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:51.531369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] PATH_INFO: `/v3/users/8f9ffe2976bf4682840f0da3d6778e15` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:51.533393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9ffe2976bf4682840f0da3d6778e15)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:51.535537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:51.564262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:51.844589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9ffe2976bf4682840f0da3d6778e15'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.858417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9ffe2976bf4682840f0da3d6778e15'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.859225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9ffe2976bf4682840f0da3d6778e15'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.863781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9ffe2976bf4682840f0da3d6778e15'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:51.898416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9ffe2976bf4682840f0da3d6778e15'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:52.009600 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1850/3689] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:51 2022] DELETE /identity/v3/users/8f9ffe2976bf4682840f0da3d6778e15 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:52.014592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:52.015166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:52.015626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:52.053377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:52.054894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:52.163189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1840/3690] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:52.175649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:52.178586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:52.264835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f910b-be7b-4267-8073-0b972d67066a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:52.271938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:52.272586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:52.272874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:52.273191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:52.284816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:52.286873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:52.301601 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1851/3691] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:58:53.900273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:54.184841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:54.186839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:54.373202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d52fd-e905-4452-9c3c-1fb5f7b2b48d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:54.379793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:54.380652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:54.382379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:54.382675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:54.385482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:54.400828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:54.402774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:54.417687 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1841/3692] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:54.432312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:54.434437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:54.452974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090060a5-8425-4c91-8bdc-c7644ead2838 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:54.461051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:54.462149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:54.462836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:54.463407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:54.470663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:54.471630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:54.474873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:54.486688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:54.488499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:54.503787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7d0de-7139-46a3-8434-dc1cd1179ec8 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:54.505846 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1852/3693] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:54.516527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:54.518311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:54.520178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:54.520476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] PATH_INFO: `/v3/projects/efe859cbfb0541c6b1ba08e9d3f4c4a4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:54.521917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe859cbfb0541c6b1ba08e9d3f4c4a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:54.527670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:54.619318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:54.697948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe859cbfb0541c6b1ba08e9d3f4c4a4', 'request_id': 'req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:54.733597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe859cbfb0541c6b1ba08e9d3f4c4a4', 'request_id': 'req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:54.747788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe859cbfb0541c6b1ba08e9d3f4c4a4', 'request_id': 'req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:54.804313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:54.843683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] The token cache is being invalidate because project efe859cbfb0541c6b1ba08e9d3f4c4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:54.844045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:54.846618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df9b9de2-9cba-420f-9e1d-dcbc68f4ec90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:54.850429 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1842/3694] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:54 2022] DELETE /identity/v3/projects/efe859cbfb0541c6b1ba08e9d3f4c4a4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:54.854668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:54.873954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ac05-eb49-4975-b32c-4b45e6f2c6e3 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:54.994937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:54.995624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:54.996058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:54.996501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] PATH_INFO: `/v3/users/830adcaa7c4746c89453adfe4dfb8ee8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:54.997944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830adcaa7c4746c89453adfe4dfb8ee8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:55.000794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:55.253172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830adcaa7c4746c89453adfe4dfb8ee8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:55.262932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830adcaa7c4746c89453adfe4dfb8ee8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:55.263900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830adcaa7c4746c89453adfe4dfb8ee8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:55.264819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830adcaa7c4746c89453adfe4dfb8ee8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:55.282691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830adcaa7c4746c89453adfe4dfb8ee8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:55.374239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1853/3695] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:54 2022] DELETE /identity/v3/users/830adcaa7c4746c89453adfe4dfb8ee8 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:56.050898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1880f-0079-49f3-b2fd-c1e48f77b3e6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:56.051383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1880f-0079-49f3-b2fd-c1e48f77b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:56.051612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1880f-0079-49f3-b2fd-c1e48f77b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:56.072898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f1c1880f-0079-49f3-b2fd-c1e48f77b3e6 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:56.074412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f1c1880f-0079-49f3-b2fd-c1e48f77b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:56.134142 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1843/3696] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:56.180817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:56.182898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:56.293247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c964-caf9-4e80-a01d-390027fb10b8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:56.299040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:56.300527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:56.300821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:56.301107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] PATH_INFO: `/v3/projects/33c3a8526df44e51b1034ba172bd8e70` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:56.302882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c3a8526df44e51b1034ba172bd8e70)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:56.304880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:56.316096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:56.457806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c3a8526df44e51b1034ba172bd8e70', 'request_id': 'req-c8160a4b-d510-4766-b398-1a215c20324a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:56.466371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c3a8526df44e51b1034ba172bd8e70', 'request_id': 'req-c8160a4b-d510-4766-b398-1a215c20324a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:56.475108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c3a8526df44e51b1034ba172bd8e70', 'request_id': 'req-c8160a4b-d510-4766-b398-1a215c20324a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:56.586464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] The token cache is being invalidate because project 33c3a8526df44e51b1034ba172bd8e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:58:56.587092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:56.588075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8160a4b-d510-4766-b398-1a215c20324a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:58:56.596457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:56.596751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:56.597034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:56.597331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1854/3697] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:58:56 2022] DELETE /identity/v3/projects/33c3a8526df44e51b1034ba172bd8e70 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:56.622768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:56.624099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:56.707651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1844/3698] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:56.712312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:56.719226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:56.719226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:56.719533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:56.748155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:56.749805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:56.778182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1855/3699] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:56.783210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:56.805181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876b26c-89d7-42fe-ace0-a0f0c94a2313 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:56.811101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:56.811998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:56.812488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:56.814321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:56.814653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:58:56.815143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:56.817149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:56.836874 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1845/3700] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:58:56.849005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:56.863293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5c99-9989-42ac-9873-9d5fc566c31d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:56.873443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:56.874549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:56.875767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:56.876211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:56.882466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:56.884895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:57.074703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:57.075785 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1856/3701] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:56 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:57.085731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5e634-9bc9-4284-baf0-247cac8a8318 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:57.158058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:57.159848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:57.160343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:57.160776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:57.161604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:57.163681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:57.365336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:57.376383 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1846/3702] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:57 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:58:57.378983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb2c3e-b5ae-489c-b1ad-d708d16ca762 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:57.384843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:57.385500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:57.385791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:57.386072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:57.386807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:57.388804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:57.404356 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1857/3703] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:57.407238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:57.416604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaa669-4b41-4ca0-badc-e55130a66e61 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:57.423536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaadcee-da85-4656-8a1b-ddbc7059c7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:57.427339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaadcee-da85-4656-8a1b-ddbc7059c7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:57.427339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaadcee-da85-4656-8a1b-ddbc7059c7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:57.427339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaadcee-da85-4656-8a1b-ddbc7059c7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:57.427339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaadcee-da85-4656-8a1b-ddbc7059c7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:57.427339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaadcee-da85-4656-8a1b-ddbc7059c7d7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:57.442520 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1847/3704] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:58:57.447422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:57.471583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcbab3-6303-4947-9f51-068ce59bd598 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:57.478192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:57.479224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:57.479660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:57.480255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] PATH_INFO: `/v3/projects/757a9905ea7c4858b61df5331464eeb1/users/05cf9d63e50746d3947cccbfba312067/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:57.503508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] RBAC: Authorizing `identity:create_grant(project_id=757a9905ea7c4858b61df5331464eeb1, user_id=05cf9d63e50746d3947cccbfba312067, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:57.506813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:57.574428 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1858/3705] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:57 2022] PUT /identity/v3/projects/757a9905ea7c4858b61df5331464eeb1/users/05cf9d63e50746d3947cccbfba312067/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:57.586355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:57.587262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:57.587570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:57.630025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] MFA Rules not processed for user `05cf9d63e50746d3947cccbfba312067`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:57.631717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:57.730728 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1848/3706] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:57.735856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:57.860592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94887a-309c-4c70-981d-1571e97f214c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:57.869222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:57.870094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:57.870796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:57.871258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:57.872057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:57.874581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:57.978035 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1859/3707] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:58:57 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:57.980504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:58.003063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce747-07d4-4e72-94b2-f03beb42a611 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:58.108067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:58.110285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:58.110586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:58.110858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:58.111567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:58.117242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:58.209799 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1849/3708] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:58:57 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:58:58.214304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:58.230952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474942-ad2b-4817-98c0-2c8391950ad9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:58.242108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:58.243318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:58.243794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:58.244445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:58.245297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:58.247547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:58.315136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:58.315136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:58.321370 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1860/3709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:58.331239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d5bbc-d06c-49a3-a958-c5d496e255b9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:58.342273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:58.342980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:58.344712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:58.345142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] PATH_INFO: `/v3/projects/8be95061c55c4dcd9425aee76011e514/users/f3291f1b72424528a44a995954274965/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:58.388450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be95061c55c4dcd9425aee76011e514, user_id=f3291f1b72424528a44a995954274965, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:58.394239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:58.410550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:58:58.487285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:58.487945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1850/3710] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:58 2022] PUT /identity/v3/projects/8be95061c55c4dcd9425aee76011e514/users/f3291f1b72424528a44a995954274965/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:58.506479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0008-5713-42e1-8020-5b6952cbdc63 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:58.653209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8cf67-777c-41d1-8830-01ccf3249fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:58.654348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cf67-777c-41d1-8830-01ccf3249fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:58.654915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cf67-777c-41d1-8830-01ccf3249fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:58.655555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cf67-777c-41d1-8830-01ccf3249fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:58.657069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8cf67-777c-41d1-8830-01ccf3249fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:58.661898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8cf67-777c-41d1-8830-01ccf3249fd7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:58.676172 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1861/3711] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:58:58.683303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:58.706341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a86bf9-798c-4c47-9b26-3097a2ff9948 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:58.718668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:58.720323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:58.720716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:58.721246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] PATH_INFO: `/v3/projects/8be95061c55c4dcd9425aee76011e514/users/f3291f1b72424528a44a995954274965/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:58.727980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be95061c55c4dcd9425aee76011e514, user_id=f3291f1b72424528a44a995954274965, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:58.734022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:58.762858 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1851/3712] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:58:58 2022] PUT /identity/v3/projects/8be95061c55c4dcd9425aee76011e514/users/f3291f1b72424528a44a995954274965/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:58:58.773326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:58.773899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:58.774352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:58.835507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] MFA Rules not processed for user `f3291f1b72424528a44a995954274965`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:58:58.836817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:58.991193 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1862/3713] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:58:59.019129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:59.024273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:59.127646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4ebc7-8676-4fff-bf48-1794fc257919 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:59.132295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:59.133554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:59.133907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:59.134104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:59.146525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:59.148126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:58:59.164895 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1852/3714] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:58:59.863557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:58:59.865646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:58:59.968797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba377df-8180-4f3b-9000-f75c592dab34 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:58:59.975140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:58:59.977812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:58:59.977812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:58:59.977812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] PATH_INFO: `/v3/users/6c557446cb39475dba1fc800d061b9e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:58:59.978348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c557446cb39475dba1fc800d061b9e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:58:59.980702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:00.335492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c557446cb39475dba1fc800d061b9e1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:00.353796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c557446cb39475dba1fc800d061b9e1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:00.354606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c557446cb39475dba1fc800d061b9e1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:00.355562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c557446cb39475dba1fc800d061b9e1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:00.373203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c557446cb39475dba1fc800d061b9e1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:00.415046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:00.472162 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1863/3715] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:58:59 2022] DELETE /identity/v3/users/6c557446cb39475dba1fc800d061b9e1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:00.798831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:00.810409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f520f-efde-4a07-bb2d-14639202835f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:00.929553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:00.930556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:00.931066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:00.931450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] PATH_INFO: `/v3/projects/740286d1464549609e6d4b3280aa50ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:00.934458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740286d1464549609e6d4b3280aa50ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:00.942151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:01.152876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740286d1464549609e6d4b3280aa50ce', 'request_id': 'req-2f6250c2-d9c8-40e6-abe3-d27c9a728573'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.160693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740286d1464549609e6d4b3280aa50ce', 'request_id': 'req-2f6250c2-d9c8-40e6-abe3-d27c9a728573'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.173519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740286d1464549609e6d4b3280aa50ce', 'request_id': 'req-2f6250c2-d9c8-40e6-abe3-d27c9a728573'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.277974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] The token cache is being invalidate because project 740286d1464549609e6d4b3280aa50ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:01.277974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.277974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.278564 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1853/3716] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:00 2022] DELETE /identity/v3/projects/740286d1464549609e6d4b3280aa50ce => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:59:01.283584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:01.285354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:01.305971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d57267-e79a-4b87-a9f4-ccd17a671dc6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:01.379875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:01.380524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:01.380805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:01.381384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] PATH_INFO: `/v3/users/6a18cb9df0834bf7a271f48f4075ca58` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:01.382564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a18cb9df0834bf7a271f48f4075ca58)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:01.384585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:01.593318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a18cb9df0834bf7a271f48f4075ca58'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.601190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a18cb9df0834bf7a271f48f4075ca58'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.601891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a18cb9df0834bf7a271f48f4075ca58'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.602510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a18cb9df0834bf7a271f48f4075ca58'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.615254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b19f914-d4f9-40b5-bd2a-c76ba9552cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a18cb9df0834bf7a271f48f4075ca58'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:01.676719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:01.712821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1864/3717] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:01 2022] DELETE /identity/v3/users/6a18cb9df0834bf7a271f48f4075ca58 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:59:02.061497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:02.065847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:02.081707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6250c2-d9c8-40e6-abe3-d27c9a728573 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:02.159825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:02.160580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:02.161031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:02.161525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] PATH_INFO: `/v3/projects/ff5ee808788043528fdeadc86f89b84d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:02.164199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5ee808788043528fdeadc86f89b84d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:02.166573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:02.354949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5ee808788043528fdeadc86f89b84d', 'request_id': 'req-951ba4a4-3042-494e-90d3-e4e4488f45ed'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:02.365576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5ee808788043528fdeadc86f89b84d', 'request_id': 'req-951ba4a4-3042-494e-90d3-e4e4488f45ed'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:02.373561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5ee808788043528fdeadc86f89b84d', 'request_id': 'req-951ba4a4-3042-494e-90d3-e4e4488f45ed'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:02.494600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] The token cache is being invalidate because project ff5ee808788043528fdeadc86f89b84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:02.494600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:02.495559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-951ba4a4-3042-494e-90d3-e4e4488f45ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:02.498102 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1854/3718] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:02 2022] DELETE /identity/v3/projects/ff5ee808788043528fdeadc86f89b84d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:02.503721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:02.504578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:02.505042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:02.556352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:02.560028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:02.642074 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1865/3719] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:02.650185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:02.650648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:02.650932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:02.677678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:02.679070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:02.698227 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1855/3720] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:02.701925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:02.713569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b442b3-8770-47e5-9e74-3845c3d6b8b0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:02.724957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:02.724957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:02.724957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:02.728582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:02.730113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:59:02.730985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:02.733861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932ef81-13da-4e5a-97fb-083a0d0e7e44 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:02.758381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:02.759937 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1866/3721] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:59:02.771911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445d15-c72d-495a-ba1e-02224bccd30a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:02.777323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:02.777949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:02.778232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:02.778511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:02.779406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:02.782052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:02.894902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:02.895320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:02.895614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:02.928190 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1856/3722] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:59:02 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:59:02.932641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:02.951616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] MFA Rules not processed for user `5689d1981ee04c7b8dbcb4e9e1afd6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:02.954663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:03.027774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ecf67-23f8-4be8-bf0a-e74fd908a25f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:03.044349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:03.045213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:03.045506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:03.045787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:03.046439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:03.050130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:03.089569 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1867/3723] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:03.152684 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1857/3724] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:59:02 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:59:03.157304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:03.173321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808cd7a-6c5d-4536-8729-5db834ab10ad None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:03.186060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:03.186711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:03.193243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:03.193634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:03.194342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:03.196070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:03.216490 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1868/3725] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:03.221365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:03.234950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a887269-02cb-4fa3-91dc-943f2f0fcb19 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:03.241231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc867-555b-4618-a2e9-4bab48d2e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:03.241984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc867-555b-4618-a2e9-4bab48d2e164 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:03.242278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc867-555b-4618-a2e9-4bab48d2e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:03.242594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc867-555b-4618-a2e9-4bab48d2e164 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:03.243463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc867-555b-4618-a2e9-4bab48d2e164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:03.245098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fc867-555b-4618-a2e9-4bab48d2e164 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:03.259165 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1858/3726] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:03.268277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:03.279651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4373dc-58e1-41e7-88f0-941a3eb66087 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:03.285597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:03.286535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:03.286915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:03.287687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] PATH_INFO: `/v3/projects/8931ef8e49e64ed482c8c01bbdb4fed6/users/6726546cf675485391ccd6a72735d3cb/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:03.306020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8931ef8e49e64ed482c8c01bbdb4fed6, user_id=6726546cf675485391ccd6a72735d3cb, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:03.309005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:03.309770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:03.413272 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1869/3727] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:03 2022] PUT /identity/v3/projects/8931ef8e49e64ed482c8c01bbdb4fed6/users/6726546cf675485391ccd6a72735d3cb/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:03.423568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:03.424030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:03.424443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:03.465613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:03.467505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:03.541182 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1859/3728] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:03.568425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:03.570321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:03.658065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf36ee-d542-4fa5-a955-7c514d7bdae5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:03.663138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c37b2-5d33-4b65-84a5-63e00e69097b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:03.665947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c37b2-5d33-4b65-84a5-63e00e69097b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:03.665947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c37b2-5d33-4b65-84a5-63e00e69097b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:03.665947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c37b2-5d33-4b65-84a5-63e00e69097b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:03.677192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c37b2-5d33-4b65-84a5-63e00e69097b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:03.679197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c37b2-5d33-4b65-84a5-63e00e69097b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:03.697342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1870/3729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:03.762346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:04.391190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:04.393147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:04.424648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f319f-5327-4ed1-b720-17d012bd86a3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:04.439703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:04.440652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:04.441086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:04.441512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] PATH_INFO: `/v3/users/05cf9d63e50746d3947cccbfba312067` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:04.446131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05cf9d63e50746d3947cccbfba312067)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:04.448369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:04.779982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05cf9d63e50746d3947cccbfba312067'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:04.802446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05cf9d63e50746d3947cccbfba312067'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:04.803575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05cf9d63e50746d3947cccbfba312067'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:04.834549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05cf9d63e50746d3947cccbfba312067'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:04.836180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05cf9d63e50746d3947cccbfba312067'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:04.975360 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1860/3730] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:04 2022] DELETE /identity/v3/users/05cf9d63e50746d3947cccbfba312067 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:04.975456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:04.975456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:04.975948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:05.004270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:05.005521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:05.079241 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1871/3731] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:05.090052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:05.091563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:05.165625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59b394-51aa-41a0-ae33-64ec603f7854 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:05.170787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:05.171742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:05.172541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:05.173004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:05.182776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:05.184199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:05.199348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1861/3732] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:05.425941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:05.978532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:05.980076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:05.993974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c1ed5-d9e7-4cfa-b09a-2bf491c31ba6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:05.999371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:06.000775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:06.001257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:06.001528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] PATH_INFO: `/v3/projects/757a9905ea7c4858b61df5331464eeb1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:06.002733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757a9905ea7c4858b61df5331464eeb1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:06.004783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:06.187714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757a9905ea7c4858b61df5331464eeb1', 'request_id': 'req-85f49d96-1c5d-49ea-9a92-858dc2e9f616'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.196928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757a9905ea7c4858b61df5331464eeb1', 'request_id': 'req-85f49d96-1c5d-49ea-9a92-858dc2e9f616'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.208356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757a9905ea7c4858b61df5331464eeb1', 'request_id': 'req-85f49d96-1c5d-49ea-9a92-858dc2e9f616'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.349256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] The token cache is being invalidate because project 757a9905ea7c4858b61df5331464eeb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:06.349885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.350611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.352185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1872/3733] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:05 2022] DELETE /identity/v3/projects/757a9905ea7c4858b61df5331464eeb1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:06.356345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:06.367692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17616808-e459-49e3-b00d-328a835fe734 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:06.441448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:06.442758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:06.443127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:06.443408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] PATH_INFO: `/v3/users/f3291f1b72424528a44a995954274965` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:06.444568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3291f1b72424528a44a995954274965)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:06.446495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:06.654235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:06.741415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3291f1b72424528a44a995954274965'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.767236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3291f1b72424528a44a995954274965'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.769438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3291f1b72424528a44a995954274965'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.795666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3291f1b72424528a44a995954274965'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.796463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22a74b5e-f720-4e48-83ec-349135eb88a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3291f1b72424528a44a995954274965'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:06.922266 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1862/3734] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:06 2022] DELETE /identity/v3/users/f3291f1b72424528a44a995954274965 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:07.465953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:07.468247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:07.493695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:07.498267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49d96-1c5d-49ea-9a92-858dc2e9f616 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:07.641289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:07.642356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:07.642857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:07.643372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] PATH_INFO: `/v3/projects/8be95061c55c4dcd9425aee76011e514` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:07.644999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be95061c55c4dcd9425aee76011e514)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:07.647176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:07.837965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be95061c55c4dcd9425aee76011e514', 'request_id': 'req-c0908030-30db-4c00-9ddb-4c1beb427efd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:07.850421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be95061c55c4dcd9425aee76011e514', 'request_id': 'req-c0908030-30db-4c00-9ddb-4c1beb427efd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:07.865474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be95061c55c4dcd9425aee76011e514', 'request_id': 'req-c0908030-30db-4c00-9ddb-4c1beb427efd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:07.974313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] The token cache is being invalidate because project 8be95061c55c4dcd9425aee76011e514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:07.974916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:07.976457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c0908030-30db-4c00-9ddb-4c1beb427efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:07.979876 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1873/3735] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:07 2022] DELETE /identity/v3/projects/8be95061c55c4dcd9425aee76011e514 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:07.986711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:07.987400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:07.987736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:08.044237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:08.045669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:08.174753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1863/3736] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:08.182437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:08.182721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:08.183400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:08.206682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:08.208066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:08.237895 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1874/3737] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:08.243777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:08.257789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4a53e-7fed-4236-8100-48d179ce1e6f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:08.279534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:08.286665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:08.292473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:08.292843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:08.295731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:59:08.297348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:08.325672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:08.360766 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1864/3738] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:59:08.365442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:08.409934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef659b-34c3-40cc-9d69-e60c4519fcf6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:08.424253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:08.424893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:08.425199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:08.427428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:08.428249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:08.430213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:08.571448 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1875/3739] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:59:08 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:59:08.575771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:08.594679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b073e30-41c9-452d-bb8d-e2d9afc28abf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:08.701698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:08.703463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:08.704537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:08.705074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:08.706042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:08.712196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:08.917144 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1865/3740] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:59:08 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:08.918377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:08.932931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63787a-fdb2-47fc-a47d-072b80c426c5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:08.948822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:08.948822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:08.948822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:08.948822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:08.949779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:08.951646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:08.970310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1876/3741] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:08.971363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:08.983300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f06e-1389-4eeb-8bae-377e4a662065 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:08.989128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae86c16-2e69-492e-b6c3-f0e02c83890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:09.000864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae86c16-2e69-492e-b6c3-f0e02c83890f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:09.001227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae86c16-2e69-492e-b6c3-f0e02c83890f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:09.001831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae86c16-2e69-492e-b6c3-f0e02c83890f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:09.003515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae86c16-2e69-492e-b6c3-f0e02c83890f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:09.009057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae86c16-2e69-492e-b6c3-f0e02c83890f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:09.035194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:09.036586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:09.049293 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1866/3742] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:59:09.052305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274742c-d13e-44ac-b145-ada01a4eb0e3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:09.073307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:09.074152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:09.074561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:09.075195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] PATH_INFO: `/v3/projects/f789cfedaac348d08b77238731887fc5/users/1636966859164d7a85237a0209eacac9/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:09.136855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f789cfedaac348d08b77238731887fc5, user_id=1636966859164d7a85237a0209eacac9, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:09.146925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:09.261647 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1877/3743] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:09 2022] PUT /identity/v3/projects/f789cfedaac348d08b77238731887fc5/users/1636966859164d7a85237a0209eacac9/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:09.272705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:09.272980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:09.273259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:09.336211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] MFA Rules not processed for user `1636966859164d7a85237a0209eacac9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:09.337775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:09.442238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1867/3744] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:09.469215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:09.475870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:09.564833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ae79-91da-4879-bab6-b09c05e06704 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:09.566416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408553f7-a0e8-44d3-a5e5-3fe622ce0a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:09.567129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408553f7-a0e8-44d3-a5e5-3fe622ce0a3a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:09.567421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408553f7-a0e8-44d3-a5e5-3fe622ce0a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:09.567694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408553f7-a0e8-44d3-a5e5-3fe622ce0a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:09.578133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408553f7-a0e8-44d3-a5e5-3fe622ce0a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:09.580783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408553f7-a0e8-44d3-a5e5-3fe622ce0a3a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:09.595971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1878/3745] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:10.504530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:12.236965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:14.002480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:14.762856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:15.949184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:15.956332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14301f19-96bf-4860-9d51-01c24a7405b9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:15.962145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:15.963177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:15.963613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:15.963900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:15.965753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:16.065183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:16.079684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:16.081473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:16.098711 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1868/3746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 10:59:18.506056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f5e2-f8af-4f96-aa51-87247df4d079 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:18.506768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f5e2-f8af-4f96-aa51-87247df4d079 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:18.507428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f5e2-f8af-4f96-aa51-87247df4d079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:18.560683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e123f5e2-f8af-4f96-aa51-87247df4d079 None None] MFA Rules not processed for user `6726546cf675485391ccd6a72735d3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:18.580319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e123f5e2-f8af-4f96-aa51-87247df4d079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:18.719739 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1879/3747] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:18.731103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:18.735204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:18.773734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:18.993538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2893-1e09-4f67-b142-49a5a6ed76a8 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:19.011400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:19.020218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:19.020509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:19.020751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:19.044955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:19.047384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:19.071697 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1869/3748] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:19.076833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:21.396775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:21.860018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:23.871061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:24.065157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:25.013283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:25.269483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:26.546558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:27.240491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:27.573416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:28.213336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:29.405432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:30.088205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:30.090308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:30.090308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:30.115090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:30.116459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:30.181211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1880/3749] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:30.231429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:31.156561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:31.310764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:32.253237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:32.385593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:33.898899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:34.666070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:35.824859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:35.864952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:36.500532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:36.968887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:37.305369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:38.544717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:38.899208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:39.199781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:39.201265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:39.255562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff5d13-0e98-44e8-9301-165f0374db31 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:39.273269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:39.276740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:39.281392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:39.281955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] PATH_INFO: `/v3/users/d9f88a4c72854cff9bba7ed2920f55b0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:39.284226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f88a4c72854cff9bba7ed2920f55b0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:39.289390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:39.688162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f88a4c72854cff9bba7ed2920f55b0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:39.700756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f88a4c72854cff9bba7ed2920f55b0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:39.701699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f88a4c72854cff9bba7ed2920f55b0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:39.722235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f88a4c72854cff9bba7ed2920f55b0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:39.723272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f88a4c72854cff9bba7ed2920f55b0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:39.867510 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1870/3750] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:39 2022] DELETE /identity/v3/users/d9f88a4c72854cff9bba7ed2920f55b0 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:40.059146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:40.245796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:40.273428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7c9d-ea44-458c-bfa7-56fb49571b33 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:40.392962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:40.393942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:40.394595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:40.412690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] PATH_INFO: `/v3/projects/437799e22df2433a83eca67987e942c6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:40.416230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437799e22df2433a83eca67987e942c6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:40.425783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:40.625646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437799e22df2433a83eca67987e942c6', 'request_id': 'req-12b31658-7847-48da-9d8b-4b4e52b1e063'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:40.637056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437799e22df2433a83eca67987e942c6', 'request_id': 'req-12b31658-7847-48da-9d8b-4b4e52b1e063'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:40.646646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437799e22df2433a83eca67987e942c6', 'request_id': 'req-12b31658-7847-48da-9d8b-4b4e52b1e063'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:40.775300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] The token cache is being invalidate because project 437799e22df2433a83eca67987e942c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:40.775736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:40.777529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:40.786521 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1881/3751] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:40 2022] DELETE /identity/v3/projects/437799e22df2433a83eca67987e942c6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:40.788326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:40.798993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:40.834246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4ff60-6dde-46ed-bb98-b7a107e24342 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:40.969405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:40.971325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:40.973123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:40.973427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] PATH_INFO: `/v3/users/fe55f7413ca34eb6af1c74a7f5e6ade3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:40.975625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe55f7413ca34eb6af1c74a7f5e6ade3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:40.977635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:41.284864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe55f7413ca34eb6af1c74a7f5e6ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:41.305004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe55f7413ca34eb6af1c74a7f5e6ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:41.309104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe55f7413ca34eb6af1c74a7f5e6ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:41.355835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe55f7413ca34eb6af1c74a7f5e6ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:41.357384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25ac0403-d810-463d-865a-af2bc89bfc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe55f7413ca34eb6af1c74a7f5e6ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:41.484051 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1871/3752] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:40 2022] DELETE /identity/v3/users/fe55f7413ca34eb6af1c74a7f5e6ade3 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:41.625442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:42.604798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:42.893186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:43.191330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:43.195680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:43.223834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b31658-7847-48da-9d8b-4b4e52b1e063 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:43.327184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:43.328064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:43.328904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:43.329513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] PATH_INFO: `/v3/projects/03ee8cf2ad5141c5b8d7c4c935a409bd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:43.332497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ee8cf2ad5141c5b8d7c4c935a409bd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:43.336192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:43.502514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ee8cf2ad5141c5b8d7c4c935a409bd', 'request_id': 'req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:43.525913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ee8cf2ad5141c5b8d7c4c935a409bd', 'request_id': 'req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:43.538600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ee8cf2ad5141c5b8d7c4c935a409bd', 'request_id': 'req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:43.656675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] The token cache is being invalidate because project 03ee8cf2ad5141c5b8d7c4c935a409bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:43.657306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:43.658254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4bf70c97-5a74-4858-bc99-6cf70b9fc97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:43.664949 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1882/3753] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:43 2022] DELETE /identity/v3/projects/03ee8cf2ad5141c5b8d7c4c935a409bd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:43.665977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:43.666469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:43.666561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:43.705542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:43.711115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:43.832832 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1872/3754] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:43.916996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:43.918949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:43.918949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:43.952437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:43.953724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:43.967041 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1883/3755] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:59:43.968087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:43.980564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900648c0-ea0f-4017-aba4-dc385dbbe5cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:43.987338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:43.988216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:43.988672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:43.989848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:43.990273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:59:43.990810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:43.992829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:44.012904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:44.015222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1873/3756] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 10:59:44.036150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a762b9-604f-4fb7-b83c-5134c5a690ac None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:44.051993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:44.053716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:44.053900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:44.054188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:44.054831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:44.057823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:44.207986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1884/3757] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:59:44 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:44.209721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:44.223939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd6f18-17ad-4b27-92f9-fd1079a4c1ee admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:44.336219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:44.337595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:44.338923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:44.339637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:44.340279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:44.343182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:44.433636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1874/3758] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:59:44 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:59:44.438978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:44.455115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe1fc-b70e-4027-a0e7-c8bc39ec0a24 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:44.471196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:44.472229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:44.473611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:44.474255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:44.475534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:44.491916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:44.521028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1885/3759] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:44.525307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:44.539983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fcfad-e4a1-4a69-aad7-a5aee8e4b817 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:44.549066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487a4f4-d9e5-4d02-8510-5896d372cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:44.551143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487a4f4-d9e5-4d02-8510-5896d372cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:44.551546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487a4f4-d9e5-4d02-8510-5896d372cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:44.553168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487a4f4-d9e5-4d02-8510-5896d372cd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:44.553446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487a4f4-d9e5-4d02-8510-5896d372cd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:44.556305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487a4f4-d9e5-4d02-8510-5896d372cd00 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:44.582298 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1875/3760] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:44.584924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:44.605097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56be7f8-c22e-4cf6-a5ff-2d3a9ff3b81d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:44.629860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:44.633263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:44.641068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:44.641068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] PATH_INFO: `/v3/projects/2a1f6f54c8d24eaa9eae09e8f30c56f1/users/3b6e2046e3bd40b3b46802dfa796260b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:44.684755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1f6f54c8d24eaa9eae09e8f30c56f1, user_id=3b6e2046e3bd40b3b46802dfa796260b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:44.693485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:44.707708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:44.820702 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1886/3761] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:44 2022] PUT /identity/v3/projects/2a1f6f54c8d24eaa9eae09e8f30c56f1/users/3b6e2046e3bd40b3b46802dfa796260b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 10:59:44.830892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:44.831241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:44.831529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:44.892767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] MFA Rules not processed for user `3b6e2046e3bd40b3b46802dfa796260b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:44.894618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:45.059520 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1876/3762] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:45.065102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:45.067306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:45.210594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36986fac-c933-4ddf-9bac-2453d6615c79 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:45.246610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:45.246610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:45.246610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:45.246610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:45.248223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:45.252174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:45.418660 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1887/3763] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:59:45 2022] POST /identity/v3/projects => generated 375 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:45.419930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:45.433662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3f99-5c27-4af8-b26e-f206571d0504 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:45.564191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:45.565416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:45.566102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:45.566521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:45.567449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:45.569555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:45.667612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1877/3764] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:59:45 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:45.670713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:45.686465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696ee66-92bf-4a73-8478-a985d1e159a3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:45.723739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:45.724854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:45.727404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:45.727893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:45.728769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:45.730692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:45.757601 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1888/3765] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:59:45.767045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:45.782023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a02e6-1690-4681-abee-6c86157d4068 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:45.800328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:45.801324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:45.801849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:45.802340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] PATH_INFO: `/v3/projects/e2d99cfecc7d499ea8a478b100e9b061/users/3320982894964d85bef7eaa13a2f72ac/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:45.855208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d99cfecc7d499ea8a478b100e9b061, user_id=3320982894964d85bef7eaa13a2f72ac, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:45.872151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:46.031347 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1878/3766] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:45 2022] PUT /identity/v3/projects/e2d99cfecc7d499ea8a478b100e9b061/users/3320982894964d85bef7eaa13a2f72ac/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:46.037303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:46.055884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b015d-6585-4839-a907-30832f5ed926 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:46.108372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:46.110741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:46.161910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:46.162711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:46.174504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:46.177042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:46.178679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:46.184539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:46.217576 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1889/3767] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 10:59:46.224148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:46.242062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8405702-62e1-4124-9cac-3aa8c7af4a2c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:46.245520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d84a1-6580-4aca-8592-732f2cefe5f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:46.254146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:46.256263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:46.257127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:46.257620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:46.259216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6ec4-fc35-4aab-bedd-09a7a1121e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:46.260094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6ec4-fc35-4aab-bedd-09a7a1121e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:46.260557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6ec4-fc35-4aab-bedd-09a7a1121e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:46.261063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6ec4-fc35-4aab-bedd-09a7a1121e16 admin admin] PATH_INFO: `/v3/projects/e2d99cfecc7d499ea8a478b100e9b061/users/3320982894964d85bef7eaa13a2f72ac/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:46.261987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:46.263713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de6ec4-fc35-4aab-bedd-09a7a1121e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d99cfecc7d499ea8a478b100e9b061, user_id=3320982894964d85bef7eaa13a2f72ac, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:46.266653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de6ec4-fc35-4aab-bedd-09a7a1121e16 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:46.306785 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1890/3768] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:46 2022] PUT /identity/v3/projects/e2d99cfecc7d499ea8a478b100e9b061/users/3320982894964d85bef7eaa13a2f72ac/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:46.308753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:46.309202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:46.309636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:46.311858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:46.318492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0b592-701a-41ec-aa55-f2d2fa0c6a06 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:46.358472 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1879/3769] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:46.377985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] MFA Rules not processed for user `3320982894964d85bef7eaa13a2f72ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:46.379760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:46.595951 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1891/3770] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:46.598284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:46.598810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:46.599323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:46.621618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] MFA Rules not processed for user `3b6e2046e3bd40b3b46802dfa796260b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:46.623446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:46.737535 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1880/3771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:46.744597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:46.746385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:46.870374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:46.917297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a53c4-e3a9-4b2b-a228-05d0c8e402d8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:46.927046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:46.928447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:46.928564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:46.928779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:46.944889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:46.946847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:46.959995 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1892/3772] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:47.242330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:49.008728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:49.352262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:50.398327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:50.428733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:50.580316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdba4c-6447-4804-8d27-b1e13d7d773c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:50.594113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:50.594782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:50.595160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:50.595441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] PATH_INFO: `/v3/users/6726546cf675485391ccd6a72735d3cb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:50.596738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6726546cf675485391ccd6a72735d3cb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:50.599061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:50.797047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6726546cf675485391ccd6a72735d3cb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:50.801884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:50.816813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6726546cf675485391ccd6a72735d3cb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:50.823798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6726546cf675485391ccd6a72735d3cb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:50.849758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6726546cf675485391ccd6a72735d3cb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:50.851322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6726546cf675485391ccd6a72735d3cb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:50.932489 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1881/3773] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:50 2022] DELETE /identity/v3/users/6726546cf675485391ccd6a72735d3cb => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:51.277815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:51.280397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:51.304573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048d2b8-0d78-45d5-9f42-a74ba0593d39 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:51.393352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:51.394103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:51.394578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:51.394848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] PATH_INFO: `/v3/users/5c02f8592a8842b8baf95d76c55a4d6e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:51.396331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c02f8592a8842b8baf95d76c55a4d6e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:51.399233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:51.405413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:51.405413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:51.439158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12232d-b26d-46b8-8dc2-8745316590c7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:51.445528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:51.446934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:51.447433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:51.447916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] PATH_INFO: `/v3/projects/8931ef8e49e64ed482c8c01bbdb4fed6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:51.450109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8931ef8e49e64ed482c8c01bbdb4fed6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:51.453279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:51.743083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c02f8592a8842b8baf95d76c55a4d6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.760338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8931ef8e49e64ed482c8c01bbdb4fed6', 'request_id': 'req-077c48e4-df0c-4cbe-8167-5e535899f60e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.768352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c02f8592a8842b8baf95d76c55a4d6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.769313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8931ef8e49e64ed482c8c01bbdb4fed6', 'request_id': 'req-077c48e4-df0c-4cbe-8167-5e535899f60e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.770186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c02f8592a8842b8baf95d76c55a4d6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.770967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c02f8592a8842b8baf95d76c55a4d6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.790877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8931ef8e49e64ed482c8c01bbdb4fed6', 'request_id': 'req-077c48e4-df0c-4cbe-8167-5e535899f60e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.797516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9b79cd47-321f-4b6a-a99c-1f948d4a5098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c02f8592a8842b8baf95d76c55a4d6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.924486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] The token cache is being invalidate because project 8931ef8e49e64ed482c8c01bbdb4fed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:51.924903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.926202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-077c48e4-df0c-4cbe-8167-5e535899f60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:51.928252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1882/3774] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:51 2022] DELETE /identity/v3/projects/8931ef8e49e64ed482c8c01bbdb4fed6 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:51.933047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:51.933524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:51.933959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:51.957294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:51.958888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:52.018579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:52.058349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1893/3775] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 10:59:51 2022] DELETE /identity/v3/users/5c02f8592a8842b8baf95d76c55a4d6e => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:52.078839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1883/3776] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:59:52.087758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.088622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.089127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.126274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:52.127979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:52.219242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1894/3777] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:52.222663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.237302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6097-f0f9-430a-9d61-337b42fca9ee None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.242579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.243260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.243552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.244256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.259230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:59:52.260045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.261295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.286928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1884/3778] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:59:52.288418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.301551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d7e30-ae5c-4eb0-a7ef-bb0c2e98f7ed None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.308045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.309158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.309576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.309954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.311472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.314108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.434472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1895/3779] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:59:52 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:52.439525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.449879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8da79-eb86-4e49-af5c-a3945202b699 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.457704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.459636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:52.552440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.554232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.554531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.554812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.555486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.557430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.561170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c04b9-7b74-462a-9f3a-7a965f49d629 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.576735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.577475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.577814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.578210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] PATH_INFO: `/v3/projects/d5e0ac401b45419795e5127ed1f667b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.579877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e0ac401b45419795e5127ed1f667b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.583814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.656297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1885/3780] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:59:52 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:52.662453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.696830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6af454-93d3-46be-9119-d10366414c2f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.715375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.719195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.720661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.721448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.726470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.729763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.735453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e0ac401b45419795e5127ed1f667b9', 'request_id': 'req-9fe56400-2601-44de-8b72-e850422a7fe9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:52.751798 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1886/3781] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:52.752526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e0ac401b45419795e5127ed1f667b9', 'request_id': 'req-9fe56400-2601-44de-8b72-e850422a7fe9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:52.753292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.756632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:52.775083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e0ac401b45419795e5127ed1f667b9', 'request_id': 'req-9fe56400-2601-44de-8b72-e850422a7fe9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:52.775188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0c8d-b205-4de5-a6c2-28445b8a915b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.860332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.860947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.861230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.861682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.862354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.864111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.875410 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1887/3782] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:52.877963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] The token cache is being invalidate because project d5e0ac401b45419795e5127ed1f667b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 10:59:52.878450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:52.879705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:52.885701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9fe56400-2601-44de-8b72-e850422a7fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 10:59:52.889276 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1896/3783] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 10:59:52 2022] DELETE /identity/v3/projects/d5e0ac401b45419795e5127ed1f667b9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:52.891528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5a5f8-f64a-4303-b6ad-54cf56e64a15 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:52.894114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889a389-11f1-4575-a674-2817bfdcd64d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.894402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889a389-11f1-4575-a674-2817bfdcd64d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.894674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889a389-11f1-4575-a674-2817bfdcd64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.898996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e5479-9e6e-4df3-9dfb-0945b7cc3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:52.900073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e5479-9e6e-4df3-9dfb-0945b7cc3d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.900361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e5479-9e6e-4df3-9dfb-0945b7cc3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.900639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e5479-9e6e-4df3-9dfb-0945b7cc3d87 admin admin] PATH_INFO: `/v3/projects/a63d14f0f3fd42a486fc2b395cb87709/users/41ebe48dba334e2fb49aafcc72aa8e79/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:52.933737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e5479-9e6e-4df3-9dfb-0945b7cc3d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63d14f0f3fd42a486fc2b395cb87709, user_id=41ebe48dba334e2fb49aafcc72aa8e79, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:52.934327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e5479-9e6e-4df3-9dfb-0945b7cc3d87 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:52.955105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8889a389-11f1-4575-a674-2817bfdcd64d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:52.956660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8889a389-11f1-4575-a674-2817bfdcd64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:52.970791 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1897/3784] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:59:52.978491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:52.978848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:52.979168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.003936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:53.005150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:53.015842 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1898/3785] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 10:59:53.020464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.032573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511a822-a01d-4971-9c57-2d31942e2758 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.037824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.038758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.039143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.039698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.040187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 10:59:53.040552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.042483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.055612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1888/3786] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:52 2022] PUT /identity/v3/projects/a63d14f0f3fd42a486fc2b395cb87709/users/41ebe48dba334e2fb49aafcc72aa8e79/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:53.061550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.061841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.062113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.066351 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1899/3787] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 10:59:53.066984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.083576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74460955-e3ad-420e-b1df-a0afbcf1a589 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.085880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:53.087380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:53.184208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:53.190555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.191459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.191913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.192340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.193133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.193531 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1889/3788] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:59:53.195657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.205017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.206886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:53.306335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dd2a2-f139-48c1-b649-af4678d146a4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.311559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.312214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.312496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.312767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.333840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.335252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.342993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1900/3789] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 10:59:53 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 10:59:53.347157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.349894 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1890/3790] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:53.444152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8771d18-d7d6-4f81-a62d-f99d37cc5c48 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.449129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.449984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.450272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.450548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.451779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.453703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.558819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.560801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1901/3791] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 10:59:53 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 10:59:53.571140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f708b9-fc02-4e48-8ff7-2860151ce762 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.589717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.590387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.590676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.590951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.592314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.595522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.615995 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1891/3792] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:53.619861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.648375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c25c-710e-4ca5-85ba-a1672c6b6a68 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.668775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ebde-ec21-4849-8409-8a6336cf5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.670681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ebde-ec21-4849-8409-8a6336cf5d94 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.670988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ebde-ec21-4849-8409-8a6336cf5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.671530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ebde-ec21-4849-8409-8a6336cf5d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.672395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5ebde-ec21-4849-8409-8a6336cf5d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.674808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5ebde-ec21-4849-8409-8a6336cf5d94 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.688521 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1902/3793] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 10:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 10:59:53.692585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:53.703827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30fcb-856e-4c56-94dc-f628b47cf5c0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:53.710037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:53.711045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.711552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.712170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] PATH_INFO: `/v3/projects/dcd5ffec2c6246fb89ba181542692585/users/f16abbf8a68344b68444ff8fc2795c67/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.731218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd5ffec2c6246fb89ba181542692585, user_id=f16abbf8a68344b68444ff8fc2795c67, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:53.734510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:53.863505 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1892/3794] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 10:59:53 2022] PUT /identity/v3/projects/dcd5ffec2c6246fb89ba181542692585/users/f16abbf8a68344b68444ff8fc2795c67/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 10:59:53.869445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b443c-13d5-40ec-abc0-ce6f142963dc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:53.870006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b443c-13d5-40ec-abc0-ce6f142963dc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:53.870511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b443c-13d5-40ec-abc0-ce6f142963dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:53.900123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6e8b443c-13d5-40ec-abc0-ce6f142963dc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 10:59:53.902820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6e8b443c-13d5-40ec-abc0-ce6f142963dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 10:59:54.041932 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1903/3795] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 10:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 10:59:54.053471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 10:59:54.168996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705972a5-2413-4831-bf00-7e57a291886d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 10:59:54.173560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b2cf-97c4-49e7-a4e4-4c1b3a943883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 10:59:54.174464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b2cf-97c4-49e7-a4e4-4c1b3a943883 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 10:59:54.174827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b2cf-97c4-49e7-a4e4-4c1b3a943883 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 10:59:54.175233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b2cf-97c4-49e7-a4e4-4c1b3a943883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 10:59:54.189637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0b2cf-97c4-49e7-a4e4-4c1b3a943883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 10:59:54.191426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0b2cf-97c4-49e7-a4e4-4c1b3a943883 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 10:59:54.205929 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1893/3796] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 10:59:54.978879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:55.161723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:55.990677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:56.323546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:57.014278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:57.978792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 10:59:59.053394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:00.059865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:06.847601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:06.848439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:06.848905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:06.891648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] MFA Rules not processed for user `f16abbf8a68344b68444ff8fc2795c67`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:06.892825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:07.057887 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1904/3797] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:07.138719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c10b1-1e7a-4965-ab34-8b2b26054606 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:07.139246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c10b1-1e7a-4965-ab34-8b2b26054606 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:07.139544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c10b1-1e7a-4965-ab34-8b2b26054606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:07.211546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c79c10b1-1e7a-4965-ab34-8b2b26054606 None None] MFA Rules not processed for user `41ebe48dba334e2fb49aafcc72aa8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:07.214958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c79c10b1-1e7a-4965-ab34-8b2b26054606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:07.263899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:07.266195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:07.362014 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1894/3798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:07.375123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:07.375123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:07.375123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:07.431957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] MFA Rules not processed for user `41ebe48dba334e2fb49aafcc72aa8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:07.431957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:07.440754 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1895/3799] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:00:07.449663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf96d-c89b-4c98-a420-b384fc1afdb9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:07.455394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:07.457555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:07.471617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:07.472243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:07.472728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:07.472854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:07.489050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851175b-5691-4138-b9d5-128c4b0ed88e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:07.490291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:07.495150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:07.497649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:07.506761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:07.507573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:07.507857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:07.508132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:07.522607 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1905/3800] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:07.524787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:07.526393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:07.543461 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1896/3801] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:10.069904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:10.073342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:10.104353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8a16-0250-45f8-b0e3-ed05ced1f6bd service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:10.117090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:10.119072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:10.119533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:10.120027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] PATH_INFO: `/v3/users/c4e1ac1b40e94dbc80548a1f45919b6f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:10.122751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e1ac1b40e94dbc80548a1f45919b6f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:10.125542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:10.374997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e1ac1b40e94dbc80548a1f45919b6f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:10.398550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e1ac1b40e94dbc80548a1f45919b6f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:10.399857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e1ac1b40e94dbc80548a1f45919b6f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:10.400506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e1ac1b40e94dbc80548a1f45919b6f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:10.426570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e1ac1b40e94dbc80548a1f45919b6f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:10.524827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:10.536826 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1906/3802] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:10 2022] DELETE /identity/v3/users/c4e1ac1b40e94dbc80548a1f45919b6f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:10.540948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17606d66-7706-45ae-aca3-f2be6b533862 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:10.645940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:10.647097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:10.647402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:10.647686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:10.649939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:10.679500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:10.750533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:10.752682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:10.778511 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1897/3803] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:11.087510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:11.090173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:11.206979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb51f88-3bb2-4fbb-aae1-079a1eef3a8a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:11.213226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:11.214301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:11.214301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:11.214670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] PATH_INFO: `/v3/projects/fb1af95268504c5bbed702fce756f5f4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:11.216105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1af95268504c5bbed702fce756f5f4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:11.218280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:11.426687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1af95268504c5bbed702fce756f5f4', 'request_id': 'req-bda7284a-82a2-494b-970d-67354d6d4237'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:11.440337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1af95268504c5bbed702fce756f5f4', 'request_id': 'req-bda7284a-82a2-494b-970d-67354d6d4237'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:11.454507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1af95268504c5bbed702fce756f5f4', 'request_id': 'req-bda7284a-82a2-494b-970d-67354d6d4237'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:11.556684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:11.565476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] The token cache is being invalidate because project fb1af95268504c5bbed702fce756f5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:11.565793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:11.575653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:11.577881 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1907/3804] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:11 2022] DELETE /identity/v3/projects/fb1af95268504c5bbed702fce756f5f4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:11.582059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:11.598248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e34a5f-6f97-4c4f-904a-a4b4a93c291a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:11.712517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:11.713939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:11.714372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:11.714803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] PATH_INFO: `/v3/users/d5d302ff09154360a47801a0a064c578` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:11.716415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d302ff09154360a47801a0a064c578)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:11.718712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:12.011527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d302ff09154360a47801a0a064c578'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:12.034793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d302ff09154360a47801a0a064c578'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:12.036468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d302ff09154360a47801a0a064c578'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:12.061832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d302ff09154360a47801a0a064c578'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:12.062581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d302ff09154360a47801a0a064c578'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:12.204167 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1898/3805] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:11 2022] DELETE /identity/v3/users/d5d302ff09154360a47801a0a064c578 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:12.395888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:12.397379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:12.551391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7284a-82a2-494b-970d-67354d6d4237 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:12.687629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:12.689979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:12.697974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:12.698605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:12.698887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:12.699218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:12.702315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:12.724992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:12.726730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103534e6-86dd-4362-b4e5-b5e081c0456c service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:12.755657 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1908/3806] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:12.891168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:12.972736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353035d3-a02a-434c-a5e7-b72c95d4cea7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:12.980198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:12.982164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:12.982594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:12.983119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] PATH_INFO: `/v3/projects/c749505ca3fa4d9fad77a9ddf33aac43` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:12.984517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c749505ca3fa4d9fad77a9ddf33aac43)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:12.987294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:13.149198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c749505ca3fa4d9fad77a9ddf33aac43', 'request_id': 'req-59a77117-eb59-432d-b4f8-265555418ca0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:13.167861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c749505ca3fa4d9fad77a9ddf33aac43', 'request_id': 'req-59a77117-eb59-432d-b4f8-265555418ca0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:13.198078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c749505ca3fa4d9fad77a9ddf33aac43', 'request_id': 'req-59a77117-eb59-432d-b4f8-265555418ca0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:13.330151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] The token cache is being invalidate because project c749505ca3fa4d9fad77a9ddf33aac43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:13.330450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:13.331226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59a77117-eb59-432d-b4f8-265555418ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:13.332756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1899/3807] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:12 2022] DELETE /identity/v3/projects/c749505ca3fa4d9fad77a9ddf33aac43 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:13.341507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:13.342332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:13.342792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:13.398208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:13.399484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:13.517020 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1909/3808] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:13.527286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:13.527839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:13.528825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:13.585909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:13.595143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:13.627873 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1900/3809] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:13.633762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:13.657588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56059215-af68-4e31-9367-f2a52a1c3148 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:13.677030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:13.678445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:13.679503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:13.680069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:13.680960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:00:13.681442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:13.683299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:13.703565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1910/3810] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:00:13.780607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:13.796818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac56a-661a-4330-8b6f-8910f97f83a2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:13.808543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:13.816331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:13.816331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:13.816331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:13.817291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:13.820575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:13.964413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1901/3811] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:13 2022] POST /identity/v3/projects => generated 359 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:13.965814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:13.993305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce10bf-f68b-4786-b73c-cdd4938b7d97 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:14.191099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5ed9-5acd-4e40-8fb5-2b0c42c7a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:14.191976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5ed9-5acd-4e40-8fb5-2b0c42c7a899 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.192363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5ed9-5acd-4e40-8fb5-2b0c42c7a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.194602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5ed9-5acd-4e40-8fb5-2b0c42c7a899 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.195425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5ed9-5acd-4e40-8fb5-2b0c42c7a899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:14.206433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5ed9-5acd-4e40-8fb5-2b0c42c7a899 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:14.391994 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1911/3812] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:13 2022] POST /identity/v3/users => generated 280 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:14.396991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:14.417325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01a6bf-d58b-4bec-8e8a-fca5288d806b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:14.425834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c0b53-4e58-41e9-8d08-80c36243d658 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.426282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c0b53-4e58-41e9-8d08-80c36243d658 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.426406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c0b53-4e58-41e9-8d08-80c36243d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.453692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:14.453692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.453692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.455825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.456589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:14.458240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:14.492720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9c2c0b53-4e58-41e9-8d08-80c36243d658 None None] MFA Rules not processed for user `f16abbf8a68344b68444ff8fc2795c67`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:14.495162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c2c0b53-4e58-41e9-8d08-80c36243d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:14.508282 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1902/3813] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:14.511568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:14.539348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71c9d4-fa4d-457b-a3e7-21b22b316a83 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:14.554039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:14.554677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.560199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.560199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.562715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:14.569934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:14.621730 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1903/3814] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:14.625889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:14.642559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889628c1-472b-482c-8724-675a72b5e3d5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:14.651119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b051a44-507e-4455-87f5-bbb97d9d2700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:14.651119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b051a44-507e-4455-87f5-bbb97d9d2700 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.651119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b051a44-507e-4455-87f5-bbb97d9d2700 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.651119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b051a44-507e-4455-87f5-bbb97d9d2700 admin admin] PATH_INFO: `/v3/projects/02aa4e51376949c9a2a1694be9954537/users/64abfe7aa30641788178b1d25eda569c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.677518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b051a44-507e-4455-87f5-bbb97d9d2700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02aa4e51376949c9a2a1694be9954537, user_id=64abfe7aa30641788178b1d25eda569c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:14.682916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b051a44-507e-4455-87f5-bbb97d9d2700 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:14.684725 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1912/3815] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:00:14.763555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae35c1-ef0b-45de-8d04-b9abe1c4f0a8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.763843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae35c1-ef0b-45de-8d04-b9abe1c4f0a8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.764121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae35c1-ef0b-45de-8d04-b9abe1c4f0a8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.765768 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1913/3816] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 11:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:00:14.774844 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1904/3817] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:14 2022] PUT /identity/v3/projects/02aa4e51376949c9a2a1694be9954537/users/64abfe7aa30641788178b1d25eda569c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:14.785750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.786073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.786354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.792416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:14.792912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:14.792991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:14.810909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:14.848383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] MFA Rules not processed for user `64abfe7aa30641788178b1d25eda569c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:14.849795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:14.863708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:14.865760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:14.951718 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1914/3818] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:14.955411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:15.035233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1905/3819] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:00:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:00:15.048844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b7af6-5484-4943-90b2-21866dae7edc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:15.056312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:15.057755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:15.058091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:15.058373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:15.059034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:15.061063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:15.066532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:15.068870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:15.202733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a031aa-6604-49ae-b1d9-49204e1d8573 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:15.207986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:15.208927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:15.209334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:15.210890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:15.235820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:15.237216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:15.258088 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1906/3820] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:15.259663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:15.261121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:15.280415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18ad66-3a84-4f16-8a33-0100a0657a62 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:15.290464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:15.291880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:15.292484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:15.292867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] PATH_INFO: `/v3/users/5689d1981ee04c7b8dbcb4e9e1afd6cd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:15.294971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5689d1981ee04c7b8dbcb4e9e1afd6cd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:15.297103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:15.347166 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1915/3821] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:14 2022] POST /identity/v3/projects => generated 361 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:15.349636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:15.501343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5689d1981ee04c7b8dbcb4e9e1afd6cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:15.505979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d18df2-2868-415c-a85d-d97d13d68d27 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:15.520782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5689d1981ee04c7b8dbcb4e9e1afd6cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:15.522099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:15.524420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5689d1981ee04c7b8dbcb4e9e1afd6cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:15.524600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:15.524905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:15.525193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:15.525853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:15.527885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:15.560957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5689d1981ee04c7b8dbcb4e9e1afd6cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:15.561742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5689d1981ee04c7b8dbcb4e9e1afd6cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:15.679674 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1907/3822] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:15 2022] DELETE /identity/v3/users/5689d1981ee04c7b8dbcb4e9e1afd6cd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:15.723653 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1916/3823] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:15 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:00:15.725420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:15.727912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:15.738289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:15.841120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:15.844250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa19a7-7c49-4e70-a77a-9da598334110 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:15.867828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:15.870290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:15.871507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:15.873534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:15.874977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:15.895637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:15.916029 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1908/3824] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:00:15.920862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:15.937931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f524d-d966-402f-bc54-03961f010f13 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:15.943617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:15.944482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:15.944918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:15.946220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] PATH_INFO: `/v3/projects/4b8a4afad07a4e67a63d3b80190ca873/users/0c707d59f1f64bab929d8527d9a1a297/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:15.971793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8a4afad07a4e67a63d3b80190ca873, user_id=0c707d59f1f64bab929d8527d9a1a297, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:15.975458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:16.123621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1917/3825] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:15 2022] PUT /identity/v3/projects/4b8a4afad07a4e67a63d3b80190ca873/users/0c707d59f1f64bab929d8527d9a1a297/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:16.129038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:16.156729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85509ede-9b38-43bf-b624-0335b6103dca admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:16.281476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf2ee-f17a-4f56-b96b-5e67f7a7841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:16.282301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf2ee-f17a-4f56-b96b-5e67f7a7841d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:16.282536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf2ee-f17a-4f56-b96b-5e67f7a7841d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:16.282682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf2ee-f17a-4f56-b96b-5e67f7a7841d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:16.284122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf2ee-f17a-4f56-b96b-5e67f7a7841d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:16.285848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf2ee-f17a-4f56-b96b-5e67f7a7841d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:16.324613 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1909/3826] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:16.326872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:16.343234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf010c8-a99a-4f40-854a-a517d8605d5f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:16.353641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:16.354927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:16.354927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:16.355390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] PATH_INFO: `/v3/projects/4b8a4afad07a4e67a63d3b80190ca873/users/0c707d59f1f64bab929d8527d9a1a297/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:16.358236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8a4afad07a4e67a63d3b80190ca873, user_id=0c707d59f1f64bab929d8527d9a1a297, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:16.361545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:16.393831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:16.394137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:16.394427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:16.410661 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1918/3827] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:16 2022] PUT /identity/v3/projects/4b8a4afad07a4e67a63d3b80190ca873/users/0c707d59f1f64bab929d8527d9a1a297/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:16.458574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] MFA Rules not processed for user `0c707d59f1f64bab929d8527d9a1a297`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:16.460460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:16.617553 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1910/3828] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:16.808124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:16.810755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:16.973707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280e212-c786-4d89-aab2-ab0fb7b3d7b3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:16.979633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:16.980999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:16.982374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:16.983282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] PATH_INFO: `/v3/projects/0df100d31d294ce6858d12ea23adb2b4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:16.985789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df100d31d294ce6858d12ea23adb2b4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:16.989047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:17.130782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df100d31d294ce6858d12ea23adb2b4', 'request_id': 'req-0e6a3bf1-840d-4319-866f-b097e49d5eb5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:17.142366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:17.143832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:17.145727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df100d31d294ce6858d12ea23adb2b4', 'request_id': 'req-0e6a3bf1-840d-4319-866f-b097e49d5eb5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:17.170832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df100d31d294ce6858d12ea23adb2b4', 'request_id': 'req-0e6a3bf1-840d-4319-866f-b097e49d5eb5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:17.271645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] The token cache is being invalidate because project 0df100d31d294ce6858d12ea23adb2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:17.271808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120e972-40d1-49e5-8add-2488cad0d0d4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:17.272313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:17.279517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e6a3bf1-840d-4319-866f-b097e49d5eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:17.281865 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1919/3829] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:16 2022] DELETE /identity/v3/projects/0df100d31d294ce6858d12ea23adb2b4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:17.287391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e33aef-13cc-4cd5-be4d-cadcbfc3a67b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:17.287952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e33aef-13cc-4cd5-be4d-cadcbfc3a67b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:17.288418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e33aef-13cc-4cd5-be4d-cadcbfc3a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:17.342774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e1e33aef-13cc-4cd5-be4d-cadcbfc3a67b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:17.347374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e1e33aef-13cc-4cd5-be4d-cadcbfc3a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:17.512227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:17.532524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:17.533157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:17.533446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:17.533727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:17.539600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:17.556783 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1920/3830] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:00:17.567530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:17.568554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:17.568957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:17.611252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:17.614716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:17.626025 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1921/3831] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:17.626828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:17.636751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812569ad-2951-4dd3-bbb6-2b9c11e447f1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:17.642304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:17.650094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:17.650094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:17.650094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:17.650094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:00:17.650094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:17.650094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:17.660453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1922/3832] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:00:17.665012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:17.676465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bbd73-fff9-4db8-9a99-3dfe47414424 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:17.682416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:17.684318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:17.684318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:17.684318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:17.684645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:17.685696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:17.686606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:17.687855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:17.704121 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1911/3833] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:17.826277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:17.827266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1923/3834] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:17 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:17.848456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9cd7d-7b04-4bdf-a4ff-f6d95856a5bb service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:17.968446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:17.971894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:17.971894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:17.971894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:17.974320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:17.977923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:18.095350 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1912/3835] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:17 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:00:18.097170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:18.113550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439b03b-eddc-4a68-837e-279ebea64092 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:18.129586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:18.130641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:18.131167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:18.131926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:18.133406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:18.136109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:18.166158 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1924/3836] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:18.166897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:18.186206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fd2c5-26c9-42d8-bff3-acc5b81629d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:18.194409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe50a13-79f2-4f5f-b909-dccc57d0d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:18.196000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50a13-79f2-4f5f-b909-dccc57d0d59a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:18.196564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50a13-79f2-4f5f-b909-dccc57d0d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:18.203385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50a13-79f2-4f5f-b909-dccc57d0d59a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:18.206531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe50a13-79f2-4f5f-b909-dccc57d0d59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:18.209231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe50a13-79f2-4f5f-b909-dccc57d0d59a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:18.224123 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1913/3837] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:18.225415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:18.258650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e54d88-fa2e-4680-8f00-922814337efe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:18.271852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:18.274587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:18.274587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:18.274587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] PATH_INFO: `/v3/projects/91b83e289c414e499c91fc7f711774b7/users/99ebe881ffd44893879bb9e7ab63c9fd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:18.293723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b83e289c414e499c91fc7f711774b7, user_id=99ebe881ffd44893879bb9e7ab63c9fd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:18.297441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:18.430629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:18.434537 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1925/3838] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:18 2022] PUT /identity/v3/projects/91b83e289c414e499c91fc7f711774b7/users/99ebe881ffd44893879bb9e7ab63c9fd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:18.439621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576416d9-741b-4a8a-9502-82c5749ec7c9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:18.439916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576416d9-741b-4a8a-9502-82c5749ec7c9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:18.440199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576416d9-741b-4a8a-9502-82c5749ec7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:18.504122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-576416d9-741b-4a8a-9502-82c5749ec7c9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:18.509915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-576416d9-741b-4a8a-9502-82c5749ec7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:18.708747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1914/3839] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:18.724689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:18.726947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:18.841912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:18.842205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:18.842483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:18.868194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19814ddb-fb41-4698-a68d-0d8094fb7d77 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:18.877500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:18.878209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:18.879197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:18.883325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:18.898392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:18.899686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:18.917522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:18.919319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:18.944993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1926/3840] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:18.950772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:18.956132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:18.984712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68de8-8d34-4160-b9af-04c8970e54bc service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:19.000557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:19.000557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:19.015152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:19.016320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] PATH_INFO: `/v3/users/64abfe7aa30641788178b1d25eda569c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:19.034792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:19.036406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64abfe7aa30641788178b1d25eda569c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:19.042970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:19.085834 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1915/3841] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:00:19.280096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:19.281691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:19.334624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64abfe7aa30641788178b1d25eda569c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:19.343566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64abfe7aa30641788178b1d25eda569c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:19.344286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64abfe7aa30641788178b1d25eda569c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:19.344921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64abfe7aa30641788178b1d25eda569c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:19.360098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64abfe7aa30641788178b1d25eda569c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:19.387936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90171116-fd88-407a-bfc7-a3f0d9de07bb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:19.394646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:19.395302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:19.395601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:19.396057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:19.397943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:19.417089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:19.420118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a199e-d965-4661-9c9f-07e929fb1f5b service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:19.431931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1916/3842] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:00:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:00:19.435871 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1927/3843] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:18 2022] DELETE /identity/v3/users/64abfe7aa30641788178b1d25eda569c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:19.457767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:19.457767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:19.457767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:19.506524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:19.508069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:19.631931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1917/3844] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:19.656303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:19.657773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:20.125430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b0adb-4ed7-49a9-9c0d-06bda68a9d89 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:20.142720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:20.143787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:20.144276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:20.144750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:20.161170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:20.165968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:20.182133 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1928/3845] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:20.339426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:20.414446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:20.417211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:20.463657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7e769-1199-4e96-9791-f5449da507b1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:20.475770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:20.476871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:20.478080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:20.478936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:20.484623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:20.712434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:20.714027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:20.746228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1918/3846] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:21.110615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:21.761443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:21.763812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:21.807741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9211f9a-35da-448a-abf6-89d2fbaf1b52 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:21.824075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:21.825729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:21.826223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:21.827327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] PATH_INFO: `/v3/projects/02aa4e51376949c9a2a1694be9954537` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:21.833856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02aa4e51376949c9a2a1694be9954537)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:21.833856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:21.997400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:22.019996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:22.030141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02aa4e51376949c9a2a1694be9954537', 'request_id': 'req-96c29f18-5b20-4313-a9e2-e290469f6e33'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.037112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02aa4e51376949c9a2a1694be9954537', 'request_id': 'req-96c29f18-5b20-4313-a9e2-e290469f6e33'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.049949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02aa4e51376949c9a2a1694be9954537', 'request_id': 'req-96c29f18-5b20-4313-a9e2-e290469f6e33'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.194833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] The token cache is being invalidate because project 02aa4e51376949c9a2a1694be9954537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:22.196001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.197397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.200281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1929/3847] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:21 2022] DELETE /identity/v3/projects/02aa4e51376949c9a2a1694be9954537 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:22.203964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:22.218961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c50a-796b-4812-9511-6ac780a795b7 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:22.344599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:22.345170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:22.345452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:22.345936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] PATH_INFO: `/v3/users/0c707d59f1f64bab929d8527d9a1a297` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:22.350121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c707d59f1f64bab929d8527d9a1a297)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:22.353785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:22.637836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c707d59f1f64bab929d8527d9a1a297'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.647912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c707d59f1f64bab929d8527d9a1a297'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.649891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c707d59f1f64bab929d8527d9a1a297'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.676474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c707d59f1f64bab929d8527d9a1a297'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.678415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c707d59f1f64bab929d8527d9a1a297'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:22.810923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1919/3848] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:22 2022] DELETE /identity/v3/users/0c707d59f1f64bab929d8527d9a1a297 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:00:23.843496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:23.843496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:23.883463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c29f18-5b20-4313-a9e2-e290469f6e33 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:24.024445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:24.025192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:24.025547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:24.025900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] PATH_INFO: `/v3/projects/4b8a4afad07a4e67a63d3b80190ca873` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:24.027227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8a4afad07a4e67a63d3b80190ca873)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:24.029794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:24.229253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8a4afad07a4e67a63d3b80190ca873', 'request_id': 'req-260a8f87-6d11-4470-8928-65309a7fe1b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:24.241659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8a4afad07a4e67a63d3b80190ca873', 'request_id': 'req-260a8f87-6d11-4470-8928-65309a7fe1b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:24.264698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8a4afad07a4e67a63d3b80190ca873', 'request_id': 'req-260a8f87-6d11-4470-8928-65309a7fe1b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:24.331906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:24.333987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:24.348433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:24.479389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] The token cache is being invalidate because project 4b8a4afad07a4e67a63d3b80190ca873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:24.479389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:24.479610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207be29e-e15f-418d-a00b-572d35ce2470 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:24.479704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-260a8f87-6d11-4470-8928-65309a7fe1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:24.484421 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1930/3849] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:23 2022] DELETE /identity/v3/projects/4b8a4afad07a4e67a63d3b80190ca873 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:24.486061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1ed0-2332-48e8-a101-c906ac44f1d1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:24.486611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1ed0-2332-48e8-a101-c906ac44f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:24.487215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee1ed0-2332-48e8-a101-c906ac44f1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:24.532217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-66ee1ed0-2332-48e8-a101-c906ac44f1d1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:24.533815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-66ee1ed0-2332-48e8-a101-c906ac44f1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:24.617968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:24.619102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:24.621269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:24.622842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:24.629000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:24.709593 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1931/3850] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:24.724292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:24.724621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:24.724857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:24.754473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:24.787586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:24.791201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:24.810363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:24.813581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:24.814375 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1932/3851] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:24.820047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:24.837830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35498fe-0366-4036-9364-77bc02c4ebe7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:24.842863 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1920/3852] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:24.846892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:24.847778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:24.848123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:24.848463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:24.849802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:00:24.851060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:24.852311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:24.869204 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1933/3853] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:00:24.874122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:24.899546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cec0d-c22b-4b60-ac06-d2da975166ee service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:24.913527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:24.913527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:24.913527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:24.913527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:24.914149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:24.916349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:25.101197 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1921/3854] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:24 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:25.101833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:25.116637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc3c2-2f2b-4eae-9eee-bd4c301987e7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:25.400444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:25.402453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:25.404609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:25.405048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:25.407733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:25.412140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:25.525632 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1934/3855] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:25 2022] POST /identity/v3/users => generated 291 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:25.530547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:25.544555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb9421-adc9-4ac9-9679-47d0f5d90232 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:25.572222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:25.572222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:25.572222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:25.572222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:25.572623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:25.575766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:25.610903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1922/3856] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:25.612237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:25.630478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db43ce-40d5-460c-8e30-0872c27c85ee admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:25.680745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044726-07b6-4ac9-9e5c-7ea7458affaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:25.680745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044726-07b6-4ac9-9e5c-7ea7458affaf admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:25.680745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044726-07b6-4ac9-9e5c-7ea7458affaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:25.680745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044726-07b6-4ac9-9e5c-7ea7458affaf admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:25.681346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044726-07b6-4ac9-9e5c-7ea7458affaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:25.681346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044726-07b6-4ac9-9e5c-7ea7458affaf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:25.699049 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1935/3857] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:25.703830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:25.726930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e61dc-756f-405c-8ffc-b69ff9634a1a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:25.735569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:25.736109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:25.736998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:25.736998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] PATH_INFO: `/v3/projects/0a7af966e1b740a59920ff9370b5dade/users/9e84745e5df647d1921e8d1ffc08711c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:25.759693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7af966e1b740a59920ff9370b5dade, user_id=9e84745e5df647d1921e8d1ffc08711c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:25.762597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:26.127172 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1923/3858] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:25 2022] PUT /identity/v3/projects/0a7af966e1b740a59920ff9370b5dade/users/9e84745e5df647d1921e8d1ffc08711c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:26.128778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:26.130921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:26.135940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:26.195222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:26.198332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:26.307788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1936/3859] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:26.312585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:26.325467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:26.491129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f2556-103e-4171-8180-9ab61ed94c83 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:26.518557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:26.519891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:26.523221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:26.523523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:26.526110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:26.536547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:26.722826 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1924/3860] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:26 2022] POST /identity/v3/projects => generated 381 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:26.727258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:26.757163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52ef0d-06c3-46d1-8a23-9322fa60c511 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:26.984015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:26.990401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:26.991095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:26.991442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:26.991725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:26.992369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:27.004665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:27.127129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1937/3861] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:26 2022] POST /identity/v3/users => generated 297 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:27.130634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:27.184750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b20fb-b286-4d5e-a96d-610090d069bd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:27.200684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:27.201233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:27.201523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:27.201926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:27.202857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:27.204834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:27.250235 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1925/3862] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:27.250333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:27.288085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adb5b9-ee67-4b51-a009-1dae077af0d1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:27.317518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:27.322189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:27.322189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:27.322189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] PATH_INFO: `/v3/projects/9030d09b2ed947afbde268e235e93c54/users/b64351219f3948ce918889871fde5560/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:27.372336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9030d09b2ed947afbde268e235e93c54, user_id=b64351219f3948ce918889871fde5560, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:27.374661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:27.501185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1938/3863] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:27 2022] PUT /identity/v3/projects/9030d09b2ed947afbde268e235e93c54/users/b64351219f3948ce918889871fde5560/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:27.502282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:27.518926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea39e4-feb1-414d-a66f-0a3142b7f23c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:27.667243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534032b-d507-44a9-86e3-96db999706b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:27.667996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534032b-d507-44a9-86e3-96db999706b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:27.669065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534032b-d507-44a9-86e3-96db999706b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:27.669513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534032b-d507-44a9-86e3-96db999706b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:27.670322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534032b-d507-44a9-86e3-96db999706b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:27.674502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534032b-d507-44a9-86e3-96db999706b6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:27.702376 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1926/3864] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:27.707636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:27.723654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d7490-7372-446b-8367-db7823e3f923 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:27.748249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ffb14-f553-4a87-b01d-bc593276ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:27.749252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ffb14-f553-4a87-b01d-bc593276ab36 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:27.749682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ffb14-f553-4a87-b01d-bc593276ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:27.750100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ffb14-f553-4a87-b01d-bc593276ab36 admin admin] PATH_INFO: `/v3/projects/9030d09b2ed947afbde268e235e93c54/users/b64351219f3948ce918889871fde5560/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:27.759816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ffb14-f553-4a87-b01d-bc593276ab36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9030d09b2ed947afbde268e235e93c54, user_id=b64351219f3948ce918889871fde5560, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:27.762993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ffb14-f553-4a87-b01d-bc593276ab36 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:27.793041 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1939/3865] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:27 2022] PUT /identity/v3/projects/9030d09b2ed947afbde268e235e93c54/users/b64351219f3948ce918889871fde5560/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:27.814249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:27.814813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:27.815232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:27.949931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] MFA Rules not processed for user `b64351219f3948ce918889871fde5560`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:27.953751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:28.071889 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1927/3866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:28.083226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:28.087461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:28.087969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:28.130742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:28.133110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:28.281336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1940/3867] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:28.289603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:28.291512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:28.297153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:28.442297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efa6a9-3045-4c2c-a91e-94cef07fe219 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:28.455449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef3f4-bc6f-44af-835e-515c4fecc7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:28.456174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef3f4-bc6f-44af-835e-515c4fecc7c8 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:28.456612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef3f4-bc6f-44af-835e-515c4fecc7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:28.456921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef3f4-bc6f-44af-835e-515c4fecc7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:28.472599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef3f4-bc6f-44af-835e-515c4fecc7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:28.474600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ef3f4-bc6f-44af-835e-515c4fecc7c8 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:28.509427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1928/3868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:29.485625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:29.489325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:29.683056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03de8-f5c3-4451-8775-0e73aa8f5934 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:29.710324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:29.711170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:29.711555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:29.711952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:29.716890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:29.735423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:29.737629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:29.773621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1941/3869] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:36.258024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:36.258895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:36.259380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:36.328194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] MFA Rules not processed for user `99ebe881ffd44893879bb9e7ab63c9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:36.329803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:36.434130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:36.435126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:36.441968 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1929/3870] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:36.477113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:36.483454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:36.555948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:36.585974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80e1d2-faef-4308-9f9e-baeebef9a799 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:36.597838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:36.599214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:36.602003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:36.602003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:36.603598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:36.632750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:36.634551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:36.637482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83dfaa-7484-4880-bd52-de8b434bd1be None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:36.643455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b57d-6962-4625-9d5e-2edd4711534e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:36.646405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b57d-6962-4625-9d5e-2edd4711534e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:36.646811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b57d-6962-4625-9d5e-2edd4711534e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:36.647240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b57d-6962-4625-9d5e-2edd4711534e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:36.658648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1942/3871] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:36.662890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b57d-6962-4625-9d5e-2edd4711534e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:36.664564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b57d-6962-4625-9d5e-2edd4711534e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:36.677274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1930/3872] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:43.369138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:43.387769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59321d-0400-4504-a144-aecd7f2986ef service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:43.394984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:43.395884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:43.399046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:43.399531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:43.402629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:43.422454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:43.424409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ac55f-7881-4f8c-b0c5-0b9fc06bbe56 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:43.439196 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1943/3873] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:46.222573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:46.223416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:46.224510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:46.298681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] MFA Rules not processed for user `99ebe881ffd44893879bb9e7ab63c9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:46.312222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:46.340853 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1931/3874] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:47.160016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:47.160840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:47.161261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:47.283480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:47.287664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:47.471205 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1944/3875] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:47.488694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:47.490774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:47.524762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:47.683749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754eecf7-376f-4cda-84cb-fda3e16051cc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:47.689454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:47.690381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:47.690822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:47.691279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:47.717440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:47.719593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:47.748951 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1932/3876] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:00:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:00:50.577826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:50.579930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:50.710217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:50.737994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ddb7-cf02-4f31-9b82-74403ca86e84 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:50.750226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b29f-2ca5-4133-8c4f-6407c4c93bc8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:50.756440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:50.757690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:50.758404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:50.758851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] PATH_INFO: `/v3/users/41ebe48dba334e2fb49aafcc72aa8e79` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:50.760426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ebe48dba334e2fb49aafcc72aa8e79)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:50.764989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:50.765493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:50.766128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:50.766412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:50.766685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:50.785535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:50.820040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:50.827335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:50.859431 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1933/3877] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:51.111713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ebe48dba334e2fb49aafcc72aa8e79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:51.122940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:51.128258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ebe48dba334e2fb49aafcc72aa8e79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:51.129030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ebe48dba334e2fb49aafcc72aa8e79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:51.129997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ebe48dba334e2fb49aafcc72aa8e79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:51.161906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ebe48dba334e2fb49aafcc72aa8e79'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:51.184028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:51.202295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f18e-6924-46a4-9dda-01355a01f08e service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:51.208944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:51.210266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:51.210698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:51.211053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:51.213448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:51.231433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:51.233763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634831b-6658-4cb8-bffb-146436833fb4 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:51.258168 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1934/3878] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:00:51.294380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1945/3879] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:50 2022] DELETE /identity/v3/users/41ebe48dba334e2fb49aafcc72aa8e79 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:51.640546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9ce8-1b31-4c07-9a80-52ac8bcc8e17 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:51.645000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9ce8-1b31-4c07-9a80-52ac8bcc8e17 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:51.645000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9ce8-1b31-4c07-9a80-52ac8bcc8e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:51.671577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c0ef9ce8-1b31-4c07-9a80-52ac8bcc8e17 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:51.673758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c0ef9ce8-1b31-4c07-9a80-52ac8bcc8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:51.872729 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1935/3880] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:52.181444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:52.181444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:52.283840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e43f9-af27-43c7-9d95-a20d5bfa6e48 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:52.294829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:52.295770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:52.296340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:52.296930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] PATH_INFO: `/v3/projects/a63d14f0f3fd42a486fc2b395cb87709` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:52.298746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63d14f0f3fd42a486fc2b395cb87709)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:52.301722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:52.467712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63d14f0f3fd42a486fc2b395cb87709', 'request_id': 'req-dfe73030-a001-48c4-83f7-af023a63f054'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:52.497801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63d14f0f3fd42a486fc2b395cb87709', 'request_id': 'req-dfe73030-a001-48c4-83f7-af023a63f054'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:52.522529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63d14f0f3fd42a486fc2b395cb87709', 'request_id': 'req-dfe73030-a001-48c4-83f7-af023a63f054'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:52.624944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] The token cache is being invalidate because project a63d14f0f3fd42a486fc2b395cb87709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:52.625300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:52.626403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfe73030-a001-48c4-83f7-af023a63f054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:52.635446 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1946/3881] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:52 2022] DELETE /identity/v3/projects/a63d14f0f3fd42a486fc2b395cb87709 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:52.635980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:52.636459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:52.636941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:52.665773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:52.668277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:52.782887 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1936/3882] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:52.790816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:52.790816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:52.791108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:52.815690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:52.817048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:52.826680 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1947/3883] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:52.830887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:52.842138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6cdcd-241e-4e3a-9bdf-ad8c1d0b76b2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:52.849294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:52.850198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:52.850684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:52.851176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:52.852064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:00:52.852525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:52.854395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:52.862891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:52.872818 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1937/3884] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:00:52.874627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:52.885024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df546-194f-4d1e-92a1-80ae81c64382 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:52.891623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:52.896314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:52.896314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:52.896314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:52.896314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:52.896314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:53.002336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1948/3885] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:52 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:53.002957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:53.017334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2daa7-3d09-421c-821f-b0c4fc350fe8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:53.206890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:53.207811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:53.208250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:53.208699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:53.209564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:53.211813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:53.316775 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1938/3886] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:53 2022] POST /identity/v3/users => generated 291 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:53.319449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:53.356203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22562b-3a8c-40f8-8bd4-8e70df1e6deb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:53.420164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:53.421230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:53.422048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:53.422480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:53.423975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:53.426227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:53.447993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1949/3887] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:53.452531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:53.469627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9b84-20fb-49c6-ad35-b27d0839e230 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:53.480025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36371a-49ed-4818-bbd8-dbbfed773773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:53.481037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36371a-49ed-4818-bbd8-dbbfed773773 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:53.481564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36371a-49ed-4818-bbd8-dbbfed773773 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:53.481931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36371a-49ed-4818-bbd8-dbbfed773773 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:53.484691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36371a-49ed-4818-bbd8-dbbfed773773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:53.490779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36371a-49ed-4818-bbd8-dbbfed773773 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:53.501675 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1939/3888] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:53.505838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:53.531909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075611e-2012-4577-b2f1-34d89807097e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:53.553168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae81b0-3d3c-47d6-9c2b-0245115c153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:53.553168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae81b0-3d3c-47d6-9c2b-0245115c153a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:53.553168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae81b0-3d3c-47d6-9c2b-0245115c153a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:53.553168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae81b0-3d3c-47d6-9c2b-0245115c153a admin admin] PATH_INFO: `/v3/projects/b95359a2b44943ffb79fc08740136038/users/8f3b667643cc4aa7ab16e7a3957ba302/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:53.584776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae81b0-3d3c-47d6-9c2b-0245115c153a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95359a2b44943ffb79fc08740136038, user_id=8f3b667643cc4aa7ab16e7a3957ba302, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:53.590874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae81b0-3d3c-47d6-9c2b-0245115c153a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:53.598858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:53.647800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:53.648447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:53.648919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:53.689088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:53.690416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:53.712647 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1950/3889] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:53 2022] PUT /identity/v3/projects/b95359a2b44943ffb79fc08740136038/users/8f3b667643cc4aa7ab16e7a3957ba302/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:53.720865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:53.721154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:53.721436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:53.782406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] MFA Rules not processed for user `8f3b667643cc4aa7ab16e7a3957ba302`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:53.784214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:53.849616 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1940/3890] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:53.933835 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1951/3891] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:00:54.487538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:54.489994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:54.600908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc8c27-e6b9-47be-8eda-e23122edc37d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:54.626059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:54.722237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11353a1c-f1d6-4134-8121-d73d8046e6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:54.724463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353a1c-f1d6-4134-8121-d73d8046e6f5 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:54.724755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353a1c-f1d6-4134-8121-d73d8046e6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:54.725038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353a1c-f1d6-4134-8121-d73d8046e6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:54.739330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11353a1c-f1d6-4134-8121-d73d8046e6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:54.744112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11353a1c-f1d6-4134-8121-d73d8046e6f5 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:54.759928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1941/3892] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:54.850848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:54.947232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d823192-ee48-4bbd-a207-1ff173e32ce2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:54.964885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:54.966731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:54.967528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:54.968008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] PATH_INFO: `/v3/users/8f3b667643cc4aa7ab16e7a3957ba302` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:54.970655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3b667643cc4aa7ab16e7a3957ba302)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:54.973842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:55.284037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3b667643cc4aa7ab16e7a3957ba302'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:55.297827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3b667643cc4aa7ab16e7a3957ba302'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:55.297827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3b667643cc4aa7ab16e7a3957ba302'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:55.297827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3b667643cc4aa7ab16e7a3957ba302'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:55.311386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3b667643cc4aa7ab16e7a3957ba302'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:55.418349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1952/3893] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:00:54 2022] DELETE /identity/v3/users/8f3b667643cc4aa7ab16e7a3957ba302 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:55.423060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:55.423356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:55.423634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:55.465801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:55.468974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:55.577494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1942/3894] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:55.592100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:55.593645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:55.662254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba28e6-580d-4a85-9c10-7e230d3de1d4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:55.670455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d36ca-60dd-46cb-90ab-be6d44202166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:55.671194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d36ca-60dd-46cb-90ab-be6d44202166 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:55.671475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d36ca-60dd-46cb-90ab-be6d44202166 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:55.671747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d36ca-60dd-46cb-90ab-be6d44202166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:55.681341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d36ca-60dd-46cb-90ab-be6d44202166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:55.688654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d36ca-60dd-46cb-90ab-be6d44202166 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:55.692393 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1953/3895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:56.423798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:56.685688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:56.687856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:56.704482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4b6d1-44e2-49c8-9d50-366018d0fff2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:56.712178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:56.713700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:56.714849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:56.718706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] PATH_INFO: `/v3/projects/b95359a2b44943ffb79fc08740136038` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:56.718706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95359a2b44943ffb79fc08740136038)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:56.721170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:56.993676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95359a2b44943ffb79fc08740136038', 'request_id': 'req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:57.007373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95359a2b44943ffb79fc08740136038', 'request_id': 'req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:57.020527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95359a2b44943ffb79fc08740136038', 'request_id': 'req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:57.259422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] The token cache is being invalidate because project b95359a2b44943ffb79fc08740136038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:00:57.259943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:57.261380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-19fbf97f-30d6-4d34-81f0-9bd2fd85a8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:00:57.264553 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1943/3896] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:00:56 2022] DELETE /identity/v3/projects/b95359a2b44943ffb79fc08740136038 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:57.269459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:57.269793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:57.270064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:57.335728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:57.335728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:57.543344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:57.543647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:57.543869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1954/3897] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:57.544317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:57.591003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:57.593324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:57.619074 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1944/3898] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:57.620230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:57.633856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a7c3-9a82-4bca-b3a7-9b4a29f8ebc8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:57.643724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:57.644669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:57.646832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:57.646832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:57.646832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:00:57.646832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:57.654353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:57.692035 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1955/3899] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:00:57.698472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:57.712086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e618-0fc9-4f43-975a-ad4cdbd8b120 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:57.730994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:57.735613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:57.735818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:57.736088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:57.736733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:57.738665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:57.883070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:57.890131 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1945/3900] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:00:57 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:57.892230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:57.914938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db40cec-68cc-4d05-a6d7-292c635bd82c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:58.032291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:58.033574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:58.034066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:58.040758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:58.040758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:58.040758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:58.141321 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1956/3901] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:00:57 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:00:58.145911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:58.163367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d53e89-e7c5-4359-a99c-acaee902ce0b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:58.171358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:58.172264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:58.173247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:58.173552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:58.174258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:58.176905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:58.196770 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1946/3902] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:58.201248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:58.212359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5ea67-54eb-4ece-b8b0-56c7c3f901e8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:58.220813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da796e-c111-414b-92f9-36ac183af184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:58.221559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da796e-c111-414b-92f9-36ac183af184 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:58.222139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da796e-c111-414b-92f9-36ac183af184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:58.222573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da796e-c111-414b-92f9-36ac183af184 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:58.227137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da796e-c111-414b-92f9-36ac183af184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:58.227137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da796e-c111-414b-92f9-36ac183af184 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:58.237854 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1957/3903] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:00:58.242133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:58.261591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce41a9-7e4b-45b7-a2a0-e0c541d24e50 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:58.270726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:58.272597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:58.273279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:58.277421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] PATH_INFO: `/v3/projects/4fe5fe7328b44d5589755674135f64d6/users/924121a80acf4f72a356b4df01ce8692/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:58.301745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe5fe7328b44d5589755674135f64d6, user_id=924121a80acf4f72a356b4df01ce8692, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:58.307080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:58.451328 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1947/3904] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:00:58 2022] PUT /identity/v3/projects/4fe5fe7328b44d5589755674135f64d6/users/924121a80acf4f72a356b4df01ce8692/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:00:58.457167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abada7c-0fb3-4673-ae1b-100eb8643806 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:58.457760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abada7c-0fb3-4673-ae1b-100eb8643806 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:58.458409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abada7c-0fb3-4673-ae1b-100eb8643806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:58.481641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9abada7c-0fb3-4673-ae1b-100eb8643806 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:58.483283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9abada7c-0fb3-4673-ae1b-100eb8643806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:58.653380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1958/3905] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:00:58.693064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:00:58.694898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:58.819872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2346a1-aff0-4d4f-bda7-fd308c93a1a8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:00:58.825789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:00:58.827697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:58.829322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:58.829772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:58.860940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:00:58.864365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:00:58.885504 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1948/3906] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:00:59.006070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:00:59.006570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:00:59.006679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:00:59.028841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] MFA Rules not processed for user `3b6e2046e3bd40b3b46802dfa796260b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:00:59.030071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:00:59.038640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:00:59.115644 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1959/3907] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:00.449169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:00.450824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:00.622096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580850b-d087-4657-9108-08825d9cccf4 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:00.631454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:00.632369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:00.632660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:00.632942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:00.635677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:00.666293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:00.671557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a300fe2-9559-4f72-8727-5ef06df277ab service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:00.709656 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1949/3908] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:01:09.278853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:09.292785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da7fed-49bc-4c0d-93a2-888982138836 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:09.308008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:09.311928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:09.311928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:09.311928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:09.311928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:09.330575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:09.337069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:09.353257 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1960/3909] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:10.685487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:13.597574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:13.598184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:13.598184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:13.651458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] MFA Rules not processed for user `924121a80acf4f72a356b4df01ce8692`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:13.652978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:13.743703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1950/3910] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:13.756731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:13.760175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:13.807736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7c25-73a5-4b9b-9967-7fea2b7014e9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:13.817040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778323d9-299c-4fc4-9101-dafcf12a507f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:13.817877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778323d9-299c-4fc4-9101-dafcf12a507f service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:13.818264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778323d9-299c-4fc4-9101-dafcf12a507f service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:13.818647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778323d9-299c-4fc4-9101-dafcf12a507f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:13.832717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778323d9-299c-4fc4-9101-dafcf12a507f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:13.840779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778323d9-299c-4fc4-9101-dafcf12a507f service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:13.846215 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1961/3911] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:16.019973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:16.022344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:16.051117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a40b-a874-41ca-831c-d08e4107d0b8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:16.065208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:16.066335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:16.066781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:16.067311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] PATH_INFO: `/v3/users/1636966859164d7a85237a0209eacac9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:16.072204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1636966859164d7a85237a0209eacac9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:16.075394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:16.351768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1636966859164d7a85237a0209eacac9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:16.374672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1636966859164d7a85237a0209eacac9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:16.375507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1636966859164d7a85237a0209eacac9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:16.398307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1636966859164d7a85237a0209eacac9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:16.399109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1636966859164d7a85237a0209eacac9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:16.496496 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1951/3912] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:01:16 2022] DELETE /identity/v3/users/1636966859164d7a85237a0209eacac9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:16.500838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:16.501364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:16.501450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:16.539598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:16.558219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:16.714090 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1962/3913] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:16.732758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:16.734067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:16.876567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fced9e-6247-4c91-8110-83168553d840 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:16.886524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e26c3-80b8-4bba-8cd9-387434364474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:16.887328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e26c3-80b8-4bba-8cd9-387434364474 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:16.887996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e26c3-80b8-4bba-8cd9-387434364474 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:16.887996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e26c3-80b8-4bba-8cd9-387434364474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:16.898747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e26c3-80b8-4bba-8cd9-387434364474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:16.900418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e26c3-80b8-4bba-8cd9-387434364474 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:16.913150 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1952/3914] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:17.257439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:17.258940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:17.279540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10313c1-c2a5-4c88-a39c-1984886a3d9a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:17.285156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:17.286189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:17.286662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:17.287429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] PATH_INFO: `/v3/projects/f789cfedaac348d08b77238731887fc5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:17.298269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f789cfedaac348d08b77238731887fc5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:17.303532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:17.422407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:17.439766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f789cfedaac348d08b77238731887fc5', 'request_id': 'req-89a2f674-7039-4f50-91c1-9112cacf4c3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:17.448546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f789cfedaac348d08b77238731887fc5', 'request_id': 'req-89a2f674-7039-4f50-91c1-9112cacf4c3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:17.456050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f789cfedaac348d08b77238731887fc5', 'request_id': 'req-89a2f674-7039-4f50-91c1-9112cacf4c3d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:17.599603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] The token cache is being invalidate because project f789cfedaac348d08b77238731887fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:01:17.600282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:17.600981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89a2f674-7039-4f50-91c1-9112cacf4c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:17.602900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1963/3915] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:01:17 2022] DELETE /identity/v3/projects/f789cfedaac348d08b77238731887fc5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:17.608162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:17.608677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:17.608779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:17.621153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:17.637862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:17.648716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:17.717841 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1953/3916] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:01:17.727165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:17.727826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:17.728276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:17.751929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:17.753183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:17.763770 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1964/3917] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:17.769381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:17.782082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb505-6472-4d27-bd59-9fa2459afc8c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:17.786959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:17.787636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:17.787927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:17.788203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:17.789056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:01:17.789595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:17.791984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:17.808976 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1954/3918] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:01:17.821136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:17.833123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2145-eb01-4685-8d70-749fb493da7a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:17.838206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:17.838925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:17.839532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:17.839953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:17.841038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:17.843206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:17.975132 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1965/3919] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:01:17 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:01:17.976032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:17.987748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb4d-42b3-465b-807d-dcfa7fcf4180 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.054497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.055242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.055532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.055818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.057110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.059217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.211093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1955/3920] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:01:17 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:01:18.215623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:18.228023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7f5af-d373-4fbb-86ce-d484a653919c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.234151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.234770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.235099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.235351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.235991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.237705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.250431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1966/3921] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:18.254624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:18.265613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948592e6-506b-4f1b-8c31-42e5ebb35a19 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.270969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6f520-a865-4798-8e94-265e45c8874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.271146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f520-a865-4798-8e94-265e45c8874e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.271391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f520-a865-4798-8e94-265e45c8874e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.271813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6f520-a865-4798-8e94-265e45c8874e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.272673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6f520-a865-4798-8e94-265e45c8874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.274283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6f520-a865-4798-8e94-265e45c8874e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.285825 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1956/3922] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:18.290114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:18.301055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9b773-ef22-4e52-9628-c3fdcd4d48e5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.305773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.306437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.311303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.311303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] PATH_INFO: `/v3/projects/4c11fa62b10f4b6594216e09c34054f5/users/3d9b2e89af46412db10b27a4ce0877f5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.323187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c11fa62b10f4b6594216e09c34054f5, user_id=3d9b2e89af46412db10b27a4ce0877f5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.325978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.423205 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1967/3923] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:18 2022] PUT /identity/v3/projects/4c11fa62b10f4b6594216e09c34054f5/users/3d9b2e89af46412db10b27a4ce0877f5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:18.434186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.434477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.434751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.464650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] MFA Rules not processed for user `3d9b2e89af46412db10b27a4ce0877f5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:18.465965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:18.552390 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1957/3924] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:18.555387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:18.633940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7665ba4-598a-4e77-b8d0-4af6bcada357 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.639093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.639678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.639963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.640391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.641095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.643209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.729580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1968/3925] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:01:18 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:01:18.733752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:18.746056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5256cc-1b69-4941-93e3-aec809994140 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.827241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.828141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.828469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.828955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.830029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.832146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.953759 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1958/3926] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:01:18 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:01:18.954756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:18.968069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad9ef6-52b3-4b64-878d-bae3a6ff62fe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:18.974154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:18.975523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:18.976244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:18.976244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:18.976725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:18.979554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:18.997872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1969/3927] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:01:19.001743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:19.017971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a5a43-c353-40c2-9a04-dcee8f72a791 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:19.024922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:19.026607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:19.026966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:19.027632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] PATH_INFO: `/v3/projects/9c701fdbd734420cb4368a89b4600a11/users/199427c25d354027ae53e7adf4610094/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:19.046417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c701fdbd734420cb4368a89b4600a11, user_id=199427c25d354027ae53e7adf4610094, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:19.049207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:19.168234 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1959/3928] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:18 2022] PUT /identity/v3/projects/9c701fdbd734420cb4368a89b4600a11/users/199427c25d354027ae53e7adf4610094/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:19.169077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:19.187221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4878c-fc46-4068-b6a3-a38103fd1d65 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:19.243659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:19.303158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa77f-8e11-4c87-8db4-222b779e97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:19.304099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa77f-8e11-4c87-8db4-222b779e97cd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:19.304566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa77f-8e11-4c87-8db4-222b779e97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:19.305058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa77f-8e11-4c87-8db4-222b779e97cd admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:19.305700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefa77f-8e11-4c87-8db4-222b779e97cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:19.308020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefa77f-8e11-4c87-8db4-222b779e97cd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:19.321982 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1970/3929] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:19.323970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:19.335608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365ce0-8467-487c-bfa3-2b2d2a113204 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:19.341267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:19.341735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:19.342122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:19.342521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] PATH_INFO: `/v3/projects/9c701fdbd734420cb4368a89b4600a11/users/199427c25d354027ae53e7adf4610094/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:19.345856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c701fdbd734420cb4368a89b4600a11, user_id=199427c25d354027ae53e7adf4610094, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:19.348694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:19.362637 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1960/3930] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:19 2022] PUT /identity/v3/projects/9c701fdbd734420cb4368a89b4600a11/users/199427c25d354027ae53e7adf4610094/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:19.376016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0f92-c12d-4acd-963f-7f97b088ffe3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:19.376701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0f92-c12d-4acd-963f-7f97b088ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:19.377173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0f92-c12d-4acd-963f-7f97b088ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:19.412368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:19.422185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-08eb0f92-c12d-4acd-963f-7f97b088ffe3 None None] MFA Rules not processed for user `199427c25d354027ae53e7adf4610094`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:19.424447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-08eb0f92-c12d-4acd-963f-7f97b088ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:19.565895 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1971/3931] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:19.589722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:19.592111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:19.671408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ed310-ee5b-40e6-a0df-90c529d0169d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:19.675166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:19.675992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:19.676280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:19.676556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:19.687295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:19.689248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:19.700443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1961/3932] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:20.060252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:20.060828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:20.060828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:20.101250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:20.102969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:20.217385 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1972/3933] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:20.239333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:20.239333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:20.359895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208944-9a3c-443a-9053-b696e34c6704 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:20.366232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec5e77-4e8b-4527-a6e5-f1ec01f6b4f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:20.367222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5e77-4e8b-4527-a6e5-f1ec01f6b4f6 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:20.367341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5e77-4e8b-4527-a6e5-f1ec01f6b4f6 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:20.367687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5e77-4e8b-4527-a6e5-f1ec01f6b4f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:20.381353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec5e77-4e8b-4527-a6e5-f1ec01f6b4f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:20.383592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec5e77-4e8b-4527-a6e5-f1ec01f6b4f6 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:20.403290 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1962/3934] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:20.841377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:20.926544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:21.057264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dfa1d-3716-4f08-ab05-57ab5b685bfa None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:21.070602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:21.074302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:21.074603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:21.074890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] PATH_INFO: `/v3/users/3d9b2e89af46412db10b27a4ce0877f5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:21.079496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9b2e89af46412db10b27a4ce0877f5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:21.084437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:21.301585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:21.319236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9b2e89af46412db10b27a4ce0877f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:21.333043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9b2e89af46412db10b27a4ce0877f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:21.334668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9b2e89af46412db10b27a4ce0877f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:21.335625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9b2e89af46412db10b27a4ce0877f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:21.354449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9b2e89af46412db10b27a4ce0877f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:21.429118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1973/3935] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:01:20 2022] DELETE /identity/v3/users/3d9b2e89af46412db10b27a4ce0877f5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:21.431290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:21.432456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:21.432639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:21.478049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:21.480521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:21.593498 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1963/3936] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:01:21.608883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:21.618874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:21.731647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674549e8-727e-4d38-987b-a0a80ff7b848 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:21.735526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:21.736217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:21.736584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:21.736960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:21.776914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:21.779269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:21.819625 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1974/3937] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:22.485461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:22.486915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:22.510476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018daa37-2e7d-4299-8b9a-7c11f11b276c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:22.524852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:22.525678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:22.526285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:22.527956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] PATH_INFO: `/v3/projects/4c11fa62b10f4b6594216e09c34054f5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:22.531270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c11fa62b10f4b6594216e09c34054f5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:22.537126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:22.796051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c11fa62b10f4b6594216e09c34054f5', 'request_id': 'req-01c7e07a-66df-4436-bcb4-aa629dc91976'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:22.814300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c11fa62b10f4b6594216e09c34054f5', 'request_id': 'req-01c7e07a-66df-4436-bcb4-aa629dc91976'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:22.826859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c11fa62b10f4b6594216e09c34054f5', 'request_id': 'req-01c7e07a-66df-4436-bcb4-aa629dc91976'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:22.896921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] The token cache is being invalidate because project 4c11fa62b10f4b6594216e09c34054f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:01:22.897375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:22.898118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:22.903257 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1964/3938] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:01:22 2022] DELETE /identity/v3/projects/4c11fa62b10f4b6594216e09c34054f5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:22.904814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:22.918555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639645c-6780-4bbd-aaa6-1f239ec30721 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:23.065753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:23.067128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:23.067128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:23.067567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] PATH_INFO: `/v3/users/199427c25d354027ae53e7adf4610094` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:23.068879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199427c25d354027ae53e7adf4610094)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:23.071486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:23.102102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:23.296526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199427c25d354027ae53e7adf4610094'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:23.312090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199427c25d354027ae53e7adf4610094'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:23.314136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199427c25d354027ae53e7adf4610094'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:23.316264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199427c25d354027ae53e7adf4610094'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:23.347200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199427c25d354027ae53e7adf4610094'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:23.495900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1975/3939] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:01:22 2022] DELETE /identity/v3/users/199427c25d354027ae53e7adf4610094 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:23.620085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:23.621685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:23.704832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7e07a-66df-4436-bcb4-aa629dc91976 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:23.748664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:23.832750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:23.838963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:23.838963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:23.838963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:23.838963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:23.879161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:23.881048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a21e-1ba3-4ffe-ac1b-4a5d2bc16bdf service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:23.912298 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1965/3940] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:24.091704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:24.093702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:24.212254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12127d-01c6-47ed-84b4-9ab5809f5225 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:24.218762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:24.220524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.220977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.221443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] PATH_INFO: `/v3/projects/9c701fdbd734420cb4368a89b4600a11` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.223281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c701fdbd734420cb4368a89b4600a11)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:24.226231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:24.441804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c701fdbd734420cb4368a89b4600a11', 'request_id': 'req-0039a683-807b-4788-850d-8c7ad5901eb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:24.457824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c701fdbd734420cb4368a89b4600a11', 'request_id': 'req-0039a683-807b-4788-850d-8c7ad5901eb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:24.479600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c701fdbd734420cb4368a89b4600a11', 'request_id': 'req-0039a683-807b-4788-850d-8c7ad5901eb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:24.592668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] The token cache is being invalidate because project 9c701fdbd734420cb4368a89b4600a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:01:24.592821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:24.594195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0039a683-807b-4788-850d-8c7ad5901eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:24.600242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1976/3941] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:01:24 2022] DELETE /identity/v3/projects/9c701fdbd734420cb4368a89b4600a11 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:24.606316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3622-57d5-46f9-a7e4-da75a77e5aa4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.610078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3622-57d5-46f9-a7e4-da75a77e5aa4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.610078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3622-57d5-46f9-a7e4-da75a77e5aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.661357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-40ea3622-57d5-46f9-a7e4-da75a77e5aa4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:24.661867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e73136-c018-482c-a3f2-a0c608d6f9a8 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.662039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e73136-c018-482c-a3f2-a0c608d6f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.662196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e73136-c018-482c-a3f2-a0c608d6f9a8 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.663643 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1977/3942] 10.222.0.20 () {54 vars in 921 bytes} [Tue Sep 6 11:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:01:24.664485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-40ea3622-57d5-46f9-a7e4-da75a77e5aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:24.676801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.677187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.677493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.780169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1966/3943] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:24.795208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:24.798231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.798551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.799585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.804589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:24.851320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:24.862055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:24.864843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:24.875560 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1967/3944] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:01:24.880005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:24.892472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa65405-5bb5-4666-88ae-cee6f6e4dcf4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:24.900414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:24.901335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.902261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.902261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.902536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:01:24.903062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:24.913310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:24.934503 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1968/3945] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:01:24.936213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:24.947102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad18dc-e59a-4c93-87e2-ba8c6397141d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:24.947981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1978/3946] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:01:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:01:24.953291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:24.953902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:24.954187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:24.954461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:24.955410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:24.957568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:24.959878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:24.961338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:25.025467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab9f3-10b5-4b0d-8d2f-ce68e7f2ac20 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:25.029249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:25.029865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:25.030145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:25.030418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:25.049634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:25.051473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:25.064985 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1979/3947] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:25.234621 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1969/3948] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:01:24 2022] POST /identity/v3/projects => generated 377 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:01:25.239123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:25.252728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2598fa-9542-4b93-9f4e-683db12febba service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:25.399302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:25.399803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:25.400619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:25.400897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:25.401532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:25.404362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:25.636563 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1980/3949] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:01:25 2022] POST /identity/v3/users => generated 289 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:01:25.640543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:25.656445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36215-9a86-4f0d-8980-1270c4c1a1e3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:25.661526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:25.662775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:25.663562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:25.664038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:25.664785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:25.667294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:25.685150 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1970/3950] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:25.686340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:25.697817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699039-2efc-4467-b445-9fe5fbc40dc6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:25.702955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1c8fa-c006-4964-b644-e0b2f97eeefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:25.703579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c8fa-c006-4964-b644-e0b2f97eeefc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:25.706645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c8fa-c006-4964-b644-e0b2f97eeefc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:25.706645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c8fa-c006-4964-b644-e0b2f97eeefc admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:25.706645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1c8fa-c006-4964-b644-e0b2f97eeefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:25.707666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1c8fa-c006-4964-b644-e0b2f97eeefc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:25.720913 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1981/3951] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:25.731524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:25.751428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e2ac0-bfdf-4df9-a4d6-72b3977e1d1e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:25.769917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:25.773202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:25.773566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:25.773959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] PATH_INFO: `/v3/projects/9e57d652e04149709c4d6b3cb160d7e2/users/448ccb88a71546c9b4bd1960e9c213b9/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:25.801801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e57d652e04149709c4d6b3cb160d7e2, user_id=448ccb88a71546c9b4bd1960e9c213b9, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:25.804623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:25.905287 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1971/3952] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:25 2022] PUT /identity/v3/projects/9e57d652e04149709c4d6b3cb160d7e2/users/448ccb88a71546c9b4bd1960e9c213b9/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:25.916424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:25.916965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:25.917491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:25.967348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] MFA Rules not processed for user `448ccb88a71546c9b4bd1960e9c213b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:25.968654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:26.084611 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1982/3953] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:01:26.084810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:26.223048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:26.241637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac49c37-66ef-4134-aef7-62868212a0ed admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:26.248124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:26.249102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:26.249420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:26.249796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:26.250568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:26.252936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:26.399487 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1972/3954] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:01:26 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:01:26.404154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:26.440943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975a7f5-e3d6-4aa8-9ad7-8fa59d5501e9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:26.533896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:26.534526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:26.534887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:26.535200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:26.536033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:26.538217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:26.657794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1983/3955] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:01:26 2022] POST /identity/v3/users => generated 295 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:01:26.661516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:26.688947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491773-41f5-4ec1-aa84-9af2fd66eab8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:26.702335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:26.702335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:26.702335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:26.702335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:26.702854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:26.702854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:26.716782 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1973/3956] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:26.722590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:26.739719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b05d-05b9-4b9a-bffb-c87792718324 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:26.752541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:26.753547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:26.753995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:26.755775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] PATH_INFO: `/v3/projects/cead502ec10246d5b173f76d7a370f75/users/8b2ecb895e0e43599dc5b739c0ff570a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:26.784487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cead502ec10246d5b173f76d7a370f75, user_id=8b2ecb895e0e43599dc5b739c0ff570a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:26.787255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:26.898382 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1984/3957] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:26 2022] PUT /identity/v3/projects/cead502ec10246d5b173f76d7a370f75/users/8b2ecb895e0e43599dc5b739c0ff570a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:26.902740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:26.926818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7bae-f14f-4752-9586-4d7b396ec31b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:27.036627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717dcd-3b56-4e3d-9ff4-b422ebbfe508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:27.037537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717dcd-3b56-4e3d-9ff4-b422ebbfe508 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:27.038012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717dcd-3b56-4e3d-9ff4-b422ebbfe508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:27.040813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717dcd-3b56-4e3d-9ff4-b422ebbfe508 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:27.042311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717dcd-3b56-4e3d-9ff4-b422ebbfe508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:27.044598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717dcd-3b56-4e3d-9ff4-b422ebbfe508 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:27.069255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1974/3958] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:27.073725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:27.093926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166fe0-5fda-40ac-9175-ab45daa2a9e5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:27.100658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:27.101698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:27.102177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:27.102457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] PATH_INFO: `/v3/projects/cead502ec10246d5b173f76d7a370f75/users/8b2ecb895e0e43599dc5b739c0ff570a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:27.108672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cead502ec10246d5b173f76d7a370f75, user_id=8b2ecb895e0e43599dc5b739c0ff570a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:27.113014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:27.145697 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1985/3959] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:27 2022] PUT /identity/v3/projects/cead502ec10246d5b173f76d7a370f75/users/8b2ecb895e0e43599dc5b739c0ff570a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:27.147426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0990d-d7e1-4b68-a8a7-e4940fb5384c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:27.147714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0990d-d7e1-4b68-a8a7-e4940fb5384c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:27.147998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0990d-d7e1-4b68-a8a7-e4940fb5384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:27.192603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e6a0990d-d7e1-4b68-a8a7-e4940fb5384c None None] MFA Rules not processed for user `8b2ecb895e0e43599dc5b739c0ff570a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:27.194742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e6a0990d-d7e1-4b68-a8a7-e4940fb5384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:27.338434 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1975/3960] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:27.347880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:27.349669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:27.450154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea3ef-97ba-4a09-935b-eda96d6cf258 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:27.466860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:27.467523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:27.467831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:27.468381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:27.563448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:27.564911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:27.598435 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1986/3961] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:27.600393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:28.776803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:31.213302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:31.213796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:31.213917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:31.240099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:31.244494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:31.304776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:31.319991 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1976/3962] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:38.492978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:38.495108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:38.604603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4cb7e-1822-49a8-9be6-3efa1ed0f0f7 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:38.611850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:38.614829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:38.615370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:38.615812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] PATH_INFO: `/v3/users/924121a80acf4f72a356b4df01ce8692` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:38.617380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924121a80acf4f72a356b4df01ce8692)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:38.619708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:38.847244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:38.848696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:38.858000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924121a80acf4f72a356b4df01ce8692'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:38.867469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e914c0-c326-49b1-bae4-0a88f87e4933 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:38.871480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:38.872088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:38.872535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:38.872810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:38.873124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924121a80acf4f72a356b4df01ce8692'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:38.873844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924121a80acf4f72a356b4df01ce8692'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:38.874471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924121a80acf4f72a356b4df01ce8692'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:38.882905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:38.884383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:38.895264 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1977/3963] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:01:38.898085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2012f3c9-1070-4fb9-8a49-fdda26066c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924121a80acf4f72a356b4df01ce8692'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:38.987792 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1987/3964] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:01:38 2022] DELETE /identity/v3/users/924121a80acf4f72a356b4df01ce8692 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:39.924785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:39.936447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c8a19-82aa-4bd4-b145-e82ba6030491 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:40.005937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:40.006619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:40.006908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:40.007485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] PATH_INFO: `/v3/projects/4fe5fe7328b44d5589755674135f64d6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:40.010150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe5fe7328b44d5589755674135f64d6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:40.012188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:40.170309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe5fe7328b44d5589755674135f64d6', 'request_id': 'req-6df44d07-e984-4da3-9d79-9a1bc8625533'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:40.194197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe5fe7328b44d5589755674135f64d6', 'request_id': 'req-6df44d07-e984-4da3-9d79-9a1bc8625533'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:40.237653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe5fe7328b44d5589755674135f64d6', 'request_id': 'req-6df44d07-e984-4da3-9d79-9a1bc8625533'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:40.366061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] The token cache is being invalidate because project 4fe5fe7328b44d5589755674135f64d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:01:40.374598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:40.380611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6df44d07-e984-4da3-9d79-9a1bc8625533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:01:40.396017 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1978/3965] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:01:39 2022] DELETE /identity/v3/projects/4fe5fe7328b44d5589755674135f64d6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:40.397555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:40.398095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:40.398292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:40.464253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:40.476434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:40.657468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:40.734753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1988/3966] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:40.743874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:40.744166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:40.744450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:40.779324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:40.783231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:40.807914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1979/3967] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:40.813484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:40.831451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ccce7-6b45-4ae2-b388-86d0ed8a5030 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:40.837177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:40.838334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:40.839167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:40.839745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:40.840796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:01:40.841323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:40.843250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:40.862670 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1989/3968] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:01:40.874179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:40.906773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2608f5-6c61-4079-a5d1-5812ed0927ed None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:40.921413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:40.923562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:40.924188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:40.934051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:40.934051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:40.934051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:41.100811 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1980/3969] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:01:40 2022] POST /identity/v3/projects => generated 395 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:01:41.105416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:41.122372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fa563-e3db-43f2-8e4d-f83503a4108b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:41.280269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:41.281352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:41.281773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:41.282217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:41.283376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:41.288214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:41.456266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1990/3970] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:01:41 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:01:41.460967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:41.476983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398fe6f-de3a-40f9-9505-286973ec7bfe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:41.485578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:41.485578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:41.485578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:41.485578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:41.486083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:41.487453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:41.503734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1981/3971] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:41.508475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:41.523759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b081aa-9dbd-4334-9082-c06ac8141940 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:41.531836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bdab2-699b-47e9-8b46-a928564c95c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:41.531977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bdab2-699b-47e9-8b46-a928564c95c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:41.532256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bdab2-699b-47e9-8b46-a928564c95c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:41.532694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bdab2-699b-47e9-8b46-a928564c95c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:41.533525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bdab2-699b-47e9-8b46-a928564c95c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:41.535386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bdab2-699b-47e9-8b46-a928564c95c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:41.548624 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1991/3972] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:01:41.553590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:41.569365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e3fbe-c910-45ed-b04b-06cf437c628a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:41.576101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:41.581177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:41.581177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:41.581177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] PATH_INFO: `/v3/projects/a953396744854dcba117451ace5815de/users/d53d3a5df7974a03ad02b5ceca6f4425/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:41.605716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a953396744854dcba117451ace5815de, user_id=d53d3a5df7974a03ad02b5ceca6f4425, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:41.609991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:41.701360 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1982/3973] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:01:41 2022] PUT /identity/v3/projects/a953396744854dcba117451ace5815de/users/d53d3a5df7974a03ad02b5ceca6f4425/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:01:41.706559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99873694-a9dc-48c6-a789-540353660506 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:41.706698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99873694-a9dc-48c6-a789-540353660506 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:41.706938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99873694-a9dc-48c6-a789-540353660506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:41.748170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-99873694-a9dc-48c6-a789-540353660506 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:41.749623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-99873694-a9dc-48c6-a789-540353660506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:41.838392 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1992/3974] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:41.853670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:41.856087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:41.865502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:41.961090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9d56-5d43-4e4a-aae0-79d4b699eee7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:41.967240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:41.967906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:41.968198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:41.968555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:41.979063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:41.980776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:41.990387 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1983/3975] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:01:44.233066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9588-bcc0-4b89-8b70-2f5ee227f432 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:44.233882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9588-bcc0-4b89-8b70-2f5ee227f432 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:44.234362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9588-bcc0-4b89-8b70-2f5ee227f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:44.272186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-31bc9588-bcc0-4b89-8b70-2f5ee227f432 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:44.273446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-31bc9588-bcc0-4b89-8b70-2f5ee227f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:44.345546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:44.379196 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1993/3976] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:01:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:44.384709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:44.388728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:44.489157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47c333-c6bc-402b-a34b-a6b1a0b9f9c0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:44.506185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73581feb-a740-4aee-9bfb-d133409acddf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:44.509230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581feb-a740-4aee-9bfb-d133409acddf service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:44.509630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581feb-a740-4aee-9bfb-d133409acddf service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:44.509988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73581feb-a740-4aee-9bfb-d133409acddf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:44.535514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581feb-a740-4aee-9bfb-d133409acddf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:44.537233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73581feb-a740-4aee-9bfb-d133409acddf service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:44.557460 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1984/3977] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:01:46.748057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9eb37-d152-4a0e-bdfe-bfc8f9f65767 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:46.748590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9eb37-d152-4a0e-bdfe-bfc8f9f65767 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:46.748701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9eb37-d152-4a0e-bdfe-bfc8f9f65767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:46.798604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dba9eb37-d152-4a0e-bdfe-bfc8f9f65767 None None] MFA Rules not processed for user `99ebe881ffd44893879bb9e7ab63c9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:46.806183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dba9eb37-d152-4a0e-bdfe-bfc8f9f65767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:47.047894 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1994/3978] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:50.966128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:50.966939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:50.967419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:51.013161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] MFA Rules not processed for user `e19903666a1243e3a66411e30babe299`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:51.022236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:51.136236 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1985/3979] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:56.990089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=29 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:57.521509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38b3a3-c3a4-457f-adf8-168325a4aeae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:57.521919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38b3a3-c3a4-457f-adf8-168325a4aeae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:57.522313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38b3a3-c3a4-457f-adf8-168325a4aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:57.597488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ae38b3a3-c3a4-457f-adf8-168325a4aeae None None] MFA Rules not processed for user `d53d3a5df7974a03ad02b5ceca6f4425`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:01:57.598771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae38b3a3-c3a4-457f-adf8-168325a4aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:57.830792 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1995/3980] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:01:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:01:57.915781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:01:57.919246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:01:57.995456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:01:58.035274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230461d-7d60-4bcc-8f09-c35fe1d4c971 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:01:58.041363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:01:58.043719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:01:58.044334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:01:58.044774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:01:58.054462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:01:58.056443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:01:58.076574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1986/3981] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:01:57 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:04.149326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:04.149911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:04.149911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:04.210092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:04.216746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:04.374316 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1996/3982] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:08.295720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=15 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:09.272217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:09.283272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787049-59b2-4137-a8b6-d130d7fb07f0 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:09.294571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:09.295208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:09.295363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:09.295642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] PATH_INFO: `/v3/users/d53d3a5df7974a03ad02b5ceca6f4425` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:09.300030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53d3a5df7974a03ad02b5ceca6f4425)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:09.302244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:09.584693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53d3a5df7974a03ad02b5ceca6f4425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:09.593446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53d3a5df7974a03ad02b5ceca6f4425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:09.594227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53d3a5df7974a03ad02b5ceca6f4425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:09.613075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53d3a5df7974a03ad02b5ceca6f4425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:09.613873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-628654b6-84d3-4e20-850c-510a6d1ef964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53d3a5df7974a03ad02b5ceca6f4425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:09.769598 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1987/3983] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:09 2022] DELETE /identity/v3/users/d53d3a5df7974a03ad02b5ceca6f4425 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:10.074987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:10.088811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705bd33-3d10-4e1b-9bdd-f2321c750ac6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:10.201547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:10.202654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:10.202890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:10.203381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] PATH_INFO: `/v3/projects/a953396744854dcba117451ace5815de` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:10.204638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a953396744854dcba117451ace5815de)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:10.206554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:10.405701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:10.419785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a953396744854dcba117451ace5815de', 'request_id': 'req-0b2e35b7-7c13-48f6-9544-9f80c218fb10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:10.428252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a953396744854dcba117451ace5815de', 'request_id': 'req-0b2e35b7-7c13-48f6-9544-9f80c218fb10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:10.436936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a953396744854dcba117451ace5815de', 'request_id': 'req-0b2e35b7-7c13-48f6-9544-9f80c218fb10'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:10.590380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] The token cache is being invalidate because project a953396744854dcba117451ace5815de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:10.591305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:10.610232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b2e35b7-7c13-48f6-9544-9f80c218fb10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:10.616466 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1997/3984] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:10 2022] DELETE /identity/v3/projects/a953396744854dcba117451ace5815de => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:10.618588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:10.619195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:10.619195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:10.675658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:10.678216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:10.783381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1988/3985] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:10.794944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:10.794944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:10.794944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:10.818425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:10.825651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:10.837049 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1998/3986] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:10.841845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:10.856614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3edcbf-1c63-461e-94e5-63167bbb808a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:10.884388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:10.885263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:10.885542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:10.885821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:10.886483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:10.886789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:10.889115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:10.911272 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1989/3987] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:10.912431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:10.932171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de903df-dcc1-4bf9-b4cb-8032ae873b7a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:10.937443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:10.938074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:10.938356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:10.938631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:10.939323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:10.941268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:11.058858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 1999/3988] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:10 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:11.060406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:11.071098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22128c-b628-40e5-b7ed-4c771d0d08c2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:11.133055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:11.133988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:11.134431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:11.134862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:11.135686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:11.138001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:11.166694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:11.263166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1990/3989] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:11 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:11.264718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:11.292693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53da7-abf6-43ac-a901-a51db885b016 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:11.298038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:11.298655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:11.299194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:11.299474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:11.300122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:11.301890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:11.315263 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2000/3990] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:11.320361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:11.331988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae0fa3-5c2a-4c2f-8867-10cdcf7c6ac1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:11.339709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb635b-3c53-4f6f-8d67-b096370daeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:11.340753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb635b-3c53-4f6f-8d67-b096370daeef admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:11.340753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb635b-3c53-4f6f-8d67-b096370daeef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:11.343589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb635b-3c53-4f6f-8d67-b096370daeef admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:11.343589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb635b-3c53-4f6f-8d67-b096370daeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:11.344616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb635b-3c53-4f6f-8d67-b096370daeef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:11.358105 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1991/3991] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:11.362746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:11.373203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92654606-0308-465d-acc8-41cc483c9979 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:11.377919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:11.378579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:11.378863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:11.379177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] PATH_INFO: `/v3/projects/0e8540c8171e480b83fd68fbb5f159be/users/00e93a2f8ed643ba8bc92b4def1ce7f3/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:11.400706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8540c8171e480b83fd68fbb5f159be, user_id=00e93a2f8ed643ba8bc92b4def1ce7f3, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:11.403502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:11.477876 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2001/3992] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:11 2022] PUT /identity/v3/projects/0e8540c8171e480b83fd68fbb5f159be/users/00e93a2f8ed643ba8bc92b4def1ce7f3/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:11.479520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f131-ee50-4dc6-93be-ceb132ff5ca2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:11.479811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f131-ee50-4dc6-93be-ceb132ff5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:11.480090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f131-ee50-4dc6-93be-ceb132ff5ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:11.508708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7fc8f131-ee50-4dc6-93be-ceb132ff5ca2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:11.510232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7fc8f131-ee50-4dc6-93be-ceb132ff5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:11.579864 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1992/3993] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:11.589969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:11.592258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:11.668758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f41553-999c-46f0-80f0-6f90c034cb92 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:11.680540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefede7-ae6f-4122-be8d-d18c7be92c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:11.681172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefede7-ae6f-4122-be8d-d18c7be92c3a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:11.681456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefede7-ae6f-4122-be8d-d18c7be92c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:11.681752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefede7-ae6f-4122-be8d-d18c7be92c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:11.693777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefede7-ae6f-4122-be8d-d18c7be92c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:11.696575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefede7-ae6f-4122-be8d-d18c7be92c3a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:11.709548 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2002/3994] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:02:12.854995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:12.854995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:12.854995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:12.891872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] MFA Rules not processed for user `3b6e2046e3bd40b3b46802dfa796260b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:12.895952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:12.998990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1993/3995] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:19.565937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4e92-f9ec-4083-9e31-3c00a057b586 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:19.566893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4e92-f9ec-4083-9e31-3c00a057b586 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:19.567304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4e92-f9ec-4083-9e31-3c00a057b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:19.588188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ecdd4e92-f9ec-4083-9e31-3c00a057b586 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:19.589690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ecdd4e92-f9ec-4083-9e31-3c00a057b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:19.680703 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2003/3996] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:02:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:19.694391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:19.697431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:19.796971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9d95b-7819-470e-9c17-4af9b3e45d15 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:19.803720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8ff9d-4230-45e5-a58f-9a470289f194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:19.806097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8ff9d-4230-45e5-a58f-9a470289f194 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:19.806097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8ff9d-4230-45e5-a58f-9a470289f194 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:19.806097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8ff9d-4230-45e5-a58f-9a470289f194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:19.825544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8ff9d-4230-45e5-a58f-9a470289f194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:19.829007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8ff9d-4230-45e5-a58f-9a470289f194 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:19.847338 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1994/3997] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:02:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:21.803047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:21.809041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:21.809041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:21.844032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:21.854985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] MFA Rules not processed for user `00e93a2f8ed643ba8bc92b4def1ce7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:21.856951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:21.987689 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2004/3998] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:22.000997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50347a-9ad5-40e3-9fd6-97b2d5c0d451 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:22.001447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50347a-9ad5-40e3-9fd6-97b2d5c0d451 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:22.002043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50347a-9ad5-40e3-9fd6-97b2d5c0d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:22.025891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9c50347a-9ad5-40e3-9fd6-97b2d5c0d451 None None] MFA Rules not processed for user `00e93a2f8ed643ba8bc92b4def1ce7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:22.027220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9c50347a-9ad5-40e3-9fd6-97b2d5c0d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:22.042003 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1995/3999] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:22.366397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:22.368658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:22.504583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71183d5b-f300-4ccf-82cb-95223b4cfef3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:22.518318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:22.519090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:22.519376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:22.521275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:22.538079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:22.540507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:22.576523 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2005/4000] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:30.275194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:30.276211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:30.277317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:30.299368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:30.307723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:30.311928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:30.414791 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1996/4001] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:31.065393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:31.069690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:31.208905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b75fb-a71d-4a0c-aea3-b09d66751def service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:31.212865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:31.213492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:31.213777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:31.214117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:31.220014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:31.358052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:31.420448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:31.429084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:31.460154 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2006/4002] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:33.008569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:33.010200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:33.117665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1210-d714-48bb-ad1d-da4885b37669 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:33.125880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:33.130702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:33.130702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:33.130702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:33.133604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:33.155474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:33.155474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:33.166910 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1997/4003] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:33.600457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:33.612848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe2ca5-dce8-45c2-b3e8-7157379673a4 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:33.619952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:33.621368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:33.623143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:33.623572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:33.628349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:33.654956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:33.658108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:33.671514 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2007/4004] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:40.995346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:40.997831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.015945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6a2ae-5248-4c7c-ba0b-eb4bf3b08375 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:41.020016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:41.020941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:41.021412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:41.022383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:41.025903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.043229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:41.045159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:41.059624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1998/4005] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:41.127348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:41.133519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.151873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:41.156112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.156873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc325-fbb8-4d1d-b40e-60ccabdbd6f9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:41.163294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:41.164142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:41.164562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:41.164843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] PATH_INFO: `/v3/users/448ccb88a71546c9b4bd1960e9c213b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:41.165999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448ccb88a71546c9b4bd1960e9c213b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:41.168313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:41.197140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cca518-c7c2-4793-a556-fd86af8e6030 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:41.214563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:41.216556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:41.217035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:41.217485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] PATH_INFO: `/v3/users/99ebe881ffd44893879bb9e7ab63c9fd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:41.220424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ebe881ffd44893879bb9e7ab63c9fd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:41.229602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:41.408769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448ccb88a71546c9b4bd1960e9c213b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.422868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448ccb88a71546c9b4bd1960e9c213b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.423871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448ccb88a71546c9b4bd1960e9c213b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.424678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448ccb88a71546c9b4bd1960e9c213b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.440482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9bbe8ac4-db8e-485f-808d-c5550208fbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448ccb88a71546c9b4bd1960e9c213b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.488980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ebe881ffd44893879bb9e7ab63c9fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.498246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ebe881ffd44893879bb9e7ab63c9fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.500055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ebe881ffd44893879bb9e7ab63c9fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.519185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ebe881ffd44893879bb9e7ab63c9fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.520328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce88f58e-903e-4049-a965-500409c01a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ebe881ffd44893879bb9e7ab63c9fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:41.552357 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2008/4006] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:41 2022] DELETE /identity/v3/users/448ccb88a71546c9b4bd1960e9c213b9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:41.554313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:41.555047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:41.555552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:41.583000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:41.589602 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 1999/4007] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:41 2022] DELETE /identity/v3/users/99ebe881ffd44893879bb9e7ab63c9fd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:41.591319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:41.591800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:41.592303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:41.614276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:41.615985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.706389 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2009/4008] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:02:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:41.722162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:41.724150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.808397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:41.842614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79983-00b5-4ad0-ac7d-1215f91290df None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:41.849277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:41.850223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:41.850698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:41.851173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:41.863955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:41.866796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:41.877283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2010/4009] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:02:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:02:41.901182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:41.901182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:41.982840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2000/4010] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:41.994483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:41.997232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:42.055291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:42.057791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:42.072076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b69cf-7a93-491a-967f-e98c5f965406 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:42.079895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:42.081040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.081788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.082569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] PATH_INFO: `/v3/projects/91b83e289c414e499c91fc7f711774b7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.084969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b83e289c414e499c91fc7f711774b7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:42.087918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:42.095499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595badb-3835-4b22-9560-77bc592b394b service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:42.103507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d122d6b-d89a-4838-b853-f2ec5c803c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:42.115826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d122d6b-d89a-4838-b853-f2ec5c803c25 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.115826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d122d6b-d89a-4838-b853-f2ec5c803c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.115826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d122d6b-d89a-4838-b853-f2ec5c803c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.137397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d122d6b-d89a-4838-b853-f2ec5c803c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:42.140267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d122d6b-d89a-4838-b853-f2ec5c803c25 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:42.153386 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2011/4011] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:42.234064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b83e289c414e499c91fc7f711774b7', 'request_id': 'req-03dc76f9-9d94-441b-be20-53704e6e8d2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:42.249698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b83e289c414e499c91fc7f711774b7', 'request_id': 'req-03dc76f9-9d94-441b-be20-53704e6e8d2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:42.260953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b83e289c414e499c91fc7f711774b7', 'request_id': 'req-03dc76f9-9d94-441b-be20-53704e6e8d2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:42.362928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] The token cache is being invalidate because project 91b83e289c414e499c91fc7f711774b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:42.363271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:42.363928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03dc76f9-9d94-441b-be20-53704e6e8d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:42.366195 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2001/4012] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:42 2022] DELETE /identity/v3/projects/91b83e289c414e499c91fc7f711774b7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:42.371300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.371668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.371950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.393538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:42.394551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:42.472329 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2012/4013] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:42.481723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.486417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.486417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.502504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:42.503752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:42.511884 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2002/4014] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:42.516144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:42.526140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe51c5e-aa65-4867-a315-c5d93ab85b00 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:42.531277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:42.532135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.532557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.532946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.533488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:42.533797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:42.535444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:42.547864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2013/4015] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:42.552248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:42.563566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90690b-6aab-4d0a-98c8-906748af3421 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:42.569676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:42.570239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.570696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.571237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.572060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:42.574391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:42.745874 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2003/4016] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:42 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:42.751906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:42.753274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:42.753774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:42.779306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411e3ea-f3eb-4af3-ad18-318ee352ddde admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:42.871641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29774af-03f3-4139-8e59-ec57932e9c9e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:42.873635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:42.874433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.874857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.875337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.876125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:42.878228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:42.922848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:42.923659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:42.924057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:42.924397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] PATH_INFO: `/v3/projects/9e57d652e04149709c4d6b3cb160d7e2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:42.925613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e57d652e04149709c4d6b3cb160d7e2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:42.927662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:43.044503 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2004/4017] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:42 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:43.048392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:43.061095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e777-2f89-4583-879f-fd786b9836a6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:43.071286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:43.072207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:43.072597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:43.072981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:43.073739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:43.075491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:43.089066 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2005/4018] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:43.093316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:43.111831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b65c61-6b5c-488f-9592-dd0a365b3d13 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:43.118738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:43.124277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e57d652e04149709c4d6b3cb160d7e2', 'request_id': 'req-e5c09460-10ea-4502-80ae-cc5717379475'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.134770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e57d652e04149709c4d6b3cb160d7e2', 'request_id': 'req-e5c09460-10ea-4502-80ae-cc5717379475'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.141879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e57d652e04149709c4d6b3cb160d7e2', 'request_id': 'req-e5c09460-10ea-4502-80ae-cc5717379475'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.199882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:43.200598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:43.200983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:43.201394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:43.203446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:43.205478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:43.219092 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2006/4019] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:02:43.221843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:43.241472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] The token cache is being invalidate because project 9e57d652e04149709c4d6b3cb160d7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:43.241793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.244213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.258963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe137e7-e20b-44bd-81b8-e12f42ca4f27 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:43.260306 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2014/4020] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:42 2022] DELETE /identity/v3/projects/9e57d652e04149709c4d6b3cb160d7e2 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:43.265968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:43.269063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:43.276004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3460f-0080-4983-b9ed-4c4845953c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:43.276953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3460f-0080-4983-b9ed-4c4845953c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:43.277343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3460f-0080-4983-b9ed-4c4845953c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:43.277891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3460f-0080-4983-b9ed-4c4845953c8c admin admin] PATH_INFO: `/v3/projects/f753981cf9264d27b16090d7499bf372/users/176b78609fe64a958eb12cddae83c0b9/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:43.306238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c09460-10ea-4502-80ae-cc5717379475 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:43.315586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3460f-0080-4983-b9ed-4c4845953c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f753981cf9264d27b16090d7499bf372, user_id=176b78609fe64a958eb12cddae83c0b9, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:43.319678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3460f-0080-4983-b9ed-4c4845953c8c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:43.325805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:43.325805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:43.325805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:43.325805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] PATH_INFO: `/v3/users/8b2ecb895e0e43599dc5b739c0ff570a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:43.326358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2ecb895e0e43599dc5b739c0ff570a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:43.327177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:43.346500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:43.394747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2007/4021] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:43 2022] PUT /identity/v3/projects/f753981cf9264d27b16090d7499bf372/users/176b78609fe64a958eb12cddae83c0b9/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:02:43.399988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:43.400423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:43.400805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:43.446503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:43.448801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:43.547583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2ecb895e0e43599dc5b739c0ff570a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.560185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2ecb895e0e43599dc5b739c0ff570a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.561161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2ecb895e0e43599dc5b739c0ff570a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.561794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2ecb895e0e43599dc5b739c0ff570a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.571937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2008/4022] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:43.581611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:43.582621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:43.586994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2ecb895e0e43599dc5b739c0ff570a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:43.675509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621215b1-5fbe-4453-bcd6-75645e531e61 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:43.687219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:43.687960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:43.688255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:43.692326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:43.692326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:43.704579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2015/4023] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:43 2022] DELETE /identity/v3/users/8b2ecb895e0e43599dc5b739c0ff570a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:43.718230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:43.722105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d384ca2-7968-4cb8-9a7e-4d81fa60d6b7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:43.737184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2009/4024] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:02:44.364076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:44.365573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:44.417121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:44.417660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:44.417660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:44.470132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:44.471551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:44.570470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7f63-f4ad-48b9-ae3b-e6604e6e6d26 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:44.579545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:44.585184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:44.585724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:44.586286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] PATH_INFO: `/v3/projects/cead502ec10246d5b173f76d7a370f75` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:44.588013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cead502ec10246d5b173f76d7a370f75)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:44.591949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:44.593404 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2010/4025] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:44.614548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:44.634966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:44.637471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:44.731034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d16f-7624-4392-8681-bb84b427a973 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:44.736504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47929bb-800b-4b38-878d-e51f2c45ca99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:44.736852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47929bb-800b-4b38-878d-e51f2c45ca99 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:44.737132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47929bb-800b-4b38-878d-e51f2c45ca99 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:44.737404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47929bb-800b-4b38-878d-e51f2c45ca99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:44.746264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47929bb-800b-4b38-878d-e51f2c45ca99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:44.747879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47929bb-800b-4b38-878d-e51f2c45ca99 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:44.756768 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2011/4026] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:02:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:02:44.780626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cead502ec10246d5b173f76d7a370f75', 'request_id': 'req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:44.786028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cead502ec10246d5b173f76d7a370f75', 'request_id': 'req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:44.792296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cead502ec10246d5b173f76d7a370f75', 'request_id': 'req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:44.963533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] The token cache is being invalidate because project cead502ec10246d5b173f76d7a370f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:44.963878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:44.965044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39bd10fd-e6e7-4ce6-80a4-74947ad44ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:44.975172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:44.975463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:44.975796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:44.977051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2016/4027] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:44 2022] DELETE /identity/v3/projects/cead502ec10246d5b173f76d7a370f75 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:44.998015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:44.999377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:45.074896 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2012/4028] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:45.086683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.087031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.090408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.117704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:45.119851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:45.130393 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2017/4029] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:45.135699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:45.153549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64986a5-4051-4bc1-b342-2e084f9bbf09 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:45.162885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:45.163745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.164516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.165073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.166017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:45.167636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:45.169505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:45.189632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2013/4030] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:45.192979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:45.203054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82402-4f4e-4cc5-906e-c8f18650be47 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:45.218997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:45.220325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.221068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.222831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.223479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:45.227413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:45.318755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:45.325002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2018/4031] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:45 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:45.328927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:45.342576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496767d0-d309-4ecd-8b49-a6e50a982c3b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:45.410881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:45.411531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.411813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.412703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.413406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:45.415339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:45.545592 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2014/4032] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:45 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:45.550069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:45.562982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d5ca-1d7e-4097-8ffb-74a9cc895a93 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:45.569077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:45.569710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.570020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.570482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.571949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:45.574051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:45.588166 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2019/4033] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:45.592310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:45.606037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af87b-e289-4003-9970-b303d5bdddab admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:45.616532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f15b1-0a06-4bc4-abfd-c908a57e1f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:45.617143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f15b1-0a06-4bc4-abfd-c908a57e1f4e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.617430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f15b1-0a06-4bc4-abfd-c908a57e1f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.618723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f15b1-0a06-4bc4-abfd-c908a57e1f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.618723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f15b1-0a06-4bc4-abfd-c908a57e1f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:45.620041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f15b1-0a06-4bc4-abfd-c908a57e1f4e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:45.630821 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2015/4034] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:45.635268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:45.657693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34de7e-18cd-4ed0-8368-ac2aee4e6aa1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:45.676377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc306d-c55a-49fd-8dbd-4d895743be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:45.677314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc306d-c55a-49fd-8dbd-4d895743be39 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.677629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc306d-c55a-49fd-8dbd-4d895743be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.678067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc306d-c55a-49fd-8dbd-4d895743be39 admin admin] PATH_INFO: `/v3/projects/0906e15648684dc48826b6957c71ce69/users/89a5a6aa44c04bf1a73e2cef433ff796/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.715957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc306d-c55a-49fd-8dbd-4d895743be39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0906e15648684dc48826b6957c71ce69, user_id=89a5a6aa44c04bf1a73e2cef433ff796, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:45.718574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc306d-c55a-49fd-8dbd-4d895743be39 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:45.829536 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2020/4035] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:45 2022] PUT /identity/v3/projects/0906e15648684dc48826b6957c71ce69/users/89a5a6aa44c04bf1a73e2cef433ff796/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:45.843917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.844451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.844827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.873066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:45.873635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:45.874747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:45.922494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] MFA Rules not processed for user `89a5a6aa44c04bf1a73e2cef433ff796`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:45.924189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:45.929812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:45.931896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:46.012411 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2021/4036] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:46.026767 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2016/4037] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:46.030308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:46.031427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:46.031725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:46.119000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3b94b-3bee-4af5-aae1-c50d59ac3e30 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:46.126656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:46.129735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:46.129873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422bcf2-1051-49ac-b279-319e586d8179 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:46.130342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:46.130813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:46.131758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:46.135423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:46.136054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:46.136679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:46.136968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:46.137248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:46.146012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:46.147698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:46.156321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:46.160497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2022/4038] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:02:46.326483 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2017/4039] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:46 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:46.331700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:46.348240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e29e-3650-4ef5-a06b-8a3ac38bec68 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:46.457885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:46.457885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:46.457885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:46.457885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:46.458247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:46.460942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:46.607053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:46.608094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2023/4040] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:46 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:46.621153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb38f6-1e21-486f-8e86-2d4a41135a5b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:46.634459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:46.635404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:46.635686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:46.635965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:46.636616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:46.638337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:46.650601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2018/4041] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:02:46.654831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:46.660589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:46.670907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353320f-329d-4faa-a3b1-98f87cd37f3b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:46.677225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:46.678262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:46.678741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:46.680313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] PATH_INFO: `/v3/projects/8d3cef548d7340d9a974801198e7a2f5/users/2c85fe7cc70e46dd9141122ca81bc26b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:46.732433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cef548d7340d9a974801198e7a2f5, user_id=2c85fe7cc70e46dd9141122ca81bc26b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:46.736173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:46.794081 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2024/4042] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:46 2022] PUT /identity/v3/projects/8d3cef548d7340d9a974801198e7a2f5/users/2c85fe7cc70e46dd9141122ca81bc26b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:46.797615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:46.812384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc9a2-f693-49cf-a056-859a66315100 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:46.977932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861dab2-fb41-48cb-8934-17f0f695d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:46.978657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861dab2-fb41-48cb-8934-17f0f695d22f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:46.985272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861dab2-fb41-48cb-8934-17f0f695d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:46.985272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861dab2-fb41-48cb-8934-17f0f695d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:46.985272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861dab2-fb41-48cb-8934-17f0f695d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:46.985272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861dab2-fb41-48cb-8934-17f0f695d22f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:47.034558 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2019/4043] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:47.038615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:47.055236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28117-0b52-4697-a312-180b3445fd0e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:47.068036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:47.069378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:47.075478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:47.075478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] PATH_INFO: `/v3/projects/8d3cef548d7340d9a974801198e7a2f5/users/2c85fe7cc70e46dd9141122ca81bc26b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:47.082471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3cef548d7340d9a974801198e7a2f5, user_id=2c85fe7cc70e46dd9141122ca81bc26b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:47.086230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:47.114481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2025/4044] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:47 2022] PUT /identity/v3/projects/8d3cef548d7340d9a974801198e7a2f5/users/2c85fe7cc70e46dd9141122ca81bc26b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:47.117043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:47.117564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:47.118058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:47.170769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] MFA Rules not processed for user `2c85fe7cc70e46dd9141122ca81bc26b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:47.172835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:47.318969 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2020/4045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:47.328544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:47.330661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:47.457889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a41fec-8e0d-4d6e-99de-7829424571e3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:47.463583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:47.475717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:47.483742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:47.488086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:47.488086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:47.528130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:47.529868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:47.546373 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2026/4046] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:47.735107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:47.737082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:47.855857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664918-659e-4411-a1ac-1ac339209b57 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:47.867160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:47.867853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:47.868145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:47.868417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] PATH_INFO: `/v3/users/e19903666a1243e3a66411e30babe299` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:47.869953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19903666a1243e3a66411e30babe299)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:47.872218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:48.082750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19903666a1243e3a66411e30babe299'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:48.098884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19903666a1243e3a66411e30babe299'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:48.104446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19903666a1243e3a66411e30babe299'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:48.130125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19903666a1243e3a66411e30babe299'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:48.137971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19903666a1243e3a66411e30babe299'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:48.257671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2021/4047] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:47 2022] DELETE /identity/v3/users/e19903666a1243e3a66411e30babe299 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:48.853358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:48.866749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b1464-9475-493d-a480-176c92a06f81 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:48.870007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:48.872488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:48.939540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c85fe7cc70e46dd9141122ca81bc26b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d3cef548d7340d9a974801198e7a2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:48.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:48.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:48.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:48.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:48.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:48.952232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:48.975879 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2027/4048] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:48.980743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:48.983793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:48.998457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:49.016482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00338d2-3b0c-4638-a7f5-3b93310c2b81 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:49.030239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c85fe7cc70e46dd9141122ca81bc26b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d3cef548d7340d9a974801198e7a2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:49.030875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.031526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.031887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.032558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:49.040068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:49.054529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc166a-fb29-46e1-b8bd-310217ecef5f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:49.069543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:49.070213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.070528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.072242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] PATH_INFO: `/v3/projects/4061aad7f45b4c6192c02f3179d13687` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.074385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4061aad7f45b4c6192c02f3179d13687)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:49.077351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:49.203450 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2028/4049] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:48 2022] POST /identity/v3/projects => generated 355 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:49.205125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:49.291096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee2d11-9598-4ec4-bb56-3f5a4afff784 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:49.299989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c85fe7cc70e46dd9141122ca81bc26b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d3cef548d7340d9a974801198e7a2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:49.299989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.299989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.300336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.300614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:49.301018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:49.303516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:49.319339 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2029/4050] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:49.327893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:49.352659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4061aad7f45b4c6192c02f3179d13687', 'request_id': 'req-48288a01-57c9-4f5a-86f8-16e5e45e73ca'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.375859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4061aad7f45b4c6192c02f3179d13687', 'request_id': 'req-48288a01-57c9-4f5a-86f8-16e5e45e73ca'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.388671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4061aad7f45b4c6192c02f3179d13687', 'request_id': 'req-48288a01-57c9-4f5a-86f8-16e5e45e73ca'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.407583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:49.418933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b8d49-933b-481f-97c9-41e7a81ac798 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:49.514138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c85fe7cc70e46dd9141122ca81bc26b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d3cef548d7340d9a974801198e7a2f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:49.514775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.515610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.515893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] PATH_INFO: `/v3/projects/8b84df58eed946179779d2e985ca20f3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.517208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b84df58eed946179779d2e985ca20f3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:49.519813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:49.530758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] The token cache is being invalidate because project 4061aad7f45b4c6192c02f3179d13687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:49.531183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.532486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-48288a01-57c9-4f5a-86f8-16e5e45e73ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.540279 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2022/4051] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:48 2022] DELETE /identity/v3/projects/4061aad7f45b4c6192c02f3179d13687 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:49.542623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e637-620d-4d00-990d-716412a3d5db None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.542919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e637-620d-4d00-990d-716412a3d5db None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.543370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e637-620d-4d00-990d-716412a3d5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.577800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3a55e637-620d-4d00-990d-716412a3d5db None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:49.577800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a55e637-620d-4d00-990d-716412a3d5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:49.661155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2023/4052] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:49.663137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.663464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.663742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.691252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:49.692760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:49.700386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b84df58eed946179779d2e985ca20f3', 'request_id': 'req-10fe2615-4bfc-449a-a669-837e1df4f1b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.718742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b84df58eed946179779d2e985ca20f3', 'request_id': 'req-10fe2615-4bfc-449a-a669-837e1df4f1b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.736671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b84df58eed946179779d2e985ca20f3', 'request_id': 'req-10fe2615-4bfc-449a-a669-837e1df4f1b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.772756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2024/4053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:49.777489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:49.806639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89c95-473e-4c21-87a6-8069bbd46ff5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:49.819607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] The token cache is being invalidate because project 8b84df58eed946179779d2e985ca20f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:49.819927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.820932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:49.821639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.829380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.829380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.830048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:49.830048 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2030/4054] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:49 2022] DELETE /identity/v3/projects/8b84df58eed946179779d2e985ca20f3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:02:49.830250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:49.830250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:49.830250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:49.861417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2025/4055] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:49.862419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:49.865871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:49.895906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe2615-4bfc-449a-a669-837e1df4f1b2 tempest-VolumeQuotaClassesTest-153770565 tempest-VolumeQuotaClassesTest-153770565-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:49.910401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:49.910983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:49.911339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:49.911561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:49.912819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:49.914644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.069769 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2031/4056] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:49 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:50.074465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:50.085513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e44c20-2e76-42e0-b190-7ed2d4f341b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:50.209995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:50.210632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.211084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.211366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.212191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:50.214176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.366189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2026/4057] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:50 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:50.370396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:50.383243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b488-3773-4989-ba1c-e2a6f5d7e981 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:50.392411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:50.393525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.394089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.394603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.397333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:50.400373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.414181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2032/4058] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:50.418520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:50.431130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3f20-c1f1-40ed-8985-7ff7a306364f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:50.437722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bce2b0-c32d-4624-8862-398a531a133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:50.438351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bce2b0-c32d-4624-8862-398a531a133b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.438633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bce2b0-c32d-4624-8862-398a531a133b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.438908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bce2b0-c32d-4624-8862-398a531a133b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.439750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bce2b0-c32d-4624-8862-398a531a133b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:50.441478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bce2b0-c32d-4624-8862-398a531a133b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.461190 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2027/4059] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:50.466197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:50.485321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20a25-4de8-445d-b59a-1ff423efaffe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:50.490867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:50.491640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.491922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.492203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] PATH_INFO: `/v3/projects/fa79011a2d334f1c939a773e393c0822/users/a9d2c87b521a4478b9ca8cab2c35362e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.512004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa79011a2d334f1c939a773e393c0822, user_id=a9d2c87b521a4478b9ca8cab2c35362e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:50.522619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.614133 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2033/4060] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:50 2022] PUT /identity/v3/projects/fa79011a2d334f1c939a773e393c0822/users/a9d2c87b521a4478b9ca8cab2c35362e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:50.627715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.628005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.628289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.662509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:50.663842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:50.738293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:50.739962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:50.763418 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2028/4061] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:50.774397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:50.782506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:50.854940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8600c-cb58-4a03-80b1-0575c310874b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:50.878428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:50.880484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.883174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.883667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] PATH_INFO: `/v3/users/89a5a6aa44c04bf1a73e2cef433ff796` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.888294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a5a6aa44c04bf1a73e2cef433ff796)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:50.901284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.922933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae356-732b-40d4-99b4-bae6158ebc40 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:50.936094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc1d6-a146-4651-82df-6e814bb62f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:50.936812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc1d6-a146-4651-82df-6e814bb62f68 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:50.937096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc1d6-a146-4651-82df-6e814bb62f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:50.937388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc1d6-a146-4651-82df-6e814bb62f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:50.954246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:50.959790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc1d6-a146-4651-82df-6e814bb62f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:50.960729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc1d6-a146-4651-82df-6e814bb62f68 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:50.976591 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2029/4062] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:02:51.279240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a5a6aa44c04bf1a73e2cef433ff796'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:51.293808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a5a6aa44c04bf1a73e2cef433ff796'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:51.294761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a5a6aa44c04bf1a73e2cef433ff796'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:51.297055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a5a6aa44c04bf1a73e2cef433ff796'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:51.318119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a5a6aa44c04bf1a73e2cef433ff796'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:51.353526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:51.418118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2034/4063] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:50 2022] DELETE /identity/v3/users/89a5a6aa44c04bf1a73e2cef433ff796 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:51.422608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1748a-eb96-4279-9ae6-a4d81c4dd2a9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:51.423041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1748a-eb96-4279-9ae6-a4d81c4dd2a9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:51.423477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1748a-eb96-4279-9ae6-a4d81c4dd2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:51.447334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cbc1748a-eb96-4279-9ae6-a4d81c4dd2a9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:51.448510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cbc1748a-eb96-4279-9ae6-a4d81c4dd2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:51.575073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2030/4064] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:51.589068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:51.590614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:51.765213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da188728-e758-4021-88e6-96219f16bca9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:51.769233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be200281-9715-461a-b380-4f06831782bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:51.770140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200281-9715-461a-b380-4f06831782bf service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:51.770433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200281-9715-461a-b380-4f06831782bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:51.770711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be200281-9715-461a-b380-4f06831782bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:51.785585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200281-9715-461a-b380-4f06831782bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:51.804552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be200281-9715-461a-b380-4f06831782bf service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:51.832383 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2035/4065] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:51.920012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d294db-6882-4358-a9e4-1d3048dbf0b0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:51.920395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d294db-6882-4358-a9e4-1d3048dbf0b0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:51.920744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d294db-6882-4358-a9e4-1d3048dbf0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:51.981732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-65d294db-6882-4358-a9e4-1d3048dbf0b0 None None] MFA Rules not processed for user `a9d2c87b521a4478b9ca8cab2c35362e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:51.982722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65d294db-6882-4358-a9e4-1d3048dbf0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:52.072524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.073000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.073095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.141574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2031/4066] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:52.143352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.143835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.144319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.151690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] MFA Rules not processed for user `176b78609fe64a958eb12cddae83c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:52.162149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:52.179030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] MFA Rules not processed for user `a9d2c87b521a4478b9ca8cab2c35362e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:52.180292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:52.199219 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2032/4067] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:52.205711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.207912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:52.286387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2036/4068] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:52.287720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.289722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:52.310061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a494-6f1e-4044-9d66-1cc67984a4f3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:52.319224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:52.319448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c912f30-d9f3-437b-a505-80562e193625 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:52.319915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.320254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.320535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.321869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:52.324756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:52.325803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:52.326517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.326878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.327354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.339943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:52.341729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:52.364015 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2033/4069] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:02:52.491459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2037/4070] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:52 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:52.491898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.505248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966c56-6541-46aa-a863-ecf1e0ebabef service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:52.578015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:52.578015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.578015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.578015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.578887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:52.580863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:52.662263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.674293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:52.695968 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2034/4071] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:52 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:52.695968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.696558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3067-554c-4eb6-b6b8-785c8e338941 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:52.705327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467ea7a-7407-4666-96a4-cc096ba73e2a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:52.706350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:52.709206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.709498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.709920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] PATH_INFO: `/v3/projects/0906e15648684dc48826b6957c71ce69` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.710361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:52.711196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0906e15648684dc48826b6957c71ce69)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:52.711312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.711693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.712024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.712671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:52.713136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:52.714354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:52.739717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2035/4072] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:52.748419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.755079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dbacc-c1ec-4b1d-9d4f-5b9f0c8a733d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:52.772147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:52.773066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:52.774919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:52.774919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] PATH_INFO: `/v3/projects/403d1c06f29f4076ab6e9a2156a3ccff/users/9657b4e5915d4efaadc6c6e563f2e5b9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:52.806195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] RBAC: Authorizing `identity:create_grant(project_id=403d1c06f29f4076ab6e9a2156a3ccff, user_id=9657b4e5915d4efaadc6c6e563f2e5b9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:52.809527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:52.921122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2036/4073] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:52 2022] PUT /identity/v3/projects/403d1c06f29f4076ab6e9a2156a3ccff/users/9657b4e5915d4efaadc6c6e563f2e5b9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:52.924996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:52.937207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0906e15648684dc48826b6957c71ce69', 'request_id': 'req-27166b01-3b59-4890-873e-7e1f606488b3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:52.948497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0906e15648684dc48826b6957c71ce69', 'request_id': 'req-27166b01-3b59-4890-873e-7e1f606488b3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:52.957920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0906e15648684dc48826b6957c71ce69', 'request_id': 'req-27166b01-3b59-4890-873e-7e1f606488b3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.024372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9ab43-807f-40f0-ad89-061fe5f527db admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:53.050637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] The token cache is being invalidate because project 0906e15648684dc48826b6957c71ce69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:53.050637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.050637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.052950 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2038/4074] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:52 2022] DELETE /identity/v3/projects/0906e15648684dc48826b6957c71ce69 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:53.056624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:53.058688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:53.122592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:53.123257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:53.123547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:53.124039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:53.124855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:53.137312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:53.159468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166b01-3b59-4890-873e-7e1f606488b3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:53.165868 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2037/4075] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:02:53.168934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:53.171210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:53.171537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:53.171537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:53.171537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] PATH_INFO: `/v3/users/2c85fe7cc70e46dd9141122ca81bc26b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:53.171997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c85fe7cc70e46dd9141122ca81bc26b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:53.174015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:53.174595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:53.200845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200888-5a25-4954-b26b-3e2f22ca780f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:53.215106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882a13-981d-4764-ab48-991239d0d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:53.221743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882a13-981d-4764-ab48-991239d0d7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:53.221743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882a13-981d-4764-ab48-991239d0d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:53.221743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882a13-981d-4764-ab48-991239d0d7e5 admin admin] PATH_INFO: `/v3/projects/403d1c06f29f4076ab6e9a2156a3ccff/users/9657b4e5915d4efaadc6c6e563f2e5b9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:53.221743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882a13-981d-4764-ab48-991239d0d7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403d1c06f29f4076ab6e9a2156a3ccff, user_id=9657b4e5915d4efaadc6c6e563f2e5b9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:53.222112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882a13-981d-4764-ab48-991239d0d7e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:53.242371 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2038/4076] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:53 2022] PUT /identity/v3/projects/403d1c06f29f4076ab6e9a2156a3ccff/users/9657b4e5915d4efaadc6c6e563f2e5b9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:53.322442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:53.405335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c85fe7cc70e46dd9141122ca81bc26b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.415919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c85fe7cc70e46dd9141122ca81bc26b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.416682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c85fe7cc70e46dd9141122ca81bc26b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.417308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c85fe7cc70e46dd9141122ca81bc26b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.434877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c85fe7cc70e46dd9141122ca81bc26b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:53.537903 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2039/4077] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:53 2022] DELETE /identity/v3/users/2c85fe7cc70e46dd9141122ca81bc26b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:53.558656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:54.175732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:54.176471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:54.177836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:54.211088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] MFA Rules not processed for user `9e84745e5df647d1921e8d1ffc08711c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:54.212574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:54.304285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:54.306479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:54.317420 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2039/4078] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:54.439805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750a3f8-fe04-4859-afaf-56bf1aa5f80b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:54.445006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:54.445667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:54.445950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:54.446229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] PATH_INFO: `/v3/projects/8d3cef548d7340d9a974801198e7a2f5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:54.447826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3cef548d7340d9a974801198e7a2f5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:54.449746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:54.522599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:54.524422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:54.554053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1542c-759f-4708-8457-a6350ce43684 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:54.556584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:54.557299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:54.557588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:54.557974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] PATH_INFO: `/v3/users/a9d2c87b521a4478b9ca8cab2c35362e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:54.559234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d2c87b521a4478b9ca8cab2c35362e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:54.561498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:54.622820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3cef548d7340d9a974801198e7a2f5', 'request_id': 'req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.634620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3cef548d7340d9a974801198e7a2f5', 'request_id': 'req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.643749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3cef548d7340d9a974801198e7a2f5', 'request_id': 'req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.758594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:54.769426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] The token cache is being invalidate because project 8d3cef548d7340d9a974801198e7a2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:54.770254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.772744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-78f64ad2-9c4f-423f-8c0a-4acc5a40da7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.774840 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2040/4079] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:54 2022] DELETE /identity/v3/projects/8d3cef548d7340d9a974801198e7a2f5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:54.780940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887383ac-8a3e-42d6-88f6-2ad47407f040 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:54.781511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887383ac-8a3e-42d6-88f6-2ad47407f040 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:54.781961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887383ac-8a3e-42d6-88f6-2ad47407f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:54.812219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-887383ac-8a3e-42d6-88f6-2ad47407f040 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:54.813266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-887383ac-8a3e-42d6-88f6-2ad47407f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:54.855627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d2c87b521a4478b9ca8cab2c35362e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.867726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d2c87b521a4478b9ca8cab2c35362e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.868520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d2c87b521a4478b9ca8cab2c35362e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.887497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d2c87b521a4478b9ca8cab2c35362e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.887497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d2c87b521a4478b9ca8cab2c35362e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:54.929114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2041/4080] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:54.936989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:54.937545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:54.938163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:54.960431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:54.961661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:54.970588 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2042/4081] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:54.976841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:54.986987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20866-6150-4911-a359-6277f0e12744 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:54.992802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:54.996942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:54.996942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:54.996942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:54.996942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:54.996942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.000351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.016592 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2043/4082] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:02:55.021053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:55.034719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c81262-2b15-48d4-809d-2d3d6864ddb9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:55.042352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:55.042953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.043310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.043570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.044202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.045333 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2040/4083] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:54 2022] DELETE /identity/v3/users/a9d2c87b521a4478b9ca8cab2c35362e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:02:55.046316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.167317 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2044/4084] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:55 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:55.172329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:55.290737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562bb5-2ebe-4209-ab48-8da893b78206 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:55.438705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:55.443566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:55.443566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.443566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.443566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.445286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.449967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.600693 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2041/4085] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:55 2022] POST /identity/v3/users => generated 295 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:55.602778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:55.614024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6690-f2b9-414f-a88c-b3018d22a767 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:55.624333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:55.625136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.625486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.626023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.626880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.629229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.644927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:55.647214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:55.669853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2045/4086] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:55.671108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:55.683432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb688add-7135-4d95-9702-348d1af361d8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:55.697131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:55.697790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.698056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcc1f8-b068-47c6-8b97-83ed893b7b30 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:55.699044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.700301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] PATH_INFO: `/v3/projects/fa79011a2d334f1c939a773e393c0822` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.708223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:55.708883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.709167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.709440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.710524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.712431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.721902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa79011a2d334f1c939a773e393c0822)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.725667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.729075 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2046/4087] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:55.732808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:55.746429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78848e56-1ac8-4587-aa09-ca39f54b1238 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:55.753442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8b54-cd49-4dc6-9642-75b006bcb904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:55.754427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8b54-cd49-4dc6-9642-75b006bcb904 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.754972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8b54-cd49-4dc6-9642-75b006bcb904 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.756171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8b54-cd49-4dc6-9642-75b006bcb904 admin admin] PATH_INFO: `/v3/projects/17e6e326e30146d7af2b7fe3227d55e8/users/834fa238c17f46449af017bb9421112b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.782398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8b54-cd49-4dc6-9642-75b006bcb904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6e326e30146d7af2b7fe3227d55e8, user_id=834fa238c17f46449af017bb9421112b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:55.785676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8b54-cd49-4dc6-9642-75b006bcb904 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:55.892136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:55.901088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2047/4088] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:55 2022] PUT /identity/v3/projects/17e6e326e30146d7af2b7fe3227d55e8/users/834fa238c17f46449af017bb9421112b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:55.902643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8c3c2-5182-4dbd-874b-e6174b42ca0e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:55.902939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8c3c2-5182-4dbd-874b-e6174b42ca0e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:55.903878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8c3c2-5182-4dbd-874b-e6174b42ca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:55.929588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa79011a2d334f1c939a773e393c0822', 'request_id': 'req-c289e89e-19ab-47cb-84b7-4d7454dd7732'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:55.956009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa79011a2d334f1c939a773e393c0822', 'request_id': 'req-c289e89e-19ab-47cb-84b7-4d7454dd7732'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:55.974908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2eb8c3c2-5182-4dbd-874b-e6174b42ca0e None None] MFA Rules not processed for user `834fa238c17f46449af017bb9421112b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:55.977664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2eb8c3c2-5182-4dbd-874b-e6174b42ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:55.979972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa79011a2d334f1c939a773e393c0822', 'request_id': 'req-c289e89e-19ab-47cb-84b7-4d7454dd7732'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:56.104399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2048/4089] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:56.105909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7df300-1350-412d-8e16-8808a3d5cd26 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.106096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7df300-1350-412d-8e16-8808a3d5cd26 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.106349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7df300-1350-412d-8e16-8808a3d5cd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.128268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1d7df300-1350-412d-8e16-8808a3d5cd26 None None] MFA Rules not processed for user `f16abbf8a68344b68444ff8fc2795c67`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:56.130010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1d7df300-1350-412d-8e16-8808a3d5cd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:56.151985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] The token cache is being invalidate because project fa79011a2d334f1c939a773e393c0822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:02:56.152296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:56.154351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:56.160412 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2042/4090] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:02:55 2022] DELETE /identity/v3/projects/fa79011a2d334f1c939a773e393c0822 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:56.160412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.162133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:56.258872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2049/4091] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:56.258872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7bdea-034c-4112-9895-550b7745b8a2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.258872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7bdea-034c-4112-9895-550b7745b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.258872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7bdea-034c-4112-9895-550b7745b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.302716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289e89e-19ab-47cb-84b7-4d7454dd7732 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.311287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7db7bdea-034c-4112-9895-550b7745b8a2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:56.314578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7db7bdea-034c-4112-9895-550b7745b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:56.316890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.317524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.318405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.318683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.319479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.323233 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2050/4092] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:56.323721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.334296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.337416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.337416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.362812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:56.364217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:56.375483 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2051/4093] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:56.387083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.393755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01caf4d-aa52-4c1e-a2b6-6274eefe8485 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.398815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.399594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.399980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.400406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.401603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:02:56.402246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.404029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.421317 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2052/4094] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:02:56.423118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.436519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ad836-c1da-4239-9a61-03eed7877743 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.445643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.446237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.446538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.446814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.447625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.449608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.475514 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2043/4095] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/projects => generated 389 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:56.479850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.564719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b4b2-9c6e-4490-bbe4-ec1e8ac28843 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.571540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.572220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.572466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.572827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.573395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.576293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.600062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2053/4096] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:56.606463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.765228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2044/4097] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/users => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:56.769347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.790908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf93c60-4d72-4c33-884e-8f0829b9b4f4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.803598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f75fa7-dc3f-4f34-93d5-abc34f07f78e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.814836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.820353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.822350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.823179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.823576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.825506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.825670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.827625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.828000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.828756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.830733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.832529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.857795 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2045/4098] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:56.861327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:56.872927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be8595-6a61-4ebd-b59b-1652599bc0c7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:56.878766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:56.879667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:56.880032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:56.881615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] PATH_INFO: `/v3/projects/9a9fbbb08440465ea639131a809f179c/users/3a587a230f8c4181a2b8a338d63bc29b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:56.902724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9fbbb08440465ea639131a809f179c, user_id=3a587a230f8c4181a2b8a338d63bc29b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:56.906490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:56.991359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2054/4099] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:56 2022] POST /identity/v3/users => generated 295 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:56.992863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:57.004648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2046/4100] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:56 2022] PUT /identity/v3/projects/9a9fbbb08440465ea639131a809f179c/users/3a587a230f8c4181a2b8a338d63bc29b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:57.009756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:57.036494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c43b40-4089-4198-920b-2c4e78338ba6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:57.221147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6e3c1-64fd-4045-95bb-ab0d2bfbaba2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:57.231962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:57.232592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.232876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.233149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.233793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:57.235437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:57.242438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:57.242438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.242438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.242438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.243745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:57.243745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:57.269778 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2055/4101] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:57.272090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:57.280306 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2047/4102] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:57.283266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:57.293079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634f237-06a0-4439-adc9-451014617603 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:57.312639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:57.313262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.313590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.313864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.315635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:57.319807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:57.323184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec65f-6505-4803-ae29-26daaf677ef4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:57.340163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ec5cc-24ff-4cf4-909c-0e7bc3d8c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:57.340163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec5cc-24ff-4cf4-909c-0e7bc3d8c266 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.340163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec5cc-24ff-4cf4-909c-0e7bc3d8c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.340163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec5cc-24ff-4cf4-909c-0e7bc3d8c266 admin admin] PATH_INFO: `/v3/projects/9a9fbbb08440465ea639131a809f179c/users/3a587a230f8c4181a2b8a338d63bc29b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.343076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ec5cc-24ff-4cf4-909c-0e7bc3d8c266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9fbbb08440465ea639131a809f179c, user_id=3a587a230f8c4181a2b8a338d63bc29b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:57.349650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ec5cc-24ff-4cf4-909c-0e7bc3d8c266 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:57.373779 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2056/4103] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:57.375766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:57.387620 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2048/4104] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:57 2022] PUT /identity/v3/projects/9a9fbbb08440465ea639131a809f179c/users/3a587a230f8c4181a2b8a338d63bc29b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:57.403096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.403666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.404180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.416284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951d96-5f54-42e9-86fc-137ced3753ef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:57.467581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] MFA Rules not processed for user `3a587a230f8c4181a2b8a338d63bc29b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:57.469265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:57.609337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0acc42-f515-4bdb-98c5-3521c523436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:57.611422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acc42-f515-4bdb-98c5-3521c523436e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.611422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acc42-f515-4bdb-98c5-3521c523436e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.611822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acc42-f515-4bdb-98c5-3521c523436e admin admin] PATH_INFO: `/v3/projects/4de0c4c1ac084bc98cfeedd69ebd8fe1/users/59b7705d83dc40a3aa1513e89b8f17b5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.634405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2049/4105] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:02:57.645537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0acc42-f515-4bdb-98c5-3521c523436e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de0c4c1ac084bc98cfeedd69ebd8fe1, user_id=59b7705d83dc40a3aa1513e89b8f17b5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:57.649942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0acc42-f515-4bdb-98c5-3521c523436e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:57.653696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:57.659482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:57.814531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2057/4106] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:57 2022] PUT /identity/v3/projects/4de0c4c1ac084bc98cfeedd69ebd8fe1/users/59b7705d83dc40a3aa1513e89b8f17b5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:57.836300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:57.836683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:57.837061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:57.903056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:57.913393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db9718-e23e-4c88-a6d1-2a478a477783 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:57.970465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] MFA Rules not processed for user `59b7705d83dc40a3aa1513e89b8f17b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:57.990179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:58.065599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:58.067448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:58.068417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:58.068916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:58.169305 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2058/4107] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:58.179244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:58.231500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:58.236431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:58.274891 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2050/4108] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:58.356680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5553ab6-bca0-42c7-9d1b-63ba3274ddfe None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:58.365928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:58.366586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:58.366910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:58.367841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:58.374307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:58.374307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:58.374867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:02:58.443680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:58.454918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72012-7d0c-47e3-a986-d44d8608ddb5 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:58.460115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:58.460822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:58.461112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:58.461393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] PATH_INFO: `/v3/users/834fa238c17f46449af017bb9421112b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:58.462554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834fa238c17f46449af017bb9421112b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:58.464686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:58.532993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2059/4109] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:02:58 2022] POST /identity/v3/projects => generated 389 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:58.544029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:58.622390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643e542-8256-4ad6-96bd-92494cde35c1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:58.652736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:58.652736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:58.652736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:58.652736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:58.653055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:58.653055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:58.753594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834fa238c17f46449af017bb9421112b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:58.769310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2060/4110] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:02:58 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:02:58.771296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834fa238c17f46449af017bb9421112b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:58.773234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:58.774500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834fa238c17f46449af017bb9421112b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:58.775848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:58.807520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834fa238c17f46449af017bb9421112b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:58.810557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-959ceaff-8d5c-4fc2-8dd2-8d2854d7c9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834fa238c17f46449af017bb9421112b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:02:58.815763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44202-d36f-47ed-a105-2f6c71a6be78 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:58.831472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:58.840076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:58.840076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:58.840076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:58.840076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:58.843946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:58.875449 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2061/4111] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:58.876216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:58.920179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422f59-aab2-45c2-8960-200b6292b9bc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:58.921663 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2051/4112] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:02:58 2022] DELETE /identity/v3/users/834fa238c17f46449af017bb9421112b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:02:58.926121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:58.926442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:58.926751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:58.990279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:58.991775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:59.051765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:59.054267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.054679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.055056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] PATH_INFO: `/v3/projects/1b4e909b83314539a2236213569d93e6/users/f9e62e5e2f36401683a62ed03be380da/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.082624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4e909b83314539a2236213569d93e6, user_id=f9e62e5e2f36401683a62ed03be380da, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:59.105782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:59.154783 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2052/4113] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:59.172260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:59.173961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:59.266530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1e52a-d669-41af-9d16-47407f813ee5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:59.272257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:59.273187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.273477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.273750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.295352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2062/4114] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:58 2022] PUT /identity/v3/projects/1b4e909b83314539a2236213569d93e6/users/f9e62e5e2f36401683a62ed03be380da/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:59.296560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:59.297832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:59.300031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:59.317666 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2053/4115] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:02:59.412078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdcc0e-e129-4507-aa12-5dcdf0ec240a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:59.418070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5bf4e-a200-4d96-83a1-0547a3fe2ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:59.420106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5bf4e-a200-4d96-83a1-0547a3fe2ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.420603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5bf4e-a200-4d96-83a1-0547a3fe2ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.421127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5bf4e-a200-4d96-83a1-0547a3fe2ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.422990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5bf4e-a200-4d96-83a1-0547a3fe2ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:59.426341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5bf4e-a200-4d96-83a1-0547a3fe2ec8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:59.447262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:59.460415 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2063/4116] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:02:59.461609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ebbc-4f5b-49b8-b223-d3b8401773a6 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:59.467391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:59.467785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.468072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.468345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] PATH_INFO: `/v3/projects/1b4e909b83314539a2236213569d93e6/users/f9e62e5e2f36401683a62ed03be380da/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.472453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4e909b83314539a2236213569d93e6, user_id=f9e62e5e2f36401683a62ed03be380da, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:59.473822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:59.499097 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2054/4117] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:02:59 2022] PUT /identity/v3/projects/1b4e909b83314539a2236213569d93e6/users/f9e62e5e2f36401683a62ed03be380da/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:02:59.506679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.506980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.508178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.547229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] MFA Rules not processed for user `f9e62e5e2f36401683a62ed03be380da`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:02:59.548539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:02:59.688042 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2064/4118] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:02:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:02:59.693169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:59.725614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63ebd0-9a57-409b-bb69-2fb1f1566474 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:59.736078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:59.736800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.737239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.737589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.738359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:59.741075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:02:59.866795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:02:59.867154 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2055/4119] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:02:59 2022] POST /identity/v3/domains => generated 274 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:02:59.882561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71225bf-6994-4b4e-ad24-9a40255d2599 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:02:59.955063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:02:59.955063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:02:59.955063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:02:59.955540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:02:59.955540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:02:59.955540 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:02:59.955540 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:02:59.955540 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:02:59.955540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.053048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.056061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:00.071618 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2065/4120] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:02:59 2022] PUT /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config => generated 138 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:00.075615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.100627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783926b-0fbe-421e-8d7d-a91f5e6d6bd9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.121504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.122173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.122464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.123044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.124043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935, group=identity)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.125081 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:00.125081 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:00.125081 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:00.125993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.140921 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2066/4121] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:03:00 2022] GET /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/identity => generated 45 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:00.145406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.188734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f3a4d-a79c-4f53-b810-42b5516f7c85 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.220143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.221237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.221741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.222235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/identity/driver` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.227497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935, group=identity, option=driver)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.229449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.242314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2067/4122] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Sep 6 11:03:00 2022] GET /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/identity/driver => generated 31 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:00.243660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.256052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743670e-e399-4a44-9acf-e14fa4a06871 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.257956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20d457-4e4d-449c-b1b2-276282410852 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.262569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.263584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.264112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.264755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/ldap` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.266156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935, group=ldap)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.268170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.269538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.270198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.270544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.270866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] PATH_INFO: `/v3/projects/17e6e326e30146d7af2b7fe3227d55e8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.274088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e6e326e30146d7af2b7fe3227d55e8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.278191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2068/4123] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:03:00 2022] GET /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/ldap => generated 106 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:00.279389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.279625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.295841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb127c-a185-4389-8f8e-5855d8cf1fdd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.301989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.303330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.303695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.304083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/ldap/url` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.305388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935, group=ldap, option=url)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.307422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.312736 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2069/4124] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:03:00 2022] GET /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/ldap/url => generated 46 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:00.327033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.362756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b1f8d-5f01-4269-91f2-a495b8795618 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.379020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.381279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.384801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.385352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/ldap/user_tree_dn` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.391076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935, group=ldap, option=user_tree_dn)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.396362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.424981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2070/4125] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 11:03:00 2022] GET /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config/ldap/user_tree_dn => generated 63 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:00.437030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.452735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be890c9-ca66-480d-9e85-8ec920d0f97f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.462026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e6e326e30146d7af2b7fe3227d55e8', 'request_id': 'req-292faebe-a4c5-4922-b080-7a67ab963115'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.477662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e6e326e30146d7af2b7fe3227d55e8', 'request_id': 'req-292faebe-a4c5-4922-b080-7a67ab963115'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.495196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e6e326e30146d7af2b7fe3227d55e8', 'request_id': 'req-292faebe-a4c5-4922-b080-7a67ab963115'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.537616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.538710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.539857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.540143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.540804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=04004f1809e04eb79fc1016bb0ea6935)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.541981 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:00.541981 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:00.541981 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:00.542956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.608915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] The token cache is being invalidate because project 17e6e326e30146d7af2b7fe3227d55e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:00.609265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.610498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.615542 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2056/4126] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:00 2022] DELETE /identity/v3/projects/17e6e326e30146d7af2b7fe3227d55e8 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:00.616651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.618889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:00.653222 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2071/4127] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:00 2022] DELETE /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935/config => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:00.660000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.663416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:00.679450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b461817-e8a7-4bf3-aa00-1e2016aabc71 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.687168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.688099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.688652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.688846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.690253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=04004f1809e04eb79fc1016bb0ea6935)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.692867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.722535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.723478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.743350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292faebe-a4c5-4922-b080-7a67ab963115 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:00.850328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:00.851708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:00.868977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:00.869595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] PATH_INFO: `/v3/users/3a587a230f8c4181a2b8a338d63bc29b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:00.874428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.875143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a587a230f8c4181a2b8a338d63bc29b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:00.878370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:00.889781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:00.902121 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2072/4128] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:00 2022] PATCH /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:00.904775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:00.908528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:01.038085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a396b-24ae-4282-99bd-f91a0e7118dd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:01.049087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:01.053530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:01.053530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:01.053530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:01.068117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=04004f1809e04eb79fc1016bb0ea6935)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:01.070884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:01.108630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.113802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.192078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a587a230f8c4181a2b8a338d63bc29b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.210072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a587a230f8c4181a2b8a338d63bc29b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.214314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a587a230f8c4181a2b8a338d63bc29b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.253344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a587a230f8c4181a2b8a338d63bc29b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.254108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a587a230f8c4181a2b8a338d63bc29b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.316076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935', 'request_id': 'req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.339238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935', 'request_id': 'req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.348322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935', 'request_id': 'req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.360789 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2057/4129] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:00 2022] DELETE /identity/v3/users/3a587a230f8c4181a2b8a338d63bc29b => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:01.436474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] The token cache is being invalidate because project 04004f1809e04eb79fc1016bb0ea6935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:01.437176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.437890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.459039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935', 'request_id': 'req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.459842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935', 'request_id': 'req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.466710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '04004f1809e04eb79fc1016bb0ea6935', 'request_id': 'req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:01.474658 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2073/4130] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:00 2022] DELETE /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:01.479926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:01.483740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:01.596417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dce63-3374-493c-a8c7-6cb538437f21 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:01.602351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:01.602970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:01.603313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:01.603596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:01.604292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:01.607076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:01.688729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:01.741291 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2058/4131] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:03:01 2022] POST /identity/v3/domains => generated 276 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:01.745529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:01.747361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:01.861476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f20cf-93fc-4765-a5c6-341f3ef4a5b8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.006228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.006897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.007754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.007938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a/config` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.009103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.011260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.180848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2074/4132] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:03:01 2022] PUT /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a/config => generated 138 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:02.181485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.193794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8982-4350-4d52-bf3b-2fd099d997ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.207168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.207944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.211872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.212229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.213481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.214525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:02.214653 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:02.214653 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:02.214653 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:02.217965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.267363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.269480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:02.356176 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2059/4133] 10.222.0.20 () {60 vars in 1271 bytes} [Tue Sep 6 11:03:02 2022] PATCH /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a/config => generated 142 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:02.357362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.368611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bb4b7-6b6e-48ca-ae39-c509861297e9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.375211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.375211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.375211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.378232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.378232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.378399 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:02.378399 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:02.378399 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:02.379462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.389295 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2060/4134] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:02 2022] GET /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a/config => generated 142 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:02.389612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a9045-030f-4583-ba7b-fbe76087116f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.390205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.397698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.398414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.398709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.398991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] PATH_INFO: `/v3/projects/9a9fbbb08440465ea639131a809f179c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.400382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9fbbb08440465ea639131a809f179c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.402580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d980-f89c-46bb-95d9-1d645f9d2947 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.404159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.408258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.408882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.409237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.410003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.410608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.416048 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:02.416048 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:02.416048 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:02.417806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.543398 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2061/4135] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:02 2022] DELETE /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a/config => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:02.549653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.568926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c5d25-5b46-494b-a5a2-218317a677fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.571447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9fbbb08440465ea639131a809f179c', 'request_id': 'req-853b2a50-1c34-4d2a-82ff-316bda98dfae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.584367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9fbbb08440465ea639131a809f179c', 'request_id': 'req-853b2a50-1c34-4d2a-82ff-316bda98dfae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.600658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9fbbb08440465ea639131a809f179c', 'request_id': 'req-853b2a50-1c34-4d2a-82ff-316bda98dfae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.688839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] The token cache is being invalidate because project 9a9fbbb08440465ea639131a809f179c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:02.689166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.689936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-853b2a50-1c34-4d2a-82ff-316bda98dfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.695983 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2075/4136] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:02 2022] DELETE /identity/v3/projects/9a9fbbb08440465ea639131a809f179c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:02.697622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db6cf-60a6-4cbc-8621-c5f22a87bd9f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.697911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db6cf-60a6-4cbc-8621-c5f22a87bd9f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.698188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db6cf-60a6-4cbc-8621-c5f22a87bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.704190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.705122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.705571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.706008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.707650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.710120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Could not find any options in domain configuration for domain 4e9872abcf47460e965735fd7dfa407a.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 4e9872abcf47460e965735fd7dfa407a. Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 06 11:03:02.719638 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 4e9872abcf47460e965735fd7dfa407a. Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:02.722253 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2062/4137] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:02 2022] GET /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a/config => generated 151 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:02.725706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.727939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:02.742492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a326a6-3480-46b8-981a-8aa1cb36351c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.748008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.749024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.749604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.750065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.750834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.752620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.753506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-572db6cf-60a6-4cbc-8621-c5f22a87bd9f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:02.754769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-572db6cf-60a6-4cbc-8621-c5f22a87bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:02.761641 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2063/4138] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:02 2022] DELETE /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a/config => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:02.765441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:02.803545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21426ee-1daa-4132-86df-e965686f0ade tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:02.804676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:02.805317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.805601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.805884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.807471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:02.810427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:02.866223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4e9872abcf47460e965735fd7dfa407a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.867466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4e9872abcf47460e965735fd7dfa407a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:02.883648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2076/4139] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:02.986738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:02.987078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:02.987390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:02.999671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4e9872abcf47460e965735fd7dfa407a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.000523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4e9872abcf47460e965735fd7dfa407a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.003791 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2064/4140] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:02 2022] PATCH /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a => generated 277 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:03.008530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.010856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:03.034835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:03.036243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:03.127797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0dece-9bca-4ab8-acc3-86de789699a3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.137340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.138314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.139740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.140181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.153818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4e9872abcf47460e965735fd7dfa407a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.155826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.216140 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2077/4141] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:03.216923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.219571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4e9872abcf47460e965735fd7dfa407a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.236998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe124c-7492-406a-838f-3eb0abc36169 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.238742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4e9872abcf47460e965735fd7dfa407a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.245200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.246427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.247000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.247558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.249234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:03.249755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.254628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.268024 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2078/4142] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:03.272641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.316634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ad33a-3e16-46fb-b1c4-170d51443a7a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.334565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.335473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.336831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.337325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.338226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.340377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.420272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9872abcf47460e965735fd7dfa407a', 'request_id': 'req-dffb81d1-74d1-49e2-9fed-5e5e687279fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.429087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9872abcf47460e965735fd7dfa407a', 'request_id': 'req-dffb81d1-74d1-49e2-9fed-5e5e687279fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.436293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9872abcf47460e965735fd7dfa407a', 'request_id': 'req-dffb81d1-74d1-49e2-9fed-5e5e687279fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.480353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2079/4143] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:03 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:03.486722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.568977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] The token cache is being invalidate because project 4e9872abcf47460e965735fd7dfa407a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:03.568977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.570045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.580360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4e9872abcf47460e965735fd7dfa407a', 'request_id': 'req-dffb81d1-74d1-49e2-9fed-5e5e687279fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.581127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4e9872abcf47460e965735fd7dfa407a', 'request_id': 'req-dffb81d1-74d1-49e2-9fed-5e5e687279fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.587996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4e9872abcf47460e965735fd7dfa407a', 'request_id': 'req-dffb81d1-74d1-49e2-9fed-5e5e687279fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:03.598493 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2065/4144] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:03 2022] DELETE /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:03.603770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.606650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:03.669066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d18e4-6bbf-47e8-b400-ec2f0dfa321b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.684131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.684780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.685068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.685355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.686000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.688015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.773818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb81d1-74d1-49e2-9fed-5e5e687279fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.802348 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2080/4145] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:03 2022] POST /identity/v3/users => generated 305 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:03.803757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.811974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:03.852281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d8aa-3eec-4288-ae69-afe52146ea81 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.857802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.858560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.858848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.859161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.859898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.861783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.877522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.878386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.878848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.879159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.880891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.892995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.912179 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2081/4146] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:03.915785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:03.935303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e62a7a-8ab5-465e-a795-f5c2c4ed1dc4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:03.954119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:03.954776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:03.955065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:03.955568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:03.956383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:03.958230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:03.981643 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2082/4147] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:03.985630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:04.000840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2066/4148] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:03:03 2022] POST /identity/v3/domains => generated 277 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:04.003462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d48fd4-ce66-4097-b4df-6a6536a92e94 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:04.008338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:04.115387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ea726-6b48-4adc-bafa-10f80dec8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:04.115387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ea726-6b48-4adc-bafa-10f80dec8139 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.115387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ea726-6b48-4adc-bafa-10f80dec8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.115387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ea726-6b48-4adc-bafa-10f80dec8139 admin admin] PATH_INFO: `/v3/projects/51bb720baeb34b4bb625b338646c9819/users/1f730c7032814297ad6009c89452b3ba/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.122926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ea726-6b48-4adc-bafa-10f80dec8139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bb720baeb34b4bb625b338646c9819, user_id=1f730c7032814297ad6009c89452b3ba, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:04.132924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ea726-6b48-4adc-bafa-10f80dec8139 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:04.178949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273a310-9656-465e-8927-1a429b5369a7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:04.196288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:04.212395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.213226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.213503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.214275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:04.215440 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:04.215440 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:04.215440 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:04.216348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:04.230518 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2083/4149] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:03 2022] PUT /identity/v3/projects/51bb720baeb34b4bb625b338646c9819/users/1f730c7032814297ad6009c89452b3ba/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:04.262947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.266972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.270125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.399518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] MFA Rules not processed for user `1f730c7032814297ad6009c89452b3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:04.401277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:04.455566 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2067/4150] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:03:04 2022] PUT /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config => generated 138 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:04.460535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:04.463334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:04.493554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61e601-e495-4966-9d59-9a686159e32b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:04.553163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2084/4151] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:04 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:04.554717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:04.628833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:04.631226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.631692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.632123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.633720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b, group=identity)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:04.636669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:04.687918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49eb3-cac6-4ca8-b20e-4b8cfad97ac1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:04.697840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:04.698941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.699362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.699893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.700922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:04.703266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:04.771424 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2068/4152] 10.222.0.20 () {60 vars in 1297 bytes} [Tue Sep 6 11:03:04 2022] PATCH /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity => generated 177 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:04.775931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:04.795172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:04.803730 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2085/4153] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:04 2022] POST /identity/v3/projects => generated 407 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:04.804413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3691bb-9768-4924-b124-5058083c10da tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:04.808367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:04.919266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:04.920459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.921189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.921585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity/driver` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.922463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b, group=identity, option=driver)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:04.924739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:04.967656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159002d-1ba2-47f5-8521-af20459a69d3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:04.987963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:04.988601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:04.989020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:04.989201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:04.996137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:04.999188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.093671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2069/4154] 10.222.0.20 () {60 vars in 1318 bytes} [Tue Sep 6 11:03:04 2022] PATCH /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity/driver => generated 176 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:05.098349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.109361 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2086/4155] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:04 2022] POST /identity/v3/users => generated 310 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:05.121814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cbe61-56dd-4b5d-b916-f76214d3e281 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.130908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.142933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.142933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.142933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.143400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity/driver` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.143927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b, group=identity, option=driver)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.145696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.153452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3df5a-de14-4c10-a29c-0d711ee01e5d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.173398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.173398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.173398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.176122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.177462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.184918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.230965 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2087/4156] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:05.237071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.249296 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2070/4157] 10.222.0.20 () {58 vars in 1299 bytes} [Tue Sep 6 11:03:05 2022] DELETE /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity/driver => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:05.258024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.272084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dc625-0fbc-4d98-957d-0dd4cfa5ad6f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.294625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3433029-1f7a-4828-bd17-d47778b24963 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.305989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371015f-7271-4932-bc5c-86078da1b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.307130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.310010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371015f-7271-4932-bc5c-86078da1b9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.310618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.311171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371015f-7271-4932-bc5c-86078da1b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.311606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371015f-7271-4932-bc5c-86078da1b9e4 admin admin] PATH_INFO: `/v3/projects/7b1d9d12463547bbad613b16d3caea6b/users/1d09c20427f6480f8398c272207bdc3a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.312064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.312959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity/driver` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.315231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b, group=identity, option=driver)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.320755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.338433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371015f-7271-4932-bc5c-86078da1b9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1d9d12463547bbad613b16d3caea6b, user_id=1d09c20427f6480f8398c272207bdc3a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.341958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371015f-7271-4932-bc5c-86078da1b9e4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Could not find option driver in group identity in domain configuration for domain 1438a9455c2a461b9043f6dfb9541b1b.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:05.355557 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:05.356580 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:05.367438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2071/4158] 10.222.0.20 () {58 vars in 1296 bytes} [Tue Sep 6 11:03:05 2022] GET /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity/driver => generated 171 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:05.369038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.393021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52ae02-cfa4-44cf-9595-399a14de6e61 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.407412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.408370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.408535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.408712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.409329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b, group=identity)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.412967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.464058 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2088/4159] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:05 2022] PUT /identity/v3/projects/7b1d9d12463547bbad613b16d3caea6b/users/1d09c20427f6480f8398c272207bdc3a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:05.465575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.465731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.465974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.557780 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2072/4160] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Sep 6 11:03:05 2022] DELETE /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:05.562306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:05.563590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.576075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] MFA Rules not processed for user `9657b4e5915d4efaadc6c6e563f2e5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:05.582008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73718d84-41a9-4f58-b683-26f1b50b5324 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.584437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:05.757570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:05.778270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.778974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.783362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.783362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.783362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.783362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.798021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2073/4161] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:05.798985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.808793 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2089/4162] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:05.810539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.827037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cabbb-59da-4374-8b7b-ff5844654cc6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.833447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:05.837211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:05.837211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:05.837211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] PATH_INFO: `/v3/projects/7b1d9d12463547bbad613b16d3caea6b/users/1d09c20427f6480f8398c272207bdc3a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:05.841646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1d9d12463547bbad613b16d3caea6b, user_id=1d09c20427f6480f8398c272207bdc3a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:05.849732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:05.876941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2090/4163] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:05 2022] PUT /identity/v3/projects/7b1d9d12463547bbad613b16d3caea6b/users/1d09c20427f6480f8398c272207bdc3a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:05.887623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:05.892398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:05.961983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e7b1-a9ef-4f3a-ad48-9c4d1c67c704 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:05.992465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828431-4a86-42c7-a60f-b3040509f31d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:06.001489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:06.002368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.002852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.003259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.005472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:06.103951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:06.104536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:06.105609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.105609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.105822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.108569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a4cf-2f7e-4737-ab42-8ca8345a7f58 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:06.113666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b, group=identity)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:06.116249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:06.122379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2091/4164] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:06.124374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.124921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.125409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Could not find group identity in domain configuration for domain 1438a9455c2a461b9043f6dfb9541b1b.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:06.127740 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:06.128562 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:06.135075 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2074/4165] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 11:03:05 2022] GET /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config/identity => generated 154 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:06.147491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:06.168721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378460be-5ebc-4199-a783-96329eed8d82 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:06.180307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:06.181389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.185956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.186281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.186564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] MFA Rules not processed for user `1d09c20427f6480f8398c272207bdc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:06.187894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1438a9455c2a461b9043f6dfb9541b1b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:06.189595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:06.189696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:06.341601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2075/4166] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:06 2022] DELETE /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b/config => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:06.345589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:06.386860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1fe9b-1bb2-4db8-b1a6-c4508677e491 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:06.394194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2092/4167] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:06.403739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:06.404209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.404496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.404776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.406382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1438a9455c2a461b9043f6dfb9541b1b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:06.409140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:06.413911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:06.419304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:06.448436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42a7d2-c5d5-4b92-8d89-7c38d7afec89 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:06.454393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.459150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.460258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:06.460962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.461309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.461659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.465196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:06.490377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:06.491856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:06.503742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2093/4168] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:06 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:06.592418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.593849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.599082 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2076/4169] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:06 2022] PATCH /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b => generated 278 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:06.603186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:06.605101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:06.637296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc723-b5e8-4cae-92bf-6b699bf895ca service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:06.705943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:06.715444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:06.718389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:06.718673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:06.718952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:06.745648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1438a9455c2a461b9043f6dfb9541b1b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:06.762363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:06.799310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.804093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.929069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b', 'request_id': 'req-48b2b073-17cb-4bef-8f2a-c25df45c5c49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.937819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:06.939802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:06.952194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b', 'request_id': 'req-48b2b073-17cb-4bef-8f2a-c25df45c5c49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:06.971800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b', 'request_id': 'req-48b2b073-17cb-4bef-8f2a-c25df45c5c49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:07.029382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933e98-56ea-4ab8-a376-07325e329f94 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.045964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] The token cache is being invalidate because project 1438a9455c2a461b9043f6dfb9541b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:07.046277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:07.047534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:07.063928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b', 'request_id': 'req-48b2b073-17cb-4bef-8f2a-c25df45c5c49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:07.065176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b', 'request_id': 'req-48b2b073-17cb-4bef-8f2a-c25df45c5c49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:07.075454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1438a9455c2a461b9043f6dfb9541b1b', 'request_id': 'req-48b2b073-17cb-4bef-8f2a-c25df45c5c49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:07.102252 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2094/4170] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:06 2022] DELETE /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:07.103463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.104255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.104892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.109552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.109552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.109769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:07.109862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:07.110207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:07.210739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.212531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.232305 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2077/4171] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:06 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:07.264846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2b073-17cb-4bef-8f2a-c25df45c5c49 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.299981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.300629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.300914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.301191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.301799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.302886 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:07.302886 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:07.302886 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:07.303918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.322330 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2095/4172] 10.222.0.20 () {58 vars in 1173 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:07.323267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.346192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcda10-1caa-4b68-abaf-90c07ad4587d service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.369537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.369537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.369537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.370077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.370077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.370077 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:07.370077 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:07.370077 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:07.370077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.382042 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2078/4173] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.389983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.403590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60148c18-2261-4d56-b048-d821d9c9661a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.427002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.427802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.428186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.428563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.429258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.431695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.443662 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2096/4174] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.444225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.470294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70458c-235a-443a-80eb-434a22c87f45 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.489399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.490655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.490655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.490966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.491611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.495175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.495862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2079/4175] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.500303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.517357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda63f8-d515-45e3-b6e2-fd9a268e4df4 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.548686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.548686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.549663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.549663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.550476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.552241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.558623 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2097/4176] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:07.559595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.575227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7079f-f7d0-4020-884c-9a9cfe9fb05e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.581190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.581726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.582240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.582688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.584199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.585966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.588033 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2080/4177] 10.222.0.20 () {58 vars in 1200 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:07.591783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.608228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b371a3-0357-4989-9eea-17fc7366a50d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.621164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.621911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.622275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.622622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.623338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.633257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.634664 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2098/4178] 10.222.0.20 () {58 vars in 1203 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.638995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.671257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548f8ae-5505-4069-89b4-a9be81abe6d1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.681107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.686022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.686567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.696148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.696148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.696148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.696148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2081/4179] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.696653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.709838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec7abe-b0a8-4840-989b-5d05a6fd4547 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.725338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.733017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.733017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.733017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.733017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.733436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.733436 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2099/4180] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.735042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.746751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac37e8-30e0-4ae8-b312-afaac250d326 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.770112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.771632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.772176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.772679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.773552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.776804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.780126 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2082/4181] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.784277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.803504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecdefb-172a-407f-8c70-6d58f5859fb0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.819540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.820245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.820546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.820825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.821391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.823204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.829070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.831240 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2100/4182] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.843560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845663-8634-4988-ae9d-159829974aaf tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.863783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.865763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.865763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.865763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.866374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.871559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.877615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.890788 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2083/4183] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.898670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e695ba-5e3d-4aa7-9b6f-13e537773358 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.911934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.912620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.912900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.913372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.914110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.916983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.926196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.942803 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2101/4184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.947412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920d6d-3e19-4d4f-8ad5-07917971035e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.952914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.953882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.954426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.954895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.955859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.958625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.964505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.971639 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2084/4185] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:07.976642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edd26-4ad8-4f8b-97a5-9e66c9754818 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:07.982772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:07.983988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:07.984222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:07.985122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:07.985960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:07.987954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:07.993539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:07.999551 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2102/4186] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.006104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261bc1-be88-4605-8544-49c2e2994bcd tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.014414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.014414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.015101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.015540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.018371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.022543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.027940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.029229 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2085/4187] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:07 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.041306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a5f4f-992a-421d-a6a9-dedc0c34c4ab tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.049089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.050346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.050787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.051261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.053352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.055209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.071701 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2103/4188] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.075556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.089443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a7828-a810-4d14-8d50-30581f3bc679 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.100177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.101102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.101582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.102139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.102804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.104774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.108939 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2086/4189] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.110113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.126026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb0f18-5ec5-4bd5-b7f3-34ef4ad9153f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.132613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.133290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.133589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.133926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.134521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.136375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.137829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2104/4190] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.142090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.152622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117c488-c72e-4a3a-b66b-ac5dc4e9ea64 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.157914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.158680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.158975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.159326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.159924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.161621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.162839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2087/4191] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:08.166784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.179368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43fdb-0807-4f50-9250-33317cba9493 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.187159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.187909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.188246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.188528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.198499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.206364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.210796 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2105/4192] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:08.212394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.225674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5914d-c97e-4e8d-a2c7-97c795214f6c tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.232616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.233326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.233602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.233888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.234485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.241820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.241820 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2088/4193] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.243923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.256417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4259-8416-4eb8-b8f3-4a5af408a4c3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.261896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.263305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.263305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.272268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.275806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.277449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.280773 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2106/4194] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.284740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.296254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbe47-bbcf-494a-bdca-d9ca1b40a800 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.301328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.302687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.303225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.303657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.304510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.306234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.307467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2089/4195] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.311885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.323571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e367a8d-07f9-42c9-b03b-243ae2e98ae8 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.329436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.330080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.330362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.330641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.331328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.332989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.334085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2107/4196] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.339060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.354372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5345f2-65ea-44ae-8940-a9725ebbf137 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.383543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.384211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.390702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.390702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.390702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.390702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.390702 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2090/4197] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.392639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.409128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e0cd-045a-457d-8a33-0930ce4ea2f3 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.422170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.422838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.423427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.423754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.424411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.426284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.429342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2108/4198] 10.222.0.20 () {58 vars in 1290 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.435378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.459109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508b8ed-7303-4281-8d72-e41d4851fbe9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.464042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.464711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.468481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.468481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.468481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.468481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.471108 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2091/4199] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:08.472680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.484732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa79b-2e21-4c10-93ae-6e247496f065 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.492105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.501725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.501725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.501725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.501725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.502705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.502705 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2109/4200] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:08.504831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.515927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef7e4-a8e3-47ae-9d93-e8d0896ab2a5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.523755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.531803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.531803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.531803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.531803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.532586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.532586 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2092/4201] 10.222.0.20 () {58 vars in 1308 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.534650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.547280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc535-42c5-4701-ace7-81805b7c0aef tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.553660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.554344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.554632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.554911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.555574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.557207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.560456 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2110/4202] 10.222.0.20 () {58 vars in 1290 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.563487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.573921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daea17b-ec1d-4b70-9864-1b8b384d9fc9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.579395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.580123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.580479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.580884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.581601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.583447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.584635 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2093/4203] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.588645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.599501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7a49-3a64-48b5-aaa5-45c6838f00f0 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.604863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.605709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.605997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.606273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.606885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.608670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.609804 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2111/4204] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.618325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.628657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcc1c1-557a-4460-aa56-2c2084222f38 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.634886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.635197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.635559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.635909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.636573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.638407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.639751 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2094/4205] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.644250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.654349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311eaf1-f1d4-41fb-9755-e032efe6864d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.659093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.659739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.660024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.660311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.661413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.663153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.666942 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2112/4206] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.668101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.679945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60749-4aab-451a-9e86-9ca45337cac7 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.684942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.686043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.686816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.687141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.687736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.689335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.690540 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2095/4207] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.694986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.710366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550a4da-7d80-479e-98c8-42cd2601c3b2 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.715722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.716372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.716661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.717014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.717524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.719154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.720301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2113/4208] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.725312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.736427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fdc1d-c1d8-4bfb-bd7d-cbd3f1ba90ed tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.742235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.742940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.743254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.743537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.744126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.745713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.746917 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2096/4209] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:08.751369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.762671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118f0f8-5ae7-4ffc-a33d-f23e4c427886 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.767435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.768094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.768382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.768661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.769249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.771429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.775065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2114/4210] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.777134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.788440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb06ec-c185-45d2-b66c-02ebdc6ae42a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.793311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.793953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.794268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.794547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.795329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.796915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.798103 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2097/4211] 10.222.0.20 () {58 vars in 1257 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.808150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.818605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e73c0-0475-47d2-8bb7-d3ecaf0dcc29 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.823449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.829621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.829621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.829621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.829621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.830017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.830017 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2115/4212] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.832646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.843725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd58e2-c65c-4fef-a002-b0fd2da27af5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.852802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.852802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.852802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.853276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.853276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.855280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.857117 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2098/4213] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.861120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.871378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b8a7e-f0c3-41a0-8865-f708cb5243fc tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.876389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.879856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.879856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.879856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.879856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.880403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.881103 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2116/4214] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.885829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.896319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98f6b-1ca6-4073-881e-250ff932ff59 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.901514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.902148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.903752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.903752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.903752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.906498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.908100 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2099/4215] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:08.912724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.923553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645453c-da0f-4ead-9b0e-28a7d49fd37d tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.928685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.929361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.929652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.929931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.930514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.932172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.933830 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2117/4216] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.937422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.949049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494581-a2dc-4923-8b59-549d6fd755b9 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.953218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.953882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.954170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.954447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.955096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.956719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.961077 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2100/4217] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.963486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.975310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1059e-8228-4c4c-aa3c-4213eb492977 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:08.980026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:08.980675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:08.980965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:08.981245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:08.981882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:08.983469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:08.984622 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2118/4218] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:08.988592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:08.999614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b341d-fd63-433b-92fb-f40eaeb94647 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.004431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.005254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.005544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.005850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.006524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.008432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.011061 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2101/4219] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:08 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:09.013631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.025414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70602-ee1c-4132-9f8a-bcb953534bd6 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.030248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.030892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.031213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.031495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.032086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.033727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.034835 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2119/4220] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:09.039767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.052267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4475d-a875-4e30-9ff6-b75611e0c6c1 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.056999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.057642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.057927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.058275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.058865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.060617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.061786 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2102/4221] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:09.065833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.077269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3015ef-8260-4ea5-ae34-9ba4d6bdc89b tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.083899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.084697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.085092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.085480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.086555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.090195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.096793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.096931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:09.097280 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2120/4222] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:09.108704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56171-96f9-4849-8f40-0f851ec78aa5 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.114460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.115270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.115564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.115898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.116522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.118213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.122648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2103/4223] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:09.123875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.149128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95272-45ad-4d44-8c7f-140fc9189d7f tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.165877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.167795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.168155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.168573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.169307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.171082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.176741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.179383 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2121/4224] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Sep 06 11:03:09.192620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64071061-cf7c-430c-a425-ef379b52b376 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.198459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.199354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.199656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.200008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.202353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.204373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.207406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2104/4225] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:03:09.213087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.225862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ffc1-86ba-40fb-b6cc-2f43b4921b7e tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.237649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.238663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.239189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.239688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/1438a9455c2a461b9043f6dfb9541b1b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.250837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Could not find domain: 1438a9455c2a461b9043f6dfb9541b1b.: keystone.exception.DomainNotFound: Could not find domain: 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:09.259401 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:09.260567 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:03:09.261729 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1438a9455c2a461b9043f6dfb9541b1b. Sep 06 11:03:09.262746 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:09.267863 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2122/4226] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:09 2022] PATCH /identity/v3/domains/1438a9455c2a461b9043f6dfb9541b1b => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:09.272071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.284526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5c86-815c-4148-ac92-ed4476bdc250 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.296035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.297295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.297596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.298167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/4e9872abcf47460e965735fd7dfa407a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.315846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Could not find domain: 4e9872abcf47460e965735fd7dfa407a.: keystone.exception.DomainNotFound: Could not find domain: 4e9872abcf47460e965735fd7dfa407a. Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e9872abcf47460e965735fd7dfa407a. Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:09.322060 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:09.323418 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:03:09.324729 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4e9872abcf47460e965735fd7dfa407a. Sep 06 11:03:09.326598 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:09.326598 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2105/4227] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:09 2022] PATCH /identity/v3/domains/4e9872abcf47460e965735fd7dfa407a => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:09.328364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.343751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc17a57-698a-4e30-aaab-e73adf097c97 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.350760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85349a39-7882-4c76-b16f-7571a92a882a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e62e5e2f36401683a62ed03be380da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4e909b83314539a2236213569d93e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.351517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85349a39-7882-4c76-b16f-7571a92a882a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.351813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85349a39-7882-4c76-b16f-7571a92a882a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.352099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85349a39-7882-4c76-b16f-7571a92a882a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] PATH_INFO: `/v3/domains/04004f1809e04eb79fc1016bb0ea6935` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.364554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85349a39-7882-4c76-b16f-7571a92a882a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-85349a39-7882-4c76-b16f-7571a92a882a tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Could not find domain: 04004f1809e04eb79fc1016bb0ea6935.: keystone.exception.DomainNotFound: Could not find domain: 04004f1809e04eb79fc1016bb0ea6935. Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 04004f1809e04eb79fc1016bb0ea6935. Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:09.372209 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:09.381048 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:03:09.382168 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 04004f1809e04eb79fc1016bb0ea6935. Sep 06 11:03:09.383411 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:09.383411 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2123/4228] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:09 2022] PATCH /identity/v3/domains/04004f1809e04eb79fc1016bb0ea6935 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:09.383570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:09.387278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:09.451295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:09.488115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2b106-1409-42aa-ba5f-760faeb20141 tempest-DomainConfigurationTestJSON-980287534 tempest-DomainConfigurationTestJSON-980287534-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:09.495684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:09.496857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.499539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.499742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] PATH_INFO: `/v3/users/59b7705d83dc40a3aa1513e89b8f17b5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.503963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b7705d83dc40a3aa1513e89b8f17b5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:09.508059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:09.720367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b7705d83dc40a3aa1513e89b8f17b5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:09.728812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b7705d83dc40a3aa1513e89b8f17b5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:09.729660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b7705d83dc40a3aa1513e89b8f17b5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:09.742765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b7705d83dc40a3aa1513e89b8f17b5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:09.743739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b7705d83dc40a3aa1513e89b8f17b5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:09.871213 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2106/4229] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:09 2022] DELETE /identity/v3/users/59b7705d83dc40a3aa1513e89b8f17b5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:09.876080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:09.876551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:09.876984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:09.903393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:09.904865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:09.987123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2124/4230] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:10.001235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:10.002980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:10.087561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956dc32-636b-42cc-b4f1-a0b30a5cebf2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:10.091281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:10.091898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:10.092222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:10.092504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:10.102774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:10.104925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:10.114775 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2107/4231] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:10.323385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:10.325374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:10.441874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afcfbc-53b1-4d00-be1a-a156178475a6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:10.449776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:10.450958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:10.451519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:10.451879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:10.453913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:10.486203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:10.486203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:10.510837 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2125/4232] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:10.540426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:10.878303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:10.880694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:10.896921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74e11-d783-4193-931d-bbe2a455dddc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:10.915134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:10.916163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:10.916613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:10.917081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] PATH_INFO: `/v3/projects/4de0c4c1ac084bc98cfeedd69ebd8fe1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:10.918496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de0c4c1ac084bc98cfeedd69ebd8fe1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:10.920769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:11.055623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de0c4c1ac084bc98cfeedd69ebd8fe1', 'request_id': 'req-a665580b-9c34-41e0-8a45-b3a1e6f72304'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.062001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de0c4c1ac084bc98cfeedd69ebd8fe1', 'request_id': 'req-a665580b-9c34-41e0-8a45-b3a1e6f72304'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.067555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de0c4c1ac084bc98cfeedd69ebd8fe1', 'request_id': 'req-a665580b-9c34-41e0-8a45-b3a1e6f72304'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.146461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] The token cache is being invalidate because project 4de0c4c1ac084bc98cfeedd69ebd8fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:11.147223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.148386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.150322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2108/4233] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:10 2022] DELETE /identity/v3/projects/4de0c4c1ac084bc98cfeedd69ebd8fe1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:11.154816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:11.177483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98f215-ed36-46a7-a866-b452d559ff67 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:11.259701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:11.260263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:11.260735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:11.261017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] PATH_INFO: `/v3/users/f9e62e5e2f36401683a62ed03be380da` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:11.262293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e62e5e2f36401683a62ed03be380da)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:11.264269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:11.462248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e62e5e2f36401683a62ed03be380da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.472034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e62e5e2f36401683a62ed03be380da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.472758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e62e5e2f36401683a62ed03be380da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.475533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e62e5e2f36401683a62ed03be380da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.485999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2de38afd-2e10-4440-8e70-d3fa0e980ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e62e5e2f36401683a62ed03be380da'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:11.539967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:11.566149 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2126/4234] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:11 2022] DELETE /identity/v3/users/f9e62e5e2f36401683a62ed03be380da => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:12.187218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:12.189396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:12.204166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665580b-9c34-41e0-8a45-b3a1e6f72304 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:12.290235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:12.291363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:12.291915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:12.292474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] PATH_INFO: `/v3/projects/1b4e909b83314539a2236213569d93e6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:12.293837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4e909b83314539a2236213569d93e6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:12.296264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:12.474383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4e909b83314539a2236213569d93e6', 'request_id': 'req-33c36766-eb1f-40ef-a657-44117bafc0c9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:12.482502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4e909b83314539a2236213569d93e6', 'request_id': 'req-33c36766-eb1f-40ef-a657-44117bafc0c9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:12.490944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4e909b83314539a2236213569d93e6', 'request_id': 'req-33c36766-eb1f-40ef-a657-44117bafc0c9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:12.697520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] The token cache is being invalidate because project 1b4e909b83314539a2236213569d93e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:12.699513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:12.699513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33c36766-eb1f-40ef-a657-44117bafc0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:12.700711 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2109/4235] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:12 2022] DELETE /identity/v3/projects/1b4e909b83314539a2236213569d93e6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:12.706618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:12.708139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:12.708430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:12.749607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:12.751160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:12.839178 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2127/4236] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:12.852430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:12.852430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:12.852430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:12.900143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:12.901494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:12.917740 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2110/4237] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:12.922011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:12.933661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75143af-0ddf-4101-9bb6-af81da1dbfb9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:12.938525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:12.939175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:12.939458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:12.939729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:12.940537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:12.940842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:12.942986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:12.960647 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2128/4238] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:12.965584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:12.976565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33063ea3-5b51-4b35-8dcf-4c175af43bf2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:12.982953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:12.986033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:12.986033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:12.986033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:12.986033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:12.986784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:13.107747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2111/4239] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:12 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:13.117879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:13.132198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218dc1-2062-448b-8821-3aec560c9428 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:13.217281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:13.217911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.218196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.218473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.219222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:13.221212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:13.329314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2129/4240] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:13 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:13.333999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:13.344789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193c1a9-6960-4dbb-999c-50ecb634a2a1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:13.350356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:13.355105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.355105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.355105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.355105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:13.355105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:13.365233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2112/4241] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:13.369517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:13.380992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d799a-9ec0-4c81-8085-e4d6ec9d3458 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:13.392955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ed2c-eaba-4bbb-a911-5ff50e3d68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:13.403543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ed2c-eaba-4bbb-a911-5ff50e3d68f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.403543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ed2c-eaba-4bbb-a911-5ff50e3d68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.403543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ed2c-eaba-4bbb-a911-5ff50e3d68f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.403543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ed2c-eaba-4bbb-a911-5ff50e3d68f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:13.403543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975ed2c-eaba-4bbb-a911-5ff50e3d68f1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:13.408628 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2130/4242] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:13.413126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:13.423618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a47a8-8aed-4596-b285-cd6e7bc92f8a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:13.429293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:13.429947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.430234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.430516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] PATH_INFO: `/v3/projects/00add8177ef345c399bf01b3b5c79deb/users/865766a5c850493e8aa7d0de2a2b036d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.449980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00add8177ef345c399bf01b3b5c79deb, user_id=865766a5c850493e8aa7d0de2a2b036d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:13.452701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:13.516593 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2113/4243] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:13 2022] PUT /identity/v3/projects/00add8177ef345c399bf01b3b5c79deb/users/865766a5c850493e8aa7d0de2a2b036d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:13.526431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:13.527746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.528034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.528306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.558480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] MFA Rules not processed for user `865766a5c850493e8aa7d0de2a2b036d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:13.560058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:13.628915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2131/4244] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:13.634264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:13.700517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a498-8c1b-4552-ae4e-895da769ea2b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:13.705554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:13.706167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.706452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.706730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.707392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:13.709454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:13.832286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2114/4245] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:13 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:13.837027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:13.847864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e8e37-3131-4c03-b8a7-44c7f54e5ed2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:13.871316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:13.906734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:13.907304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:13.907588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:13.907859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:13.908481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:13.910522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.000089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2132/4246] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:13 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:14.001399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.012842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f6665-ef14-4bd5-9b86-3a7e9ab40019 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.018805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.019576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.019864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.020712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.021410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.023073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.034488 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2115/4247] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:14.038695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.049482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340acd-92f2-4117-b47d-fb3e1f6940a7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.054963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.059813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.059813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.059813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] PATH_INFO: `/v3/projects/9a68da0cc9f24cc999c9b23986ba6904/users/25ded6f7165c4a56bdaee3559a9f05e0/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.075174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a68da0cc9f24cc999c9b23986ba6904, user_id=25ded6f7165c4a56bdaee3559a9f05e0, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.077896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.179159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2133/4248] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:14 2022] PUT /identity/v3/projects/9a68da0cc9f24cc999c9b23986ba6904/users/25ded6f7165c4a56bdaee3559a9f05e0/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:14.183290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.194387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2b361-5b53-40d2-be41-5a93143e41ed admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.254131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959098db-87e3-4c1a-8c3e-b37269ab96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.255382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959098db-87e3-4c1a-8c3e-b37269ab96e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.255666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959098db-87e3-4c1a-8c3e-b37269ab96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.256023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959098db-87e3-4c1a-8c3e-b37269ab96e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.256591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959098db-87e3-4c1a-8c3e-b37269ab96e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.258436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959098db-87e3-4c1a-8c3e-b37269ab96e4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.268313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2116/4249] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:14.272697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.282914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9b217-d560-4eaa-8135-ca77ae37b1f0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.287539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.288185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.288465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.288739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] PATH_INFO: `/v3/projects/9a68da0cc9f24cc999c9b23986ba6904/users/25ded6f7165c4a56bdaee3559a9f05e0/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.290636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a68da0cc9f24cc999c9b23986ba6904, user_id=25ded6f7165c4a56bdaee3559a9f05e0, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.293273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.303749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2134/4250] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:14 2022] PUT /identity/v3/projects/9a68da0cc9f24cc999c9b23986ba6904/users/25ded6f7165c4a56bdaee3559a9f05e0/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:14.314921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.320760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.320760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.344438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] MFA Rules not processed for user `25ded6f7165c4a56bdaee3559a9f05e0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:14.345701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:14.420870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2117/4251] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:14.425841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.439716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289be6-6da5-438d-bac4-c81395d01fb6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.446142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.446790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.447310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.447462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.448287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.449692 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:14.449692 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:14.449692 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:14.451240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.527586 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2135/4252] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:14 2022] POST /identity/v3/services => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:14.531737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.543981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b680-1fd9-4f60-87f5-506ef319e086 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.560913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.561806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.562098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.562378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.563075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.564095 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:14.564095 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:14.564095 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:14.564985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.715665 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2118/4253] 10.222.0.20 () {60 vars in 1213 bytes} [Tue Sep 6 11:03:14 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:14.717241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.729505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7831f1d-adc6-4c5a-9c20-0925d28a0843 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.740891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.741589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.741943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.742230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.743045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.744679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:14.887505 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2136/4254] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:14 2022] POST /identity/v3/services => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:14.894967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:14.908859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538ceaf-a14e-4078-a7e6-5801f9b2eeef tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:14.938537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:14.939196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:14.940330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:14.942252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:14.943169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:14.945551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.039239 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2119/4255] 10.222.0.20 () {60 vars in 1213 bytes} [Tue Sep 6 11:03:14 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:15.042955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.054043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6ca1-7de4-41f6-85a1-907bc526492b tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.058986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.059850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.060131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.060405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.061206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.062233 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:15.062233 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:15.062233 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:15.063214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.090527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2137/4256] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Sep 6 11:03:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:15.094479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.107837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe182-8c10-4d52-a83a-1cffeb7b6d4a tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.118186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.119149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.119462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.119720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.120886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=c36903b860204301a80a3aa8e78228e5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.126100 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:15.126100 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:15.126100 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:15.127119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.136210 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2120/4257] 10.222.0.20 () {58 vars in 1290 bytes} [Tue Sep 6 11:03:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5 => generated 332 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:15.139959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.151386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce088e-e924-4b84-a6b3-84ae685aa548 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.156216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.156881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.157165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.159120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.159120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=c36903b860204301a80a3aa8e78228e5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.159326 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:15.159326 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:15.159326 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:15.160487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.166469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2138/4258] 10.222.0.20 () {58 vars in 1291 bytes} [Tue Sep 6 11:03:15 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:15.170424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.182282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407325-eb45-431e-8c56-6829e5055aee tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.192579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.193298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.193889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.194180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.199489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c36903b860204301a80a3aa8e78228e5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.200518 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:15.200518 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:15.200518 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:15.201411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.385792 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2121/4259] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:03:15 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:15.389766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.400579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed89c5-5107-4c22-81b9-4a48ba0820f1 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.405477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.406098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.406396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.412020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.412020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.412020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.413759 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2139/4260] 10.222.0.20 () {58 vars in 1191 bytes} [Tue Sep 6 11:03:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:15.417972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.428388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb177-356e-447f-bf30-db745a0ad137 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.433111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.433791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.434080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.434362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.435042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c36903b860204301a80a3aa8e78228e5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.436632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Could not find Endpoint Group: c36903b860204301a80a3aa8e78228e5.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: c36903b860204301a80a3aa8e78228e5. Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Sep 06 11:03:15.449133 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: c36903b860204301a80a3aa8e78228e5. Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:15.450240 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2122/4261] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:03:15 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c36903b860204301a80a3aa8e78228e5 => generated 120 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:15.454126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.465057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43744c18-17ca-4c3d-a3cc-939a9079e3bd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.469881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.470766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.471079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.471360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services/b290ebdc292f429e9f263f30d77fb716` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.471952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b290ebdc292f429e9f263f30d77fb716)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.473710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.557869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2140/4262] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:15 2022] DELETE /identity/v3/services/b290ebdc292f429e9f263f30d77fb716 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:15.564128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.575628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831d312-a568-4b19-a0e0-de0b319cd72e tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.590660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.591330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.591620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.591897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.592551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.594181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.715963 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2123/4263] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:15 2022] POST /identity/v3/services => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:15.717408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.733438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a9276-d19b-446e-81ae-5e1c04131f94 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.756066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.756689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.756971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.757245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.758248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.759349 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:15.759349 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:15.759349 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:15.760423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:15.920880 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2141/4264] 10.222.0.20 () {60 vars in 1213 bytes} [Tue Sep 6 11:03:15 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:15.921752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:15.939041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd4450-baf5-4c33-8b0c-a6a90711f9a7 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:15.957238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:15.957238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:15.957238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:15.957574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:15.957975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:15.959902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.025559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:16.033035 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2124/4265] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:15 2022] POST /identity/v3/services => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:16.037986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.048899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad288-4dd0-4589-9bea-75de24692fab tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.068416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.069053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.069337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.069616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d9665bf34af443e4b54789c23a6e679f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.070435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=d9665bf34af443e4b54789c23a6e679f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.071505 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:16.071505 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:16.071505 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:16.072400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.186501 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2142/4266] 10.222.0.20 () {60 vars in 1313 bytes} [Tue Sep 6 11:03:16 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/d9665bf34af443e4b54789c23a6e679f => generated 336 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:16.190508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.215593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aae144-145b-4737-80a0-916c8b2d65ed tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.226200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.226847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.227163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.227441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services/5ae097e5f7ec42dab16395e41b9423b2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.228038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5ae097e5f7ec42dab16395e41b9423b2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.229312 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:16.229312 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:16.229312 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:16.230358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.347854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2125/4267] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:16 2022] DELETE /identity/v3/services/5ae097e5f7ec42dab16395e41b9423b2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:16.352754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.365476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a51b0-7b6e-4b36-a47a-965ab7a0fc1c tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.383773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.384711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.385080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.391090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d9665bf34af443e4b54789c23a6e679f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.391090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d9665bf34af443e4b54789c23a6e679f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.391090 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:16.391090 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:16.391090 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:16.391090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.472319 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2143/4268] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:03:16 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d9665bf34af443e4b54789c23a6e679f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:16.477735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.489054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8bf42-d719-4246-8671-e00f3460c5a3 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.493857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.494709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.494997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.495300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services/ec16681b45714977b0ea63e7f0ba088f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.495881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ec16681b45714977b0ea63e7f0ba088f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.497468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.602712 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2126/4269] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:16 2022] DELETE /identity/v3/services/ec16681b45714977b0ea63e7f0ba088f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:16.607516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.628832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4025-0fba-4539-a845-ba6d34842022 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.646122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.646787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.654296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.654296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/eeb6aa4176704e0180d94ef24fa18cf4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.654296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=eeb6aa4176704e0180d94ef24fa18cf4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.654296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.717114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2144/4270] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:03:16 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/eeb6aa4176704e0180d94ef24fa18cf4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:16.721121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.735128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294f9ac-456f-48aa-9a7d-46db6f431afd tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.736551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770b015-60ec-4af6-b00c-1bb8b25d6437 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25ded6f7165c4a56bdaee3559a9f05e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a68da0cc9f24cc999c9b23986ba6904', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.737166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b015-60ec-4af6-b00c-1bb8b25d6437 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.737454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b015-60ec-4af6-b00c-1bb8b25d6437 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.737732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b015-60ec-4af6-b00c-1bb8b25d6437 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] PATH_INFO: `/v3/services/0fe6059efdfd49828e2203f4f33c9c43` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.738319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b015-60ec-4af6-b00c-1bb8b25d6437 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0fe6059efdfd49828e2203f4f33c9c43)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.740057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b015-60ec-4af6-b00c-1bb8b25d6437 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:16.848881 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2127/4271] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:16 2022] DELETE /identity/v3/services/0fe6059efdfd49828e2203f4f33c9c43 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:16.853869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:16.963865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483909-4586-4528-8317-3bf1ae402c93 tempest-EndPointGroupsTest-1929644238 tempest-EndPointGroupsTest-1929644238-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:16.985552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:16.986336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:16.986683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:16.987071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] PATH_INFO: `/v3/users/865766a5c850493e8aa7d0de2a2b036d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:16.988477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865766a5c850493e8aa7d0de2a2b036d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:16.990603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:17.140554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:17.213892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865766a5c850493e8aa7d0de2a2b036d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:17.223811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865766a5c850493e8aa7d0de2a2b036d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:17.224566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865766a5c850493e8aa7d0de2a2b036d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:17.225188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865766a5c850493e8aa7d0de2a2b036d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:17.238477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865766a5c850493e8aa7d0de2a2b036d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:17.390905 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2145/4272] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:16 2022] DELETE /identity/v3/users/865766a5c850493e8aa7d0de2a2b036d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:17.395671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5541b5-5b34-4e6a-8a6f-39bcb066ccfd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:17.395971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5541b5-5b34-4e6a-8a6f-39bcb066ccfd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:17.396401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5541b5-5b34-4e6a-8a6f-39bcb066ccfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:17.416860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5c5541b5-5b34-4e6a-8a6f-39bcb066ccfd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:17.418089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5c5541b5-5b34-4e6a-8a6f-39bcb066ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:17.487197 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2128/4273] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:17.498488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:17.500074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:17.526784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:17.527349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:17.527821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:17.555233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] MFA Rules not processed for user `3b6e2046e3bd40b3b46802dfa796260b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:17.556639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:17.596413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84446e0c-9f76-4f67-8057-a56f22d00e80 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:17.602675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:17.603530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:17.603637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:17.604017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:17.624326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:17.625891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:17.638250 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2146/4274] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:17.649026 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2129/4275] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:18.267483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:18.274256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:18.311747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c32534-06b1-4f4f-a21b-227171b96d01 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:18.347040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:18.353000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:18.353000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:18.353254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] PATH_INFO: `/v3/projects/00add8177ef345c399bf01b3b5c79deb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:18.360861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00add8177ef345c399bf01b3b5c79deb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:18.369034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:18.677757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:18.699467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00add8177ef345c399bf01b3b5c79deb', 'request_id': 'req-939b0e24-705b-43ef-9447-6b2757b34811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:18.714833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00add8177ef345c399bf01b3b5c79deb', 'request_id': 'req-939b0e24-705b-43ef-9447-6b2757b34811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:18.722647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00add8177ef345c399bf01b3b5c79deb', 'request_id': 'req-939b0e24-705b-43ef-9447-6b2757b34811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:18.865687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] The token cache is being invalidate because project 00add8177ef345c399bf01b3b5c79deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:18.865987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:18.867855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:18.874852 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2147/4276] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:18 2022] DELETE /identity/v3/projects/00add8177ef345c399bf01b3b5c79deb => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:18.875950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:18.892747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1096-36e0-4951-a0ad-b2bc97b9cc1d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:19.065478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:19.069458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:19.069962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:19.070398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] PATH_INFO: `/v3/users/25ded6f7165c4a56bdaee3559a9f05e0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:19.071860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ded6f7165c4a56bdaee3559a9f05e0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:19.081473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:19.411062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ded6f7165c4a56bdaee3559a9f05e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:19.418254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ded6f7165c4a56bdaee3559a9f05e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:19.419084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ded6f7165c4a56bdaee3559a9f05e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:19.432018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ded6f7165c4a56bdaee3559a9f05e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:19.432735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c8d2433-c322-4ba9-aa04-9a1b32cce991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ded6f7165c4a56bdaee3559a9f05e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:19.577074 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2130/4277] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:18 2022] DELETE /identity/v3/users/25ded6f7165c4a56bdaee3559a9f05e0 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:20.139526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:20.221296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:20.229072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:20.261596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0e24-705b-43ef-9447-6b2757b34811 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:20.322911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:20.323630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:20.323845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:20.324201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] PATH_INFO: `/v3/projects/9a68da0cc9f24cc999c9b23986ba6904` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:20.325907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a68da0cc9f24cc999c9b23986ba6904)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:20.327949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:20.449565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a68da0cc9f24cc999c9b23986ba6904', 'request_id': 'req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:20.455392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a68da0cc9f24cc999c9b23986ba6904', 'request_id': 'req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:20.463879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a68da0cc9f24cc999c9b23986ba6904', 'request_id': 'req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:20.598200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] The token cache is being invalidate because project 9a68da0cc9f24cc999c9b23986ba6904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:20.598200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:20.598442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bde3438f-d9db-4dbc-8a6b-7b8cb684b486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:20.605588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:20.605939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:20.606458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:20.611939 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2148/4278] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:20 2022] DELETE /identity/v3/projects/9a68da0cc9f24cc999c9b23986ba6904 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:20.635801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:20.637080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:20.707993 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2131/4279] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:20.715985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:20.716296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:20.716569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:20.737094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:20.738284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:20.746345 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2149/4280] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:20.750510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:20.763699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15ac25-ff62-4d40-a84f-41c1c54a855e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:20.768688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:20.769296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:20.769580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:20.770471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:20.771150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:20.771672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:20.773874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:20.795474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2132/4281] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:20.797113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:20.807397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3afae4-aaeb-4a92-a811-abd5f8ce0362 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:20.812090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:20.812687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:20.812966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:20.813243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:20.813870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:20.815805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:20.961570 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2150/4282] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:20 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:20.962810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:20.973548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626d8f8-81b6-4bca-a447-863ca9109251 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:21.037211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:21.037815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.038097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.038371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.038991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:21.040924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:21.226485 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2133/4283] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:20 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:21.230826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:21.249008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e146b7d-39c8-4d61-8b07-5b468b5d1a15 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:21.253960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:21.254848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.255337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.255615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.256252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:21.258195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:21.272940 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2151/4284] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:21.276520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:21.290824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5bcc4-48a9-48aa-b3c4-1f9cb5bb9eac admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:21.304724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31000d0a-111a-40b6-a060-6582b08c8de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:21.305378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000d0a-111a-40b6-a060-6582b08c8de3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.305647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000d0a-111a-40b6-a060-6582b08c8de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.306099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000d0a-111a-40b6-a060-6582b08c8de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.306915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000d0a-111a-40b6-a060-6582b08c8de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:21.308581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31000d0a-111a-40b6-a060-6582b08c8de3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:21.321726 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2134/4285] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:21.325897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:21.333276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:21.339247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ec463-0483-45ac-b01c-1693d5d0bf1c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:21.347227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:21.348462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.348816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.349103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] PATH_INFO: `/v3/projects/f9be2a24b93f44d5b4148ca7f0c09016/users/3cadd49fab254b57b918e200acb3e071/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.365353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9be2a24b93f44d5b4148ca7f0c09016, user_id=3cadd49fab254b57b918e200acb3e071, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:21.372613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:21.505105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2152/4286] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:21 2022] PUT /identity/v3/projects/f9be2a24b93f44d5b4148ca7f0c09016/users/3cadd49fab254b57b918e200acb3e071/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:21.515563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.516075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.516510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.545024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] MFA Rules not processed for user `3cadd49fab254b57b918e200acb3e071`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:21.546232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:21.611959 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2135/4287] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:21.616583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:21.682426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48af2f-2abf-47a6-9d33-993883172fa2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:21.687533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:21.688145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.688425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.688702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.689339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:21.691314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:21.902198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2153/4288] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:21 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:21.903403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:21.915375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923cc85-6d9c-4978-a60a-c825205b0520 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:21.977763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:21.978377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:21.978655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:21.978925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:21.979619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:21.981621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:22.128235 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2136/4289] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:21 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:22.129328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:22.140906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d5b7-0214-4bc4-9204-f015ec9a714d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:22.146472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:22.147132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.147508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.147782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.149128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:22.150305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:22.173365 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2154/4290] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:22.179062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:22.195205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e3d95-c930-4aad-9af3-a5e9959527b2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:22.198380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:22.199097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.199389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.199702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] PATH_INFO: `/v3/projects/c4d4e52eda174ecc893027dcfbe2cc49/users/d514c2b9277341c9a3e694c1ce4f7283/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.223850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d4e52eda174ecc893027dcfbe2cc49, user_id=d514c2b9277341c9a3e694c1ce4f7283, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:22.229751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:22.361404 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2137/4291] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:22 2022] PUT /identity/v3/projects/c4d4e52eda174ecc893027dcfbe2cc49/users/d514c2b9277341c9a3e694c1ce4f7283/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:22.365596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:22.381571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c25e-3ade-4e7c-be7e-c110b79eaf0d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:22.482331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fde69-c838-4473-9ab7-c04ec5d511bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:22.483336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fde69-c838-4473-9ab7-c04ec5d511bb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.483914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fde69-c838-4473-9ab7-c04ec5d511bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.484403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fde69-c838-4473-9ab7-c04ec5d511bb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.485419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fde69-c838-4473-9ab7-c04ec5d511bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:22.487753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fde69-c838-4473-9ab7-c04ec5d511bb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:22.502972 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2155/4292] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:22.506950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:22.521152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946851d8-5eec-40f2-9420-c32b3914b05f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:22.534075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:22.536234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.536234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.536234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] PATH_INFO: `/v3/projects/c4d4e52eda174ecc893027dcfbe2cc49/users/d514c2b9277341c9a3e694c1ce4f7283/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.538925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d4e52eda174ecc893027dcfbe2cc49, user_id=d514c2b9277341c9a3e694c1ce4f7283, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:22.541846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:22.553972 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2138/4293] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:22 2022] PUT /identity/v3/projects/c4d4e52eda174ecc893027dcfbe2cc49/users/d514c2b9277341c9a3e694c1ce4f7283/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:22.565563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.565952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.566702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.604248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] MFA Rules not processed for user `d514c2b9277341c9a3e694c1ce4f7283`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:22.613679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:22.714256 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2156/4294] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:22.716158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:22.731160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e99d8-689b-4dff-9744-7f79ede018b8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:22.737278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:22.737943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.738226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.738726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.739426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:22.741172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:22.849608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2139/4295] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:22 2022] POST /identity/v3/services => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:22.853363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:22.865747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358bbb-1bb3-4d89-ac4f-3d45d8911348 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:22.898851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:22.899584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:22.900917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:22.900917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:22.901151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:22.902907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:23.019419 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1274509658. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:23.019419 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:23.019419 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:23.183804 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2157/4296] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 11:03:22 2022] POST /identity/v3/endpoints => generated 361 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:23.184974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:23.207045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2ea4-9c3d-406f-8a1f-4b3afa8ac131 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:23.226625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:23.233364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:23.234595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:23.235468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:23.235906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-1274509658` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:23.236967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1274509658)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:23.238527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:23.242333 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2140/4297] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 11:03:23 2022] GET /identity/v3/regions/tempest-region-1274509658 => generated 180 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:23.246124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:23.278169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583b48-dab3-4288-8f0c-b389fd9a3498 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:23.297183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:23.298310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:23.298833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:23.299337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:23.300003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:23.301673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:23.462575 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2158/4298] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:23 2022] POST /identity/v3/services => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:23.466426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:23.490702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16668f-43c6-4617-9bff-e94968f4da07 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:23.520856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:23.523706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:23.523706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:23.523706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:23.523706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:23.525184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:23.591206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:23.618859 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-182895924. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:23.618859 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:23.618859 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:23.705667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2141/4299] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 11:03:23 2022] POST /identity/v3/endpoints => generated 360 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:23.709912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:23.730320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49676b8-c41e-4500-9564-2ebc624f56c4 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:23.756673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:23.757771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:23.758639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:23.758639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-182895924` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:23.759076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-182895924)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:23.760223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:23.762808 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2159/4300] 10.222.0.20 () {58 vars in 1203 bytes} [Tue Sep 6 11:03:23 2022] GET /identity/v3/regions/tempest-region-182895924 => generated 178 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:23.766932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:23.783844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e608-a06c-424e-974f-5f2daf048545 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:23.789342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:23.790207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:23.790327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:23.791601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:23.791601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:23.793298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:23.887692 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-802074499. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:23.887692 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:23.887692 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:24.135957 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2142/4301] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 11:03:23 2022] POST /identity/v3/endpoints => generated 358 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:24.139966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.161516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1cf12-704d-4e81-b440-9c6a679ef434 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.202418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.203093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.203584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.203870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-802074499` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.204457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-802074499)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.205547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.207528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2160/4302] 10.222.0.20 () {58 vars in 1203 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/regions/tempest-region-802074499 => generated 178 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:24.212698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.246966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285e8c-d9fa-482c-a717-9d2455052a47 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.264662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.265310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.272042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.272042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.272042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.272042 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:24.272042 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:24.272042 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:24.272729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.274085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.275944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:24.299262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2143/4303] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints => generated 4393 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:24.300483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.324906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b6a30-13ce-4ef1-8303-ace85af29d8b tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.340278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.341233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.341533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.341832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/594a288592544bbaa6ddb7ebc0908e55` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.355917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=594a288592544bbaa6ddb7ebc0908e55)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.357334 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:24.357334 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:24.357334 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:24.358250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.361960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2144/4304] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints/594a288592544bbaa6ddb7ebc0908e55 => generated 358 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:24.366737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.386303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f608c-99b1-433e-bc4f-ce0982665841 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.400554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.402027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.402309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.402584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/594a288592544bbaa6ddb7ebc0908e55` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.403958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=594a288592544bbaa6ddb7ebc0908e55)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.405601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.454154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020317c-0ee6-4be2-baeb-02e1276b4782 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.461387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.462607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.463661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.464189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.466256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:24.481735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.484013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.496864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '594a288592544bbaa6ddb7ebc0908e55', 'request_id': 'req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:24.499217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2161/4305] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/auth/tokens => generated 4120 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:03:24.505639 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2145/4306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:24 2022] DELETE /identity/v3/endpoints/594a288592544bbaa6ddb7ebc0908e55 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:24.509651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.523306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3d157-e1f6-40e6-bbaf-45db7d41b428 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.544182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.545170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.545663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.546094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.546872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.548966 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:24.548966 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:24.548966 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:24.550327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.567888 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2162/4307] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints => generated 4048 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:24.568678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.582825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44a0e2-2b84-4c8e-a31e-6e70b25a12c7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.589695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.593171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.593463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.593961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/594a288592544bbaa6ddb7ebc0908e55` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.601465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Could not find endpoint: 594a288592544bbaa6ddb7ebc0908e55.: keystone.exception.EndpointNotFound: Could not find endpoint: 594a288592544bbaa6ddb7ebc0908e55. Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._iter().one() Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._only_one_row( Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:24.622735 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 594a288592544bbaa6ddb7ebc0908e55. Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:24.624079 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:03:24.625283 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 594a288592544bbaa6ddb7ebc0908e55. Sep 06 11:03:24.626479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:24.629992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2146/4308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:24 2022] DELETE /identity/v3/endpoints/594a288592544bbaa6ddb7ebc0908e55 => generated 114 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:24.634422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.647600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f0ab2-a03b-4fac-8d3b-2b28006c987e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.653047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.653880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.654320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.654890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-802074499` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.655753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-802074499)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.657934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.711923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:24.812366 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-802074499. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:24.812366 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:24.812366 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:24.812366 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2163/4309] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 11:03:24 2022] DELETE /identity/v3/regions/tempest-region-802074499 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:24.837353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.849867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ee85e-adc6-4aa9-95b7-d13eed5e3f0a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.868091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.876826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.877445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.877727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.878533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.881783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.896615 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2147/4310] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints => generated 4048 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:24.899825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.915199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba616ed-0917-4610-960d-e05d564d49b1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.923873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.924496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.924832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.925108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.925758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Adding query filter params (service_id=ab477f9ca8ed4d9b8651da45e0402021) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:24.926173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.928086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.939347 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2164/4311] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints?service_id=ab477f9ca8ed4d9b8651da45e0402021 => generated 503 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:24.944384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.956606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99369bfc-6e11-4e31-a5d8-931f0e3d2c1d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:24.964241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:24.965075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:24.965555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:24.965832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:24.966642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Adding query filter params (service_id=2509d21e94ac45fba804b447578bd7b1) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:24.967164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:24.968930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:24.975869 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2148/4312] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints?service_id=2509d21e94ac45fba804b447578bd7b1 => generated 502 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:24.980112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:24.998318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518af72-0cb1-4861-9009-55daff1d65fe tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:25.004825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:25.005468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:25.005757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:25.006036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:25.006761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:25.007801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:25.010326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:25.030357 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2165/4313] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 11:03:24 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:25.031554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:25.048839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9b9b-294f-43ef-9744-c74f6cbc8de9 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:25.059865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:25.061847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:25.061847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:25.062017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:25.062830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:25.063186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:25.064815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:25.081720 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2149/4314] 10.222.0.20 () {58 vars in 1171 bytes} [Tue Sep 6 11:03:25 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:25.089623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:25.103475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb49bbd-9f36-47f0-b046-990ac085f6bc tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:25.119046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:25.119655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:25.119943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:25.120346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:25.121880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:25.123365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:25.263163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2166/4315] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:25 2022] POST /identity/v3/services => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:25.263293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:25.275244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1df9-48cc-4eac-930e-a87e7f13d600 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:25.326597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:25.326887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:25.327289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:25.327648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:25.328419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:25.333781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:25.459644 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-493321495. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:25.459644 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:25.459644 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:25.566844 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2150/4316] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 11:03:25 2022] POST /identity/v3/endpoints => generated 358 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:25.573786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:25.591948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80608-a2b9-49c8-9af8-15a94fea6c92 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:25.626978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:25.637355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:25.638400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:25.639695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:25.640168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-493321495` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:25.640813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-493321495)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:25.642306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:25.661292 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2167/4317] 10.222.0.20 () {58 vars in 1203 bytes} [Tue Sep 6 11:03:25 2022] GET /identity/v3/regions/tempest-region-493321495 => generated 178 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:25.666189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:25.689006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b5a26-3111-420a-949f-397f4b91f1a3 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:25.700259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:25.701334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:25.701883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:25.702387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/453faa83fa8f4d1b9e1c354f312aef44` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:25.714656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=453faa83fa8f4d1b9e1c354f312aef44)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:25.715910 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:25.715910 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:25.715910 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:25.717579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:25.813197 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1535893823. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:25.813197 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:25.813197 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:25.989825 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2151/4318] 10.222.0.20 () {60 vars in 1256 bytes} [Tue Sep 6 11:03:25 2022] PATCH /identity/v3/endpoints/453faa83fa8f4d1b9e1c354f312aef44 => generated 363 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:25.991089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:26.003448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e279-10ab-44bd-ab13-25a864a0f09a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:26.029512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:26.030250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:26.030822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:26.031352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-1535893823` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:26.032016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1535893823)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:26.033199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:26.039283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2168/4319] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 11:03:25 2022] GET /identity/v3/regions/tempest-region-1535893823 => generated 180 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:26.040645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:26.055063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63840ba-f4ad-42f3-b2d9-b1295b460805 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:26.074145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:26.075815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:26.076131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:26.077508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/453faa83fa8f4d1b9e1c354f312aef44` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:26.089723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=453faa83fa8f4d1b9e1c354f312aef44)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:26.093605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:26.135996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '453faa83fa8f4d1b9e1c354f312aef44', 'request_id': 'req-21229156-6579-4f80-960b-17de26069fd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:26.146998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:26.156730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:26.158849 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2152/4320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:26 2022] DELETE /identity/v3/endpoints/453faa83fa8f4d1b9e1c354f312aef44 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:26.182013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088bd5-6c91-4e36-b197-f0e17c950a7d tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:26.218821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:26.233948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:26.233948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:26.233948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-1535893823` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:26.233948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1535893823)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:26.233948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:26.448438 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1535893823. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:26.448438 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:26.448438 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:26.473180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2169/4321] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 11:03:26 2022] DELETE /identity/v3/regions/tempest-region-1535893823 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:26.477530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:26.497754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21229156-6579-4f80-960b-17de26069fd6 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:26.554960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:26.555785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:26.556194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:26.556606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-493321495` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:26.557224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-493321495)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:26.559915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:26.651646 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2153/4322] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 11:03:26 2022] DELETE /identity/v3/regions/tempest-region-493321495 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:26.655966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:26.673041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314761d-a14d-495a-93f7-3f9dae2f32c2 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:26.700677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:26.701323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:26.701706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:26.702043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/services/a79a1dea87d5473cb2355863c6ef8f54` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:26.702635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a79a1dea87d5473cb2355863c6ef8f54)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:26.706471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:26.830115 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2170/4323] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:26 2022] DELETE /identity/v3/services/a79a1dea87d5473cb2355863c6ef8f54 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:26.836918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:26.876329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c6da-e2b3-40df-9a31-61595e7667dd tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:26.949729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:26.952241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:26.952241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:26.952241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/117b919eb231455daeebd082834ee762` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:26.959001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=117b919eb231455daeebd082834ee762)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:26.960838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:27.059975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '117b919eb231455daeebd082834ee762', 'request_id': 'req-9a28546f-6fd6-4112-a5e6-f3edb2d23206'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:27.083193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2154/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:26 2022] DELETE /identity/v3/endpoints/117b919eb231455daeebd082834ee762 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:27.087617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:27.112662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08723aa5-e784-4907-b370-84879673bae1 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:27.190630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:27.190630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:27.190630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:27.190926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-182895924` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:27.190926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-182895924)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:27.192649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:27.305005 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-182895924. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:27.305005 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:27.305005 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:27.318492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2171/4325] 10.222.0.20 () {58 vars in 1206 bytes} [Tue Sep 6 11:03:27 2022] DELETE /identity/v3/regions/tempest-region-182895924 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:27.322181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:27.341151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28546f-6fd6-4112-a5e6-f3edb2d23206 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:27.365090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:27.366603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:27.367198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:27.367856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/services/2509d21e94ac45fba804b447578bd7b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:27.368780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2509d21e94ac45fba804b447578bd7b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:27.371703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:27.498399 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2155/4326] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:27 2022] DELETE /identity/v3/services/2509d21e94ac45fba804b447578bd7b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:27.502374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:27.522029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6900a64-8061-4a0c-8f79-d51e35947f0e tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:27.545762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:27.546599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:27.546891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:27.547209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/endpoints/2fad1b90390d423294b38bd31d8b2a36` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:27.554373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2fad1b90390d423294b38bd31d8b2a36)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:27.556468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:27.647324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2fad1b90390d423294b38bd31d8b2a36', 'request_id': 'req-9ec6102f-3840-4969-9aa6-e90db65beea7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:27.668627 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2172/4327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 11:03:27 2022] DELETE /identity/v3/endpoints/2fad1b90390d423294b38bd31d8b2a36 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:27.669893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:27.692379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86b712-de76-45c4-a4d6-806f54ca33db tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:27.721086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:27.722332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:27.722813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:27.723510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/regions/tempest-region-1274509658` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:27.725462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1274509658)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:27.728143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:27.870239 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1274509658. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:03:27.870239 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:03:27.870239 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:27.885724 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2156/4328] 10.222.0.20 () {58 vars in 1209 bytes} [Tue Sep 6 11:03:27 2022] DELETE /identity/v3/regions/tempest-region-1274509658 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:27.891369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:27.908080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6102f-3840-4969-9aa6-e90db65beea7 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:27.939554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06779271-e64e-4875-ac55-755bb938613a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd514c2b9277341c9a3e694c1ce4f7283', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d4e52eda174ecc893027dcfbe2cc49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:27.940554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06779271-e64e-4875-ac55-755bb938613a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:27.941038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06779271-e64e-4875-ac55-755bb938613a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:27.941541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06779271-e64e-4875-ac55-755bb938613a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] PATH_INFO: `/v3/services/ab477f9ca8ed4d9b8651da45e0402021` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:27.942354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06779271-e64e-4875-ac55-755bb938613a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ab477f9ca8ed4d9b8651da45e0402021)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:27.945531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06779271-e64e-4875-ac55-755bb938613a tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:27.990954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:28.131829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2173/4329] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:27 2022] DELETE /identity/v3/services/ab477f9ca8ed4d9b8651da45e0402021 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:28.136023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:28.218940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655a83c-02b6-4262-aaeb-020ccf746677 tempest-EndPointsTestJSON-941759889 tempest-EndPointsTestJSON-941759889-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:28.242339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:28.243768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:28.244205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:28.244499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] PATH_INFO: `/v3/users/3cadd49fab254b57b918e200acb3e071` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:28.245733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cadd49fab254b57b918e200acb3e071)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:28.247779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:28.562544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cadd49fab254b57b918e200acb3e071'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:28.572349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cadd49fab254b57b918e200acb3e071'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:28.574078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cadd49fab254b57b918e200acb3e071'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:28.609987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cadd49fab254b57b918e200acb3e071'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:28.611504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cadd49fab254b57b918e200acb3e071'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:28.689736 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2157/4330] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:28 2022] DELETE /identity/v3/users/3cadd49fab254b57b918e200acb3e071 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:28.693391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:28.694231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:28.694752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:28.791207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:28.792742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:28.859733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:28.959884 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2174/4331] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:28.976968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:28.978966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:29.101869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c7c9b-e64d-49bc-8419-9a76756755ff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:29.107102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:29.108701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:29.108701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:29.108701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:29.123818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:29.125403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:29.148411 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2158/4332] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:29.254212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:30.050097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:30.052223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:30.067733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91882201-2c55-4a52-9e76-f6a7759f70b6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:30.072864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:30.073672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:30.074061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:30.074638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] PATH_INFO: `/v3/projects/f9be2a24b93f44d5b4148ca7f0c09016` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:30.076223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9be2a24b93f44d5b4148ca7f0c09016)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:30.080160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:30.111236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:30.243326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9be2a24b93f44d5b4148ca7f0c09016', 'request_id': 'req-34072778-7c2e-4ba2-b832-3646dbbefc80'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.253104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9be2a24b93f44d5b4148ca7f0c09016', 'request_id': 'req-34072778-7c2e-4ba2-b832-3646dbbefc80'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.262305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9be2a24b93f44d5b4148ca7f0c09016', 'request_id': 'req-34072778-7c2e-4ba2-b832-3646dbbefc80'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.342658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] The token cache is being invalidate because project f9be2a24b93f44d5b4148ca7f0c09016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:30.343459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.345459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34072778-7c2e-4ba2-b832-3646dbbefc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.348299 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2175/4333] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:30 2022] DELETE /identity/v3/projects/f9be2a24b93f44d5b4148ca7f0c09016 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:30.351929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:30.383431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb6bfd-bc89-4f66-a490-b9cc8e9951e7 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:30.559696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:30.560675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:30.561461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:30.561980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] PATH_INFO: `/v3/users/d514c2b9277341c9a3e694c1ce4f7283` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:30.563676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d514c2b9277341c9a3e694c1ce4f7283)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:30.569070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:30.811393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd514c2b9277341c9a3e694c1ce4f7283'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.824855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd514c2b9277341c9a3e694c1ce4f7283'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.830472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd514c2b9277341c9a3e694c1ce4f7283'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.841290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd514c2b9277341c9a3e694c1ce4f7283'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.842112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd514c2b9277341c9a3e694c1ce4f7283'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:30.940459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2159/4334] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:30 2022] DELETE /identity/v3/users/d514c2b9277341c9a3e694c1ce4f7283 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:31.256767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:31.258243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:31.258936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:31.296510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] MFA Rules not processed for user `00e93a2f8ed643ba8bc92b4def1ce7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:31.299424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:31.389202 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2176/4335] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:31.682877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:31.684419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:31.773867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d40700-945e-45a7-a0f4-33b5545f456e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:31.781439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:31.783113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:31.783796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:31.784244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] PATH_INFO: `/v3/projects/c4d4e52eda174ecc893027dcfbe2cc49` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:31.786156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d4e52eda174ecc893027dcfbe2cc49)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:31.788402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:31.824501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:31.826378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:31.908608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afb0e0-347b-49e9-b5e8-7d96433e2050 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:31.908608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:31.908608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:31.908882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:31.908982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:31.913544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:31.924598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:31.927600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44628cd-5bd3-41df-b6fe-4d1e559898a2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:31.937729 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2177/4336] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:31.968684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d4e52eda174ecc893027dcfbe2cc49', 'request_id': 'req-4256b122-ee03-4381-b3bc-f0a0dd269566'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:31.975705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d4e52eda174ecc893027dcfbe2cc49', 'request_id': 'req-4256b122-ee03-4381-b3bc-f0a0dd269566'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:31.981761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d4e52eda174ecc893027dcfbe2cc49', 'request_id': 'req-4256b122-ee03-4381-b3bc-f0a0dd269566'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:32.093334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] The token cache is being invalidate because project c4d4e52eda174ecc893027dcfbe2cc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:32.093689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:32.094320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4256b122-ee03-4381-b3bc-f0a0dd269566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:32.095856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2160/4337] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:31 2022] DELETE /identity/v3/projects/c4d4e52eda174ecc893027dcfbe2cc49 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:32.100697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.100988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.101261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.128195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:32.130226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:32.202743 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2178/4338] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:32.211611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.211900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.212179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.238662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:32.240484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:32.251108 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2161/4339] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:32.255978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:32.267134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba89b4c-ed81-4d81-9346-5068229e6025 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:32.276049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:32.277044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.277543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.277833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.278499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:32.278983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:32.281780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:32.299945 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2179/4340] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:32.307726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:32.317805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00670562-08dd-44e2-b1ae-3211c2531b01 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:32.324621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:32.325235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.325518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.325791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.326423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:32.328410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:32.460909 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2162/4341] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:32 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:32.465124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:32.477196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6ef6-4790-4e94-a884-6ae8da6e6f9f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:32.547743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:32.548373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.548738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.549017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.549910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:32.552757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:32.579233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:32.680323 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2180/4342] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:32 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:32.683362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:32.694385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c9e2d-b54d-495d-b3ea-5ce51b70924d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:32.699838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:32.703163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.703163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.703163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.703163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:32.703777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:32.716698 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2163/4343] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:32.721327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:32.736029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec244dd-bf47-4ae3-a3fa-b72ffbec7a96 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:32.744899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853c969-60f8-43e4-b8a1-c3895eef05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:32.745888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853c969-60f8-43e4-b8a1-c3895eef05ca admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.746325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853c969-60f8-43e4-b8a1-c3895eef05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.746768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853c969-60f8-43e4-b8a1-c3895eef05ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.749118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853c969-60f8-43e4-b8a1-c3895eef05ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:32.751029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853c969-60f8-43e4-b8a1-c3895eef05ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:32.765339 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2181/4344] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:32.770418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:32.785726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92140442-39e7-4fe2-8d2b-f66edbd9ec80 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:32.791385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cda707-1874-415d-8c45-bc6263ea2fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:32.792180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cda707-1874-415d-8c45-bc6263ea2fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.792470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cda707-1874-415d-8c45-bc6263ea2fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.792745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cda707-1874-415d-8c45-bc6263ea2fcb admin admin] PATH_INFO: `/v3/projects/2859357df1e1440abcfb162316cf6aa2/users/152baeeb16a14dacaee0ef0b85d39bd8/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.811113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cda707-1874-415d-8c45-bc6263ea2fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2859357df1e1440abcfb162316cf6aa2, user_id=152baeeb16a14dacaee0ef0b85d39bd8, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:32.814067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cda707-1874-415d-8c45-bc6263ea2fcb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:32.871841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fa19-154c-4179-a64b-ec18fc62812d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.872128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fa19-154c-4179-a64b-ec18fc62812d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.872402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fa19-154c-4179-a64b-ec18fc62812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.892670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c1d7fa19-154c-4179-a64b-ec18fc62812d None None] MFA Rules not processed for user `176b78609fe64a958eb12cddae83c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:32.893898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1d7fa19-154c-4179-a64b-ec18fc62812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:32.950134 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2164/4345] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:32 2022] PUT /identity/v3/projects/2859357df1e1440abcfb162316cf6aa2/users/152baeeb16a14dacaee0ef0b85d39bd8/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:32.962110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:32.962674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:32.963168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:32.991988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2182/4346] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:32.995813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] MFA Rules not processed for user `152baeeb16a14dacaee0ef0b85d39bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:32.997062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:33.001878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.002778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.003170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.024265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] MFA Rules not processed for user `176b78609fe64a958eb12cddae83c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:33.025584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:33.089278 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2165/4347] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:33.090717 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2183/4348] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:33.096493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:33.171324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176fc78-1904-4be3-bdb7-2808fda04203 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:33.176734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:33.177463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.178401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.178783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.179947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:33.181714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:33.298123 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2166/4349] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:33 2022] POST /identity/v3/projects => generated 395 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:33.303177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:33.317242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860a0a-695f-4c8d-b143-bd3494a7143e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:33.351268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:33.377222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:33.377842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.378126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.379105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.379718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:33.381653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:33.471044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2184/4350] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:33 2022] POST /identity/v3/users => generated 304 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:33.473921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:33.484925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd5c11-3000-4b2a-a493-b09424b8ad08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:33.490157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:33.496314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.496314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.496314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.496314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:33.496314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:33.505870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2167/4351] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:33.510473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:33.523893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec89a9-eadb-4bdd-a189-4b06dd45fba6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:33.528684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:33.529346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.529629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.529923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] PATH_INFO: `/v3/projects/6f0b14660197442da644aab9a083ad2f/users/c2bcfbfb3c7945bb842b7b1126ce4179/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.545441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0b14660197442da644aab9a083ad2f, user_id=c2bcfbfb3c7945bb842b7b1126ce4179, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:33.548161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:33.637984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2185/4352] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:33 2022] PUT /identity/v3/projects/6f0b14660197442da644aab9a083ad2f/users/c2bcfbfb3c7945bb842b7b1126ce4179/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:33.642051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:33.652964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920cecb-baa7-4a93-8b19-4bff67fb4b67 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:33.733102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f82098-55a3-4d1c-82d9-cf5917f79d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:33.733947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f82098-55a3-4d1c-82d9-cf5917f79d03 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.734239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f82098-55a3-4d1c-82d9-cf5917f79d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.734522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f82098-55a3-4d1c-82d9-cf5917f79d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.735401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f82098-55a3-4d1c-82d9-cf5917f79d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:33.737051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f82098-55a3-4d1c-82d9-cf5917f79d03 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:33.752946 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2168/4353] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:33.755866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:33.769255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71a4eb-8054-47d4-a97a-69e4cf32fdf1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:33.774057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:33.777218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.777218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.777218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] PATH_INFO: `/v3/projects/6f0b14660197442da644aab9a083ad2f/users/c2bcfbfb3c7945bb842b7b1126ce4179/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.777218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0b14660197442da644aab9a083ad2f, user_id=c2bcfbfb3c7945bb842b7b1126ce4179, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:33.780320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:33.791239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2186/4354] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:33 2022] PUT /identity/v3/projects/6f0b14660197442da644aab9a083ad2f/users/c2bcfbfb3c7945bb842b7b1126ce4179/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:33.806776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:33.806776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:33.806776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:33.881481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] MFA Rules not processed for user `c2bcfbfb3c7945bb842b7b1126ce4179`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:33.883356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:34.005010 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2169/4355] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:34.011495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.122637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6ea7c-dc8f-465e-b167-f80b0589e44f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.138831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152baeeb16a14dacaee0ef0b85d39bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2859357df1e1440abcfb162316cf6aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.139504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.139791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.140072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.140740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Sep 06 11:03:34.147724 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.150624 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2187/4356] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:03:34 2022] POST /identity/v3/projects => generated 136 bytes in 138 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Sep 06 11:03:34.154540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.168746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb209c-71c7-4f54-a8b2-7f7f0da38de2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.175256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bcfbfb3c7945bb842b7b1126ce4179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f0b14660197442da644aab9a083ad2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.176993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.178151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.178518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.180101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.185617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invalid input for field 'name': '' is too short Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: On instance['name']: Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: On instance['name']: Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: '' Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise error Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application '' Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.193130 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 11:03:34.195260 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application '' Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.196316 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2170/4357] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:03:34 2022] POST /identity/v3/projects => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 11:03:34.200396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.233682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8120ad-9bff-4657-b756-2d9ea8393b89 tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.245637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bcfbfb3c7945bb842b7b1126ce4179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f0b14660197442da644aab9a083ad2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.246759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.247309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.247780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.248638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.250744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: On instance['name']: Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: On instance['name']: Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise error Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:03:34.261210 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:34.262527 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:03:34.263715 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.268147 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2188/4358] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:03:34 2022] POST /identity/v3/projects => generated 412 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 11:03:34.274123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.290801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4db36-de05-4df5-8e92-f0d34efec713 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.299055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bcfbfb3c7945bb842b7b1126ce4179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f0b14660197442da644aab9a083ad2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.300215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.301280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.301771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] PATH_INFO: `/v3/projects/2e5a95563c7c496899f196178e9ab866` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.312528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e5a95563c7c496899f196178e9ab866)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.314864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Could not find project: 2e5a95563c7c496899f196178e9ab866.: keystone.exception.ProjectNotFound: Could not find project: 2e5a95563c7c496899f196178e9ab866. Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 06 11:03:34.334890 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2e5a95563c7c496899f196178e9ab866. Sep 06 11:03:34.336123 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:34.341875 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2171/4359] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:34 2022] DELETE /identity/v3/projects/2e5a95563c7c496899f196178e9ab866 => generated 113 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:34.345576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.370310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db35268-5061-406c-a96f-107a639e9d76 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.386945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152baeeb16a14dacaee0ef0b85d39bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2859357df1e1440abcfb162316cf6aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.387899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.388198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.388481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.389146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Sep 06 11:03:34.399543 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._list_projects() Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Sep 06 11:03:34.401506 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.405619 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2189/4360] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:03:34 2022] GET /identity/v3/projects => generated 135 bytes in 62 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:34.415404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.435292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f73df5-98b2-459b-82ea-14e2798b40e7 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.440475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bcfbfb3c7945bb842b7b1126ce4179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f0b14660197442da644aab9a083ad2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.441156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.441444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.441730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.442857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.445000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:34.531470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:34.622653 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2172/4361] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:34 2022] POST /identity/v3/projects => generated 358 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:34.624150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.637745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5225-3255-422e-ac1e-0a3ebc253bef tempest-ProjectsNegativeStaticTestJSON-1804025173 tempest-ProjectsNegativeStaticTestJSON-1804025173-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.716891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bcfbfb3c7945bb842b7b1126ce4179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f0b14660197442da644aab9a083ad2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.717561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.718049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.718511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.719375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.732907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:34.825387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.sql.core [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1183068827' for key 'project.ixu_project_name_domain_id'") Sep 06 11:03:34.825387 ncdv-master-1 devstack@keystone.service[92878]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 11:03:34.825387 ncdv-master-1 devstack@keystone.service[92878]: [parameters: {'id': '68bdc99650834bf18a1773c5ad1fef26', 'name': 'tempest-project-dup-1183068827', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 11:03:34.825387 ncdv-master-1 devstack@keystone.service[92878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1183068827, project id 68bdc99650834bf18a1773c5ad1fef26.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1183068827, project id 68bdc99650834bf18a1773c5ad1fef26. Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:03:34.833740 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result.read() Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1183068827' for key 'project.ixu_project_name_domain_id'") Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 11:03:34.834983 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application yield resource Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise self.value Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 11:03:34.836141 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application session.commit() Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.session.flush() Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application compat.raise_( Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 11:03:34.837295 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 11:03:34.838341 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result.read() Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:03:34.842039 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1183068827' for key 'project.ixu_project_name_domain_id'") Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [parameters: {'id': '68bdc99650834bf18a1773c5ad1fef26', 'name': 'tempest-project-dup-1183068827', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.843801 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1183068827 at domain ID default. Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:34.845243 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1183068827, project id 68bdc99650834bf18a1773c5ad1fef26. Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:34.848842 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2190/4362] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:03:34 2022] POST /identity/v3/projects => generated 285 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:03:34.849713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:34.865706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c710335-26de-4695-a28a-5329b76c98d2 tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:34.872092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bcfbfb3c7945bb842b7b1126ce4179', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f0b14660197442da644aab9a083ad2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:34.873600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:34.874233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:34.874690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] PATH_INFO: `/v3/projects/6cfab195492a46d99c81c3e829922122` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:34.891678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6cfab195492a46d99c81c3e829922122)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:34.898963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:35.088215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfab195492a46d99c81c3e829922122', 'request_id': 'req-76c7c974-24cd-4aef-81d3-1ba6de04227c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.100889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfab195492a46d99c81c3e829922122', 'request_id': 'req-76c7c974-24cd-4aef-81d3-1ba6de04227c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.115874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:35.136780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.151715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfab195492a46d99c81c3e829922122', 'request_id': 'req-76c7c974-24cd-4aef-81d3-1ba6de04227c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.263620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] The token cache is being invalidate because project 6cfab195492a46d99c81c3e829922122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:35.263931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.264963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.266530 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2173/4363] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:34 2022] DELETE /identity/v3/projects/6cfab195492a46d99c81c3e829922122 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:35.268324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:35.271947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.295419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b249-4db7-4293-9348-b6baf330210f tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:35.368824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:35.369507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:35.369793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:35.370357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:35.372704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.383497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c974-24cd-4aef-81d3-1ba6de04227c tempest-ProjectsNegativeStaticTestJSON-377128341 tempest-ProjectsNegativeStaticTestJSON-377128341-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:35.387893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:35.388090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:35.389041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:35.389499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:35.389950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:35.390092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] PATH_INFO: `/v3/users/1f730c7032814297ad6009c89452b3ba` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:35.391999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f730c7032814297ad6009c89452b3ba)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:35.395678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:35.416935 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2191/4364] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:35.416935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:35.416935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.423762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e08fd-c129-4575-877d-b9245a4b8e4a service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:35.447367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:35.448426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:35.449012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:35.449465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] PATH_INFO: `/v3/users/152baeeb16a14dacaee0ef0b85d39bd8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:35.450852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152baeeb16a14dacaee0ef0b85d39bd8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:35.453741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:35.651903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f730c7032814297ad6009c89452b3ba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.653653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152baeeb16a14dacaee0ef0b85d39bd8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.661578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f730c7032814297ad6009c89452b3ba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.662562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f730c7032814297ad6009c89452b3ba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.667797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152baeeb16a14dacaee0ef0b85d39bd8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.679736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152baeeb16a14dacaee0ef0b85d39bd8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.680669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152baeeb16a14dacaee0ef0b85d39bd8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.685541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f730c7032814297ad6009c89452b3ba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.686603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d00e8003-9e3b-40b4-9c82-df52bee22056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f730c7032814297ad6009c89452b3ba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.697629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4305362-ea36-412a-b724-8d30b0778c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152baeeb16a14dacaee0ef0b85d39bd8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:35.773066 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2174/4365] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:35 2022] DELETE /identity/v3/users/1f730c7032814297ad6009c89452b3ba => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:35.776637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:35.777041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:35.777469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:35.829295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:35.830759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.849326 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2192/4366] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:35 2022] DELETE /identity/v3/users/152baeeb16a14dacaee0ef0b85d39bd8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:35.854029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:35.854797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:35.855288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:35.887236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:35.888680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.929734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2175/4367] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:35.940153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:35.942980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:35.991896 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2193/4368] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:36.004267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:36.005930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:36.030424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e805a-8dc0-4be7-83cc-ae4176822b21 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:36.086692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd09c-cd39-437d-b8a2-2470b5d2ff56 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:36.091684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:36.092639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:36.092992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:36.093319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:36.102232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:36.103328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:36.103810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:36.104277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:36.118378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:36.121605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:36.134356 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2194/4369] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:03:36.140726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:36.151314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:36.153172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:36.182612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2176/4370] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:03:36.815198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:36.817417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:36.834036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b3d38-a783-4a02-bd52-7e422690db7c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:36.839193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:36.839990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:36.840286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:36.840567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] PATH_INFO: `/v3/projects/51bb720baeb34b4bb625b338646c9819` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:36.841711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bb720baeb34b4bb625b338646c9819)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:36.843690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:37.045080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bb720baeb34b4bb625b338646c9819', 'request_id': 'req-4b0cf83d-66d0-4454-bcdd-e265699d39e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.051049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bb720baeb34b4bb625b338646c9819', 'request_id': 'req-4b0cf83d-66d0-4454-bcdd-e265699d39e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.059140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bb720baeb34b4bb625b338646c9819', 'request_id': 'req-4b0cf83d-66d0-4454-bcdd-e265699d39e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.084339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:37.092810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:37.114713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc700-ab94-4bd5-b4e6-f644e967fc9d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:37.136432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] The token cache is being invalidate because project 51bb720baeb34b4bb625b338646c9819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:37.136730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.138652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.141205 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2195/4371] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:36 2022] DELETE /identity/v3/projects/51bb720baeb34b4bb625b338646c9819 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:37.146621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:37.148151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:37.207911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:37.208559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:37.208844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:37.209122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] PATH_INFO: `/v3/projects/2859357df1e1440abcfb162316cf6aa2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:37.210731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2859357df1e1440abcfb162316cf6aa2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:37.215650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:37.252713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf83d-66d0-4454-bcdd-e265699d39e3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:37.266865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:37.267637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:37.268696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:37.269726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] PATH_INFO: `/v3/users/1d09c20427f6480f8398c272207bdc3a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:37.271733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d09c20427f6480f8398c272207bdc3a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:37.274968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:37.457462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2859357df1e1440abcfb162316cf6aa2', 'request_id': 'req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.466789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2859357df1e1440abcfb162316cf6aa2', 'request_id': 'req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.477285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2859357df1e1440abcfb162316cf6aa2', 'request_id': 'req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.559756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] The token cache is being invalidate because project 2859357df1e1440abcfb162316cf6aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:37.560300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.561681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.563574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2177/4372] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:37 2022] DELETE /identity/v3/projects/2859357df1e1440abcfb162316cf6aa2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:37.571358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:37.573654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:37.580992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d09c20427f6480f8398c272207bdc3a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.599940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d09c20427f6480f8398c272207bdc3a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.600515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d09c20427f6480f8398c272207bdc3a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.602171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d09c20427f6480f8398c272207bdc3a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.626186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d09c20427f6480f8398c272207bdc3a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.656770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca6af-c6f7-489a-b3f3-9556e8e5d44b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:37.662056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:37.662697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:37.662991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:37.663301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] PATH_INFO: `/v3/users/c2bcfbfb3c7945bb842b7b1126ce4179` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:37.664442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bcfbfb3c7945bb842b7b1126ce4179)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:37.666384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:37.710648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2196/4373] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:37 2022] DELETE /identity/v3/users/1d09c20427f6480f8398c272207bdc3a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:37.898620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bcfbfb3c7945bb842b7b1126ce4179'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.913177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bcfbfb3c7945bb842b7b1126ce4179'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.914050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bcfbfb3c7945bb842b7b1126ce4179'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.930265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bcfbfb3c7945bb842b7b1126ce4179'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:37.931127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bcfbfb3c7945bb842b7b1126ce4179'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:38.016360 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2178/4374] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:37 2022] DELETE /identity/v3/users/c2bcfbfb3c7945bb842b7b1126ce4179 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:38.344403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:38.345860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:38.450945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b1787-e9f3-4f7f-ad1c-1227cf845b3d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:38.513929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:38.514632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:38.514919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:38.515224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] PATH_INFO: `/v3/projects/7b1d9d12463547bbad613b16d3caea6b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:38.516386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1d9d12463547bbad613b16d3caea6b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:38.518357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:38.626494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1d9d12463547bbad613b16d3caea6b', 'request_id': 'req-491f4043-5c33-496e-948d-09b3603c3673'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:38.633319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1d9d12463547bbad613b16d3caea6b', 'request_id': 'req-491f4043-5c33-496e-948d-09b3603c3673'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:38.639953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1d9d12463547bbad613b16d3caea6b', 'request_id': 'req-491f4043-5c33-496e-948d-09b3603c3673'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:38.726607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:38.728082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:38.741005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac593851-7710-464a-bc5b-cec34796e6fb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:38.778745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] The token cache is being invalidate because project 7b1d9d12463547bbad613b16d3caea6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:38.779939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:38.782775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-491f4043-5c33-496e-948d-09b3603c3673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:38.784771 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2197/4375] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:38 2022] DELETE /identity/v3/projects/7b1d9d12463547bbad613b16d3caea6b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:38.789536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a79cf-93fc-4d8c-9852-c8c87033b1c0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:38.790052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a79cf-93fc-4d8c-9852-c8c87033b1c0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:38.790520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a79cf-93fc-4d8c-9852-c8c87033b1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:38.820491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-914a79cf-93fc-4d8c-9852-c8c87033b1c0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:38.820861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:38.821716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-914a79cf-93fc-4d8c-9852-c8c87033b1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:38.822355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:38.822831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:38.823419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] PATH_INFO: `/v3/projects/6f0b14660197442da644aab9a083ad2f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:38.825299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0b14660197442da644aab9a083ad2f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:38.830966 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2198/4376] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:38.838410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:38.838767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:38.839230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:38.839657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:38.861514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:38.863776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:38.879734 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2199/4377] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:38.888587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:38.898306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684f3ce-1c8b-4203-b73d-cb42e007758c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:38.910749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:38.911417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:38.911688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:38.911957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:38.912604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:38.912903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:38.914588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:38.928829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2200/4378] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:38.932995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:38.944045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110f11-50a1-46f2-9600-883ba7b0e485 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:38.948874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:38.949469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:38.949752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:38.950036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:38.950659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:38.952928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:38.961723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:39.058078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0b14660197442da644aab9a083ad2f', 'request_id': 'req-8113fa81-af1a-4bdb-8f22-06921e83285d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:39.065682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0b14660197442da644aab9a083ad2f', 'request_id': 'req-8113fa81-af1a-4bdb-8f22-06921e83285d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:39.072754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0b14660197442da644aab9a083ad2f', 'request_id': 'req-8113fa81-af1a-4bdb-8f22-06921e83285d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:39.095064 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2201/4379] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:38 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:39.099168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.164554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] The token cache is being invalidate because project 6f0b14660197442da644aab9a083ad2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:39.166766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:39.168359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8113fa81-af1a-4bdb-8f22-06921e83285d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:39.176712 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2179/4380] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:38 2022] DELETE /identity/v3/projects/6f0b14660197442da644aab9a083ad2f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:39.180513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0404-a092-4593-9c5d-2613275ce72e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.181488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0404-a092-4593-9c5d-2613275ce72e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.183220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0404-a092-4593-9c5d-2613275ce72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.197180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253167-7ade-407d-9151-46c4e92dccfa admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.203545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.204164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.204446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.204723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.205780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.207862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.246655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1d4d0404-a092-4593-9c5d-2613275ce72e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:39.248197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1d4d0404-a092-4593-9c5d-2613275ce72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:39.264473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2180/4381] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:39.275593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.275781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.276053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.301987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:39.303306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:39.315523 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2181/4382] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:39.316518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.326468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d12ed-0b6e-4dcd-abe7-8e8cad22be75 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.331268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.331978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.332267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.332874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.333190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:39.333498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.335197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.352752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2182/4383] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:39.353647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.355224 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2202/4384] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:39.356679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.367305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:39.371780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daad2e-6cfc-4dff-b8d6-275053d56e8d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.377504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:39.389541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.394754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.394891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.395143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.395813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.397806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.399330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1737-d307-4858-a690-71aef5a72e0c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.406771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.408070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.408823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.409309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.410707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.413464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.428058 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2203/4385] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:39.432814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.445847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633127ad-130f-4dcf-8e11-36c462ab9d6d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.451508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.452494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.453220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.453497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.454135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.462913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.477988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2204/4386] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:39.482241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.495278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42bc03-1c91-4f09-baa4-c964dfac9cac admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.500265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8ce1f-9d72-40b4-82b7-b382ec5c450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.500922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ce1f-9d72-40b4-82b7-b382ec5c450b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.501209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ce1f-9d72-40b4-82b7-b382ec5c450b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.501490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8ce1f-9d72-40b4-82b7-b382ec5c450b admin admin] PATH_INFO: `/v3/projects/51f83a5ab2764dcba7bd8de47ab57be0/users/875aff2a9be040a89b3795b91ac9c608/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.517211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8ce1f-9d72-40b4-82b7-b382ec5c450b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f83a5ab2764dcba7bd8de47ab57be0, user_id=875aff2a9be040a89b3795b91ac9c608, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.520645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8ce1f-9d72-40b4-82b7-b382ec5c450b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.552134 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2183/4387] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:39.556185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.634910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9a702-62b0-440a-a97a-75530575a30a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:39.640677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:39.666274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.668624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.668624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.668624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:39.672764 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2205/4388] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:39 2022] PUT /identity/v3/projects/51f83a5ab2764dcba7bd8de47ab57be0/users/875aff2a9be040a89b3795b91ac9c608/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:39.677532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:39.694007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:39.694007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:39.694007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:39.772588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] MFA Rules not processed for user `875aff2a9be040a89b3795b91ac9c608`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:39.773889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:39.890733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2206/4389] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:39.903837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.909332 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2184/4390] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:39.913049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:39.938775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0e80-7202-4878-820c-cbd463d37996 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.041989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.042669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.050375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.050375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.050375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.050375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.062647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2185/4391] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:40.067407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.097064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8d370-1723-4933-8010-e0fc4da2104d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.111209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.111927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.112209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.113617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5819f3-283e-400c-878a-d74df54dc330 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.120057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.121507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.123900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.138156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.138797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.139326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.144831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.144831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.145722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.176415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2186/4392] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:40.180694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.204104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d64e1-b43b-4382-aa9a-926890875f6e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.215700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a1f98-76fd-45d7-8345-f758b77de5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.216542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1f98-76fd-45d7-8345-f758b77de5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.216888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1f98-76fd-45d7-8345-f758b77de5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.217200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a1f98-76fd-45d7-8345-f758b77de5ee admin admin] PATH_INFO: `/v3/projects/594434eb76c64026a5af2780821e79d7/users/0855d30c9bb146feaa101430ab49558a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.242950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a1f98-76fd-45d7-8345-f758b77de5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=594434eb76c64026a5af2780821e79d7, user_id=0855d30c9bb146feaa101430ab49558a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.244255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a1f98-76fd-45d7-8345-f758b77de5ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.348022 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2207/4393] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:39 2022] POST /identity/v3/projects => generated 381 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:40.349384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.361426 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2187/4394] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:40 2022] PUT /identity/v3/projects/594434eb76c64026a5af2780821e79d7/users/0855d30c9bb146feaa101430ab49558a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:40.373842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.378074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.378074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.505388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] MFA Rules not processed for user `0855d30c9bb146feaa101430ab49558a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:40.506918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:40.574027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c03c-7367-4608-8236-66fb2474ccb5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.660223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.661053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.661540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.661660 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2188/4395] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:40.662113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.663044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.665905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.677889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.686598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd765-121e-40b5-8ada-8215a6f35fc4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.695363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.696111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.697041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.697464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.698230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.700636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.834054 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2208/4396] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:40 2022] POST /identity/v3/users => generated 297 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:40.835898 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2189/4397] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:40 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:40.839872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.841363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.855042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd139-e6d3-4d5e-adff-4e62a3913ec6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.965463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.966045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.966330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.966607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.967301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.968914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.977030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9a832-e453-4e45-ba03-e6df472c900f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:40.983198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2209/4398] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:40.984416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:40.984542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:40.985437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:40.985732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:40.986059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:40.986705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:40.989804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:40.996140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235c16-049b-4102-b51e-6fbdbbe88cb3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.002202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.002882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.003242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.003525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] PATH_INFO: `/v3/projects/f5c013ce4396477f9bc10860c42354de/users/9a27c15e895f4805ac6b6414e19fa845/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.022187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c013ce4396477f9bc10860c42354de, user_id=9a27c15e895f4805ac6b6414e19fa845, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.027881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.098594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2190/4399] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:40 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:41.099212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.110764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef212-5197-4723-9d13-57c820692752 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.116550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.117183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.117487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.117743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.118406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.120183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.131341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2191/4400] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:41.135611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.145860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0051-73bd-460f-aa02-ab854e191acc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.161668 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2210/4401] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:40 2022] PUT /identity/v3/projects/f5c013ce4396477f9bc10860c42354de/users/9a27c15e895f4805ac6b6414e19fa845/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:41.166027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.166520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.168444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.168803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.169089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] PATH_INFO: `/v3/projects/74ac693f45f84a1d97e793406a732cf3/users/1d514e03a2394bf08810c039cdb54b35/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.204821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ac693f45f84a1d97e793406a732cf3, user_id=1d514e03a2394bf08810c039cdb54b35, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.211325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.264952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51893bc-3c31-451a-918a-972996e5ea7c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.271307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.273668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.273668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.273869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.274622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.276496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.288987 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2211/4402] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:41.293265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.304706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa88f3-b26b-4bb3-b3c8-51ffce545029 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.312109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c747b-60b3-48f2-b070-24bedf4940a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.312793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c747b-60b3-48f2-b070-24bedf4940a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.313078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c747b-60b3-48f2-b070-24bedf4940a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.313358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c747b-60b3-48f2-b070-24bedf4940a6 admin admin] PATH_INFO: `/v3/projects/f5c013ce4396477f9bc10860c42354de/users/9a27c15e895f4805ac6b6414e19fa845/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.315579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c747b-60b3-48f2-b070-24bedf4940a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c013ce4396477f9bc10860c42354de, user_id=9a27c15e895f4805ac6b6414e19fa845, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.323140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c747b-60b3-48f2-b070-24bedf4940a6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.331905 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2192/4403] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:41 2022] PUT /identity/v3/projects/74ac693f45f84a1d97e793406a732cf3/users/1d514e03a2394bf08810c039cdb54b35/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:41.335410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2212/4404] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:41 2022] PUT /identity/v3/projects/f5c013ce4396477f9bc10860c42354de/users/9a27c15e895f4805ac6b6414e19fa845/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:41.336825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.350780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.350780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.350780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.382852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] MFA Rules not processed for user `9a27c15e895f4805ac6b6414e19fa845`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:41.384469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:41.436467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e9a5-54e7-49f0-baf2-5f8d8f4cce19 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.498340 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2213/4405] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:41.510864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.512427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:41.588633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.589627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.590012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.590637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.591467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.593998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.609676 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2193/4406] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:41.610640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.633139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c3595-0b06-4473-83da-f0a5139d5ca3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.639603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb1d2-8347-419b-8d98-2f1b84acdd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.649870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb1d2-8347-419b-8d98-2f1b84acdd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.650456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb1d2-8347-419b-8d98-2f1b84acdd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.650826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8c5a-99ef-424e-bece-7c73d0db170e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:41.651370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb1d2-8347-419b-8d98-2f1b84acdd6c admin admin] PATH_INFO: `/v3/projects/74ac693f45f84a1d97e793406a732cf3/users/1d514e03a2394bf08810c039cdb54b35/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.656653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb1d2-8347-419b-8d98-2f1b84acdd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ac693f45f84a1d97e793406a732cf3, user_id=1d514e03a2394bf08810c039cdb54b35, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.657477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb1d2-8347-419b-8d98-2f1b84acdd6c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.659778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:41.662571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.662863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.663368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.673902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:41.675873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:41.683563 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2194/4407] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:41 2022] PUT /identity/v3/projects/74ac693f45f84a1d97e793406a732cf3/users/1d514e03a2394bf08810c039cdb54b35/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:41.694507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:41.694795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:41.695096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:41.698286 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2214/4408] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:03:41.741736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] MFA Rules not processed for user `1d514e03a2394bf08810c039cdb54b35`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:41.744380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:41.893658 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2195/4409] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:41.896703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.934078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:41.993834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ae513-460e-4405-961d-000e5d8c002b service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:42.000747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d514e03a2394bf08810c039cdb54b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74ac693f45f84a1d97e793406a732cf3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:42.001378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:42.001666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:42.001996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:42.002637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:42.005737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:42.019236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ff252-1ba3-4da1-8b80-c17d223354b4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:42.024527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:42.026650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:42.027042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:42.027435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:42.117368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:42.119999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:42.131940 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2196/4410] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:42.158322 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2215/4411] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:41 2022] POST /identity/v3/projects => generated 358 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:42.163135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:42.256718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948cd35-8523-4cf3-8266-d585ce984cf5 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:42.375161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0855d30c9bb146feaa101430ab49558a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '594434eb76c64026a5af2780821e79d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:42.375759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:42.376122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:42.376711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] PATH_INFO: `/v3/projects/a45f600c355d46f99378d98f14fa0253` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:42.378122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] RBAC: Authorizing `identity:delete_project(project_id=a45f600c355d46f99378d98f14fa0253)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Sep 06 11:03:42.385554 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application enforcer_obj._enforce( Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Sep 06 11:03:42.386658 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:42.390571 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2197/4412] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:42 2022] DELETE /identity/v3/projects/a45f600c355d46f99378d98f14fa0253 => generated 136 bytes in 228 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:42.392066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:42.483920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64face82-c506-440c-8449-b80dcee4b844 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:42.490006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d514e03a2394bf08810c039cdb54b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74ac693f45f84a1d97e793406a732cf3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:42.491047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:42.491629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:42.492089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] PATH_INFO: `/v3/projects/a45f600c355d46f99378d98f14fa0253` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:42.493620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a45f600c355d46f99378d98f14fa0253)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:42.496522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:42.568115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:42.620687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:42.652778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45f600c355d46f99378d98f14fa0253', 'request_id': 'req-e4c8f9b2-e6dd-4b30-af12-6004936647f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:42.661261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45f600c355d46f99378d98f14fa0253', 'request_id': 'req-e4c8f9b2-e6dd-4b30-af12-6004936647f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:42.669680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45f600c355d46f99378d98f14fa0253', 'request_id': 'req-e4c8f9b2-e6dd-4b30-af12-6004936647f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:42.812238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] The token cache is being invalidate because project a45f600c355d46f99378d98f14fa0253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:42.812522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:42.813383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:42.817094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2216/4413] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:42 2022] DELETE /identity/v3/projects/a45f600c355d46f99378d98f14fa0253 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:42.826645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:42.829967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:42.855966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:42.857832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:42.918228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670e6e-da73-4513-85cc-13459267c48b tempest-ProjectsNegativeTestJSON-622618066 tempest-ProjectsNegativeTestJSON-622618066-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:42.964812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f9b2-e6dd-4b30-af12-6004936647f5 tempest-ProjectsNegativeTestJSON-1850282252 tempest-ProjectsNegativeTestJSON-1850282252-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:42.969843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:42.970631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:42.970923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:42.971232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] PATH_INFO: `/v3/users/875aff2a9be040a89b3795b91ac9c608` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:42.972819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] RBAC: Authorizing `identity:delete_user(user_id=875aff2a9be040a89b3795b91ac9c608)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:42.974760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:43.006587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:43.007262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:43.007895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:43.008177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] PATH_INFO: `/v3/users/0855d30c9bb146feaa101430ab49558a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:43.009395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0855d30c9bb146feaa101430ab49558a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:43.011363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:43.232388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0855d30c9bb146feaa101430ab49558a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.233048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875aff2a9be040a89b3795b91ac9c608'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.239757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875aff2a9be040a89b3795b91ac9c608'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.240026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0855d30c9bb146feaa101430ab49558a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.240580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0855d30c9bb146feaa101430ab49558a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.241846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875aff2a9be040a89b3795b91ac9c608'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.242459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875aff2a9be040a89b3795b91ac9c608'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.252880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0855d30c9bb146feaa101430ab49558a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.254060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c531dc0c-847d-41e3-af75-c63e7c6be40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0855d30c9bb146feaa101430ab49558a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.254894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b8e9c05f-7ef5-492e-a81a-47a35378878d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875aff2a9be040a89b3795b91ac9c608'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:43.339932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2198/4414] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:42 2022] DELETE /identity/v3/users/0855d30c9bb146feaa101430ab49558a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:43.344278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:43.344678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:43.345058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:43.366334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:43.367753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:43.417213 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2217/4415] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:42 2022] DELETE /identity/v3/users/875aff2a9be040a89b3795b91ac9c608 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:43.417213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:43.417213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:43.417213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:43.433935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2199/4416] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:43.436582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:43.437931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:43.449669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:43.451155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:43.517625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465287e-71d4-4cce-bf97-660eaef2291b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:43.528045 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2218/4417] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:43.539693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:43.589545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:43.590463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:43.590750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:43.591051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:43.603338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:43.605059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:43.617332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af0dac-0ca2-4bc3-901e-b049db5fb633 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:43.618332 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2200/4418] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:03:43.626646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:43.627418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:43.627708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:43.628019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:43.660746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:43.663706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:43.686573 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2219/4419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:03:44.261425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:44.263651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:44.280831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdee7e-5bf1-4f58-93a5-545116a0a0d0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:44.288142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:44.288968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:44.289430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:44.289857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] PATH_INFO: `/v3/projects/51f83a5ab2764dcba7bd8de47ab57be0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:44.291915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f83a5ab2764dcba7bd8de47ab57be0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:44.294391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:44.410486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:44.411973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:44.446549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475115e8-d242-447a-9167-219675fbaff2 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:44.447213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f83a5ab2764dcba7bd8de47ab57be0', 'request_id': 'req-d887e397-0dfe-4012-819c-a242ab92f0ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.473024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f83a5ab2764dcba7bd8de47ab57be0', 'request_id': 'req-d887e397-0dfe-4012-819c-a242ab92f0ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.480971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f83a5ab2764dcba7bd8de47ab57be0', 'request_id': 'req-d887e397-0dfe-4012-819c-a242ab92f0ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.523978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:44.524686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:44.525051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:44.525407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] PATH_INFO: `/v3/projects/594434eb76c64026a5af2780821e79d7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:44.526602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594434eb76c64026a5af2780821e79d7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:44.528615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:44.627374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] The token cache is being invalidate because project 51f83a5ab2764dcba7bd8de47ab57be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:44.627926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.629462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.631062 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2201/4420] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:44 2022] DELETE /identity/v3/projects/51f83a5ab2764dcba7bd8de47ab57be0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:44.635257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:44.636668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:44.638152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594434eb76c64026a5af2780821e79d7', 'request_id': 'req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.644840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594434eb76c64026a5af2780821e79d7', 'request_id': 'req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.651610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887e397-0dfe-4012-819c-a242ab92f0ad admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:44.653622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594434eb76c64026a5af2780821e79d7', 'request_id': 'req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.709721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:44.710272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:44.710553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:44.710827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] PATH_INFO: `/v3/users/9a27c15e895f4805ac6b6414e19fa845` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:44.711987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a27c15e895f4805ac6b6414e19fa845)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:44.714107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:44.762876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] The token cache is being invalidate because project 594434eb76c64026a5af2780821e79d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:44.763495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.763823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.765299 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2220/4421] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:44 2022] DELETE /identity/v3/projects/594434eb76c64026a5af2780821e79d7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:44.770144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:44.771503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:44.784827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e9b7b-63d9-4483-9c3f-34687ee4a934 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:44.789546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:44.790269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:44.793334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:44.793334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] PATH_INFO: `/v3/users/1d514e03a2394bf08810c039cdb54b35` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:44.793334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d514e03a2394bf08810c039cdb54b35)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:44.794556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:44.993184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a27c15e895f4805ac6b6414e19fa845'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:44.999935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a27c15e895f4805ac6b6414e19fa845'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.000628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a27c15e895f4805ac6b6414e19fa845'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.014063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a27c15e895f4805ac6b6414e19fa845'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.014769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a27c15e895f4805ac6b6414e19fa845'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.080283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d514e03a2394bf08810c039cdb54b35'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.087240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d514e03a2394bf08810c039cdb54b35'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.087919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d514e03a2394bf08810c039cdb54b35'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.088528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d514e03a2394bf08810c039cdb54b35'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.101323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d514e03a2394bf08810c039cdb54b35'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.134511 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2202/4422] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:44 2022] DELETE /identity/v3/users/9a27c15e895f4805ac6b6414e19fa845 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:45.225636 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2221/4423] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:44 2022] DELETE /identity/v3/users/1d514e03a2394bf08810c039cdb54b35 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:45.437424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:45.505406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:45.610507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:45.624281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:45.715598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0af65-c137-40ed-a6af-43df35231f59 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:45.780799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:45.781590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:45.782031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:45.782509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] PATH_INFO: `/v3/projects/f5c013ce4396477f9bc10860c42354de` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:45.783715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c013ce4396477f9bc10860c42354de)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:45.786247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:45.901443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:45.902956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:45.925239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f4ebd-eeef-41b2-a41e-ae9fe7747327 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:45.937158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c013ce4396477f9bc10860c42354de', 'request_id': 'req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.944692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c013ce4396477f9bc10860c42354de', 'request_id': 'req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.950577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c013ce4396477f9bc10860c42354de', 'request_id': 'req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:45.985052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:45.985697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:45.985981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:45.986260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] PATH_INFO: `/v3/projects/74ac693f45f84a1d97e793406a732cf3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:45.987459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ac693f45f84a1d97e793406a732cf3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:45.989432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.002284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] The token cache is being invalidate because project f5c013ce4396477f9bc10860c42354de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:46.002584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.003759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2d1f5-66e8-47a3-9289-913b5e6d83e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.005307 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2203/4424] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:45 2022] DELETE /identity/v3/projects/f5c013ce4396477f9bc10860c42354de => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:46.010396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7d61-3084-4452-8148-c4bc4419436c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.010687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7d61-3084-4452-8148-c4bc4419436c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.010969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7d61-3084-4452-8148-c4bc4419436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.031004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d0fc7d61-3084-4452-8148-c4bc4419436c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:46.032251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d0fc7d61-3084-4452-8148-c4bc4419436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.040445 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2204/4425] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:46.048150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.048452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.048710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.069554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:46.070751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.079206 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2205/4426] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:46.083897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.093006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fb0a-3cc0-4d5b-b62a-255d85d62f9a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.098562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.099199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.099482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.100123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.100388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:46.100698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.102300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.114608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2206/4427] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:46.118974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.130233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea1980-996e-4fd8-8a08-ae25d062e230 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.146387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ac693f45f84a1d97e793406a732cf3', 'request_id': 'req-0bcef1c0-e50c-4a01-bdae-392b51811436'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.154309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ac693f45f84a1d97e793406a732cf3', 'request_id': 'req-0bcef1c0-e50c-4a01-bdae-392b51811436'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.165787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ac693f45f84a1d97e793406a732cf3', 'request_id': 'req-0bcef1c0-e50c-4a01-bdae-392b51811436'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.193054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.193667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.193952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.194226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.194927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.196917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.265003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] The token cache is being invalidate because project 74ac693f45f84a1d97e793406a732cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:46.265535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.266296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bcef1c0-e50c-4a01-bdae-392b51811436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:46.271183 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2222/4428] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:03:45 2022] DELETE /identity/v3/projects/74ac693f45f84a1d97e793406a732cf3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:46.287180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b80a-b86c-4488-aa05-7ba89a7883e5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.287615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b80a-b86c-4488-aa05-7ba89a7883e5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.287965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b80a-b86c-4488-aa05-7ba89a7883e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.311989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f5e0b80a-b86c-4488-aa05-7ba89a7883e5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:46.313462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f5e0b80a-b86c-4488-aa05-7ba89a7883e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.332170 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2223/4429] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:46.335727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.336298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.336772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.358350 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2207/4430] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:46.362251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.364789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.381702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:46.385698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.449440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cd9e2-b343-4bf4-92c0-6dc89b5da6a1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.456497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.458326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.458326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.458588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.459318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.461306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.473742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2224/4431] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:46.478137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.490146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db15f9-91d0-41de-8354-419cfbcefb92 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.495912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.496767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.497192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.497544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.498304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:46.498683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.500473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.519911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2225/4432] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:46.527730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.543990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bdfce-da43-4d20-abc7-cf6a261d99b0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.549735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.553833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.553833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.553833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.553833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.557375 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2208/4433] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:46.557476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.558444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.573122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2a4b-49ae-4596-abf4-50c9c93645ce admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.576373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:46.583054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.583054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.583054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.583054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.583606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.585372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.613548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2209/4434] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:46.615667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.626312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf9c3c-9d19-4632-9a41-655bd6851ba6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.632048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.633143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.633504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.633858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.634724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.636435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.636733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:46.653958 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2210/4435] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:46.658349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.672671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba893fd-a638-4df5-93fd-bc2a7ea1cb46 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.679581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3619dbe-67c3-43ea-b115-6ec29a4ab675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.680230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619dbe-67c3-43ea-b115-6ec29a4ab675 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.680614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619dbe-67c3-43ea-b115-6ec29a4ab675 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.681069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3619dbe-67c3-43ea-b115-6ec29a4ab675 admin admin] PATH_INFO: `/v3/projects/8052bbf12c694a9eb067ba351538ce8f/users/55653ffb98a841e599b1305dcd1ec6be/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.681701 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2226/4436] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:46.682891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.699305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619dbe-67c3-43ea-b115-6ec29a4ab675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8052bbf12c694a9eb067ba351538ce8f, user_id=55653ffb98a841e599b1305dcd1ec6be, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.702411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3619dbe-67c3-43ea-b115-6ec29a4ab675 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.761292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98876b-e92f-4183-9fb2-9921dd35731f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.773071 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2211/4437] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:46 2022] PUT /identity/v3/projects/8052bbf12c694a9eb067ba351538ce8f/users/55653ffb98a841e599b1305dcd1ec6be/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:46.783647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.783941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.784776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.818998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] MFA Rules not processed for user `55653ffb98a841e599b1305dcd1ec6be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:46.820319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.825007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.825620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.825904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.826187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.826818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.828864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.888677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2212/4438] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:03:46.910222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.910222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:46.959269 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2227/4439] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:46 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:46.963838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:46.976673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b599d-226a-4629-99a5-db408fb85cfa None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.981156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.981775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.982063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.982351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.984085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4db71-64b6-4e6d-9067-b36ba8d0d854 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:46.994384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:46.995719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:46.996002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:46.996789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:46.997499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:46.998410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:46.999195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.002577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.012473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2213/4440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:03:47.021763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2228/4441] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:03:47.028376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.042204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a67df-d52f-4731-a6a8-d169bb0e1dd7 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:47.047590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6130cf-fc29-4eea-8f87-ba81f36b0c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:47.048321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6130cf-fc29-4eea-8f87-ba81f36b0c8c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.048681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6130cf-fc29-4eea-8f87-ba81f36b0c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.049032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6130cf-fc29-4eea-8f87-ba81f36b0c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.049744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6130cf-fc29-4eea-8f87-ba81f36b0c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.052829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6130cf-fc29-4eea-8f87-ba81f36b0c8c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.065340 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2214/4442] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:47.069700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.082891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163db98e-158c-4144-bd14-7dc956050320 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:47.089053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:47.089738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.090021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.090303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] PATH_INFO: `/v3/projects/8c77a7ba824945278a598e08f4ddcba8/users/fefa79f110954b649423b7304f28300d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.108796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c77a7ba824945278a598e08f4ddcba8, user_id=fefa79f110954b649423b7304f28300d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.111660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.230469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2229/4443] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:47 2022] PUT /identity/v3/projects/8c77a7ba824945278a598e08f4ddcba8/users/fefa79f110954b649423b7304f28300d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:47.241740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.242032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.242316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.270696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] MFA Rules not processed for user `fefa79f110954b649423b7304f28300d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:47.271978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:47.335784 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2215/4444] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:47.340328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.402565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d18d-cc10-4c33-a5b5-8d5c44f1cc96 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:47.407290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:47.407893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.408179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.408458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.409093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.411035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.557257 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2230/4445] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:47 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:47.561646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.573471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384bcb-2c83-491f-a8c4-c62ecf179218 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:47.635588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:47.636211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.636493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.636798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.638087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.640254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.734584 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2216/4446] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:47 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:47.739098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.751399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bb8ee-4f89-4790-a4d8-1815a498f407 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:47.757121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:47.757985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.758352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.758526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.759253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.761032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.773286 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2231/4447] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:47.777601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.789708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc89ad-f089-4a85-8a24-ec5cc75ec3c5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:47.794842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:47.795678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:47.796063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:47.796396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] PATH_INFO: `/v3/projects/40eefddbf91c4c89b9f0faeac1440f35/users/df9b193a676e40e7bc4e209e0f9adb09/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:47.845360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eefddbf91c4c89b9f0faeac1440f35, user_id=df9b193a676e40e7bc4e209e0f9adb09, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:47.849606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:47.943260 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2217/4448] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:47 2022] PUT /identity/v3/projects/40eefddbf91c4c89b9f0faeac1440f35/users/df9b193a676e40e7bc4e209e0f9adb09/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:47.946333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:47.957343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5cdf-cda7-47d6-a677-e0dd31d44b0e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:48.084652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9aacc-4e51-4e4b-9714-02d65e5aac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:48.085370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9aacc-4e51-4e4b-9714-02d65e5aac3b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.086503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9aacc-4e51-4e4b-9714-02d65e5aac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.086788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9aacc-4e51-4e4b-9714-02d65e5aac3b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.087660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9aacc-4e51-4e4b-9714-02d65e5aac3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:48.089540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9aacc-4e51-4e4b-9714-02d65e5aac3b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:48.107071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2232/4449] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:48.112356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:48.129733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461ba9-1d4d-4fb2-9b83-00a7d4ba8c30 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:48.137587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:48.138538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.138922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.139325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] PATH_INFO: `/v3/projects/40eefddbf91c4c89b9f0faeac1440f35/users/df9b193a676e40e7bc4e209e0f9adb09/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.141410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eefddbf91c4c89b9f0faeac1440f35, user_id=df9b193a676e40e7bc4e209e0f9adb09, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:48.144861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:48.172517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2218/4450] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:48 2022] PUT /identity/v3/projects/40eefddbf91c4c89b9f0faeac1440f35/users/df9b193a676e40e7bc4e209e0f9adb09/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:48.174320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.174796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.175349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.225550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] MFA Rules not processed for user `df9b193a676e40e7bc4e209e0f9adb09`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:48.227290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:48.326280 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2233/4451] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:48.328253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:48.346636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd486a36-5482-46f8-9914-186e6feb6ee7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:48.355473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:48.356721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.357092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.359355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.368872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:48.370676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:48.502692 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2219/4452] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:48 2022] POST /identity/v3/roles => generated 235 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:48.507951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:48.518893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28172cd3-c782-477e-86a8-e53829cccd82 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:48.526762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:48.531805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.531805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.531805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.531805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:48.531805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:48.550594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:48.682477 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2234/4453] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:48 2022] POST /identity/v3/roles => generated 235 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:48.683726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:48.688642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:48.703095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8d05b-0956-4d1d-8ddb-5c02ca1421a0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:48.712831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:48.736246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.737741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.738278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.741199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:48.744242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:48.896336 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2220/4454] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:48 2022] POST /identity/v3/roles => generated 234 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:48.898470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:48.922660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17b39-54a0-435c-a9fa-712cc84838e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:48.938322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:48.939799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:48.939799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:48.940241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:48.941601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:48.943947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:49.083526 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2235/4455] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:03:48 2022] POST /identity/v3/domains => generated 276 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:49.088456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:49.110124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e9af0-c6ff-4e43-926e-08cc3714f411 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:49.231807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:49.232547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:49.234923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:49.235309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:49.236062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:49.241892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:49.511506 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2221/4456] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:03:49 2022] POST /identity/v3/projects => generated 400 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:49.515633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:49.542299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27546-9403-4931-99d6-d32faee6344d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:49.723833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:49.723833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:49.724206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:49.724442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:49.725309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:49.728143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:49.833641 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2236/4457] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:03:49 2022] POST /identity/v3/groups => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:49.833950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:49.846776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdb9e1-f8bf-49d0-a294-818a0a52e5c7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:49.854201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:49.855137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:49.855610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:49.856087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:49.857823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:49.860425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:49.980847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:49.983097 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2222/4458] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:49 2022] POST /identity/v3/roles => generated 234 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:49.998766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5067ec-79ad-45ef-8cac-74903ed30e4f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:50.013050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:50.014875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:50.015356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:50.016096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:50.017777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:50.020532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:50.154286 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2237/4459] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:49 2022] POST /identity/v3/users => generated 442 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:50.158735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:50.180149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437879-f2ec-4598-a9bc-e87a849d3fd6 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:50.185909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:50.186542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:50.186834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:50.187309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:50.188019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:50.189314 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:50.189314 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:50.189314 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:50.201504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:50.325333 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2223/4460] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:50 2022] POST /identity/v3/roles => generated 270 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:50.330067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:50.341170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7ad8a-f5d7-48a0-84c9-f1eb53561995 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:50.346917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:50.347804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:50.348309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:50.348627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/80c57a030793454687839bc96250972b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:50.367998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=80c57a030793454687839bc96250972b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:50.370826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:50.495056 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2238/4461] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:50 2022] PUT /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/80c57a030793454687839bc96250972b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:50.499484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:50.511212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a82a1-b6a9-45b3-b363-00b5e91f8775 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:50.608346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:50.610213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:50.610517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:50.610854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:50.612192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Adding query filter params (scope.project.id=3ef35181980c452385ed16c7194b521c, user.id=e1ff176aea554810a7c5e7e4ef4917c8) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:50.612192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:50.614517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:50.663929 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2224/4462] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 11:03:50 2022] GET /identity/v3/role_assignments?scope.project.id=3ef35181980c452385ed16c7194b521c&user.id=e1ff176aea554810a7c5e7e4ef4917c8&effective => generated 228 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:03:50.667920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:50.679233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338f0a5-e104-4b46-be22-0974f870c86f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:50.684573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:50.685230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:50.685524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:50.685807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/80c57a030793454687839bc96250972b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:50.688947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=80c57a030793454687839bc96250972b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:50.691985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:50.699218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 80c57a030793454687839bc96250972b was removed from user e1ff176aea554810a7c5e7e4ef4917c8 on project 3ef35181980c452385ed16c7194b521c. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:50.699787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:50.700512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:50.795535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2239/4463] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:03:50 2022] DELETE /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/80c57a030793454687839bc96250972b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:50.795815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:50.795815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:50.811765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa6341-5311-4225-ae66-3cb236a6243c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:50.902789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:50.905328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:50.905906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:50.906412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/80c57a030793454687839bc96250972b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:50.909546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=80c57a030793454687839bc96250972b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:50.911497 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:50.911497 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:50.911497 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:50.913700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:51.067800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 80c57a030793454687839bc96250972b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:51.068084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:51.079787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:51.079787 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2225/4464] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:50 2022] DELETE /identity/v3/roles/80c57a030793454687839bc96250972b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:51.082971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:51.113125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4d1ed-340b-41c4-b850-44060a861e59 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:51.227704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:51.228664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:51.229114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:51.229581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/fd33ab8e5f494727acddc8baaa609999` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:51.233446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=fd33ab8e5f494727acddc8baaa609999)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:51.236648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:51.363463 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2240/4465] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:51 2022] PUT /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/fd33ab8e5f494727acddc8baaa609999 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:51.367505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:51.369172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:51.382311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6df06-3e00-4afb-b166-3e99ccb7b4e3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:51.497503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:51.498281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:51.498651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:51.499977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:51.501933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:51.503191 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:51.503191 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:51.503191 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:51.508513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:51.624562 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2226/4466] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:03:51 2022] PUT /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 521 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:51.628361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:51.652070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543471e-200d-4aa2-87bd-2fc479cebc2f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:51.767995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:51.767995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:51.767995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:51.768672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:51.768944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Adding query filter params (scope.project.id=3ef35181980c452385ed16c7194b521c, user.id=e1ff176aea554810a7c5e7e4ef4917c8) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:51.770568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:51.774731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:51.922008 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2241/4467] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 11:03:51 2022] GET /identity/v3/role_assignments?scope.project.id=3ef35181980c452385ed16c7194b521c&user.id=e1ff176aea554810a7c5e7e4ef4917c8&effective => generated 1061 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:03:51.926393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:51.939600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49791d6-be59-4023-ae03-c8b1156f03ed tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:51.946409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:51.947751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:51.948235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:51.948689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:51.950830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:51.952190 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:51.952190 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:51.952190 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:51.953735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06cf61-0c8b-48d2-a7aa-30f9b3084899 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:52.055853 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2227/4468] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:03:51 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:52.064635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:52.076576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eee83e-a723-4566-97b1-3a1ff6114555 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:52.170261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.170552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.171111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.229383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] MFA Rules not processed for user `f16abbf8a68344b68444ff8fc2795c67`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:52.243550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:52.248311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:52.265485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:52.267715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.269546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.269910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.270785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Adding query filter params (scope.project.id=3ef35181980c452385ed16c7194b521c, user.id=e1ff176aea554810a7c5e7e4ef4917c8) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:52.271900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:52.281135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:52.351427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2228/4469] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:52.374830 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2242/4470] 10.222.0.20 () {58 vars in 1356 bytes} [Tue Sep 6 11:03:52 2022] GET /identity/v3/role_assignments?scope.project.id=3ef35181980c452385ed16c7194b521c&user.id=e1ff176aea554810a7c5e7e4ef4917c8&effective => generated 577 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:52.379553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:52.394700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2f57b-5ccd-43d8-b5f0-619e4ed07cf4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:52.401150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:52.402019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.402572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.402789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.404977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:52.406896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f.: keystone.exception.ImpliedRoleNotFound: fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f. Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = query.one() Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._iter().one() Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._only_one_row( Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:52.419375 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 06 11:03:52.420504 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 06 11:03:52.421507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 06 11:03:52.421507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 06 11:03:52.421507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 06 11:03:52.421507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f. Sep 06 11:03:52.421507 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:52.425033 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2229/4471] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:03:52 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 137 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:52.425772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:52.439240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728181a9-3b5f-406f-be3d-92efa5d57127 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:52.455529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:52.460589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.475333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.475871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/fd33ab8e5f494727acddc8baaa609999` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.481200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=fd33ab8e5f494727acddc8baaa609999)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:52.486564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:52.497492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role fd33ab8e5f494727acddc8baaa609999 was removed from user e1ff176aea554810a7c5e7e4ef4917c8 on project 3ef35181980c452385ed16c7194b521c. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:52.498988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:52.499951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:52.591372 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2243/4472] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:03:52 2022] DELETE /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/fd33ab8e5f494727acddc8baaa609999 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:52.596176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:52.601017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:52.623601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177789ff-5f8e-4645-9d02-8af68417c209 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:52.726944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:52.728049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.728049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.728293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.729077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:52.730443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:52.814585 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2230/4473] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:03:52 2022] POST /identity/v3/roles => generated 271 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:52.819400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:52.830556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccaff5-224b-462b-840d-c7371a0b92cf tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:52.836487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:52.837121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.837592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.837875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.838524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Adding query filter params (domain_id=304a8a6766524b1488953fa046fd940c) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:52.838845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:52.839886 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:52.839886 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:52.839886 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:52.840803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:52.852198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2244/4474] 10.222.0.20 () {58 vars in 1207 bytes} [Tue Sep 6 11:03:52 2022] GET /identity/v3/roles?domain_id=304a8a6766524b1488953fa046fd940c => generated 408 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:52.854147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:52.865715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6be22-9a9a-4fb1-b81e-f184d6d41b14 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:52.872433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:52.873224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:52.873685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:52.873939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/ca455030923a4f9bbbd54d8b0708bcf1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:52.875737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ca455030923a4f9bbbd54d8b0708bcf1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:52.876904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:53.030265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role ca455030923a4f9bbbd54d8b0708bcf1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:53.030924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:53.035004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:53.046457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.048546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:53.048684 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2231/4475] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:52 2022] DELETE /identity/v3/roles/ca455030923a4f9bbbd54d8b0708bcf1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:53.069668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7de6-81b1-4818-98e8-aa2e50ef2b38 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:53.141575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:53.142197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:53.142579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:53.143412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:53.145019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Adding query filter params (domain_id=304a8a6766524b1488953fa046fd940c) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:03:53.145019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:53.147194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:53.154907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2245/4476] 10.222.0.20 () {58 vars in 1207 bytes} [Tue Sep 6 11:03:53 2022] GET /identity/v3/roles?domain_id=304a8a6766524b1488953fa046fd940c => generated 148 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:53.158548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.181146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd55ad4-bde1-4eea-bb14-065889b36dd4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:53.186204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:53.187428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:53.187428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:53.187822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/ca455030923a4f9bbbd54d8b0708bcf1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:53.210841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Could not find role: ca455030923a4f9bbbd54d8b0708bcf1.: keystone.exception.RoleNotFound: Could not find role: ca455030923a4f9bbbd54d8b0708bcf1. Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Sep 06 11:03:53.217606 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:03:53.218873 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ca455030923a4f9bbbd54d8b0708bcf1. Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:03:53.228419 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2232/4477] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:53 2022] DELETE /identity/v3/roles/ca455030923a4f9bbbd54d8b0708bcf1 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:53.229309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.240528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27801413-cb1b-4328-a430-c8ff864639fe tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:53.259383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:53.262694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:53.262694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:53.262694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:53.311190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=304a8a6766524b1488953fa046fd940c, group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:53.314562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:53.421124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2246/4478] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:53 2022] PUT /identity/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:53.425734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.442577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c9dd-5d3d-4c45-a785-6838be8ab7fc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:53.564868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:53.565866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:53.566318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:53.566757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:53.568712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=304a8a6766524b1488953fa046fd940c, group_id=10ae1ea79b244be88a4d92be9902fc19)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:53.571558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:53.594801 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2233/4479] 10.222.0.20 () {58 vars in 1365 bytes} [Tue Sep 6 11:03:53 2022] GET /identity/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles => generated 409 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:53.599748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.618214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af249ac-367e-42f3-bd0e-0ddcb9df3f17 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:53.624158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:53.625159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:53.625685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:53.626354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:53.628472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:53.632854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=304a8a6766524b1488953fa046fd940c, group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:53.633430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:53.641437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2247/4480] 10.222.0.20 () {58 vars in 1465 bytes} [Tue Sep 6 11:03:53 2022] HEAD /identity/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:53.645911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.656588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819b9d-693c-44ee-aba9-2fb997666ed9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:53.669998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:53.670688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:53.671095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:53.671273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:53.681060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=304a8a6766524b1488953fa046fd940c, group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:53.684380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:53.695732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role b2c5c975bee644b69e780a33862e1167 was removed from group 10ae1ea79b244be88a4d92be9902fc19 on domain 304a8a6766524b1488953fa046fd940c. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:53.696220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:53.697455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:53.866271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2234/4481] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:03:53 2022] DELETE /identity/v3/domains/304a8a6766524b1488953fa046fd940c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:53.868291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:53.870507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:53.895867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253d1a0-64bb-4eff-abe6-8eb155b8e50f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:54.008061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:54.008848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:54.009326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:54.009708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:54.014766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ef35181980c452385ed16c7194b521c, group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:54.025526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:54.116533 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2248/4482] 10.222.0.20 () {60 vars in 1486 bytes} [Tue Sep 6 11:03:53 2022] PUT /identity/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:54.123465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:54.139218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e75b6-9983-484c-bca5-af84217c5ff5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:54.287447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726763-88e5-40a5-82e9-37e6343b852c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:54.290970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726763-88e5-40a5-82e9-37e6343b852c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:54.290970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726763-88e5-40a5-82e9-37e6343b852c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:54.290970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726763-88e5-40a5-82e9-37e6343b852c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:54.290970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726763-88e5-40a5-82e9-37e6343b852c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_grants(project_id=3ef35181980c452385ed16c7194b521c, group_id=10ae1ea79b244be88a4d92be9902fc19)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:54.293870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726763-88e5-40a5-82e9-37e6343b852c tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:54.307059 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2235/4483] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:03:54 2022] GET /identity/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles => generated 410 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:54.311411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:54.324305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68773b3-1ddf-427a-9557-fcb20ec3f91e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:54.334060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:54.343106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:54.343106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:54.343106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/groups/10ae1ea79b244be88a4d92be9902fc19/users/e1ff176aea554810a7c5e7e4ef4917c8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:54.343106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=10ae1ea79b244be88a4d92be9902fc19, user_id=e1ff176aea554810a7c5e7e4ef4917c8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:54.343709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:54.459388 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2249/4484] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 11:03:54 2022] PUT /identity/v3/groups/10ae1ea79b244be88a4d92be9902fc19/users/e1ff176aea554810a7c5e7e4ef4917c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:54.463884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:54.464537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:54.465006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:54.563328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] MFA Rules not processed for user `e1ff176aea554810a7c5e7e4ef4917c8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:03:54.563328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:54.735157 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2236/4485] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:03:54 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:03:54.744621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:54.830942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fefe33-2fba-4942-9495-2b3c13f697ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:54.836943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:54.837640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:54.837930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:54.838281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:54.840802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_grant(project_id=3ef35181980c452385ed16c7194b521c, group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:54.843763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:54.851797 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2250/4486] 10.222.0.20 () {58 vars in 1468 bytes} [Tue Sep 6 11:03:54 2022] HEAD /identity/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:54.856034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:54.868650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f423-2e83-4b17-aee4-526c02c3bbd0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:54.874327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:54.874692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:54.874999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:54.875260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:54.878838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ef35181980c452385ed16c7194b521c, group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:54.884517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:54.888348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role b2c5c975bee644b69e780a33862e1167 was removed from group 10ae1ea79b244be88a4d92be9902fc19 on project 3ef35181980c452385ed16c7194b521c. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:54.888651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:54.889419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:55.022120 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2237/4487] 10.222.0.20 () {58 vars in 1470 bytes} [Tue Sep 6 11:03:54 2022] DELETE /identity/v3/projects/3ef35181980c452385ed16c7194b521c/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:55.026519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:55.030151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:55.045979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cab75b-5224-4182-89c3-36584c85fdb2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:55.117930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:55.117930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:55.118301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:55.118548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/groups/10ae1ea79b244be88a4d92be9902fc19/users/e1ff176aea554810a7c5e7e4ef4917c8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:55.120646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=10ae1ea79b244be88a4d92be9902fc19, user_id=e1ff176aea554810a7c5e7e4ef4917c8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:55.121897 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:55.121897 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:55.121897 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:55.123318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:55.326909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e1ff176aea554810a7c5e7e4ef4917c8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:55.435039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2251/4488] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 11:03:55 2022] DELETE /identity/v3/groups/10ae1ea79b244be88a4d92be9902fc19/users/e1ff176aea554810a7c5e7e4ef4917c8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:55.441743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:55.459483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce5b51-e3cb-43da-b589-e7b74ddf4780 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:55.532719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:55.533343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:55.533834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:55.534007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:55.536246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:55.538692 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:55.538692 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:55.538692 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:55.540053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:55.615938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2238/4489] 10.222.0.20 () {60 vars in 1381 bytes} [Tue Sep 6 11:03:55 2022] PUT /identity/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:55.620473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:55.635807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244735e-9ba3-48f9-a7ac-cbfbec266ba0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:55.641481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:55.642261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:55.642725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:55.643118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:55.644352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=10ae1ea79b244be88a4d92be9902fc19)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:55.645440 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:55.645440 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:55.645440 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:55.646472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:55.665535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2252/4490] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:03:55 2022] GET /identity/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles => generated 375 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:55.666438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:55.691551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256d46-d141-4f58-8da1-8707eb7c3f27 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:55.696499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:55.697170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:55.697459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:55.697737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:55.701525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:55.703000 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:55.703000 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:55.703000 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:55.707966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:55.716145 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2239/4491] 10.222.0.20 () {58 vars in 1363 bytes} [Tue Sep 6 11:03:55 2022] HEAD /identity/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:55.720554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:55.750680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21f35-1a97-484a-8ceb-2832e9423657 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:55.761502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:55.762514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:55.762995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:55.763303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:55.768654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=10ae1ea79b244be88a4d92be9902fc19, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:55.771826 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:55.771826 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:55.771826 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:55.773036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:55.912331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2253/4492] 10.222.0.20 () {58 vars in 1365 bytes} [Tue Sep 6 11:03:55 2022] DELETE /identity/v3/system/groups/10ae1ea79b244be88a4d92be9902fc19/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:55.918065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:55.950601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3094-b003-4990-bd9f-d1a769ba90ee tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:55.978000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:55.978983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:55.982377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:55.984129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:55.990356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:55.995548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=304a8a6766524b1488953fa046fd940c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.005418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.099212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:56.129777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2240/4493] 10.222.0.20 () {60 vars in 1480 bytes} [Tue Sep 6 11:03:55 2022] PUT /identity/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:56.134395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.161781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a0e2-b7ef-4d75-85c0-438fd10ffc68 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.261631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.263445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.263849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.264267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.266682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=304a8a6766524b1488953fa046fd940c, user_id=e1ff176aea554810a7c5e7e4ef4917c8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.267824 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:56.267824 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:56.267824 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:56.271045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.298797 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2254/4494] 10.222.0.20 () {58 vars in 1362 bytes} [Tue Sep 6 11:03:56 2022] GET /identity/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles => generated 408 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:56.300610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.317371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698398-3756-4805-bb9c-9491eb5b05cc tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.323919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.324832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.325396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.325968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.329854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=304a8a6766524b1488953fa046fd940c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.345855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.365149 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2241/4495] 10.222.0.20 () {58 vars in 1462 bytes} [Tue Sep 6 11:03:56 2022] HEAD /identity/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:56.369015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.381027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4eac-20e2-43b0-bab3-2b5617439176 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.399869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.400853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.401056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.401336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.403613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=304a8a6766524b1488953fa046fd940c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.406351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.421362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role b2c5c975bee644b69e780a33862e1167 was removed from user e1ff176aea554810a7c5e7e4ef4917c8 on domain 304a8a6766524b1488953fa046fd940c. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:56.422152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:56.422929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:56.513704 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2255/4496] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 6 11:03:56 2022] DELETE /identity/v3/domains/304a8a6766524b1488953fa046fd940c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:56.518333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.521102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:56.543067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02c128-a23a-464f-8a85-cd44419a1829 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.691902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.692553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.692841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.693312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.698101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.703050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.809373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2242/4497] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:03:56 2022] PUT /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:56.814664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.831094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eed38-4ea7-4bc1-b656-aec054fcaf49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.893520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.894593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.895155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.895662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.897603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_grants(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.900510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.915547 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2256/4498] 10.222.0.20 () {58 vars in 1365 bytes} [Tue Sep 6 11:03:56 2022] GET /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles => generated 409 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:56.919811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.931827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af56a4-d0bc-4982-9685-d1337eef04bd tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.938880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.939584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.940041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.940606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.943666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.947108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:56.963071 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2243/4499] 10.222.0.20 () {58 vars in 1465 bytes} [Tue Sep 6 11:03:56 2022] HEAD /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:56.967353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:56.979791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968daef-8164-4bab-9b25-3437ea5f94da tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:56.988992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:56.991293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:56.991977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:56.995543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:56.995543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ef35181980c452385ed16c7194b521c, user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:56.999182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.005886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role b2c5c975bee644b69e780a33862e1167 was removed from user e1ff176aea554810a7c5e7e4ef4917c8 on project 3ef35181980c452385ed16c7194b521c. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:57.006180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:57.006867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:57.098885 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2257/4500] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:03:56 2022] DELETE /identity/v3/projects/3ef35181980c452385ed16c7194b521c/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:57.104290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.106949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:57.120911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f05c2c-f65a-4b0f-9901-678ac1b9b380 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.194347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.195152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.195531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.195871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.201452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.203191 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:57.203191 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:57.203191 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:57.204646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.407898 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2244/4501] 10.222.0.20 () {60 vars in 1378 bytes} [Tue Sep 6 11:03:57 2022] PUT /identity/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:57.408062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.411962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f25b-1d3a-414e-a80d-a76e3acad5d5 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.417092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.419778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.419778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.419778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.421317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=e1ff176aea554810a7c5e7e4ef4917c8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.422500 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:57.422500 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:57.422500 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:57.423502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.437290 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2258/4502] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 11:03:57 2022] GET /identity/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles => generated 374 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:57.446997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.452597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf5149-e194-466c-994a-61e454f57eca tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.459065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.460542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.460808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.461149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.463211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.464310 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:57.464310 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:03:57.464310 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:03:57.465503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.470897 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2245/4503] 10.222.0.20 () {58 vars in 1360 bytes} [Tue Sep 6 11:03:57 2022] HEAD /identity/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:57.475592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.486740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829f63-ca8a-4cfa-9421-ae7aaf0c3670 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.494178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.495299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.495767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.496232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.497827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=e1ff176aea554810a7c5e7e4ef4917c8, role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.498903 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:57.498903 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:57.498903 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:57.506268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.544453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:57.567123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2259/4504] 10.222.0.20 () {58 vars in 1362 bytes} [Tue Sep 6 11:03:57 2022] DELETE /identity/v3/system/users/e1ff176aea554810a7c5e7e4ef4917c8/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:57.572756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.583634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe76a-cf8e-4201-8840-2db46175b032 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.588375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.588984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.589277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.589559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.590232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.591932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.729285 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2246/4505] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:57 2022] POST /identity/v3/roles => generated 270 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:57.733406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.744024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce7ea-e316-45a6-a2b8-e09c28ed12f2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.749145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.749806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.750306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.750588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.751319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.752338 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:57.752338 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:57.752338 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:57.753229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:57.855556 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2260/4506] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:57 2022] POST /identity/v3/roles => generated 268 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:57.859623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:57.874779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6976d5-2d96-4875-b3da-a462f0d98607 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:57.890886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:57.892136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:57.892496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:57.892867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/276ef01dcb5e49d49340ed428b62cdb3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:57.895924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7d3f2dbc20d84310aae747cd8cf62ae4, implied_role_id=276ef01dcb5e49d49340ed428b62cdb3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:57.898356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:58.007867 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2247/4507] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:03:57 2022] PUT /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/276ef01dcb5e49d49340ed428b62cdb3 => generated 529 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:58.012082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:58.023381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53487-b2ca-416b-8523-3b9ca340f648 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:58.116740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:58.117599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:58.117899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:58.118228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:58.118984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:58.120784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:58.150959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:58.235039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2261/4508] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:03:58 2022] POST /identity/v3/domains => generated 275 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:58.236270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:58.247853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cb25-d9df-4230-8dab-a7b09cd949c8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:58.333911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:58.336219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:58.336987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:58.337494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:58.338717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:58.341466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:58.536857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2248/4509] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:03:58 2022] POST /identity/v3/roles => generated 269 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:03:58.538403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:58.557173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fd815-2770-4d28-9ed7-1a8395ad4e6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:58.562009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:58.562736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:58.563141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:58.563486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/7b3cd8338a0946aca9d49b8c7012838b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:58.566221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7d3f2dbc20d84310aae747cd8cf62ae4, implied_role_id=7b3cd8338a0946aca9d49b8c7012838b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:58.567394 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:58.567394 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:58.567394 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:58.568530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:58.738236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2262/4510] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:03:58 2022] PUT /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/7b3cd8338a0946aca9d49b8c7012838b => generated 530 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:58.744774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:58.758868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13239ee-84cb-44ae-8846-9aa12c0a0d04 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:58.840889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:58.841729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:58.842569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:58.843382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:58.845801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7d3f2dbc20d84310aae747cd8cf62ae4, implied_role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:58.848875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:58.958914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2249/4511] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:03:58 2022] PUT /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/b2c5c975bee644b69e780a33862e1167 => generated 525 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:03:58.960316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:58.971314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06afbb1-f36f-4ee9-a1ea-40752b2de484 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:59.044654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:59.066090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:59.066905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:59.067312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:59.067668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/b2c5c975bee644b69e780a33862e1167/implies/7d3f2dbc20d84310aae747cd8cf62ae4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:59.069610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b2c5c975bee644b69e780a33862e1167, implied_role_id=7d3f2dbc20d84310aae747cd8cf62ae4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:59.071493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] 7d3f2dbc20d84310aae747cd8cf62ae4 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 7d3f2dbc20d84310aae747cd8cf62ae4 cannot be an implied roles. Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Sep 06 11:03:59.092465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Sep 06 11:03:59.093745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:03:59.093745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:03:59.093745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Sep 06 11:03:59.093745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Sep 06 11:03:59.093745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 7d3f2dbc20d84310aae747cd8cf62ae4 cannot be an implied roles. Sep 06 11:03:59.093745 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:03:59.095911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2263/4512] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:03:58 2022] PUT /identity/v3/roles/b2c5c975bee644b69e780a33862e1167/implies/7d3f2dbc20d84310aae747cd8cf62ae4 => generated 116 bytes in 136 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:03:59.100911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:59.112277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23078e4b-98f2-4e03-8394-e377496ad400 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:59.117772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:59.118515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:59.119062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:59.119420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:59.125180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7d3f2dbc20d84310aae747cd8cf62ae4, implied_role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:59.128177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:59.200592 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2250/4513] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:03:59 2022] DELETE /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:59.202227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:59.214331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e93938-af70-40f9-824f-7da15453d527 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:59.280623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:59.281399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:59.281694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:59.281972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/7b3cd8338a0946aca9d49b8c7012838b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:59.284256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7d3f2dbc20d84310aae747cd8cf62ae4, implied_role_id=7b3cd8338a0946aca9d49b8c7012838b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:59.286033 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:03:59.286033 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:03:59.286033 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:03:59.286924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:59.368387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2264/4514] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:03:59 2022] DELETE /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/7b3cd8338a0946aca9d49b8c7012838b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:03:59.372739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:59.385127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238072f0-0c62-41d2-b7ca-c484305405ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:59.455272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:59.459390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:59.459390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:59.459390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7b3cd8338a0946aca9d49b8c7012838b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:59.459390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7b3cd8338a0946aca9d49b8c7012838b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:59.460315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:59.575854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 7b3cd8338a0946aca9d49b8c7012838b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:03:59.576525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:59.577453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:59.582907 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2251/4515] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:03:59 2022] DELETE /identity/v3/roles/7b3cd8338a0946aca9d49b8c7012838b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:03:59.584356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:59.586838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:03:59.598173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:59.600836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8344c-5f28-44d9-b93b-50db2d027f36 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:59.673264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:59.673935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:59.674222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:59.674654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/9efaf0cfd5e34b88988c76e29de3c17d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:59.691224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9efaf0cfd5e34b88988c76e29de3c17d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:59.693533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:59.716873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:03:59.720390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:59.721391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:59.830275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:59.831865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:03:59.840737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:03:59.841300 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2265/4516] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:03:59 2022] PATCH /identity/v3/domains/9efaf0cfd5e34b88988c76e29de3c17d => generated 276 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:03:59.853048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc232cb9-18e9-4aa2-8565-ba70de4e96f9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:03:59.928924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:03:59.929710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:03:59.930008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:03:59.930325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/9efaf0cfd5e34b88988c76e29de3c17d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:03:59.946475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9efaf0cfd5e34b88988c76e29de3c17d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:03:59.948459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:03:59.986752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.008993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.124144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d', 'request_id': 'req-b0307358-b136-4732-b985-a71264b76a51'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.134364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d', 'request_id': 'req-b0307358-b136-4732-b985-a71264b76a51'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.147609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d', 'request_id': 'req-b0307358-b136-4732-b985-a71264b76a51'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.262114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] The token cache is being invalidate because project 9efaf0cfd5e34b88988c76e29de3c17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:00.272431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.272431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.275683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d', 'request_id': 'req-b0307358-b136-4732-b985-a71264b76a51'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.276459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d', 'request_id': 'req-b0307358-b136-4732-b985-a71264b76a51'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.281326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9efaf0cfd5e34b88988c76e29de3c17d', 'request_id': 'req-b0307358-b136-4732-b985-a71264b76a51'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.295291 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2252/4517] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:03:59 2022] DELETE /identity/v3/domains/9efaf0cfd5e34b88988c76e29de3c17d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:00.302466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:00.304279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:00.342023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab57790-d4d2-4a96-ab98-6a6068fd10d2 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:00.410376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:00.410376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:00.488409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:00.489021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:00.489701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:00.489985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:00.490270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/276ef01dcb5e49d49340ed428b62cdb3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:00.505079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7d3f2dbc20d84310aae747cd8cf62ae4, implied_role_id=276ef01dcb5e49d49340ed428b62cdb3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:00.506892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:00.565019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0307358-b136-4732-b985-a71264b76a51 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:00.570998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:00.572861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:00.572861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:00.572861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] PATH_INFO: `/v3/users/9e84745e5df647d1921e8d1ffc08711c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:00.575218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e84745e5df647d1921e8d1ffc08711c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:00.577407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:00.582361 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2266/4518] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:00 2022] DELETE /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4/implies/276ef01dcb5e49d49340ed428b62cdb3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:00.583538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:00.585389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:00.674058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31636b-e84d-4338-9a7d-ce5397069545 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:00.680609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:00.681540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:00.682036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:00.682323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/276ef01dcb5e49d49340ed428b62cdb3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:00.683677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=276ef01dcb5e49d49340ed428b62cdb3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:00.684925 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:00.684925 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:04:00.684925 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:04:00.686414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:00.781144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e84745e5df647d1921e8d1ffc08711c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.791544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e84745e5df647d1921e8d1ffc08711c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.793156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e84745e5df647d1921e8d1ffc08711c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.810441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e84745e5df647d1921e8d1ffc08711c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.812047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82b6b7a6-620a-43ea-a756-3f4ad80d4546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e84745e5df647d1921e8d1ffc08711c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.847307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 276ef01dcb5e49d49340ed428b62cdb3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:00.847933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.848729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:00.850803 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2267/4519] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:00 2022] DELETE /identity/v3/roles/276ef01dcb5e49d49340ed428b62cdb3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:00.854978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:00.856783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:00.933823 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2253/4520] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:00 2022] DELETE /identity/v3/users/9e84745e5df647d1921e8d1ffc08711c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:00.935291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:00.935590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:00.935873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:00.964005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d70330-be2e-41fa-b965-715ca7cf97e4 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:00.965330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:00.967134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:01.039422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.040263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.040758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.041173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.042683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7d3f2dbc20d84310aae747cd8cf62ae4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.044449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.061496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:01.090388 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2254/4521] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:01.106911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.110668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:01.187352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184c44-767a-46c5-9ed2-265ef78eedc6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.191703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.192742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.193239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.193599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.204470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.206202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.217233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2255/4522] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:01.230139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 7d3f2dbc20d84310aae747cd8cf62ae4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:01.230521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.231232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.233365 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2268/4523] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:00 2022] DELETE /identity/v3/roles/7d3f2dbc20d84310aae747cd8cf62ae4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:01.239332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.250318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb518-af31-49fd-adef-837b9b4f3489 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.325274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.325929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.326355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.326644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.328809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.332265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.459923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2256/4524] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:01 2022] PUT /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 521 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:01.463832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.465266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:01.482024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5978ef-799e-48b5-aece-d73ab3255c3a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.542186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.543220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.543677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.544074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.546076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.547618 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:01.547618 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:04:01.547618 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:04:01.548312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.549914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.550334 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:01.550334 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:04:01.550334 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:04:01.551459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.561567 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2269/4525] 10.222.0.20 () {58 vars in 1345 bytes} [Tue Sep 6 11:04:01 2022] HEAD /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:01.565254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.578801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.581933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:01.595746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043065-612d-4e04-a30b-0e3d402ee2ae tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.609241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.610339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.611356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.611850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.623608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.629582 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:01.629582 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:04:01.629582 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:04:01.630541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.641730 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2257/4526] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 11:04:01 2022] GET /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 521 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:01.644523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.655603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053176-edac-4ade-9b61-c5aab8944fcb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.660962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.661926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.662218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.662733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.668227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba33ad-caa3-487d-902f-ef22d7067720 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.671999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.673513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.673859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.674311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.674660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.675591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] PATH_INFO: `/v3/projects/0a7af966e1b740a59920ff9370b5dade` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.676820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7af966e1b740a59920ff9370b5dade)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.678844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.755918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2258/4527] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:01 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:01.760302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.826854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7af966e1b740a59920ff9370b5dade', 'request_id': 'req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.833939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7af966e1b740a59920ff9370b5dade', 'request_id': 'req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.834155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac9009-aa33-42c7-9c0b-3bb9341924db tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.840960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7af966e1b740a59920ff9370b5dade', 'request_id': 'req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.953287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:01.954267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:01.954729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:01.955747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:01.958167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:01.960412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f.: keystone.exception.ImpliedRoleNotFound: fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f. Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = query.one() Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._iter().one() Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._only_one_row( Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:01.969892 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 06 11:04:01.972109 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 06 11:04:01.973420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 06 11:04:01.973420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f. Sep 06 11:04:01.973420 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:01.975481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2259/4528] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 11:04:01 2022] GET /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 137 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:01.984078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.984283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] The token cache is being invalidate because project 0a7af966e1b740a59920ff9370b5dade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:01.984581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.988145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:01.991552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2270/4529] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:01 2022] DELETE /identity/v3/projects/0a7af966e1b740a59920ff9370b5dade => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:01.995483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41571d4-71d1-43cc-93cd-b92b0a8dc31e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:01.995645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:01.997046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:02.002381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.003540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.003794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.004186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.006634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.009356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f.: keystone.exception.ImpliedRoleNotFound: fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f. Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = query.one() Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._iter().one() Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._only_one_row( Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exc.NoResultFound( Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:02.024713 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Sep 06 11:04:02.027745 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Sep 06 11:04:02.028935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Sep 06 11:04:02.028935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Sep 06 11:04:02.028935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Sep 06 11:04:02.028935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fd33ab8e5f494727acddc8baaa609999 does not imply 2df5da0ddbe740438f7ddaf214f3de1f. Sep 06 11:04:02.028935 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:02.028935 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2260/4530] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:01 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 137 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 06 11:04:02.031950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:02.033828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:02.048739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9f632-c20e-4a76-a34a-5c3104d3f8ad tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:02.055624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.058893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.059326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:02.060110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.060502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.063806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.066152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.088297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533d8f-825d-4bc7-9101-ac13fbe8c46d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:02.094132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.094774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.096209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.096209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] PATH_INFO: `/v3/users/b64351219f3948ce918889871fde5560` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.097511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64351219f3948ce918889871fde5560)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.099508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.157605 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2261/4531] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:02 2022] PUT /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 521 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:02.158815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:02.247813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a33737-e02d-46df-b7db-fe84cecc60e8 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:02.255132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.255835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.256126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.256410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.258506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2f6f2493b50b4ac0afde18e1a3904082)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.261728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.441441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64351219f3948ce918889871fde5560'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:02.443623 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2262/4532] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:02 2022] PUT /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082 => generated 520 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:02.446537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:02.456714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64351219f3948ce918889871fde5560'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:02.457466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64351219f3948ce918889871fde5560'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:02.459287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64351219f3948ce918889871fde5560'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:02.506083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64351219f3948ce918889871fde5560'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:02.556647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8743b-4e7e-4e72-a58b-803ef5e4eb65 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:02.561728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.562380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.562666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.562946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.564645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2f6f2493b50b4ac0afde18e1a3904082, implied_role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.569335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.593988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2271/4533] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:01 2022] DELETE /identity/v3/users/b64351219f3948ce918889871fde5560 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:02.654459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2263/4534] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:02 2022] PUT /identity/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167 => generated 519 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:02.658840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:02.660684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:02.710012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:02.739839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08829cd-849f-4f08-a0e1-e42e13e1a564 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:02.802949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.803620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.803905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.804182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.804748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.805854 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:02.805854 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:04:02.805854 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:04:02.806781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.826805 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2272/4535] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:04:02 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:02.828093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:02.839536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af22846-f1c8-4795-9b01-753901655a29 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:02.844237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:02.844894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:02.845220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:02.845547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:02.848014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2f6f2493b50b4ac0afde18e1a3904082, implied_role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:02.849625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:02.935265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:02.943993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:02.945337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2264/4536] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:02 2022] DELETE /identity/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:02.949138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.052375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f29fd-674a-4f43-9350-069fd66e0e71 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.053370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2a990-b318-4f3a-bc32-afa0a60da915 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.058325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.058981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.059300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.059574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.061659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2f6f2493b50b4ac0afde18e1a3904082)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.063611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.123167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.124016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.124302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.124577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] PATH_INFO: `/v3/projects/9030d09b2ed947afbde268e235e93c54` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.125752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9030d09b2ed947afbde268e235e93c54)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.128243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.178212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2265/4537] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:02 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:03.182783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.285088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312124e-f303-4bf6-8dfa-bd8d51850e54 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.288790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9030d09b2ed947afbde268e235e93c54', 'request_id': 'req-014e7052-1d09-4b7e-bc17-ee49500464aa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:03.320035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9030d09b2ed947afbde268e235e93c54', 'request_id': 'req-014e7052-1d09-4b7e-bc17-ee49500464aa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:03.342307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9030d09b2ed947afbde268e235e93c54', 'request_id': 'req-014e7052-1d09-4b7e-bc17-ee49500464aa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:03.342426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:03.415768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.416431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.416725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.417142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.418778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.420479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.435700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] The token cache is being invalidate because project 9030d09b2ed947afbde268e235e93c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:03.435949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:03.436585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-014e7052-1d09-4b7e-bc17-ee49500464aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:03.438136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2273/4538] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:02 2022] DELETE /identity/v3/projects/9030d09b2ed947afbde268e235e93c54 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:03.444737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7e39-da5a-4e31-b123-ae2e2b25ee77 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.445339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7e39-da5a-4e31-b123-ae2e2b25ee77 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.448180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7e39-da5a-4e31-b123-ae2e2b25ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.467113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-821c7e39-da5a-4e31-b123-ae2e2b25ee77 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:03.468519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-821c7e39-da5a-4e31-b123-ae2e2b25ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:03.547058 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2274/4539] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:03.557573 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2266/4540] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:03 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:03.560060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.560585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.561147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.562508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.565182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:03.609095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:03.609095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:03.710509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da42992-5f51-4221-91d8-9c3e82b7df79 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.716152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.721539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.721539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.721539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.721539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.722044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2275/4541] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:03.723484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.723843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.735443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8e4d5-e88d-42cd-8d14-4b2e89421c64 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.742938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2267/4542] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:03 2022] GET /identity/v3/roles => generated 2322 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:03.744015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.747635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.748685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.749076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.749455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.750429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:03.750847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.754752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.764853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf73e8-ed62-4376-966f-f2a600ea6f5f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.766742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.767477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.767831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.768347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.769095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.771874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.774957 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2276/4543] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:03.778510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.794165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ae8f8-b713-40cf-8b51-67514a8fb187 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.799541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.800750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.801106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.801476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.802184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.804519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:03.859676 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2268/4544] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:03 2022] POST /identity/v3/roles => generated 234 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:03.864117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:03.874760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6133b5-3263-4ed9-b6d9-86e0694318bb tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:03.882267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:03.884313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:03.884313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:03.884313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2613ddf0afbd447183809020df790dcf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:03.885647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:update_role(role_id=2613ddf0afbd447183809020df790dcf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:03.889051 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:03.889051 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:04:03.889051 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:04:03.890316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.009974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2277/4545] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:03 2022] POST /identity/v3/projects => generated 395 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:04.013979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.056311 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2269/4546] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Sep 6 11:04:03 2022] PATCH /identity/v3/roles/2613ddf0afbd447183809020df790dcf => generated 237 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:04.061049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.083966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee022989-1287-4252-b75c-1c181a129438 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.122969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51610da5-c16f-4c21-841d-047ce25aea7b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.130945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.131760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.132120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.132841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.133533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.135829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.174393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.179918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.179918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.179918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2613ddf0afbd447183809020df790dcf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.188565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:get_role(role_id=2613ddf0afbd447183809020df790dcf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.189601 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:04.189601 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:04:04.189601 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:04:04.190995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.195362 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2270/4547] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:04:04 2022] GET /identity/v3/roles/2613ddf0afbd447183809020df790dcf => generated 237 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:04.196761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.207773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c254d61-29d0-4f35-aa00-a8663a56aa0f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.213090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.213721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.213997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.214477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.215334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.217886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.233028 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2271/4548] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:04 2022] GET /identity/v3/roles => generated 2550 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:04.239090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.251492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb2b49-bf41-4dbf-972e-e06f2280994f tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.262376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.263453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.266429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.266429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2613ddf0afbd447183809020df790dcf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.266429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2613ddf0afbd447183809020df790dcf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.267669 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2278/4549] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:04 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:04.272082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.272277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.292100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1284d9-4893-4f52-94eb-538e40945168 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.298667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.299500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.299912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.300294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.301365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.306464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.330207 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2279/4550] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:04 2022] GET /identity/v3/roles => generated 2550 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:04.335892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.351197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac77b-1cf6-4021-a953-d14c3434c4d9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.358979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.359827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.362233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:04.363718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.367475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.367475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.391807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.424659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 2613ddf0afbd447183809020df790dcf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:04.425255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:04.426850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:04.430173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2272/4551] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:04 2022] DELETE /identity/v3/roles/2613ddf0afbd447183809020df790dcf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:04.434142 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2280/4552] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:04 2022] GET /identity/v3/roles => generated 2550 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:04.436561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.437943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.444212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:04.448989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:04.482371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93564f25-c022-4254-95a6-c63251b68334 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.588913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd9244-0a1d-460a-9f79-e0f073e5577a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.601099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.601784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.602074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.602355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.608559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.615620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.622462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad4ca9-588a-497c-9f46-a117f44f123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.623515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad4ca9-588a-497c-9f46-a117f44f123a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.624071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad4ca9-588a-497c-9f46-a117f44f123a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.624542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad4ca9-588a-497c-9f46-a117f44f123a admin admin] PATH_INFO: `/v3/projects/02af2d2184304fe59a6cfc25f2df2332/users/d16999eeb7cb427a9024867f457edd3f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.661353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad4ca9-588a-497c-9f46-a117f44f123a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02af2d2184304fe59a6cfc25f2df2332, user_id=d16999eeb7cb427a9024867f457edd3f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.664110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad4ca9-588a-497c-9f46-a117f44f123a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.746693 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2281/4553] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:04 2022] PUT /identity/v3/projects/02af2d2184304fe59a6cfc25f2df2332/users/d16999eeb7cb427a9024867f457edd3f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:04.756825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.757119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.757684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.759464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2273/4554] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:04 2022] PUT /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 521 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:04.763111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:04.796032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] MFA Rules not processed for user `d16999eeb7cb427a9024867f457edd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:04.798200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:04.870462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a52a8-502d-4063-b107-5cadd3746c94 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:04.883424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:04.883424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:04.883424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:04.883853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:04.883853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2f6f2493b50b4ac0afde18e1a3904082)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:04.888036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:04.918919 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2282/4555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:05.022891 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2274/4556] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:04 2022] PUT /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082 => generated 520 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:05.024386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.036929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbc584-613f-4fdf-8e99-99eca3444a80 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.106353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.107289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.107687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.108066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.109991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2f6f2493b50b4ac0afde18e1a3904082, implied_role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.111857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.250059 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2283/4557] 10.222.0.20 () {60 vars in 1363 bytes} [Tue Sep 6 11:04:05 2022] PUT /identity/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167 => generated 519 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:05.251620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.265858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c153667-d4d7-45f4-b030-89833c517c1d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.266947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:05.351441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.352270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.352668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.353088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.356633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=2f6f2493b50b4ac0afde18e1a3904082)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.358279 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:05.358279 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:04:05.358279 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:04:05.359062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.370805 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2275/4558] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:04:05 2022] GET /identity/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies => generated 488 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:05.373261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.384005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b50b1-cf34-4223-819c-e7c445f70617 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.393514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.394334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.394628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.394906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.396138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=fd33ab8e5f494727acddc8baaa609999)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.397167 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:05.397167 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:04:05.397167 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:04:05.407764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.407764 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2284/4559] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:04:05 2022] GET /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies => generated 660 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:05.411678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.424029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4724d-e75a-40cd-bb63-2ce24caf3ad9 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.430474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.431251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.431614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.431987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.434111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2f6f2493b50b4ac0afde18e1a3904082, implied_role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.436025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.450598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.458678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:05.520075 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2276/4560] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:05 2022] DELETE /identity/v3/roles/2f6f2493b50b4ac0afde18e1a3904082/implies/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:05.521309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.556093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4265-23b5-4615-9959-13f8fd5aed0d tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.616349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52915b-a891-4d3c-92e7-9d516c601f7a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.629837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.631151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.631776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.632124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.634494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2f6f2493b50b4ac0afde18e1a3904082)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.637121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.658629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.659942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.660231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.660512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.726591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.728246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.739206 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2285/4561] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:05.743349 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2277/4562] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:05 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2f6f2493b50b4ac0afde18e1a3904082 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:05.744701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.837643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fab95-270b-4743-a056-db172f007e49 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:05.837643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:05.837643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:05.838025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:05.838025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:05.838025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fd33ab8e5f494727acddc8baaa609999, implied_role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:05.839635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:05.929514 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2278/4563] 10.222.0.20 () {58 vars in 1347 bytes} [Tue Sep 6 11:04:05 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999/implies/2df5da0ddbe740438f7ddaf214f3de1f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:05.935943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:05.947230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c29d-60e9-438a-aad7-43f41e2d58c8 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:06.020954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:06.021601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:06.021890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:06.022168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/9efaf0cfd5e34b88988c76e29de3c17d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:06.031841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Could not find domain: 9efaf0cfd5e34b88988c76e29de3c17d.: keystone.exception.DomainNotFound: Could not find domain: 9efaf0cfd5e34b88988c76e29de3c17d. Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9efaf0cfd5e34b88988c76e29de3c17d. Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:06.037688 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:06.041706 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9efaf0cfd5e34b88988c76e29de3c17d. Sep 06 11:04:06.042725 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:06.044052 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2286/4564] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:04:05 2022] PATCH /identity/v3/domains/9efaf0cfd5e34b88988c76e29de3c17d => generated 112 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:06.044131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:06.058334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25659240-25d5-4465-9039-8e6bf0eb75f0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:06.067786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:06.069786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:06.070384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:06.070942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/users/e1ff176aea554810a7c5e7e4ef4917c8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:06.073489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e1ff176aea554810a7c5e7e4ef4917c8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:06.076476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:06.088114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:06.121143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:06.224203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6aa95-05e1-4539-b651-52fcfde860a3 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:06.228981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:06.229620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:06.229901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:06.230174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] PATH_INFO: `/v3/users/d16999eeb7cb427a9024867f457edd3f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:06.231350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16999eeb7cb427a9024867f457edd3f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:06.233271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:06.326545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ff176aea554810a7c5e7e4ef4917c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.336272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ff176aea554810a7c5e7e4ef4917c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.337308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ff176aea554810a7c5e7e4ef4917c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.367900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ff176aea554810a7c5e7e4ef4917c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.368724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ff176aea554810a7c5e7e4ef4917c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.506585 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2279/4565] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:06 2022] DELETE /identity/v3/users/e1ff176aea554810a7c5e7e4ef4917c8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:06.511968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:06.513545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:06.525361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16999eeb7cb427a9024867f457edd3f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.539903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16999eeb7cb427a9024867f457edd3f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.541016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16999eeb7cb427a9024867f457edd3f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.542302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16999eeb7cb427a9024867f457edd3f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.558596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-89d96bf9-cd2b-48f5-9c08-72525b986a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16999eeb7cb427a9024867f457edd3f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.624833 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2287/4566] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:06 2022] DELETE /identity/v3/users/d16999eeb7cb427a9024867f457edd3f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:06.628599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154a34-98b3-4253-8523-3d6662b7c907 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:06.631661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:06.631997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:06.632233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:06.671891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:06.673123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:06.716085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:06.717999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:06.718401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:06.730558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/b2c5c975bee644b69e780a33862e1167` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:06.735229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b2c5c975bee644b69e780a33862e1167)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:06.742936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:06.775146 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2288/4567] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:06.841687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:06.841687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:06.912737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role b2c5c975bee644b69e780a33862e1167 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:06.922284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.922284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:06.925992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2280/4568] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:06 2022] DELETE /identity/v3/roles/b2c5c975bee644b69e780a33862e1167 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:06.927115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:06.933009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:06.946764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98078790-403f-4aa6-8844-d25df5ba1d67 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:07.022198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:07.022842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:07.023154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:07.023435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:07.029692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:07.082101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a804a1-5ea9-4eb1-a31a-b6c75e1bedd7 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:07.089489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:07.090455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:07.091451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:07.091924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/groups/10ae1ea79b244be88a4d92be9902fc19` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:07.095447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_group(group_id=10ae1ea79b244be88a4d92be9902fc19)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:07.100212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:07.124440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:07.126591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:07.141145 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2289/4569] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:07.282368 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2281/4570] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:04:06 2022] DELETE /identity/v3/groups/10ae1ea79b244be88a4d92be9902fc19 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:07.286990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:07.300890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c108-eff9-418f-a7be-2281e02cf29a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:07.373946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:07.375142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:07.375439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:07.375720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/projects/3ef35181980c452385ed16c7194b521c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:07.377037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ef35181980c452385ed16c7194b521c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:07.379241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:07.401811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:07.528087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef35181980c452385ed16c7194b521c', 'request_id': 'req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.540555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef35181980c452385ed16c7194b521c', 'request_id': 'req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.548572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef35181980c452385ed16c7194b521c', 'request_id': 'req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.619406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] The token cache is being invalidate because project 3ef35181980c452385ed16c7194b521c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:07.620141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.620990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.623433 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2290/4571] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:07 2022] DELETE /identity/v3/projects/3ef35181980c452385ed16c7194b521c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:07.628726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:07.630825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:07.650308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1068-ce0b-4ff6-a378-74461b5a9497 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:07.723757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:07.724458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:07.724832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:07.725322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:07.726805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=304a8a6766524b1488953fa046fd940c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:07.728521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:07.750542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '304a8a6766524b1488953fa046fd940c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.751339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '304a8a6766524b1488953fa046fd940c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.893802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:07.899957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '304a8a6766524b1488953fa046fd940c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.900633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '304a8a6766524b1488953fa046fd940c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:07.908858 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2282/4572] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:04:07 2022] PATCH /identity/v3/domains/304a8a6766524b1488953fa046fd940c => generated 277 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:07.916103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:07.932226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5eb4b-3b9d-4c09-8a38-f2f56fa7f1ab tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.021458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.022118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.022604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.023109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/domains/304a8a6766524b1488953fa046fd940c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.039495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=304a8a6766524b1488953fa046fd940c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.041460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.070330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '304a8a6766524b1488953fa046fd940c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.075216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '304a8a6766524b1488953fa046fd940c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.086580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.088323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.173494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0891e-9ccb-4c53-9c93-f9558af08279 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.178990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.179656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.179940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.180216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] PATH_INFO: `/v3/projects/02af2d2184304fe59a6cfc25f2df2332` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.181363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=02af2d2184304fe59a6cfc25f2df2332)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.183326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.244243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304a8a6766524b1488953fa046fd940c', 'request_id': 'req-cee49bc1-e0ad-4402-a641-22758bfd4c0a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.250111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304a8a6766524b1488953fa046fd940c', 'request_id': 'req-cee49bc1-e0ad-4402-a641-22758bfd4c0a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.258010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304a8a6766524b1488953fa046fd940c', 'request_id': 'req-cee49bc1-e0ad-4402-a641-22758bfd4c0a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.316001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02af2d2184304fe59a6cfc25f2df2332', 'request_id': 'req-7e0fdfee-8a44-4968-b820-721d9c1fa28c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.321685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] The token cache is being invalidate because project 304a8a6766524b1488953fa046fd940c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:08.321979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.322570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02af2d2184304fe59a6cfc25f2df2332', 'request_id': 'req-7e0fdfee-8a44-4968-b820-721d9c1fa28c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.322704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.328457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02af2d2184304fe59a6cfc25f2df2332', 'request_id': 'req-7e0fdfee-8a44-4968-b820-721d9c1fa28c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.331434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '304a8a6766524b1488953fa046fd940c', 'request_id': 'req-cee49bc1-e0ad-4402-a641-22758bfd4c0a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.332399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '304a8a6766524b1488953fa046fd940c', 'request_id': 'req-cee49bc1-e0ad-4402-a641-22758bfd4c0a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.336413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '304a8a6766524b1488953fa046fd940c', 'request_id': 'req-cee49bc1-e0ad-4402-a641-22758bfd4c0a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.342391 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2291/4573] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:04:07 2022] DELETE /identity/v3/domains/304a8a6766524b1488953fa046fd940c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:08.346226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.347623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.388618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] The token cache is being invalidate because project 02af2d2184304fe59a6cfc25f2df2332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:08.388926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.389567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e0fdfee-8a44-4968-b820-721d9c1fa28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.391094 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2283/4574] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:08 2022] DELETE /identity/v3/projects/02af2d2184304fe59a6cfc25f2df2332 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:08.397115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac36bd-a661-4e0b-87ba-fe4448ec5fa1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.397403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac36bd-a661-4e0b-87ba-fe4448ec5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.397675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac36bd-a661-4e0b-87ba-fe4448ec5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.426064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49bc1-e0ad-4402-a641-22758bfd4c0a tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.426289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-04ac36bd-a661-4e0b-87ba-fe4448ec5fa1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:08.426289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-04ac36bd-a661-4e0b-87ba-fe4448ec5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.483985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.484626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.484906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.485183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2f6f2493b50b4ac0afde18e1a3904082` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.485567 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2284/4575] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:08.492251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2f6f2493b50b4ac0afde18e1a3904082)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.495101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.495838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.496264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.496552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.518414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:08.519668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.528169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2285/4576] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:08.532434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.542376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e25de7-1cfb-4490-9176-c222f06b2bb5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.547081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.547782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.548069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.548347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.548994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:08.549304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.551510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.563667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2286/4577] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:08.568188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.577640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fc7bb-80fb-45b4-9d7c-01fd9ead6cd4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.582339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.586859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.586859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.586859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.586859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.586859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.635359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 2f6f2493b50b4ac0afde18e1a3904082 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:08.635657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.636342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.638191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2292/4578] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:08 2022] DELETE /identity/v3/roles/2f6f2493b50b4ac0afde18e1a3904082 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:08.641945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.643280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.705885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2287/4579] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:08 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:08.707694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.709745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.711137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ba0b-d65f-49eb-b48a-7c9ad6dceb6e tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.785017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620df6be-c89c-4657-8e8d-a3bac7853762 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:08.787165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.788058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.788656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.788957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/2df5da0ddbe740438f7ddaf214f3de1f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.791079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2df5da0ddbe740438f7ddaf214f3de1f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.791521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:08.792416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:08.793005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:08.793379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:08.794136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:08.796140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.796639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:08.960882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role 2df5da0ddbe740438f7ddaf214f3de1f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:08.961289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.962071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:08.964489 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2288/4581] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:08 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:08.964762 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2293/4581] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:08 2022] DELETE /identity/v3/roles/2df5da0ddbe740438f7ddaf214f3de1f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:08.968078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.969350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:08.972337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.972663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:08.995568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c0a9-9865-4356-9380-7d5b8671d0d8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:09.083597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa0aa-b881-456c-bc40-25820fd5d442 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:09.095983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:09.097392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.097868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.098264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.098934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:09.101700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9b193a676e40e7bc4e209e0f9adb09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40eefddbf91c4c89b9f0faeac1440f35', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:09.102561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.103040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:09.103208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.103635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] PATH_INFO: `/v3/roles/fd33ab8e5f494727acddc8baaa609999` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.106347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fd33ab8e5f494727acddc8baaa609999)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:09.108557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:09.139717 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2294/4582] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:08 2022] GET /identity/v3/roles => generated 1646 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:09.147278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:09.168993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c4d6-f372-4e41-9985-71c13791ae7e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:09.174918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:09.187554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.187554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.187554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.188504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:09.191992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:09.241559 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2295/4583] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:09 2022] GET /identity/v3/roles => generated 1646 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:09.245702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:09.272315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dc297-15f2-4ab4-904f-57fef0254b24 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:09.285375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd47ce-422a-4c13-a69f-acd4c2e9f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:09.286375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd47ce-422a-4c13-a69f-acd4c2e9f60a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.286760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd47ce-422a-4c13-a69f-acd4c2e9f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.287152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd47ce-422a-4c13-a69f-acd4c2e9f60a admin admin] PATH_INFO: `/v3/projects/dcec28a7e8334187af139cfaa47ec10f/users/7a1efa8720c8419ba917f0e9220689ac/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.312575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd47ce-422a-4c13-a69f-acd4c2e9f60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec28a7e8334187af139cfaa47ec10f, user_id=7a1efa8720c8419ba917f0e9220689ac, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:09.313378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invalidating the token cache because role fd33ab8e5f494727acddc8baaa609999 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:09.316146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.317074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.317942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd47ce-422a-4c13-a69f-acd4c2e9f60a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:09.328026 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2289/4584] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:08 2022] DELETE /identity/v3/roles/fd33ab8e5f494727acddc8baaa609999 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:09.344240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:09.345732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:09.427498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dad17f-33c0-4dbf-962d-550fbaed0bb0 tempest-RolesV3TestJSON-718006150 tempest-RolesV3TestJSON-718006150-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:09.434438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:09.435875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.435875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.436137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] PATH_INFO: `/v3/users/fefa79f110954b649423b7304f28300d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.437510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefa79f110954b649423b7304f28300d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:09.439665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:09.510027 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2296/4585] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:09 2022] PUT /identity/v3/projects/dcec28a7e8334187af139cfaa47ec10f/users/7a1efa8720c8419ba917f0e9220689ac/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:09.512373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.512765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.513208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.539826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:09.541318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:09.628381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2297/4586] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:09.641726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:09.643379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:09.708610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefa79f110954b649423b7304f28300d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.721144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefa79f110954b649423b7304f28300d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.723624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefa79f110954b649423b7304f28300d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.773309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefa79f110954b649423b7304f28300d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.774658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefa79f110954b649423b7304f28300d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:09.786953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0293c9c-9583-48e0-97ce-871d1b578888 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:09.805612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:09.805612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.805612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.805612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.807550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:09.821292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:09.823119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625b394-26ac-4e12-9fa8-b778dba92ad6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:09.835529 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2298/4587] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:09.887227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:09.889063 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2290/4588] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:09 2022] DELETE /identity/v3/users/fefa79f110954b649423b7304f28300d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:09.893880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:09.894575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:09.895029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:09.921112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:09.922425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:09.989037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2299/4589] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:10.002123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:10.002123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:10.071262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff082a7-b739-4974-86b2-5826c1d25d6d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:10.091911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:10.092980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:10.095063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:10.110134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:10.142872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:10.146365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:10.177049 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2291/4590] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:10.209162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:11.276335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:11.658705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:11.917936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:11.919696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:11.933666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263506-9bfc-4ccb-8d70-8e0b6f5548c1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:11.938642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:11.939564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:11.946878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:11.946878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] PATH_INFO: `/v3/projects/8c77a7ba824945278a598e08f4ddcba8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:11.946878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c77a7ba824945278a598e08f4ddcba8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:11.946878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:12.176194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c77a7ba824945278a598e08f4ddcba8', 'request_id': 'req-d1fca8a6-371e-4161-902d-721da4f0e434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.182650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c77a7ba824945278a598e08f4ddcba8', 'request_id': 'req-d1fca8a6-371e-4161-902d-721da4f0e434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.193169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c77a7ba824945278a598e08f4ddcba8', 'request_id': 'req-d1fca8a6-371e-4161-902d-721da4f0e434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.417607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] The token cache is being invalidate because project 8c77a7ba824945278a598e08f4ddcba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:12.418709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.419629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.422033 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2300/4591] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:11 2022] DELETE /identity/v3/projects/8c77a7ba824945278a598e08f4ddcba8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:12.426042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:12.436005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cde47-4db1-4608-a2d9-dfa6a65a2d5b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:12.561160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:12.561895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:12.562177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:12.562464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] PATH_INFO: `/v3/users/df9b193a676e40e7bc4e209e0f9adb09` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:12.567071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9b193a676e40e7bc4e209e0f9adb09)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:12.569672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:12.710120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:12.836291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9b193a676e40e7bc4e209e0f9adb09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.857744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9b193a676e40e7bc4e209e0f9adb09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.858798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9b193a676e40e7bc4e209e0f9adb09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.889283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9b193a676e40e7bc4e209e0f9adb09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.890335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc59851f-9bb3-4570-9627-96dc7f1c7a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9b193a676e40e7bc4e209e0f9adb09'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:12.983161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:13.030470 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2292/4592] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:12 2022] DELETE /identity/v3/users/df9b193a676e40e7bc4e209e0f9adb09 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:13.413425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:14.084731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:14.086527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:14.136273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fca8a6-371e-4161-902d-721da4f0e434 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:14.230876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:14.231562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:14.231920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:14.235364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] PATH_INFO: `/v3/projects/40eefddbf91c4c89b9f0faeac1440f35` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:14.237454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40eefddbf91c4c89b9f0faeac1440f35)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:14.239675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:14.344976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:14.413770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40eefddbf91c4c89b9f0faeac1440f35', 'request_id': 'req-6854b50f-3cd4-4cae-a637-1afd3b614b4c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:14.427687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40eefddbf91c4c89b9f0faeac1440f35', 'request_id': 'req-6854b50f-3cd4-4cae-a637-1afd3b614b4c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:14.439842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40eefddbf91c4c89b9f0faeac1440f35', 'request_id': 'req-6854b50f-3cd4-4cae-a637-1afd3b614b4c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:14.540028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] The token cache is being invalidate because project 40eefddbf91c4c89b9f0faeac1440f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:14.540317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:14.541291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6854b50f-3cd4-4cae-a637-1afd3b614b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:14.543863 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2301/4593] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:14 2022] DELETE /identity/v3/projects/40eefddbf91c4c89b9f0faeac1440f35 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:14.548606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:14.549153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:14.549830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:14.579759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:14.581456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:14.691039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2293/4594] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:14.693774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:14.694349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:14.694699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:14.717922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:14.722150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:14.733129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2302/4595] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:14.738852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:14.751040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cad716-68f3-4093-90c8-282d3ed82c63 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:14.759948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:14.760816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:14.761206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:14.762031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:14.762451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:14.763309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:14.765118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:14.785839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2294/4596] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:14.790034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:14.805678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71632ae-1c2d-45f1-961c-18274f8122cb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:14.819896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:14.821047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:14.821450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:14.821824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:14.823132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:14.827910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:14.989529 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2303/4597] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:14 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:14.992374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:15.013265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdae46-5d26-4128-9bd0-181f1ec451c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:15.102809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:15.104276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:15.104658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:15.105056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:15.106487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:15.109024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:15.203159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:15.245092 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2295/4598] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:14 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:15.249426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:15.269361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fea54-6977-4f88-bbb0-0f26cae8ea32 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:15.278372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:15.279879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:15.283713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:15.283713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:15.283713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:15.283713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:15.306637 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2304/4599] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:15.317244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:15.329852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16eedff-ab2f-4625-baf5-b22105fe124f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:15.347212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03547013-c5c3-4852-a831-323ca5308df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:15.347930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547013-c5c3-4852-a831-323ca5308df7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:15.348223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547013-c5c3-4852-a831-323ca5308df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:15.348505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03547013-c5c3-4852-a831-323ca5308df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:15.349169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03547013-c5c3-4852-a831-323ca5308df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:15.350806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03547013-c5c3-4852-a831-323ca5308df7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:15.379866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2296/4600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:15.385061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:15.403280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8634595-6647-4dfb-b20c-53993d3341ca admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:15.413778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:15.414654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:15.414965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:15.415429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] PATH_INFO: `/v3/projects/4f585970f6fa4389a15ebac3d1673c81/users/f987589030cc4ee9bd8affa41837a56a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:15.435618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f585970f6fa4389a15ebac3d1673c81, user_id=f987589030cc4ee9bd8affa41837a56a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:15.439177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:15.543939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:15.547389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:15.547389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:15.556760 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2305/4601] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:15 2022] PUT /identity/v3/projects/4f585970f6fa4389a15ebac3d1673c81/users/f987589030cc4ee9bd8affa41837a56a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:15.585918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] MFA Rules not processed for user `f987589030cc4ee9bd8affa41837a56a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:15.587397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:15.668706 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2297/4602] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:15.674854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:15.726970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:15.755137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6939486-f928-46d8-aac8-830c8a7928f3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:15.760424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:15.761042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:15.761331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:15.761620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:15.762826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:15.764213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:15.914393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:15.917940 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2306/4603] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:15 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:15.930763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4b8fb-de68-497a-a248-2f6dc5403ecb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.006839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.007835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.008117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.008466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.009070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.011216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:16.138796 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2298/4604] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:15 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:16.143360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:16.157471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b90b46-323e-4a5d-b825-a8d783cabc4c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.162046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.162677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.162966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.163290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.163931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.165584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:16.178585 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2307/4605] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:16.182669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:16.203817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32711af-972e-41a5-8f0d-2d39a9d41860 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.209488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.210286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.210702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.211116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] PATH_INFO: `/v3/projects/397c7644413544438161dcff64d9abad/users/46014dcadfee44d5aba489314dafec41/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.231878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397c7644413544438161dcff64d9abad, user_id=46014dcadfee44d5aba489314dafec41, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.234920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:16.374341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2299/4606] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:16 2022] PUT /identity/v3/projects/397c7644413544438161dcff64d9abad/users/46014dcadfee44d5aba489314dafec41/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:16.378126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:16.389297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2c63e-f064-45af-adca-54eb442376f2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.457820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2448a-9d18-4a0d-aa39-54c36f8348c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.458741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2448a-9d18-4a0d-aa39-54c36f8348c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.459276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2448a-9d18-4a0d-aa39-54c36f8348c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.459560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2448a-9d18-4a0d-aa39-54c36f8348c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.460210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2448a-9d18-4a0d-aa39-54c36f8348c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.462134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2448a-9d18-4a0d-aa39-54c36f8348c6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:16.476477 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2308/4607] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:16.480639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:16.492007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8129891-5488-422a-a38e-f6df0deccd72 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.498106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.498772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.499089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.499838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] PATH_INFO: `/v3/projects/397c7644413544438161dcff64d9abad/users/46014dcadfee44d5aba489314dafec41/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.501491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397c7644413544438161dcff64d9abad, user_id=46014dcadfee44d5aba489314dafec41, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.504250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:16.524671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2300/4608] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:16 2022] PUT /identity/v3/projects/397c7644413544438161dcff64d9abad/users/46014dcadfee44d5aba489314dafec41/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:16.526893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.527250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.527526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.574407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] MFA Rules not processed for user `46014dcadfee44d5aba489314dafec41`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:16.575804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:16.658977 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2309/4609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:16.664176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:16.677351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd1915-8138-4cef-be65-22e6764e2641 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.690285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.690285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.690285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.690749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.690749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.690749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:16.816744 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2301/4610] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:04:16 2022] POST /identity/v3/projects => generated 328 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:16.820421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:16.836831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce36d9-d1e8-4ebc-b50b-b1f559110881 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:16.884607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:16.948684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:16.949348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:16.949706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:16.950194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:16.951047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:16.953310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:17.039057 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2310/4611] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:16 2022] POST /identity/v3/users => generated 413 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:17.051161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:17.067873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aebc01-efc5-45e4-aca9-119ab16880d9 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:17.073430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:17.076490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:17.076490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:17.076490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:17.076490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:17.077999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:17.135581 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2302/4612] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:17 2022] POST /identity/v3/roles => generated 244 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:17.139813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:17.152263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a0b55-64cc-4ae1-8df8-3a3567723ca6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:17.157272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:17.158233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:17.159322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:17.159680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:17.162442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:17.162442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:17.260066 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2311/4613] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:17 2022] POST /identity/v3/roles => generated 247 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:17.261446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:17.274198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4667-4f74-463c-8074-f42b4cafec16 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:17.280778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:17.282110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:17.282622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:17.283194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/e8ef8b689f014609a4d45590def58ffd/users/14c779eb27934e7282541dd54363899f/roles/9e73ad6df58e4b00bd9f860d49f3f88e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:17.315625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e8ef8b689f014609a4d45590def58ffd, user_id=14c779eb27934e7282541dd54363899f, role_id=9e73ad6df58e4b00bd9f860d49f3f88e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:17.324350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:17.435786 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2303/4614] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:17 2022] PUT /identity/v3/projects/e8ef8b689f014609a4d45590def58ffd/users/14c779eb27934e7282541dd54363899f/roles/9e73ad6df58e4b00bd9f860d49f3f88e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:17.437270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:17.455105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6d948-cf81-406a-9802-bc88bc54cb10 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:17.575218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d402d-3e81-4a10-830f-50c5feaff126 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:17.576131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d402d-3e81-4a10-830f-50c5feaff126 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:17.576406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d402d-3e81-4a10-830f-50c5feaff126 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:17.576698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d402d-3e81-4a10-830f-50c5feaff126 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/e8ef8b689f014609a4d45590def58ffd/users/14c779eb27934e7282541dd54363899f/roles/bb60a59c1b2742eb8c6c605ccf65cf26` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:17.579348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d402d-3e81-4a10-830f-50c5feaff126 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e8ef8b689f014609a4d45590def58ffd, user_id=14c779eb27934e7282541dd54363899f, role_id=bb60a59c1b2742eb8c6c605ccf65cf26)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:17.582258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d402d-3e81-4a10-830f-50c5feaff126 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:17.604838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:17.726673 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2312/4615] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:17 2022] PUT /identity/v3/projects/e8ef8b689f014609a4d45590def58ffd/users/14c779eb27934e7282541dd54363899f/roles/bb60a59c1b2742eb8c6c605ccf65cf26 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:17.730487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:17.742474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f6c5-c88b-43f6-beab-a773a6f3db7e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:17.854517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:17.855277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:17.855627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:17.855917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:17.856662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:17.858069 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:17.858069 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:04:17.858069 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:04:17.859250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaec129-77d7-417e-b6b3-2cde1f389b76 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:17.913632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2304/4616] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:17 2022] GET /identity/v3/users => generated 8622 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:17.917250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:17.918976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:17.918976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:17.965763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] MFA Rules not processed for user `14c779eb27934e7282541dd54363899f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:17.967154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:18.042869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2313/4617] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:18.145874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:18.146164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:18.146636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:18.169362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] MFA Rules not processed for user `14c779eb27934e7282541dd54363899f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:18.170803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:18.180319 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2305/4618] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:18 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:18.185123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:18.200783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a2d1-19fd-4398-a678-281e741eba31 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:18.200783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c779eb27934e7282541dd54363899f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8ef8b689f014609a4d45590def58ffd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1672680088', 'tempest-NotDelegatedRole-1854309699'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:18.200783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:18.201112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:18.201112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:18.201626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: Authorizing `identity:create_trust()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:18.202882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:18.449541 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2314/4619] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:04:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:18.453925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:18.471425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd48c-8e22-42ed-aad4-01ff3430f4d9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:18.482394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:18.483046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:18.483527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:18.484120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:18.484824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:18.486006 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:04:18.486006 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:04:18.486006 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:04:18.487503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:18.499274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2306/4620] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 11:04:18 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:18.504575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:18.521000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99844-0c09-48d9-a988-66c511e73b9d tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:18.525669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c779eb27934e7282541dd54363899f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8ef8b689f014609a4d45590def58ffd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1672680088', 'tempest-NotDelegatedRole-1854309699'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:18.526601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:18.527098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:18.527535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] PATH_INFO: `/v3/OS-TRUST/trusts/8c7ed357c95b48e2b7e0ec95943d75ad` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:18.529634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:18.538837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: Authorizing `identity:delete_trust(trust_id=8c7ed357c95b48e2b7e0ec95943d75ad)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:18.540466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:18.636111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8c7ed357c95b48e2b7e0ec95943d75ad', 'request_id': 'req-8cd546df-72a5-4d24-9792-87a4ad0279ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:18.708880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8c7ed357c95b48e2b7e0ec95943d75ad', 'request_id': 'req-8cd546df-72a5-4d24-9792-87a4ad0279ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:18.709527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8c7ed357c95b48e2b7e0ec95943d75ad', 'request_id': 'req-8cd546df-72a5-4d24-9792-87a4ad0279ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:18.720103 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2315/4621] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:04:18 2022] DELETE /identity/v3/OS-TRUST/trusts/8c7ed357c95b48e2b7e0ec95943d75ad => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:18.721312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:18.723080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:18.740030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac486b0-ce7d-4b70-9a8c-4c7e6e92d924 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:18.747066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c779eb27934e7282541dd54363899f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8ef8b689f014609a4d45590def58ffd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1672680088', 'tempest-NotDelegatedRole-1854309699'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:18.747066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:18.747066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:18.747433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] PATH_INFO: `/v3/OS-TRUST/trusts/8c7ed357c95b48e2b7e0ec95943d75ad` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Could not find trust: 8c7ed357c95b48e2b7e0ec95943d75ad.: keystone.exception.TrustNotFound: Could not find trust: 8c7ed357c95b48e2b7e0ec95943d75ad. Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 06 11:04:18.776277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8c7ed357c95b48e2b7e0ec95943d75ad. Sep 06 11:04:18.777633 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:18.782434 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2307/4622] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:18 2022] GET /identity/v3/OS-TRUST/trusts/8c7ed357c95b48e2b7e0ec95943d75ad => generated 111 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:18.783441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:18.784790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:18.802822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd546df-72a5-4d24-9792-87a4ad0279ac tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:18.808992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:18.809759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:18.810359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:18.810848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/bb60a59c1b2742eb8c6c605ccf65cf26` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:18.812753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb60a59c1b2742eb8c6c605ccf65cf26)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:18.816273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:18.816808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:19.047416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role bb60a59c1b2742eb8c6c605ccf65cf26 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:19.047710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.048651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.051312 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2316/4623] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:18 2022] DELETE /identity/v3/roles/bb60a59c1b2742eb8c6c605ccf65cf26 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:19.055604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:19.058523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:19.082387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebc25f-fad8-4580-918b-5766bde266a6 tempest-TrustsV3TestJSON-586597166 tempest-user-287246240] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:19.151257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:19.151906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:19.152203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:19.152484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/9e73ad6df58e4b00bd9f860d49f3f88e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:19.154147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9e73ad6df58e4b00bd9f860d49f3f88e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:19.155866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:19.445877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 9e73ad6df58e4b00bd9f860d49f3f88e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:19.446549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.448478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.458433 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2308/4624] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:19 2022] DELETE /identity/v3/roles/9e73ad6df58e4b00bd9f860d49f3f88e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:19.464904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:19.472179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1ff2-e8d8-4e86-8066-123560148b2a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:19.548701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:19.550978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:19.551313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:19.551758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users/14c779eb27934e7282541dd54363899f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:19.553383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_user(user_id=14c779eb27934e7282541dd54363899f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:19.556898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:19.688278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c779eb27934e7282541dd54363899f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.696363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c779eb27934e7282541dd54363899f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.697232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c779eb27934e7282541dd54363899f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.697859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c779eb27934e7282541dd54363899f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.710388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-50383a35-7c5e-42f4-9161-06a614b2fb5d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c779eb27934e7282541dd54363899f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:19.829257 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2317/4625] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:19 2022] DELETE /identity/v3/users/14c779eb27934e7282541dd54363899f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:19.834226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:19.835739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:19.860888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651617d-da6d-4f17-8912-ca6dbb2947f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:19.946492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:19.948314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:19.948314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:19.948314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/e8ef8b689f014609a4d45590def58ffd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:19.949561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e8ef8b689f014609a4d45590def58ffd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:19.956409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:20.000384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:20.143901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:20.198989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ef8b689f014609a4d45590def58ffd', 'request_id': 'req-14b60557-572d-4a59-a032-c1a633802850'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:20.206582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ef8b689f014609a4d45590def58ffd', 'request_id': 'req-14b60557-572d-4a59-a032-c1a633802850'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:20.212613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ef8b689f014609a4d45590def58ffd', 'request_id': 'req-14b60557-572d-4a59-a032-c1a633802850'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:20.292841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7efea-091b-4170-a084-7d470eea30ae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.293160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7efea-091b-4170-a084-7d470eea30ae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.293464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7efea-091b-4170-a084-7d470eea30ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.304023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] The token cache is being invalidate because project e8ef8b689f014609a4d45590def58ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:20.313033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:20.313033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:20.313033 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2309/4626] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:19 2022] DELETE /identity/v3/projects/e8ef8b689f014609a4d45590def58ffd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:20.315828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:20.317814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:20.336608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b7b7efea-091b-4170-a084-7d470eea30ae None None] MFA Rules not processed for user `7a1efa8720c8419ba917f0e9220689ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:20.336608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b7b7efea-091b-4170-a084-7d470eea30ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:20.409246 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2318/4627] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:20.419317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.419613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.419886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.432826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60557-572d-4a59-a032-c1a633802850 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:20.438985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:20.440314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.440622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.440906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.441553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:20.443569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:20.449746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] MFA Rules not processed for user `7a1efa8720c8419ba917f0e9220689ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:20.451283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:20.466098 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2319/4628] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:20.536586 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2310/4629] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:04:20 2022] POST /identity/v3/projects => generated 328 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:20.540551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:20.557877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:20.560673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520dff7-f059-4d41-b989-67717a4d498d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:20.618069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:20.632994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:20.633781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.634170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.634640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.635442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:20.637409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:20.733174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2320/4630] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:20 2022] POST /identity/v3/users => generated 413 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:20.734161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:20.735917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:20.748263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36581a2-a4d3-47bd-8c7c-462753160fd8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:20.750247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:20.753979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:20.754736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.755045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.755404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.756145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:20.758157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:20.844437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec992774-dd6d-4388-b09b-b64c989e8fc7 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:20.851270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:20.851906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.852198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.852476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.871420 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2321/4631] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:20 2022] POST /identity/v3/roles => generated 244 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:20.875587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:20.889422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adc9b3-5321-4767-af6c-fcf5a2e91008 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:20.896812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:20.897507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:20.897871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:20.899464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:20.900147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:20.902672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:20.933627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:20.935411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:20.948271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2311/4632] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:21.009627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:21.017225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2322/4633] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:20 2022] POST /identity/v3/roles => generated 247 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:21.022887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:21.033166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58735a4f-9780-4e4a-b92a-4ed7ec19a141 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:21.040066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:21.045894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:21.045894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:21.045894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/783224880e8e417bb658807310c996c2/users/f7a3420bf7304e0ab3cf4b8ee9d72474/roles/13d8446d2a474c8cb59158462f2d508e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:21.064171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=783224880e8e417bb658807310c996c2, user_id=f7a3420bf7304e0ab3cf4b8ee9d72474, role_id=13d8446d2a474c8cb59158462f2d508e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:21.067749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:21.156570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2312/4634] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:21 2022] PUT /identity/v3/projects/783224880e8e417bb658807310c996c2/users/f7a3420bf7304e0ab3cf4b8ee9d72474/roles/13d8446d2a474c8cb59158462f2d508e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:21.161596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:21.177453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667656c8-3a96-42c8-8dc9-6b9df95f3f0d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:21.318268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f84d6-e1b8-4ddf-9f18-0e40866bf301 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:21.318954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f84d6-e1b8-4ddf-9f18-0e40866bf301 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:21.319292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f84d6-e1b8-4ddf-9f18-0e40866bf301 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:21.319574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f84d6-e1b8-4ddf-9f18-0e40866bf301 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/783224880e8e417bb658807310c996c2/users/f7a3420bf7304e0ab3cf4b8ee9d72474/roles/0468c40eb29843d0815424560fd29c59` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:21.322098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f84d6-e1b8-4ddf-9f18-0e40866bf301 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=783224880e8e417bb658807310c996c2, user_id=f7a3420bf7304e0ab3cf4b8ee9d72474, role_id=0468c40eb29843d0815424560fd29c59)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:21.325322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f84d6-e1b8-4ddf-9f18-0e40866bf301 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:21.344215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:21.421105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2323/4635] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:21 2022] PUT /identity/v3/projects/783224880e8e417bb658807310c996c2/users/f7a3420bf7304e0ab3cf4b8ee9d72474/roles/0468c40eb29843d0815424560fd29c59 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:21.425900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:21.443184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426f50-efc3-4fee-9047-25fd58969d5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:21.513272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:21.533842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1404241-2ae0-4990-a693-9080946b5c42 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:21.534475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1404241-2ae0-4990-a693-9080946b5c42 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:21.534764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1404241-2ae0-4990-a693-9080946b5c42 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:21.535076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1404241-2ae0-4990-a693-9080946b5c42 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:21.535740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1404241-2ae0-4990-a693-9080946b5c42 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:21.537716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1404241-2ae0-4990-a693-9080946b5c42 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:21.568933 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2313/4636] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:21 2022] GET /identity/v3/users => generated 8622 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:21.573647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:21.574141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:21.574257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:21.617357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] MFA Rules not processed for user `f7a3420bf7304e0ab3cf4b8ee9d72474`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:21.620520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:21.714726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2324/4637] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:21.733743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:21.733982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:21.734267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:21.784536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] MFA Rules not processed for user `f7a3420bf7304e0ab3cf4b8ee9d72474`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:21.792295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:21.803683 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2314/4638] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:21.808093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:21.819162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283adc-7a11-4672-a768-56788c47bb23 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:21.824024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a3420bf7304e0ab3cf4b8ee9d72474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783224880e8e417bb658807310c996c2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2042590862', 'tempest-NotDelegatedRole-1283795053'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:21.825030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:21.825498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:21.825940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:21.826759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: Authorizing `identity:create_trust()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:21.828252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:22.029445 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2325/4639] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:04:21 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:22.033581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:22.046017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd43167-8bd1-428e-9446-336c38b01b2f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:22.052252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a3420bf7304e0ab3cf4b8ee9d72474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783224880e8e417bb658807310c996c2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2042590862', 'tempest-NotDelegatedRole-1283795053'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:22.052252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:22.052969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:22.053396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:22.054252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:22.056540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:22.101703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2315/4640] 10.222.0.20 () {58 vars in 1252 bytes} [Tue Sep 6 11:04:22 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=f7a3420bf7304e0ab3cf4b8ee9d72474 => generated 611 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:22.102415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:22.136086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30156a71-8508-4b0f-828e-3a6cd9e9e205 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:22.148257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a3420bf7304e0ab3cf4b8ee9d72474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783224880e8e417bb658807310c996c2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2042590862', 'tempest-NotDelegatedRole-1283795053'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:22.148961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:22.149193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:22.149469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] PATH_INFO: `/v3/OS-TRUST/trusts/ae5ff816722b4999854281a7f138a710` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:22.173793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: Authorizing `identity:delete_trust(trust_id=ae5ff816722b4999854281a7f138a710)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:22.175411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:22.354844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ae5ff816722b4999854281a7f138a710', 'request_id': 'req-fc7d0799-3361-4936-8da8-48b42bb16d91'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:22.429695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ae5ff816722b4999854281a7f138a710', 'request_id': 'req-fc7d0799-3361-4936-8da8-48b42bb16d91'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:22.430421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ae5ff816722b4999854281a7f138a710', 'request_id': 'req-fc7d0799-3361-4936-8da8-48b42bb16d91'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:22.438012 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2326/4641] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:04:22 2022] DELETE /identity/v3/OS-TRUST/trusts/ae5ff816722b4999854281a7f138a710 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:22.442973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:22.444853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:22.465874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd77bf-9c14-40be-9d6b-054f965f2507 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:22.470440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7a3420bf7304e0ab3cf4b8ee9d72474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783224880e8e417bb658807310c996c2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-2042590862', 'tempest-NotDelegatedRole-1283795053'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:22.471139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:22.471424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:22.471708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] PATH_INFO: `/v3/OS-TRUST/trusts/ae5ff816722b4999854281a7f138a710` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Could not find trust: ae5ff816722b4999854281a7f138a710.: keystone.exception.TrustNotFound: Could not find trust: ae5ff816722b4999854281a7f138a710. Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 06 11:04:22.481791 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ae5ff816722b4999854281a7f138a710. Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:22.488270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2316/4642] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:22 2022] GET /identity/v3/OS-TRUST/trusts/ae5ff816722b4999854281a7f138a710 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:22.489333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:22.489788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:22.505869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d0799-3361-4936-8da8-48b42bb16d91 tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:22.511188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:22.511838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:22.512341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:22.512625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/0468c40eb29843d0815424560fd29c59` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:22.514051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0468c40eb29843d0815424560fd29c59)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:22.515713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:22.841056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 0468c40eb29843d0815424560fd29c59 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:22.841704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:22.846279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:22.851489 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2327/4643] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:22 2022] DELETE /identity/v3/roles/0468c40eb29843d0815424560fd29c59 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:22.858629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:22.861175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:22.907851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4169b-ff38-45a4-b127-baf47f13a79d tempest-TrustsV3TestJSON-734354025 tempest-user-372430520] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:23.035411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:23.037130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:23.038011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:23.038961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/13d8446d2a474c8cb59158462f2d508e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:23.041841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=13d8446d2a474c8cb59158462f2d508e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:23.044113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:23.081434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:23.331560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 13d8446d2a474c8cb59158462f2d508e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:23.332136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.333656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.343206 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2317/4644] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:22 2022] DELETE /identity/v3/roles/13d8446d2a474c8cb59158462f2d508e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:23.343518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:23.362316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aad9e6-6887-487b-a203-43264b3b8f90 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:23.474022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:23.474955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:23.474955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:23.475169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users/f7a3420bf7304e0ab3cf4b8ee9d72474` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:23.476941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f7a3420bf7304e0ab3cf4b8ee9d72474)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:23.479265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:23.521039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:23.649323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a3420bf7304e0ab3cf4b8ee9d72474'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.664531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a3420bf7304e0ab3cf4b8ee9d72474'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.665430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a3420bf7304e0ab3cf4b8ee9d72474'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.666330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a3420bf7304e0ab3cf4b8ee9d72474'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.687737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a3420bf7304e0ab3cf4b8ee9d72474'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:23.802244 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2328/4645] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:23 2022] DELETE /identity/v3/users/f7a3420bf7304e0ab3cf4b8ee9d72474 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:23.802830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:23.804303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:23.818942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6143a5-c9ce-4682-808b-527736b1db07 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:23.894756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:23.895766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:23.896209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:23.896548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/783224880e8e417bb658807310c996c2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:23.898194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=783224880e8e417bb658807310c996c2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:23.900315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:24.143637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783224880e8e417bb658807310c996c2', 'request_id': 'req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:24.162538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783224880e8e417bb658807310c996c2', 'request_id': 'req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:24.171677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783224880e8e417bb658807310c996c2', 'request_id': 'req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:24.259178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] The token cache is being invalidate because project 783224880e8e417bb658807310c996c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:24.259178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:24.259178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:24.259178 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2318/4646] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:23 2022] DELETE /identity/v3/projects/783224880e8e417bb658807310c996c2 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:24.267746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:24.269665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:24.289289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae4aac-9e80-4b41-b363-31acd0dd63ac tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:24.386794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:24.387942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:24.388463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:24.389057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:24.389885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:24.392189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:24.523777 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2329/4647] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:04:24 2022] POST /identity/v3/projects => generated 329 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:24.525514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:24.527004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:24.540739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bbca3-4214-4e9e-b5b0-cb9105a51b6a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:24.613700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:24.614630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:24.615208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:24.615773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:24.616656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:24.618839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:24.734742 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2319/4648] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:24 2022] POST /identity/v3/users => generated 416 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:24.735683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:24.760094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7c5de-ef57-4e4d-b3d2-0e9fc080db21 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:24.766493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:24.767275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:24.768100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:24.768542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:24.769449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:24.771846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:24.847564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:24.856406 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2330/4649] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:24 2022] POST /identity/v3/roles => generated 242 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:24.862393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b018d6-9977-43f2-83ca-ce79157b85af tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:24.867754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:24.868759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:24.869231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:24.869690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:24.870538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:24.872338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:24.965870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2320/4650] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:24 2022] POST /identity/v3/roles => generated 247 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:24.967107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:24.978700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d086-4e1e-4c7f-bde9-7f8d726601d0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:24.983492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:24.984254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:24.984560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:24.984835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/524f479933f6420bbc9a80f953ea0914/users/9f060dd1e5e747358c8085fcd93f4d56/roles/988c464e04b3497e9bdbde67088ecaa2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:25.002481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=524f479933f6420bbc9a80f953ea0914, user_id=9f060dd1e5e747358c8085fcd93f4d56, role_id=988c464e04b3497e9bdbde67088ecaa2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:25.006058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:25.134495 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2331/4651] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:24 2022] PUT /identity/v3/projects/524f479933f6420bbc9a80f953ea0914/users/9f060dd1e5e747358c8085fcd93f4d56/roles/988c464e04b3497e9bdbde67088ecaa2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:25.138420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:25.149995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c102120-1060-400d-9c9d-2dc520b1bd4f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:25.156800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:25.224920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf4b5a-e848-4753-b7ee-5379b721138e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:25.225662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4b5a-e848-4753-b7ee-5379b721138e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:25.226347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4b5a-e848-4753-b7ee-5379b721138e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:25.226798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4b5a-e848-4753-b7ee-5379b721138e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/524f479933f6420bbc9a80f953ea0914/users/9f060dd1e5e747358c8085fcd93f4d56/roles/9f353c4d8f4a493cb998b40e452ad415` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:25.229618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4b5a-e848-4753-b7ee-5379b721138e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=524f479933f6420bbc9a80f953ea0914, user_id=9f060dd1e5e747358c8085fcd93f4d56, role_id=9f353c4d8f4a493cb998b40e452ad415)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:25.233064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4b5a-e848-4753-b7ee-5379b721138e tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:25.375143 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2321/4652] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:25 2022] PUT /identity/v3/projects/524f479933f6420bbc9a80f953ea0914/users/9f060dd1e5e747358c8085fcd93f4d56/roles/9f353c4d8f4a493cb998b40e452ad415 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:25.382860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:25.398718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e136-b02b-4f87-9932-59564919dc17 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:25.544083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7917-fe41-4400-8777-0b7b927e143b tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:25.544723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7917-fe41-4400-8777-0b7b927e143b tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:25.545028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7917-fe41-4400-8777-0b7b927e143b tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:25.545285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7917-fe41-4400-8777-0b7b927e143b tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:25.545963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7917-fe41-4400-8777-0b7b927e143b tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:25.548096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7917-fe41-4400-8777-0b7b927e143b tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:25.603083 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2332/4653] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:25 2022] GET /identity/v3/users => generated 8625 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:25.608472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:25.609386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:25.609668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:25.649455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:25.672826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] MFA Rules not processed for user `9f060dd1e5e747358c8085fcd93f4d56`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:25.674563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:25.808963 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2322/4654] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:25 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:25.819376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:25.820644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:25.821201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:25.850688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] MFA Rules not processed for user `9f060dd1e5e747358c8085fcd93f4d56`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:25.853384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:25.872834 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2333/4655] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:25 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:25.884677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:25.898090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52dbb-bc09-47c8-b75d-717366754fec None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:25.920497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:25.920497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:25.920497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:25.920981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:25.920981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:create_trust()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:25.920981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.050801 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2323/4656] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:04:25 2022] POST /identity/v3/OS-TRUST/trusts => generated 857 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:26.055351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.070411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a1af-5feb-4c5f-acd8-c06d3a3dda6c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.079423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.081422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.081923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.082787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.091711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:get_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.093194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.111086 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2334/4657] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:26 2022] GET /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc => generated 857 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:26.115074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.141778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40d3e-0d33-4940-814b-23031fdfb34a tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.158930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.159710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.160003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.160284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.169718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.171356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.179949 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2324/4658] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:04:26 2022] GET /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles => generated 369 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:26.184376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.193911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da730c01-d8c4-49e1-901f-56b831b0946f tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.198295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.200454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.200454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.200454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/988c464e04b3497e9bdbde67088ecaa2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.206282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc, role_id=988c464e04b3497e9bdbde67088ecaa2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.207820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.214798 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2335/4659] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:04:26 2022] GET /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/988c464e04b3497e9bdbde67088ecaa2 => generated 242 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:26.221116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.230774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ff67b-1d91-4d3d-b2cc-3967933925cf tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.235003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.235664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.235975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.236317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/988c464e04b3497e9bdbde67088ecaa2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.242375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc, role_id=988c464e04b3497e9bdbde67088ecaa2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.243833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.250695 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2325/4660] 10.222.0.20 () {58 vars in 1369 bytes} [Tue Sep 6 11:04:26 2022] HEAD /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/988c464e04b3497e9bdbde67088ecaa2 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 06 11:04:26.254980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.264439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4b061-33f9-4309-a3f1-033239b96bd3 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.270162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.270848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.271170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.271453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/9f353c4d8f4a493cb998b40e452ad415` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.280493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc, role_id=9f353c4d8f4a493cb998b40e452ad415)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.282646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Could not find role: 9f353c4d8f4a493cb998b40e452ad415.: keystone.exception.RoleNotFound: Could not find role: 9f353c4d8f4a493cb998b40e452ad415. Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:04:26.297111 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9f353c4d8f4a493cb998b40e452ad415. Sep 06 11:04:26.299595 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:26.299595 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2336/4661] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:04:26 2022] GET /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/9f353c4d8f4a493cb998b40e452ad415 => generated 110 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:26.336872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.350109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00cea1-5a75-45d2-8ceb-ce653273d814 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.368830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.369765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.370055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.371228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/9f353c4d8f4a493cb998b40e452ad415` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.380996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc, role_id=9f353c4d8f4a493cb998b40e452ad415)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.382820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Could not find role: 9f353c4d8f4a493cb998b40e452ad415.: keystone.exception.RoleNotFound: Could not find role: 9f353c4d8f4a493cb998b40e452ad415. Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:04:26.394888 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9f353c4d8f4a493cb998b40e452ad415. Sep 06 11:04:26.396059 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:26.396222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2326/4662] 10.222.0.20 () {58 vars in 1369 bytes} [Tue Sep 6 11:04:26 2022] HEAD /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc/roles/9f353c4d8f4a493cb998b40e452ad415 => generated 0 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Sep 06 11:04:26.400362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.411910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f0b76-0b58-404e-8205-b07f120e9f61 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.417915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.419078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.419605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.420242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.429439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorizing `identity:delete_trust(trust_id=555f2be2e38f4c4882a3c9be00f495dc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.431527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.526764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '555f2be2e38f4c4882a3c9be00f495dc', 'request_id': 'req-43de973e-3d2c-475d-8190-2ffdbff9f973'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:26.632859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '555f2be2e38f4c4882a3c9be00f495dc', 'request_id': 'req-43de973e-3d2c-475d-8190-2ffdbff9f973'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:26.635612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '555f2be2e38f4c4882a3c9be00f495dc', 'request_id': 'req-43de973e-3d2c-475d-8190-2ffdbff9f973'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:26.644548 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2337/4663] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:04:26 2022] DELETE /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:26.648726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.651569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:26.669067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f261-f4a4-47ba-8467-f4666845504e tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.674025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f060dd1e5e747358c8085fcd93f4d56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524f479933f6420bbc9a80f953ea0914', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1433721883', 'tempest-DelegatedRole-31386804'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.675377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.676025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.676564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] PATH_INFO: `/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Could not find trust: 555f2be2e38f4c4882a3c9be00f495dc.: keystone.exception.TrustNotFound: Could not find trust: 555f2be2e38f4c4882a3c9be00f495dc. Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 06 11:04:26.687855 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 555f2be2e38f4c4882a3c9be00f495dc. Sep 06 11:04:26.689872 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:26.692016 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2327/4664] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:26 2022] GET /identity/v3/OS-TRUST/trusts/555f2be2e38f4c4882a3c9be00f495dc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:26.697689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:26.699981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:26.718708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de973e-3d2c-475d-8190-2ffdbff9f973 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:26.725695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:26.726424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:26.726821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:26.727227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/9f353c4d8f4a493cb998b40e452ad415` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:26.728908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9f353c4d8f4a493cb998b40e452ad415)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:26.740478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:26.887394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:27.008949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 9f353c4d8f4a493cb998b40e452ad415 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:27.009760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.010717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.014266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2338/4665] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:26 2022] DELETE /identity/v3/roles/9f353c4d8f4a493cb998b40e452ad415 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:27.018780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:27.020882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:27.038113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522a245-74c8-4bbe-8a72-721365bebd58 tempest-TrustsV3TestJSON-1009948936 tempest-user-1271514107] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:27.116025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:27.116687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:27.116980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:27.117263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/988c464e04b3497e9bdbde67088ecaa2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:27.118736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=988c464e04b3497e9bdbde67088ecaa2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:27.120470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:27.372787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 988c464e04b3497e9bdbde67088ecaa2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:27.373446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.380255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.380255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2328/4666] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:27 2022] DELETE /identity/v3/roles/988c464e04b3497e9bdbde67088ecaa2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:27.383700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:27.399379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409737b0-ae4b-4695-a74b-4de538cec79c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:27.476874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:27.477500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:27.478378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:27.480156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users/9f060dd1e5e747358c8085fcd93f4d56` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:27.481913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9f060dd1e5e747358c8085fcd93f4d56)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:27.485782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:27.543711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:27.585603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f060dd1e5e747358c8085fcd93f4d56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.594624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f060dd1e5e747358c8085fcd93f4d56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.596116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f060dd1e5e747358c8085fcd93f4d56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.596877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f060dd1e5e747358c8085fcd93f4d56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.610861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f060dd1e5e747358c8085fcd93f4d56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:27.705389 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2339/4667] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:27 2022] DELETE /identity/v3/users/9f060dd1e5e747358c8085fcd93f4d56 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:27.709772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:27.711504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:27.729772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff120d5-ced5-4505-8870-954f678c0c9a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:27.795104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:27.796188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:27.796692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:27.797184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/524f479933f6420bbc9a80f953ea0914` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:27.798821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=524f479933f6420bbc9a80f953ea0914)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:27.801317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:28.022129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524f479933f6420bbc9a80f953ea0914', 'request_id': 'req-57206dfa-81c0-4abc-8a18-63bc1741f2b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:28.029175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524f479933f6420bbc9a80f953ea0914', 'request_id': 'req-57206dfa-81c0-4abc-8a18-63bc1741f2b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:28.035292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524f479933f6420bbc9a80f953ea0914', 'request_id': 'req-57206dfa-81c0-4abc-8a18-63bc1741f2b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:28.283927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] The token cache is being invalidate because project 524f479933f6420bbc9a80f953ea0914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:28.283927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:28.294955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:28.308803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:28.310362 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2329/4668] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:27 2022] DELETE /identity/v3/projects/524f479933f6420bbc9a80f953ea0914 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:28.312110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:28.346704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f28681-14b2-43fa-b8fa-c12f9d88bef0 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:28.458684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:28.458684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:28.458684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:28.459107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:28.460022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:28.463240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:28.629574 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2340/4669] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:04:28 2022] POST /identity/v3/projects => generated 328 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:28.630392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:28.632134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:28.648359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57206dfa-81c0-4abc-8a18-63bc1741f2b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:28.732453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:28.735195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:28.735195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:28.735195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:28.735692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:28.739047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:28.908626 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2330/4670] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:28 2022] POST /identity/v3/users => generated 416 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:28.909671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:28.922661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae9da-d88f-4580-ad1f-7f69e7ea92b3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:28.928096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:28.928814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:28.929164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:28.929584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:28.930374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:28.932021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:29.060691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:29.062200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2341/4671] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:28 2022] POST /identity/v3/roles => generated 244 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:29.079194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e3ba-6bd0-4d22-b26a-69a8065fd692 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:29.085942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:29.089593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.089593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.089593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.089593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:29.090585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:29.186615 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2331/4672] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:29 2022] POST /identity/v3/roles => generated 247 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:29.190662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:29.206985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4161c-9797-4594-a8c9-3cb938d88d35 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:29.217722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:29.218404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.218688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.218965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/d2b1a3e9d5354dbf81e55045932b69ca/users/e707988fec0a4ef0afe96d650b3b4c54/roles/806637ef9a3045778f72385f6ad1cda5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.248402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d2b1a3e9d5354dbf81e55045932b69ca, user_id=e707988fec0a4ef0afe96d650b3b4c54, role_id=806637ef9a3045778f72385f6ad1cda5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:29.251605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:29.316648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2342/4673] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:29 2022] PUT /identity/v3/projects/d2b1a3e9d5354dbf81e55045932b69ca/users/e707988fec0a4ef0afe96d650b3b4c54/roles/806637ef9a3045778f72385f6ad1cda5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:29.320454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:29.333015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54f83b-73bc-4bd9-8b16-b677801675ef tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:29.401051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f06e7-9b25-40c6-9a19-0eaa5fade11a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:29.401506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f06e7-9b25-40c6-9a19-0eaa5fade11a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.401790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f06e7-9b25-40c6-9a19-0eaa5fade11a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.402070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f06e7-9b25-40c6-9a19-0eaa5fade11a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/d2b1a3e9d5354dbf81e55045932b69ca/users/e707988fec0a4ef0afe96d650b3b4c54/roles/f3974b47c7744d4c9c7fdce674bd7869` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.404387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f06e7-9b25-40c6-9a19-0eaa5fade11a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d2b1a3e9d5354dbf81e55045932b69ca, user_id=e707988fec0a4ef0afe96d650b3b4c54, role_id=f3974b47c7744d4c9c7fdce674bd7869)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:29.407131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f06e7-9b25-40c6-9a19-0eaa5fade11a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:29.443881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:29.543564 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2332/4674] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:29 2022] PUT /identity/v3/projects/d2b1a3e9d5354dbf81e55045932b69ca/users/e707988fec0a4ef0afe96d650b3b4c54/roles/f3974b47c7744d4c9c7fdce674bd7869 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:29.547589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:29.559053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e859a-a454-4048-a975-6c398eb1b67a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:29.615371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:29.630062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763c57-f602-4ef7-a5ec-fadcab9a1f43 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:29.631394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763c57-f602-4ef7-a5ec-fadcab9a1f43 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.631689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763c57-f602-4ef7-a5ec-fadcab9a1f43 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.631972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763c57-f602-4ef7-a5ec-fadcab9a1f43 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.632924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c763c57-f602-4ef7-a5ec-fadcab9a1f43 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:29.634827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c763c57-f602-4ef7-a5ec-fadcab9a1f43 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:29.667159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2343/4675] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:29 2022] GET /identity/v3/users => generated 8625 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:29.672530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.673460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.674652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.727037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] MFA Rules not processed for user `e707988fec0a4ef0afe96d650b3b4c54`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:29.728409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:29.812558 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2333/4676] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:29.832810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.833106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.833390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.889389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] MFA Rules not processed for user `e707988fec0a4ef0afe96d650b3b4c54`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:29.889389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:29.899489 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2344/4677] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:29.903353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:29.915524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c1e9-f67a-44b7-9a99-c0b3b077def7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:29.925064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e707988fec0a4ef0afe96d650b3b4c54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b1a3e9d5354dbf81e55045932b69ca', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1242821906', 'tempest-DelegatedRole-1602385326'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:29.931978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:29.931978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:29.931978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:29.931978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] RBAC: Authorizing `identity:create_trust()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:29.931978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Sep 06 11:04:30.037696 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise ValueError(str(e)) Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Sep 06 11:04:30.038795 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Sep 06 11:04:30.040569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Sep 06 11:04:30.040569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Sep 06 11:04:30.040569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Sep 06 11:04:30.040569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Sep 06 11:04:30.040569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 06 11:04:30.040569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:30.047443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2334/4678] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:04:29 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 145 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 06 11:04:30.052073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:30.067882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4945a-6e31-4f66-9fc9-f22858cabb91 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:30.074864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:30.076081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:30.076373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:30.076660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/f3974b47c7744d4c9c7fdce674bd7869` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:30.091344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f3974b47c7744d4c9c7fdce674bd7869)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:30.091344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:30.276443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role f3974b47c7744d4c9c7fdce674bd7869 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:30.276795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.279094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.283455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2345/4679] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:30 2022] DELETE /identity/v3/roles/f3974b47c7744d4c9c7fdce674bd7869 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:30.284700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:30.286646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:30.305744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847549cf-495e-4067-9852-bb5c01a48b00 tempest-TrustsV3TestJSON-533663466 tempest-user-1246289858] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:30.406094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:30.406748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:30.407046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:30.407521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/806637ef9a3045778f72385f6ad1cda5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:30.409805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=806637ef9a3045778f72385f6ad1cda5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:30.411587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:30.637467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 806637ef9a3045778f72385f6ad1cda5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:30.638025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.638967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.649104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2335/4680] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:30 2022] DELETE /identity/v3/roles/806637ef9a3045778f72385f6ad1cda5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:30.653363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:30.668703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed2c2-8da9-478f-8595-1e65e76ec9e4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:30.777320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:30.777961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:30.778247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:30.778524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users/e707988fec0a4ef0afe96d650b3b4c54` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:30.779695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e707988fec0a4ef0afe96d650b3b4c54)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:30.781662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:30.918827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:30.933158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e707988fec0a4ef0afe96d650b3b4c54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.942146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e707988fec0a4ef0afe96d650b3b4c54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.943027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e707988fec0a4ef0afe96d650b3b4c54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.943688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e707988fec0a4ef0afe96d650b3b4c54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:30.959696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e707988fec0a4ef0afe96d650b3b4c54'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:31.072152 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2346/4681] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:30 2022] DELETE /identity/v3/users/e707988fec0a4ef0afe96d650b3b4c54 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:31.075952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:31.077463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:31.097235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d7d76-7865-4416-9dbd-31e103bebb48 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:31.174418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:31.175431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:31.175722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:31.176073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/d2b1a3e9d5354dbf81e55045932b69ca` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:31.177406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2b1a3e9d5354dbf81e55045932b69ca)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:31.179581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:31.444293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b1a3e9d5354dbf81e55045932b69ca', 'request_id': 'req-43412baf-49c2-4d43-8bc3-2eaab95a463c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:31.454796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b1a3e9d5354dbf81e55045932b69ca', 'request_id': 'req-43412baf-49c2-4d43-8bc3-2eaab95a463c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:31.462850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b1a3e9d5354dbf81e55045932b69ca', 'request_id': 'req-43412baf-49c2-4d43-8bc3-2eaab95a463c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:31.539610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:31.552545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] The token cache is being invalidate because project d2b1a3e9d5354dbf81e55045932b69ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:31.553693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:31.556398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:31.558990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2336/4682] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:31 2022] DELETE /identity/v3/projects/d2b1a3e9d5354dbf81e55045932b69ca => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:31.565415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:31.567137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:31.583301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6665c-0969-4663-8ec9-6ec0f0811386 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:31.655471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:31.656188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:31.657268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:31.657554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:31.658360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:31.660354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:31.783098 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2347/4683] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:04:31 2022] POST /identity/v3/projects => generated 328 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:31.783931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:31.785409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:31.801233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412baf-49c2-4d43-8bc3-2eaab95a463c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:31.879201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:31.879822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:31.880105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:31.880381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:31.881040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:31.883291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:31.995213 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2337/4684] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:31 2022] POST /identity/v3/users => generated 413 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:31.999399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:32.010724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8e294-8e77-4912-b487-55a4b227f21d tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:32.015569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:32.016509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.017499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.018118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.018984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:32.021101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:32.105397 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2348/4685] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:31 2022] POST /identity/v3/roles => generated 244 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:32.109675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:32.121381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675668-d440-478d-aef4-f399695f7c51 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:32.138994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:32.145548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.145844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.146127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.146862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:32.148530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:32.250402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2338/4686] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:32 2022] POST /identity/v3/roles => generated 247 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:32.251798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:32.263571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e585d9-c36c-4ee0-b222-f775bcc13a5f tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:32.269458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:32.270117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.270401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.270680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/6360cdfb7c18457aa4465ceefdd4463b/users/216c391f9ab144d88f2b567b14bf59be/roles/6cfc790518914451bf3a493ed6d83282` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.297436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6360cdfb7c18457aa4465ceefdd4463b, user_id=216c391f9ab144d88f2b567b14bf59be, role_id=6cfc790518914451bf3a493ed6d83282)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:32.302785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:32.396972 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2349/4687] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:32 2022] PUT /identity/v3/projects/6360cdfb7c18457aa4465ceefdd4463b/users/216c391f9ab144d88f2b567b14bf59be/roles/6cfc790518914451bf3a493ed6d83282 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:32.401223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:32.412507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f809-290f-4c55-bd93-baa2c078fb89 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:32.498307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f217d-5149-443a-8d34-f3e43db4bff4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:32.499021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f217d-5149-443a-8d34-f3e43db4bff4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.499327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f217d-5149-443a-8d34-f3e43db4bff4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.499654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f217d-5149-443a-8d34-f3e43db4bff4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/6360cdfb7c18457aa4465ceefdd4463b/users/216c391f9ab144d88f2b567b14bf59be/roles/de3d69f68e634d9298ccc24908c313b2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.502215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f217d-5149-443a-8d34-f3e43db4bff4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6360cdfb7c18457aa4465ceefdd4463b, user_id=216c391f9ab144d88f2b567b14bf59be, role_id=de3d69f68e634d9298ccc24908c313b2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:32.504924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f217d-5149-443a-8d34-f3e43db4bff4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:32.607604 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2339/4688] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:32 2022] PUT /identity/v3/projects/6360cdfb7c18457aa4465ceefdd4463b/users/216c391f9ab144d88f2b567b14bf59be/roles/de3d69f68e634d9298ccc24908c313b2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:32.612272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:32.623557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d7a9-647b-432f-96d3-0102d706eb54 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:32.688125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459b46a-fff3-4cd5-83d3-efc45baa887a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:32.688810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b46a-fff3-4cd5-83d3-efc45baa887a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.689312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b46a-fff3-4cd5-83d3-efc45baa887a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.689591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459b46a-fff3-4cd5-83d3-efc45baa887a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.690354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459b46a-fff3-4cd5-83d3-efc45baa887a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:32.692354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459b46a-fff3-4cd5-83d3-efc45baa887a tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:32.723933 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2350/4689] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:32 2022] GET /identity/v3/users => generated 8622 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:32.729185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d91556-8886-407a-8d40-455939daa50b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.729480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d91556-8886-407a-8d40-455939daa50b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.729759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d91556-8886-407a-8d40-455939daa50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.769421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f8d91556-8886-407a-8d40-455939daa50b None None] MFA Rules not processed for user `216c391f9ab144d88f2b567b14bf59be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:32.770683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8d91556-8886-407a-8d40-455939daa50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:32.795154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:32.836983 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2340/4690] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:32.847664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.847954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.848231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.892691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] MFA Rules not processed for user `216c391f9ab144d88f2b567b14bf59be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:32.892691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:32.900803 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2351/4691] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:32.909701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d91556-8886-407a-8d40-455939daa50b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:32.934363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d91556-8886-407a-8d40-455939daa50b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:32.940209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:32.941354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:32.942067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:32.942397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:32.943172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:create_trust()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:32.944632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.145089 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2341/4692] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:04:32 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:33.149206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.157905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42910670-9c0e-4694-98ba-a04f9cfbdb7f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.162131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.164256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.164256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.164256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.169422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:get_trust(trust_id=d6257015d55046cbb093f949781a37ed)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.170880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.177994 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2352/4693] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:33 2022] GET /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed => generated 834 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:33.182307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.192381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb14fe-b7ee-4957-89b8-8ec59121fdc9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.197310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.198250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.198708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.199372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.208714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d6257015d55046cbb093f949781a37ed)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.209001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.216236 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2342/4694] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:04:33 2022] GET /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles => generated 371 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:33.220491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.230107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db90f-d520-4ea2-bf7b-76336af27b3d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.234486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.235160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.235451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.235756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/6cfc790518914451bf3a493ed6d83282` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.241711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6257015d55046cbb093f949781a37ed, role_id=6cfc790518914451bf3a493ed6d83282)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.243222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.252577 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2353/4695] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:04:33 2022] GET /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/6cfc790518914451bf3a493ed6d83282 => generated 244 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:33.256677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.264300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:33.268585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce3e8-d0ce-476e-bf8b-b7fe554196b6 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.273227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.273848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.274143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.274426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/6cfc790518914451bf3a493ed6d83282` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.280902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6257015d55046cbb093f949781a37ed, role_id=6cfc790518914451bf3a493ed6d83282)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.282366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.295130 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2343/4696] 10.222.0.20 () {58 vars in 1369 bytes} [Tue Sep 6 11:04:33 2022] HEAD /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/6cfc790518914451bf3a493ed6d83282 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Sep 06 11:04:33.295320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.305269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0732f7-0298-4721-bb71-86a97bd8846f tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.309825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.310483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.310767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.311076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/de3d69f68e634d9298ccc24908c313b2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.319533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6257015d55046cbb093f949781a37ed, role_id=de3d69f68e634d9298ccc24908c313b2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.321032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Could not find role: de3d69f68e634d9298ccc24908c313b2.: keystone.exception.RoleNotFound: Could not find role: de3d69f68e634d9298ccc24908c313b2. Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:04:33.335681 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: de3d69f68e634d9298ccc24908c313b2. Sep 06 11:04:33.336837 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:33.336915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2354/4697] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:04:33 2022] GET /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/de3d69f68e634d9298ccc24908c313b2 => generated 110 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:33.341299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.354345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726045c-3953-450e-811d-a26edbaea3d2 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.358963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.359629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.360016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.360289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/de3d69f68e634d9298ccc24908c313b2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.367481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6257015d55046cbb093f949781a37ed, role_id=de3d69f68e634d9298ccc24908c313b2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.369151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Could not find role: de3d69f68e634d9298ccc24908c313b2.: keystone.exception.RoleNotFound: Could not find role: de3d69f68e634d9298ccc24908c313b2. Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:04:33.380512 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: de3d69f68e634d9298ccc24908c313b2. Sep 06 11:04:33.381847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:33.381847 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2344/4698] 10.222.0.20 () {58 vars in 1369 bytes} [Tue Sep 6 11:04:33 2022] HEAD /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed/roles/de3d69f68e634d9298ccc24908c313b2 => generated 0 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:33.386474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.397130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a9f4-e106-4a3f-8dc2-304d582cfaa9 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.401415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.402084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.402372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.402651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.412862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorizing `identity:delete_trust(trust_id=d6257015d55046cbb093f949781a37ed)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.414541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.491687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd6257015d55046cbb093f949781a37ed', 'request_id': 'req-5d456698-d7af-4496-862e-47a2807b3409'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:33.591843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd6257015d55046cbb093f949781a37ed', 'request_id': 'req-5d456698-d7af-4496-862e-47a2807b3409'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:33.592860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd6257015d55046cbb093f949781a37ed', 'request_id': 'req-5d456698-d7af-4496-862e-47a2807b3409'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:33.599823 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2355/4699] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:04:33 2022] DELETE /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:33.604984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.606780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:33.621742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d20c-c316-403d-8356-fb26d318be4d tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.627338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '216c391f9ab144d88f2b567b14bf59be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6360cdfb7c18457aa4465ceefdd4463b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2085556062', 'tempest-DelegatedRole-1133021281'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.627960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.628494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.628777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] PATH_INFO: `/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Could not find trust: d6257015d55046cbb093f949781a37ed.: keystone.exception.TrustNotFound: Could not find trust: d6257015d55046cbb093f949781a37ed. Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 06 11:04:33.638709 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d6257015d55046cbb093f949781a37ed. Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:33.643497 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2345/4700] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:33 2022] GET /identity/v3/OS-TRUST/trusts/d6257015d55046cbb093f949781a37ed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 06 11:04:33.645382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.646886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:33.663050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d456698-d7af-4496-862e-47a2807b3409 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.668115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.672466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.672466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.672466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/de3d69f68e634d9298ccc24908c313b2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.672466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=de3d69f68e634d9298ccc24908c313b2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.672466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:33.863485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role de3d69f68e634d9298ccc24908c313b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:33.864152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:33.864679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:33.866568 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2356/4701] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:33 2022] DELETE /identity/v3/roles/de3d69f68e634d9298ccc24908c313b2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:33.870799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:33.872640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:33.888883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999150a-27bb-4025-8753-e6af24b7a578 tempest-TrustsV3TestJSON-877563571 tempest-user-614483636] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:33.944803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:33.945428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:33.945713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:33.946471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/6cfc790518914451bf3a493ed6d83282` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:33.947693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6cfc790518914451bf3a493ed6d83282)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:33.949386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:34.316493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 6cfc790518914451bf3a493ed6d83282 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:34.317107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.317669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.320095 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2346/4702] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:33 2022] DELETE /identity/v3/roles/6cfc790518914451bf3a493ed6d83282 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:34.324659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:34.337389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57eb65f-71cd-4e6c-b828-bf74f5db81b1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:34.400424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:34.401008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:34.401295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:34.401572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users/216c391f9ab144d88f2b567b14bf59be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:34.402691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_user(user_id=216c391f9ab144d88f2b567b14bf59be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:34.404684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:34.543058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216c391f9ab144d88f2b567b14bf59be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.550356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216c391f9ab144d88f2b567b14bf59be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.551199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216c391f9ab144d88f2b567b14bf59be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.562704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216c391f9ab144d88f2b567b14bf59be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.564679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216c391f9ab144d88f2b567b14bf59be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:34.636963 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2357/4703] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:34 2022] DELETE /identity/v3/users/216c391f9ab144d88f2b567b14bf59be => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:34.641325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:34.643357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:34.656943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84519f-a714-4daa-af69-48001c3c9908 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:34.731138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:34.732157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:34.732452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:34.732728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/6360cdfb7c18457aa4465ceefdd4463b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:34.733932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6360cdfb7c18457aa4465ceefdd4463b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:34.736718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:34.864179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:35.022154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6360cdfb7c18457aa4465ceefdd4463b', 'request_id': 'req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.029564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6360cdfb7c18457aa4465ceefdd4463b', 'request_id': 'req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.037173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6360cdfb7c18457aa4465ceefdd4463b', 'request_id': 'req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.102338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.103965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:35.115198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] The token cache is being invalidate because project 6360cdfb7c18457aa4465ceefdd4463b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:35.116250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.116697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.118728 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2347/4704] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:34 2022] DELETE /identity/v3/projects/6360cdfb7c18457aa4465ceefdd4463b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:35.124135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.125538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:35.187929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbf21-8863-43cc-a71c-17f959487db8 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.214798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9a500-e21e-4f62-8cd0-a2ccaa98cd84 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.223326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.224168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.224575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.224859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.225502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.227499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.258684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.259365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.260134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.260134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] PATH_INFO: `/v3/users/55653ffb98a841e599b1305dcd1ec6be` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.261048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55653ffb98a841e599b1305dcd1ec6be)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.262979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.317302 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2348/4705] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:04:35 2022] POST /identity/v3/projects => generated 328 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:35.321620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.342872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:35.397138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0cce-7567-4b55-bebd-ac41892a11f5 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.403398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.404806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.405198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.405575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.406346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.409315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.488265 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2349/4706] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:35 2022] POST /identity/v3/users => generated 413 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:35.492436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.498747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55653ffb98a841e599b1305dcd1ec6be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.503975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7c583-33af-4e75-90cb-8d3165827ef6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.509922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.510560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.510842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.511242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.511889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.512464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55653ffb98a841e599b1305dcd1ec6be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.513423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55653ffb98a841e599b1305dcd1ec6be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.513824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.514603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55653ffb98a841e599b1305dcd1ec6be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.528512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e36d1d3-647b-440c-8b56-448afab24165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55653ffb98a841e599b1305dcd1ec6be'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:35.613623 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2350/4707] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:35 2022] POST /identity/v3/roles => generated 244 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:35.617597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.619270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:35.634446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc8ba-db6c-474e-95ea-e5570f47a4a4 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.639702 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2358/4708] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:35 2022] DELETE /identity/v3/users/55653ffb98a841e599b1305dcd1ec6be => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:35.641509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.641812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.642099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.667275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:35.668596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:35.706775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.707595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.707985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.708400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.709554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.711546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.760164 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2359/4709] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:35.770941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.772467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:35.834456 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2351/4710] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:04:35 2022] POST /identity/v3/roles => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:35.835421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:35.847959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd427-2f5b-4408-85d4-b5ed7da771f6 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.854254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e8528-b2d3-4486-859d-31f72ab87f33 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:35.854520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.854520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.854520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.854789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:35.854886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/5110729894904900b654fabfc6057603/users/d98a7d1aa0b94dadac57907282233f0c/roles/ef75f2282eb04f9ca93c8fe02edfd95f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.855231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:35.855623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:35.855908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:35.874102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5110729894904900b654fabfc6057603, user_id=d98a7d1aa0b94dadac57907282233f0c, role_id=ef75f2282eb04f9ca93c8fe02edfd95f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.888398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:35.889926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.892767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:35.914054 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2360/4711] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:36.009485 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2352/4712] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:35 2022] PUT /identity/v3/projects/5110729894904900b654fabfc6057603/users/d98a7d1aa0b94dadac57907282233f0c/roles/ef75f2282eb04f9ca93c8fe02edfd95f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:36.014037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.029351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d69bd-d6e6-40f1-b730-471f7da2e1c2 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.112831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e7d0-ce50-43a1-bf66-523be59a9bc3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.113587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e7d0-ce50-43a1-bf66-523be59a9bc3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.113944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e7d0-ce50-43a1-bf66-523be59a9bc3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.114286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e7d0-ce50-43a1-bf66-523be59a9bc3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/5110729894904900b654fabfc6057603/users/d98a7d1aa0b94dadac57907282233f0c/roles/9a66bd1bca4b4975aa7b84a6350b63b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.117672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e7d0-ce50-43a1-bf66-523be59a9bc3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5110729894904900b654fabfc6057603, user_id=d98a7d1aa0b94dadac57907282233f0c, role_id=9a66bd1bca4b4975aa7b84a6350b63b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.121435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e7d0-ce50-43a1-bf66-523be59a9bc3 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:36.232325 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2361/4713] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:36 2022] PUT /identity/v3/projects/5110729894904900b654fabfc6057603/users/d98a7d1aa0b94dadac57907282233f0c/roles/9a66bd1bca4b4975aa7b84a6350b63b9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:36.236493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.247924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf85ac-93c9-48d1-8078-3227d14396d1 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.331104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8f81d-64d5-4de5-99ed-cdd9a7386c92 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.331795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8f81d-64d5-4de5-99ed-cdd9a7386c92 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.332257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8f81d-64d5-4de5-99ed-cdd9a7386c92 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.332554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8f81d-64d5-4de5-99ed-cdd9a7386c92 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.333221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8f81d-64d5-4de5-99ed-cdd9a7386c92 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.335539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8f81d-64d5-4de5-99ed-cdd9a7386c92 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:36.372371 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2353/4714] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:36 2022] GET /identity/v3/users => generated 8341 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:36.373975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.374267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.374543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.418392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] MFA Rules not processed for user `d98a7d1aa0b94dadac57907282233f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:36.419673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:36.503319 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2362/4715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:36.514566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.514566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.518669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.536872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] MFA Rules not processed for user `d98a7d1aa0b94dadac57907282233f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:36.538123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:36.546962 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2354/4716] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:36.551884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.562085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb93c-cbd8-43db-923d-55ebf7798f12 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.569538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.570191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.570776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.570997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.571669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:create_trust()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.582118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:36.683630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.685265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:36.757731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8049a-475e-4ec6-8ff3-00a1c6e0c3da None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.762370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.762998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.763329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.763583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] PATH_INFO: `/v3/projects/8052bbf12c694a9eb067ba351538ce8f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.764813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8052bbf12c694a9eb067ba351538ce8f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.768220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:36.807951 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2363/4717] 10.222.0.20 () {60 vars in 1174 bytes} [Tue Sep 6 11:04:36 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:36.814885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.826067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef3ab-4098-4f56-b1f0-b5b37146ba25 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.830880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.831670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.832015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.832355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.839918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:get_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.841540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:36.850574 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2364/4718] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:36 2022] GET /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb => generated 835 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:36.856514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.867218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53b49d-be03-4573-b3a1-5cde7e39c2ff tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.872379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.873311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.873457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.873732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.883096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.883360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:36.892140 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2365/4719] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Sep 6 11:04:36 2022] GET /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:36.897775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:36.909326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8b71c-ef07-4f4e-a0d6-d9fa97823bb5 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:36.917609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:36.950869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8052bbf12c694a9eb067ba351538ce8f', 'request_id': 'req-16e82f8f-b186-479b-a09c-081e8dd8ecb8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:36.970938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8052bbf12c694a9eb067ba351538ce8f', 'request_id': 'req-16e82f8f-b186-479b-a09c-081e8dd8ecb8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:36.978074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8052bbf12c694a9eb067ba351538ce8f', 'request_id': 'req-16e82f8f-b186-479b-a09c-081e8dd8ecb8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:36.988733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:36.989510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:36.989869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:36.990107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/ef75f2282eb04f9ca93c8fe02edfd95f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:36.998216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb, role_id=ef75f2282eb04f9ca93c8fe02edfd95f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:36.999874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.016270 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2366/4720] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:04:36 2022] GET /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/ef75f2282eb04f9ca93c8fe02edfd95f => generated 244 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:37.016270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.027220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df578-20bf-4ee2-b528-ad594ea6976e tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.032194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.034723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.039288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.039288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/ef75f2282eb04f9ca93c8fe02edfd95f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.042412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb, role_id=ef75f2282eb04f9ca93c8fe02edfd95f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.044128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.052971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2367/4721] 10.222.0.20 () {58 vars in 1369 bytes} [Tue Sep 6 11:04:37 2022] HEAD /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/ef75f2282eb04f9ca93c8fe02edfd95f => generated 0 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:37.057155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.068052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b0e8-2426-4e04-a816-398e27d0bac4 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.072501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.073364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.073716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.073920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/9a66bd1bca4b4975aa7b84a6350b63b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.076193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] The token cache is being invalidate because project 8052bbf12c694a9eb067ba351538ce8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:37.076729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:37.077552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-16e82f8f-b186-479b-a09c-081e8dd8ecb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:37.079298 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2355/4722] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:36 2022] DELETE /identity/v3/projects/8052bbf12c694a9eb067ba351538ce8f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:37.083811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb, role_id=9a66bd1bca4b4975aa7b84a6350b63b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.084211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5342-3fee-4830-bc8e-0aeb06351b95 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.084660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5342-3fee-4830-bc8e-0aeb06351b95 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.084899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e5342-3fee-4830-bc8e-0aeb06351b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.085411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Could not find role: 9a66bd1bca4b4975aa7b84a6350b63b9.: keystone.exception.RoleNotFound: Could not find role: 9a66bd1bca4b4975aa7b84a6350b63b9. Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:04:37.098889 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9a66bd1bca4b4975aa7b84a6350b63b9. Sep 06 11:04:37.100283 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:37.100283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2368/4723] 10.222.0.20 () {58 vars in 1368 bytes} [Tue Sep 6 11:04:37 2022] GET /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/9a66bd1bca4b4975aa7b84a6350b63b9 => generated 110 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:37.104296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.109181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:37.123954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bb042-1de3-453f-ac02-546377d7abd2 tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.125818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-653e5342-3fee-4830-bc8e-0aeb06351b95 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:37.127154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-653e5342-3fee-4830-bc8e-0aeb06351b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:37.129399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.130076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.130467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.130734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/9a66bd1bca4b4975aa7b84a6350b63b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.138862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb, role_id=9a66bd1bca4b4975aa7b84a6350b63b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.140268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Could not find role: 9a66bd1bca4b4975aa7b84a6350b63b9.: keystone.exception.RoleNotFound: Could not find role: 9a66bd1bca4b4975aa7b84a6350b63b9. Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 11:04:37.151772 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9a66bd1bca4b4975aa7b84a6350b63b9. Sep 06 11:04:37.152788 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:37.152890 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2369/4724] 10.222.0.20 () {58 vars in 1369 bytes} [Tue Sep 6 11:04:37 2022] HEAD /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb/roles/9a66bd1bca4b4975aa7b84a6350b63b9 => generated 0 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:37.157920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.168811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c1b37-7168-4362-bd08-c4d0c06a66bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.175131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.175999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.176504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.177111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.185621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorizing `identity:delete_trust(trust_id=ac94d376fca74a49b811f4603eeae7fb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.187852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.214490 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2356/4725] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:37.222615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.222954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.223265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.248163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:37.249715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:37.260822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2357/4726] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:37.264451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.277025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c089e-0f8d-4c06-962c-abe95ef8250c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.283557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ac94d376fca74a49b811f4603eeae7fb', 'request_id': 'req-009b3c89-c618-4568-94f3-289be90425bb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:37.292723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.294244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.295752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.296425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.299090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:37.299582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.303669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.309583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:37.321866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2358/4727] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:37.327366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.341182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b60e8-6f21-47bf-880f-3a5cb5d34389 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.356957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.357918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.358468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.358979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.359876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.362171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.374069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ac94d376fca74a49b811f4603eeae7fb', 'request_id': 'req-009b3c89-c618-4568-94f3-289be90425bb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:37.374069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ac94d376fca74a49b811f4603eeae7fb', 'request_id': 'req-009b3c89-c618-4568-94f3-289be90425bb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:37.395193 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2370/4728] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 11:04:37 2022] DELETE /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:37.396635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.399998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:37.421804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b3c89-c618-4568-94f3-289be90425bb tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.440591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd98a7d1aa0b94dadac57907282233f0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5110729894904900b654fabfc6057603', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-241119514', 'tempest-DelegatedRole-1599844072'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.441271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.441539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.441815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] PATH_INFO: `/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Could not find trust: ac94d376fca74a49b811f4603eeae7fb.: keystone.exception.TrustNotFound: Could not find trust: ac94d376fca74a49b811f4603eeae7fb. Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Sep 06 11:04:37.455106 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ac94d376fca74a49b811f4603eeae7fb. Sep 06 11:04:37.456445 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:04:37.460237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2371/4729] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 11:04:37 2022] GET /identity/v3/OS-TRUST/trusts/ac94d376fca74a49b811f4603eeae7fb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:04:37.461318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.463453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:37.514144 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2359/4730] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:37 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:37.518350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.523401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:37.608605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8387a1-3571-45ba-a540-0e58c5324bda tempest-TrustsV3TestJSON-583611416 tempest-user-997838753] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.688181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eda35-5ade-4245-8a3b-df862b8db65e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.708153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.708989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.710512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.710690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.711352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/9a66bd1bca4b4975aa7b84a6350b63b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.711717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.712430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.712875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.713695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9a66bd1bca4b4975aa7b84a6350b63b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.714030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.716403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.719554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.913945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2360/4731] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:37 2022] POST /identity/v3/users => generated 293 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:37.918154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.929498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00076c73-4c94-4318-a9c0-08cf86eead22 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.936004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.936618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.937093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.937404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.938044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.940227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.955798 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2361/4732] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:37 2022] GET /identity/v3/roles => generated 1892 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:37.960186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:37.974441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0b065-b31d-49e0-b7be-6420fee770d9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:37.979579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:37.980269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:37.980705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:37.986097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:37.986097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:37.986097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:37.998912 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2362/4733] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:37 2022] GET /identity/v3/roles => generated 1892 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:38.003963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:38.017657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10d51-ce96-414c-b6dd-748d8fecb639 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:38.024125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba298cb-6900-497e-ada6-cfb698a12a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:38.025426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba298cb-6900-497e-ada6-cfb698a12a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.025720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba298cb-6900-497e-ada6-cfb698a12a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.026070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba298cb-6900-497e-ada6-cfb698a12a4c admin admin] PATH_INFO: `/v3/projects/a1fe32cefcc04db29316568d5e8ddb50/users/0454b13d38c64d0eb91d7d512a065f45/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.039714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role 9a66bd1bca4b4975aa7b84a6350b63b9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:38.041113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.042092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.044956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2372/4734] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:37 2022] DELETE /identity/v3/roles/9a66bd1bca4b4975aa7b84a6350b63b9 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:38.049706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:38.062565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba298cb-6900-497e-ada6-cfb698a12a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fe32cefcc04db29316568d5e8ddb50, user_id=0454b13d38c64d0eb91d7d512a065f45, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:38.066288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba298cb-6900-497e-ada6-cfb698a12a4c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:38.066505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:38.069716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:38.134364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2363/4735] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:38 2022] PUT /identity/v3/projects/a1fe32cefcc04db29316568d5e8ddb50/users/0454b13d38c64d0eb91d7d512a065f45/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:38.146570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.146570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.146902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.153227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1804be0-da84-40f2-99f8-56693707b4de tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:38.196159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] MFA Rules not processed for user `0454b13d38c64d0eb91d7d512a065f45`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:38.197951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:38.225538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:38.226186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.226476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.226756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/roles/ef75f2282eb04f9ca93c8fe02edfd95f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.228409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ef75f2282eb04f9ca93c8fe02edfd95f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:38.234036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:38.291340 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2364/4736] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:38.303423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:38.304836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:38.398181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0237417-ba9f-464b-a036-ee63aeeb61d9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:38.403181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:38.403793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.404073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.404396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.413988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:38.415552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:38.426253 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2365/4737] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:38.455424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invalidating the token cache because role ef75f2282eb04f9ca93c8fe02edfd95f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:38.455781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.456632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.459483 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2373/4738] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:38 2022] DELETE /identity/v3/roles/ef75f2282eb04f9ca93c8fe02edfd95f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:38.463492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:38.484458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aca0d-8a22-40bb-b4ed-9db0954d02e8 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:38.566397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:38.567048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.567679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.567679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/users/d98a7d1aa0b94dadac57907282233f0c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.568800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d98a7d1aa0b94dadac57907282233f0c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:38.570889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:38.710875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98a7d1aa0b94dadac57907282233f0c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.718156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98a7d1aa0b94dadac57907282233f0c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.723674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98a7d1aa0b94dadac57907282233f0c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.736928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98a7d1aa0b94dadac57907282233f0c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.737722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98a7d1aa0b94dadac57907282233f0c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:38.806286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2366/4739] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:38 2022] DELETE /identity/v3/users/d98a7d1aa0b94dadac57907282233f0c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:38.812166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:38.812530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:38.826022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce1de-8af4-4f50-b63f-51a6a1dfa543 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:38.868561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:38.870822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:38.900634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46014dcadfee44d5aba489314dafec41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '397c7644413544438161dcff64d9abad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:38.901366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.901588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.901865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] PATH_INFO: `/v3/projects/5110729894904900b654fabfc6057603` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.903103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5110729894904900b654fabfc6057603)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:38.910343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:38.957327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76fd8-4dfd-46aa-8607-3f500b19185c tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:38.962279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:38.962957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:38.963272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:38.963545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] PATH_INFO: `/v3/users/3b6e2046e3bd40b3b46802dfa796260b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:38.964748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6e2046e3bd40b3b46802dfa796260b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:38.966672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:39.137137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5110729894904900b654fabfc6057603', 'request_id': 'req-5faba454-7d5a-40ee-a0a9-b40ce2beee56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.144097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5110729894904900b654fabfc6057603', 'request_id': 'req-5faba454-7d5a-40ee-a0a9-b40ce2beee56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.150685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5110729894904900b654fabfc6057603', 'request_id': 'req-5faba454-7d5a-40ee-a0a9-b40ce2beee56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.210496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6e2046e3bd40b3b46802dfa796260b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.217883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6e2046e3bd40b3b46802dfa796260b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.218565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6e2046e3bd40b3b46802dfa796260b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.229378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] The token cache is being invalidate because project 5110729894904900b654fabfc6057603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:39.229760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.230420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.231945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6e2046e3bd40b3b46802dfa796260b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.232894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df676c60-f808-43fd-bfc2-b51f7443daa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6e2046e3bd40b3b46802dfa796260b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.237860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2374/4740] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:38 2022] DELETE /identity/v3/projects/5110729894904900b654fabfc6057603 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:39.240831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:39.242570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:39.313407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faba454-7d5a-40ee-a0a9-b40ce2beee56 tempest-TrustsV3TestJSON-1007332975 tempest-TrustsV3TestJSON-1007332975-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:39.318761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:39.319373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:39.324581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:39.324581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] PATH_INFO: `/v3/users/f987589030cc4ee9bd8affa41837a56a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:39.324581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f987589030cc4ee9bd8affa41837a56a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:39.324581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:39.341817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:39.346735 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2367/4741] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:38 2022] DELETE /identity/v3/users/3b6e2046e3bd40b3b46802dfa796260b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:39.352493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:39.352780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:39.353158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:39.380210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:39.381501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:39.484594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2368/4742] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:39.494476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:39.495980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:39.556667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6e74e-936b-4955-9726-b0ef4b1862ca None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:39.560938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500db06-9711-48e0-b58a-3d26ccd483ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:39.561551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500db06-9711-48e0-b58a-3d26ccd483ce service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:39.561828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500db06-9711-48e0-b58a-3d26ccd483ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:39.562097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500db06-9711-48e0-b58a-3d26ccd483ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:39.573695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500db06-9711-48e0-b58a-3d26ccd483ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:39.575176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500db06-9711-48e0-b58a-3d26ccd483ce service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:39.586412 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2369/4743] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:39.662493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f987589030cc4ee9bd8affa41837a56a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.680316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f987589030cc4ee9bd8affa41837a56a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.681188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f987589030cc4ee9bd8affa41837a56a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.681865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f987589030cc4ee9bd8affa41837a56a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.702317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f987589030cc4ee9bd8affa41837a56a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:39.850666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:39.857573 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2375/4744] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:39 2022] DELETE /identity/v3/users/f987589030cc4ee9bd8affa41837a56a => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:39.862098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:39.862811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:39.862811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:39.894492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:39.895670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:39.958322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2370/4745] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:39.968820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:39.970476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:40.035846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dcf9e-a589-4168-b842-4e3b03c40849 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:40.041311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:40.041940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:40.042222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:40.042496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:40.053525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:40.056363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:40.075623 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2376/4746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:40.260084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:40.261760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:40.282333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be73d88-28c0-40f8-ad02-b05b74333b8b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:40.288098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:40.288744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:40.289027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:40.289445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] PATH_INFO: `/v3/projects/2a1f6f54c8d24eaa9eae09e8f30c56f1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:40.292138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1f6f54c8d24eaa9eae09e8f30c56f1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:40.295295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:40.450589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'request_id': 'req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:40.464408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'request_id': 'req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:40.479188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1f6f54c8d24eaa9eae09e8f30c56f1', 'request_id': 'req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:40.588766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] The token cache is being invalidate because project 2a1f6f54c8d24eaa9eae09e8f30c56f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:40.589367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:40.589756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:40.591315 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2371/4747] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:40 2022] DELETE /identity/v3/projects/2a1f6f54c8d24eaa9eae09e8f30c56f1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:40.595426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:40.606350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422cd76-ccca-4cff-a344-cfb6f381013a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:40.673752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:40.674824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:40.675178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:40.675672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] PATH_INFO: `/v3/users/3320982894964d85bef7eaa13a2f72ac` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:40.676929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3320982894964d85bef7eaa13a2f72ac)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:40.680066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:40.689216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:40.691331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:40.723435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f406f-d0c2-4533-831a-f59ecc0a19a2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:40.729091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:40.730502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:40.730788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:40.731103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] PATH_INFO: `/v3/projects/4f585970f6fa4389a15ebac3d1673c81` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:40.736865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f585970f6fa4389a15ebac3d1673c81)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:40.736865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:40.891598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:40.997017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3320982894964d85bef7eaa13a2f72ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:40.997224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f585970f6fa4389a15ebac3d1673c81', 'request_id': 'req-d889862f-0412-4b01-86e6-1a757f1ec710'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.003528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f585970f6fa4389a15ebac3d1673c81', 'request_id': 'req-d889862f-0412-4b01-86e6-1a757f1ec710'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.004277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3320982894964d85bef7eaa13a2f72ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.004996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3320982894964d85bef7eaa13a2f72ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.005622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3320982894964d85bef7eaa13a2f72ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.010533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f585970f6fa4389a15ebac3d1673c81', 'request_id': 'req-d889862f-0412-4b01-86e6-1a757f1ec710'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.018999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bc53ed2-0117-4d49-912d-ceb33ffbff66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3320982894964d85bef7eaa13a2f72ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.130990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] The token cache is being invalidate because project 4f585970f6fa4389a15ebac3d1673c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:41.131384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.132012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.133748 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2372/4748] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:40 2022] DELETE /identity/v3/projects/4f585970f6fa4389a15ebac3d1673c81 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:41.137582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:41.138904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:41.210668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889862f-0412-4b01-86e6-1a757f1ec710 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:41.215711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:41.216564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:41.216962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:41.217241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] PATH_INFO: `/v3/users/46014dcadfee44d5aba489314dafec41` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:41.218356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=46014dcadfee44d5aba489314dafec41)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:41.221024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:41.229684 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2377/4749] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:40 2022] DELETE /identity/v3/users/3320982894964d85bef7eaa13a2f72ac => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:41.291594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:41.291895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:41.292584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:41.314281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] MFA Rules not processed for user `00e93a2f8ed643ba8bc92b4def1ce7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:41.315544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:41.414359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2378/4750] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:41.419102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46014dcadfee44d5aba489314dafec41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.428987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46014dcadfee44d5aba489314dafec41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.450067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46014dcadfee44d5aba489314dafec41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.481799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:41.502390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46014dcadfee44d5aba489314dafec41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.503943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46014dcadfee44d5aba489314dafec41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:41.678361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:41.680334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:41.681526 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2373/4751] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:41 2022] DELETE /identity/v3/users/46014dcadfee44d5aba489314dafec41 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:41.851517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2d11-e104-446e-ad19-b0877a4d9885 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:41.937920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:41.939634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:41.939973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:41.940259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] PATH_INFO: `/v3/projects/e2d99cfecc7d499ea8a478b100e9b061` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:41.941518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d99cfecc7d499ea8a478b100e9b061)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:41.951368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:42.138240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d99cfecc7d499ea8a478b100e9b061', 'request_id': 'req-53d86a99-cab5-4165-b3a5-5b61e9a181b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.150110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d99cfecc7d499ea8a478b100e9b061', 'request_id': 'req-53d86a99-cab5-4165-b3a5-5b61e9a181b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.170864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d99cfecc7d499ea8a478b100e9b061', 'request_id': 'req-53d86a99-cab5-4165-b3a5-5b61e9a181b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.268584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:42.275477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:42.301468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] The token cache is being invalidate because project e2d99cfecc7d499ea8a478b100e9b061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:42.302003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.302860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-53d86a99-cab5-4165-b3a5-5b61e9a181b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.305974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2379/4752] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:41 2022] DELETE /identity/v3/projects/e2d99cfecc7d499ea8a478b100e9b061 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:42.310745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff2fe9-b83a-4980-ae3f-c9e18c6a4924 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.310915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff2fe9-b83a-4980-ae3f-c9e18c6a4924 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.311229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff2fe9-b83a-4980-ae3f-c9e18c6a4924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.414999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6aff2fe9-b83a-4980-ae3f-c9e18c6a4924 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:42.418421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6aff2fe9-b83a-4980-ae3f-c9e18c6a4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:42.439536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29e818-e797-493c-8e68-9158ea1050ff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:42.546076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:42.546652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.546940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.547251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] PATH_INFO: `/v3/projects/397c7644413544438161dcff64d9abad` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.548459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=397c7644413544438161dcff64d9abad)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:42.550516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:42.580021 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2380/4753] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:42.587935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.588443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.589291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.638564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:42.638868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:42.651072 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2381/4754] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:42.652242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:42.662726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385faa36-5e3a-4f7e-a279-6312dd59b9d6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:42.669279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:42.669996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.670289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.670594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.671295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:42.671605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:42.674262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:42.687917 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2382/4755] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:42.692470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:42.697556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397c7644413544438161dcff64d9abad', 'request_id': 'req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.703109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e0bf4-8a8e-4137-bf7e-5c5b10fe7dd5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:42.706903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397c7644413544438161dcff64d9abad', 'request_id': 'req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.714214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397c7644413544438161dcff64d9abad', 'request_id': 'req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.765035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:42.765652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.766044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.766397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.767594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:42.769493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:42.798677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] The token cache is being invalidate because project 397c7644413544438161dcff64d9abad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:42.798677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.798677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df768aa3-9e5d-47b2-91eb-af51a9e88bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:42.798677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2374/4756] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:42 2022] DELETE /identity/v3/projects/397c7644413544438161dcff64d9abad => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:42.798677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37a4fa-e427-4a0c-9ed8-d975e8cabbde None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.799192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37a4fa-e427-4a0c-9ed8-d975e8cabbde None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.799192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37a4fa-e427-4a0c-9ed8-d975e8cabbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.818313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2e37a4fa-e427-4a0c-9ed8-d975e8cabbde None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:42.819473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2e37a4fa-e427-4a0c-9ed8-d975e8cabbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:42.828278 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2375/4757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:42.843263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:42.843263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:42.843263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:42.897219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:42.908475 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2383/4758] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:42 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:42.913489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:42.913751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:42.917789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:43.057386 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2376/4759] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:43.058705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.059649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e46dd-2f95-479b-b22d-2d1c5f151192 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.071601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.071820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724677b-50f0-4584-83ff-10a3abe7ea80 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.071964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.071964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.072279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.072985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.075332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.078491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.079894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.080324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.080751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.081780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:43.082244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.084174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.102199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2377/4760] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:43.103616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.114505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590829c-54a8-441e-b340-b7d86ed9e13c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.120837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.121573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.121966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.122352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.123340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.126409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.168706 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2384/4761] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:42 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:43.172651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.187230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175ecae-e114-4c2a-bdb6-c1c675ae250b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.194554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.195332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.195622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.196143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.196793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.198631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.211045 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2385/4762] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:43.214642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.225039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3af51e-f103-4676-82d7-1f8130bad6b7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.229741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.230331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.230613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.230888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.231556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.233275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.249466 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2386/4763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:43.251664 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2378/4764] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:43.254304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.254440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.279294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2db53-52c8-41ee-9ed4-e57c92054efc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.350964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e1a9-23d9-4621-9abd-73d0f7e4dd4c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.356501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.357145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.357626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.357903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.358546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.361624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.368834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7aa99-56f1-42f4-9dea-cec980b62211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.376562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7aa99-56f1-42f4-9dea-cec980b62211 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.376562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7aa99-56f1-42f4-9dea-cec980b62211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.376562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7aa99-56f1-42f4-9dea-cec980b62211 admin admin] PATH_INFO: `/v3/projects/86d475f2c85b452ba4d32b1d3d77c111/users/54b95de3c60f438b813475d3e7e1e9ff/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.387177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7aa99-56f1-42f4-9dea-cec980b62211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d475f2c85b452ba4d32b1d3d77c111, user_id=54b95de3c60f438b813475d3e7e1e9ff, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.389899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7aa99-56f1-42f4-9dea-cec980b62211 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.424885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:43.476651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2379/4765] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:43.480672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.504185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297935-1648-47d7-a2e2-0dffca20a93f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.525816 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2387/4766] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:43 2022] PUT /identity/v3/projects/86d475f2c85b452ba4d32b1d3d77c111/users/54b95de3c60f438b813475d3e7e1e9ff/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:43.539097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.539574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.540062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.595277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] MFA Rules not processed for user `54b95de3c60f438b813475d3e7e1e9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:43.597053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:43.598139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.598826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.599230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.599508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.600215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.606712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.617840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2380/4767] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:43.618886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.631616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e49e-d8b8-4149-adf1-72635bc12540 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.637912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.638776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.639912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.640631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.641484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.645435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.667217 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2381/4768] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:43.669552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.686877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d640-0588-4f0d-ad1f-80d1b2ff7340 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.692837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530360-8c03-450e-bc83-a0a584dd4477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.693813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530360-8c03-450e-bc83-a0a584dd4477 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.694180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530360-8c03-450e-bc83-a0a584dd4477 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.695126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530360-8c03-450e-bc83-a0a584dd4477 admin admin] PATH_INFO: `/v3/projects/ace73809938541c9bdc4fce7fee6ade8/users/e76a6533a00947719e1b45e46537d386/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.700437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2388/4769] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:43.705930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.714661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530360-8c03-450e-bc83-a0a584dd4477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace73809938541c9bdc4fce7fee6ade8, user_id=e76a6533a00947719e1b45e46537d386, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.717759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530360-8c03-450e-bc83-a0a584dd4477 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.720632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946147d-4c08-4f4f-b4f1-2745af065ccc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.726726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.731564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.732090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.732394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.733137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:43.735167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:43.820841 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2382/4770] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:43 2022] PUT /identity/v3/projects/ace73809938541c9bdc4fce7fee6ade8/users/e76a6533a00947719e1b45e46537d386/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:43.828814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eb465-3003-4220-a262-290352345eed None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.829248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eb465-3003-4220-a262-290352345eed None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.829812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eb465-3003-4220-a262-290352345eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:43.864941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c15eb465-3003-4220-a262-290352345eed None None] MFA Rules not processed for user `e76a6533a00947719e1b45e46537d386`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:43.866153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c15eb465-3003-4220-a262-290352345eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:43.894379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2389/4771] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:43.896465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.987130 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2383/4772] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:43.991617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eb465-3003-4220-a262-290352345eed None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:43.992401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccbf29-ebeb-4ebd-a0ae-ca605c737123 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:43.998436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:43.998894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:43.999214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:43.999496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.000215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.002101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.002824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eb465-3003-4220-a262-290352345eed None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.071806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.072698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.073153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.073562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.074686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:create_application_credential(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.076308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.139863 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2390/4773] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:44.144453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.166277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092076d-4e9b-4be3-90bd-7aba306c69a5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.193182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.193933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.194327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.194821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.195831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.197745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.235568 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2391/4774] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:44.242841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.260337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdd56e-18e6-4e26-8b00-3f8182cbcea6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.270617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.271540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.273543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.273948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] PATH_INFO: `/v3/projects/9d461ac0f7b8451e9541aab71e5711a8/users/3fc2253a2551449187b3af156b3cf694/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.317016 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2384/4775] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Sep 6 11:04:43 2022] POST /identity/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials => generated 921 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:44.318136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.332162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d461ac0f7b8451e9541aab71e5711a8, user_id=3fc2253a2551449187b3af156b3cf694, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.335776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c85670-d897-4c66-a90b-71e33941b411 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.337738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.350452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.353805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.353805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.353805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/access_rules/80f53c07fcb042c5af49d7f3b1c01f58` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.353805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:delete_access_rule(user_id=e76a6533a00947719e1b45e46537d386, access_rule_id=80f53c07fcb042c5af49d7f3b1c01f58)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.354513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application session.delete(ref) Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application yield resource Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:04:44.387510 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise self.value Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application session.commit() Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.session.flush() Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 11:04:44.388939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application compat.raise_( Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._synchronize( Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise AssertionError( Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Sep 06 11:04:44.390565 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:04:44.392840 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:04:44.394401 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2385/4776] 10.222.0.20 () {58 vars in 1362 bytes} [Tue Sep 6 11:04:44 2022] DELETE /identity/v3/users/e76a6533a00947719e1b45e46537d386/access_rules/80f53c07fcb042c5af49d7f3b1c01f58 => generated 89 bytes in 71 msecs (HTTP/1.1 403) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:04:44.395721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.409806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe51a00-39e0-4fca-807d-83a9e04fc0db tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.418767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.419473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.419775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.420784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials/aa65f9e8bfdf410dbaec09c6cbb37184` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.440434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e76a6533a00947719e1b45e46537d386, application_credential_id=aa65f9e8bfdf410dbaec09c6cbb37184)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.444648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.469977 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2392/4777] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:44 2022] PUT /identity/v3/projects/9d461ac0f7b8451e9541aab71e5711a8/users/3fc2253a2551449187b3af156b3cf694/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:44.479159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.554986 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2386/4778] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:04:44 2022] DELETE /identity/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials/aa65f9e8bfdf410dbaec09c6cbb37184 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:44.558477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.566486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e154445-42f6-4194-9016-47b3bef58dfe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.570862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e389737-a927-47de-9c67-381e62bf63ba tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.571666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.572284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.572579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.572847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.573534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.575241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.588848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2393/4779] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:44.593717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.607455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54384d8-9379-4863-8d4b-9c06ff4902ee admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.620948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2506a0-7741-40dd-b5c1-8fade58ebfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.622000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2506a0-7741-40dd-b5c1-8fade58ebfef admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.622280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2506a0-7741-40dd-b5c1-8fade58ebfef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.622559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2506a0-7741-40dd-b5c1-8fade58ebfef admin admin] PATH_INFO: `/v3/projects/9d461ac0f7b8451e9541aab71e5711a8/users/3fc2253a2551449187b3af156b3cf694/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.625275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2506a0-7741-40dd-b5c1-8fade58ebfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d461ac0f7b8451e9541aab71e5711a8, user_id=3fc2253a2551449187b3af156b3cf694, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.638040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2506a0-7741-40dd-b5c1-8fade58ebfef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.666203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2394/4780] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:44 2022] PUT /identity/v3/projects/9d461ac0f7b8451e9541aab71e5711a8/users/3fc2253a2551449187b3af156b3cf694/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:44.676643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.677964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.678104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.678354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.679208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.681966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.682448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/access_rules` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.685462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:list_access_rules(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.688044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.697271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2387/4781] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 11:04:44 2022] GET /identity/v3/users/e76a6533a00947719e1b45e46537d386/access_rules => generated 369 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:44.715313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] MFA Rules not processed for user `3fc2253a2551449187b3af156b3cf694`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:44.715794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.716160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:44.735706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59f969-5c0f-45f0-b545-7e4a07bf9ede tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.820946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.820946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.820946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.821214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/access_rules/80f53c07fcb042c5af49d7f3b1c01f58` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.821849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:delete_access_rule(user_id=e76a6533a00947719e1b45e46537d386, access_rule_id=80f53c07fcb042c5af49d7f3b1c01f58)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.823473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.854040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2395/4782] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:44.855170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.865560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d69ec-db92-400f-b5c3-a3f78ab3e632 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.870440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.871086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.871378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.871662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.872347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:44.872788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.878335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.890985 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2396/4783] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:44.896737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:44.917945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0f08-bac3-443d-9701-bb3555722759 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:44.925975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:44.927791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:44.928276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:44.928769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:44.930183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:44.933373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:44.966642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:44.978619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2388/4784] 10.222.0.20 () {58 vars in 1362 bytes} [Tue Sep 6 11:04:44 2022] DELETE /identity/v3/users/e76a6533a00947719e1b45e46537d386/access_rules/80f53c07fcb042c5af49d7f3b1c01f58 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:44.982562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.000789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe8175-ad5b-4350-9467-09ae20edb834 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.005908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.006643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.006920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.007238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/access_rules` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.008914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:list_access_rules(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.010751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.018165 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2389/4785] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 11:04:44 2022] GET /identity/v3/users/e76a6533a00947719e1b45e46537d386/access_rules => generated 158 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:45.024304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.034625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca008b-5dd4-4c83-8a4e-44a68c6e4bf2 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.040831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.041457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.041744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.042027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.042701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:create_application_credential(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.043901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.054303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2397/4786] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:44 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:45.076366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.141887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:45.225060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbac2-17ca-4ab3-b40f-b4df1aef9117 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.230395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.231542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.231835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.232129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.234997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:45.239719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.239719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.265655 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2390/4787] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Sep 6 11:04:45 2022] POST /identity/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials => generated 920 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:45.271702 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2398/4788] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:45.273055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.278690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.280723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:45.292762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4838-46a9-4cf3-a31d-31b2a6ae1184 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.382095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.383310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.384203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.384687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/access_rules` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.386187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:list_access_rules(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.388237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.395551 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2391/4789] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 11:04:45 2022] GET /identity/v3/users/e76a6533a00947719e1b45e46537d386/access_rules => generated 369 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:45.400458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.418513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d67b-8df6-4a55-802e-59c0766d4f5c tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.427192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.429282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.431305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.431807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.432859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:create_application_credential(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.433411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ae949-e130-453e-8417-3569d8333aa8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.435393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.441710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a55b0-7077-4098-a218-366c30f873e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.443440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a55b0-7077-4098-a218-366c30f873e1 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.443821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a55b0-7077-4098-a218-366c30f873e1 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.444308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a55b0-7077-4098-a218-366c30f873e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.456446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a55b0-7077-4098-a218-366c30f873e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.458437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a55b0-7077-4098-a218-366c30f873e1 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.473631 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2399/4790] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:45.494774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a729a1-7362-4314-a039-52004ad9a008 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.495160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a729a1-7362-4314-a039-52004ad9a008 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.495385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a729a1-7362-4314-a039-52004ad9a008 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.496891 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2400/4791] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:04:45.503587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a729a1-7362-4314-a039-52004ad9a008 None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:04:45.531333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a729a1-7362-4314-a039-52004ad9a008 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.555752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a729a1-7362-4314-a039-52004ad9a008 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.564664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.565467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.565669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.566287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/projects/09aa9c49719543b2bf16f19f964acada` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.567143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:get_project(project_id=09aa9c49719543b2bf16f19f964acada)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.569455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.571630 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2401/4792] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:04:45 2022] GET /identity/v3/projects/09aa9c49719543b2bf16f19f964acada => generated 371 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:45.667830 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2392/4793] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Sep 6 11:04:45 2022] POST /identity/v3/users/e76a6533a00947719e1b45e46537d386/application_credentials => generated 920 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:45.672038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.682968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1737603-301b-4862-9a04-204abdb02752 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.688625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fd881-f841-469a-acc8-2b4745aac938 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e76a6533a00947719e1b45e46537d386', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ace73809938541c9bdc4fce7fee6ade8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.689462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fd881-f841-469a-acc8-2b4745aac938 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.690639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fd881-f841-469a-acc8-2b4745aac938 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.690639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fd881-f841-469a-acc8-2b4745aac938 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386/access_rules/2b777d19effe4281afc94d0331d4fa1a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.691597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fd881-f841-469a-acc8-2b4745aac938 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorizing `identity:get_access_rule(user_id=e76a6533a00947719e1b45e46537d386, access_rule_id=2b777d19effe4281afc94d0331d4fa1a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.693306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fd881-f841-469a-acc8-2b4745aac938 tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.701914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2402/4794] 10.222.0.20 () {58 vars in 1359 bytes} [Tue Sep 6 11:04:45 2022] GET /identity/v3/users/e76a6533a00947719e1b45e46537d386/access_rules/2b777d19effe4281afc94d0331d4fa1a => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:45.707635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.804314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4131-db5d-48b8-8766-30ab6d7838bf None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.805706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4131-db5d-48b8-8766-30ab6d7838bf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.806204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e4131-db5d-48b8-8766-30ab6d7838bf None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.808463 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2403/4795] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:04:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:04:45.813872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4131-db5d-48b8-8766-30ab6d7838bf None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:04:45.837540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c18e3e-8a27-4f0e-b187-22232d922e6e tempest-AccessRulesV3Test-1004451762 tempest-AccessRulesV3Test-1004451762-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.847091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4131-db5d-48b8-8766-30ab6d7838bf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:45.851673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.855269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.855905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.856695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] PATH_INFO: `/v3/users/e76a6533a00947719e1b45e46537d386` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.859632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76a6533a00947719e1b45e46537d386)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.864218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.885359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e4131-db5d-48b8-8766-30ab6d7838bf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:45.897284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:45.901040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:45.901654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:45.902953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/projects/09aa9c49719543b2bf16f19f964acada` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:45.915151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:get_project(project_id=09aa9c49719543b2bf16f19f964acada)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:45.933124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:45.933124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2404/4796] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:04:45 2022] GET /identity/v3/projects/09aa9c49719543b2bf16f19f964acada => generated 371 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:46.003476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:46.023848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5b99-4266-4e55-b1c3-2ec1cc77d17e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:46.030509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:46.031287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.031571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.031849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.032533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:46.032840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:46.035070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:46.075191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2405/4797] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:46.079938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:46.098459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477baefa-3253-4095-bf9c-4a04671e8cfc tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:46.114879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:46.115543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.115831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.116104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.116749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:46.118714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:46.148902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76a6533a00947719e1b45e46537d386'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:46.161361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76a6533a00947719e1b45e46537d386'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:46.163955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76a6533a00947719e1b45e46537d386'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:46.234074 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2406/4798] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:46 2022] POST /identity/v3/users => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:46.238965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:46.243814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:46.260968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5389d-8d57-4118-887c-72b7d41eaf56 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:46.266068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:46.267062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.267397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.267740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.268470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:46.268855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:46.270692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2529d-9f1f-452a-8113-ebfd6741e95a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:46.288475 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2407/4799] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:46.305663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.305960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.306244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.307647 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2408/4800] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:04:46.312398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:04:46.317761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:46.365338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:46.376571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03280d6f-a9ff-40ed-9ec4-fae290d465bb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:46.381374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44492b-7dae-4048-925c-842bd5b3f4e8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:46.382164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44492b-7dae-4048-925c-842bd5b3f4e8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.383137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44492b-7dae-4048-925c-842bd5b3f4e8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.383741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44492b-7dae-4048-925c-842bd5b3f4e8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/projects/09aa9c49719543b2bf16f19f964acada` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.385789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44492b-7dae-4048-925c-842bd5b3f4e8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:get_project(project_id=09aa9c49719543b2bf16f19f964acada)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:46.388192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44492b-7dae-4048-925c-842bd5b3f4e8 tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:46.394317 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2409/4801] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:04:46 2022] GET /identity/v3/projects/09aa9c49719543b2bf16f19f964acada => generated 371 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:46.416821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76a6533a00947719e1b45e46537d386'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:46.417556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76a6533a00947719e1b45e46537d386'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:46.566372 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2393/4802] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:45 2022] DELETE /identity/v3/users/e76a6533a00947719e1b45e46537d386 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:46.570973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557a2e-c17e-4cde-b5b0-c39e753f3e39 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.571285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557a2e-c17e-4cde-b5b0-c39e753f3e39 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.571570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557a2e-c17e-4cde-b5b0-c39e753f3e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.615074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-77557a2e-c17e-4cde-b5b0-c39e753f3e39 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:46.617797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-77557a2e-c17e-4cde-b5b0-c39e753f3e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:46.713939 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2410/4803] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:46.723935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:46.725621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:46.828329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af149211-eefb-4e15-82bb-133395b67734 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:46.831179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:46.835961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:46.836677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:46.837196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:46.838010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:46.852794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:46.855232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:46.873122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2394/4804] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:47.070945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:47.202160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5687-76be-45ef-9345-44b99a317dad None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:47.203130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5687-76be-45ef-9345-44b99a317dad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:47.203530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5687-76be-45ef-9345-44b99a317dad None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:47.215221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2411/4805] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:04:47 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:04:47.221858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:04:47.223476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:47.394824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:47.479744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802555d-9940-468d-a6f9-b396d5b4ee57 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:47.481796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:47.482462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:47.482887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:47.483238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/projects/09aa9c49719543b2bf16f19f964acada` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:47.484553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:get_project(project_id=09aa9c49719543b2bf16f19f964acada)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:47.486886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:47.488840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2395/4806] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:04:47 2022] GET /identity/v3/projects/09aa9c49719543b2bf16f19f964acada => generated 371 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:47.526539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5687-76be-45ef-9345-44b99a317dad None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:47.549140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5687-76be-45ef-9345-44b99a317dad None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:47.555867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:47.556666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:47.557024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:47.557912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/users/10c040d5eed84c3cbcd9a151e9ba4b4b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:47.585616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:delete_user(user_id=10c040d5eed84c3cbcd9a151e9ba4b4b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:47.587846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:47.737174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c040d5eed84c3cbcd9a151e9ba4b4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:47.745600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c040d5eed84c3cbcd9a151e9ba4b4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:47.746540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c040d5eed84c3cbcd9a151e9ba4b4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:47.747315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c040d5eed84c3cbcd9a151e9ba4b4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:47.769445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c040d5eed84c3cbcd9a151e9ba4b4b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:47.846207 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2412/4807] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:47 2022] DELETE /identity/v3/users/10c040d5eed84c3cbcd9a151e9ba4b4b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:47.851181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:47.854506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:47.873774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14163-b281-4582-b855-ad1837554c6a tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:47.955507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fc2253a2551449187b3af156b3cf694', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d461ac0f7b8451e9541aab71e5711a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:47.956425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:47.956819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:47.957232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] PATH_INFO: `/v3/projects/09aa9c49719543b2bf16f19f964acada` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:47.963255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09aa9c49719543b2bf16f19f964acada)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:47.963255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:47.970979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:47.972727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.082343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26158b-e2bb-49ce-8b23-b1dd65106c7b tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:48.087583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:48.088430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.088880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.089167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] PATH_INFO: `/v3/projects/ace73809938541c9bdc4fce7fee6ade8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.090375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace73809938541c9bdc4fce7fee6ade8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:48.092483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:48.149579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09aa9c49719543b2bf16f19f964acada', 'request_id': 'req-63ca8641-eb53-4e60-9650-2aa1c5d7060e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.159134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09aa9c49719543b2bf16f19f964acada', 'request_id': 'req-63ca8641-eb53-4e60-9650-2aa1c5d7060e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.166339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09aa9c49719543b2bf16f19f964acada', 'request_id': 'req-63ca8641-eb53-4e60-9650-2aa1c5d7060e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.249294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace73809938541c9bdc4fce7fee6ade8', 'request_id': 'req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.263170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace73809938541c9bdc4fce7fee6ade8', 'request_id': 'req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.264548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] The token cache is being invalidate because project 09aa9c49719543b2bf16f19f964acada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:48.264922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.266346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.268129 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2396/4808] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:47 2022] DELETE /identity/v3/projects/09aa9c49719543b2bf16f19f964acada => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:48.274029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:48.275621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace73809938541c9bdc4fce7fee6ade8', 'request_id': 'req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.275774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.364132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8641-eb53-4e60-9650-2aa1c5d7060e tempest-QuotasAdminTestV257-1333176352 tempest-QuotasAdminTestV257-1333176352-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:48.409214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] The token cache is being invalidate because project ace73809938541c9bdc4fce7fee6ade8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:48.409526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.410247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d634bcc-1d7c-4fa2-8ff0-0f67b0102d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.411936 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2413/4809] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:47 2022] DELETE /identity/v3/projects/ace73809938541c9bdc4fce7fee6ade8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:48.417753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc46c75-928b-4314-a38a-8d6373d3254c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.418254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc46c75-928b-4314-a38a-8d6373d3254c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.418705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc46c75-928b-4314-a38a-8d6373d3254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.478493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:48.479594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.480135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.480702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] PATH_INFO: `/v3/users/54b95de3c60f438b813475d3e7e1e9ff` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.482405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b95de3c60f438b813475d3e7e1e9ff)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:48.486227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:48.493044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cbc46c75-928b-4314-a38a-8d6373d3254c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:48.494875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cbc46c75-928b-4314-a38a-8d6373d3254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.516865 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2414/4810] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:48.516865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.516865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.516865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.545476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:48.546684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.555425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2415/4811] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:48.560298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:48.571891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b6ca-656a-4c14-9513-a98ee8fa7efd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:48.576492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:48.577110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.577392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.577664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.578543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:48.579236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:48.581080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:48.599197 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2416/4812] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:48.602421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:48.616852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47b69-1f8b-481f-bc7a-7a6eb267758e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:48.624829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:48.625615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.625972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.626325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.627075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:48.629404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:48.653794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:48.689510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b95de3c60f438b813475d3e7e1e9ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.702585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b95de3c60f438b813475d3e7e1e9ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.705207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b95de3c60f438b813475d3e7e1e9ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.718089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2417/4813] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:48 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:48.722034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:48.726567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.740295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b95de3c60f438b813475d3e7e1e9ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.741451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69a14648-d009-4713-bf91-ae374a2688b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b95de3c60f438b813475d3e7e1e9ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:48.821803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b8d8c-56a5-4d6e-9f4b-d52c10e9db67 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:48.827318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:48.833883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.833883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.833883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.833883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:48.833883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:48.838494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2397/4814] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:48 2022] DELETE /identity/v3/users/54b95de3c60f438b813475d3e7e1e9ff => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:48.841040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.841342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.841620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.872818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:48.874086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.951981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2418/4815] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:48 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:48.954380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:48.960894 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2398/4816] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:48.971438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:48.973151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:48.976110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2313-bbe8-42f2-a943-355b9699f376 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:48.983595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:48.987071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:48.987570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:48.988073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:48.988936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:48.992693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:49.030850 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2419/4817] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:49.031906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.032062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:49.060066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86c74-c674-4a00-9bef-2e1bdfd91780 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.075154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.076136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.076427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.076705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.077397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:49.079718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:49.098259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f8894-4c36-47b0-8837-84e96295e23e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.105239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2420/4818] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:49.109459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.110364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3dca1-e3ad-4235-b93e-8aeebddd831b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.111143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3dca1-e3ad-4235-b93e-8aeebddd831b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.111630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3dca1-e3ad-4235-b93e-8aeebddd831b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.113639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3dca1-e3ad-4235-b93e-8aeebddd831b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.129399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9feb-87e3-4e06-928e-aebbc04fc6c4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.133045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3dca1-e3ad-4235-b93e-8aeebddd831b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:49.136395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3dca1-e3ad-4235-b93e-8aeebddd831b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:49.137600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.140331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.140331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.140331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] PATH_INFO: `/v3/projects/f766d7db9bce4d2bad826a2fa55115fe/users/1883d14d59504977aed98287e48966f4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.151047 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2399/4819] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:49.171597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f766d7db9bce4d2bad826a2fa55115fe, user_id=1883d14d59504977aed98287e48966f4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:49.174541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:49.278572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2421/4820] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:49 2022] PUT /identity/v3/projects/f766d7db9bce4d2bad826a2fa55115fe/users/1883d14d59504977aed98287e48966f4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:49.279717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.279717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.279717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.311055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] MFA Rules not processed for user `1883d14d59504977aed98287e48966f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:49.312194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:49.383698 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2400/4821] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:49.388421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.398795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05ebd-dab7-4007-9d21-ea430f012dcb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.403446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef9f15-dade-4fd3-aea4-be01e28aeeb1 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1883d14d59504977aed98287e48966f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f766d7db9bce4d2bad826a2fa55115fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.404128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef9f15-dade-4fd3-aea4-be01e28aeeb1 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.404481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef9f15-dade-4fd3-aea4-be01e28aeeb1 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.404822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef9f15-dade-4fd3-aea4-be01e28aeeb1 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] PATH_INFO: `/v3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.406427 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2422/4822] 10.222.0.20 () {58 vars in 1104 bytes} [Tue Sep 6 11:04:49 2022] GET /identity/v3 => generated 255 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:49.411205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.421475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac4450-a425-4f02-b25b-ce9027730196 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.427244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153929-48df-41a6-a3fd-ea9997a42455 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1883d14d59504977aed98287e48966f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f766d7db9bce4d2bad826a2fa55115fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.427968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153929-48df-41a6-a3fd-ea9997a42455 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.428615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153929-48df-41a6-a3fd-ea9997a42455 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.429000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153929-48df-41a6-a3fd-ea9997a42455 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] PATH_INFO: `/v3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.430706 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2401/4823] 10.222.0.20 () {58 vars in 1104 bytes} [Tue Sep 6 11:04:49 2022] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:49.435375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef9f15-dade-4fd3-aea4-be01e28aeeb1 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.449764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef9f15-dade-4fd3-aea4-be01e28aeeb1 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.458563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdc6c5-83d1-48ef-8080-f884eeb52cf2 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1883d14d59504977aed98287e48966f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f766d7db9bce4d2bad826a2fa55115fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.459491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc6c5-83d1-48ef-8080-f884eeb52cf2 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.459903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc6c5-83d1-48ef-8080-f884eeb52cf2 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.460148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc6c5-83d1-48ef-8080-f884eeb52cf2 tempest-TestApiDiscovery-2091384107 tempest-TestApiDiscovery-2091384107-project] PATH_INFO: `/v3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.467777 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2423/4824] 10.222.0.20 () {58 vars in 1104 bytes} [Tue Sep 6 11:04:49 2022] GET /identity/v3 => generated 255 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:49.469447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dcde4-5b7d-4298-ad48-21e0aa1cd574 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.471130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dcde4-5b7d-4298-ad48-21e0aa1cd574 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.471130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dcde4-5b7d-4298-ad48-21e0aa1cd574 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.472895 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2402/4825] 10.222.0.20 () {56 vars in 895 bytes} [Tue Sep 6 11:04:49 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:04:49.482673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4135d-5383-40e4-8192-ea92f3596fd9 None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.488314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4135d-5383-40e4-8192-ea92f3596fd9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.488831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4135d-5383-40e4-8192-ea92f3596fd9 None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.490860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2424/4826] 10.222.0.20 () {56 vars in 895 bytes} [Tue Sep 6 11:04:49 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:04:49.498108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dcde4-5b7d-4298-ad48-21e0aa1cd574 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.613941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dcde4-5b7d-4298-ad48-21e0aa1cd574 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.619881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.620764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.621054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.621389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] PATH_INFO: `/v3/users/1883d14d59504977aed98287e48966f4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.622556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1883d14d59504977aed98287e48966f4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:49.624877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:49.859572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1883d14d59504977aed98287e48966f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:49.868983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1883d14d59504977aed98287e48966f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:49.869925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1883d14d59504977aed98287e48966f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:49.896142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1883d14d59504977aed98287e48966f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:49.896896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-042c7f22-98da-41da-86df-e0b624b53222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1883d14d59504977aed98287e48966f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:49.927546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4135d-5383-40e4-8192-ea92f3596fd9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:49.929408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5bc4135d-5383-40e4-8192-ea92f3596fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:49.945559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4135d-5383-40e4-8192-ea92f3596fd9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:49.950597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:49.951276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:49.952060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:49.952060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] PATH_INFO: `/v3/projects/86d475f2c85b452ba4d32b1d3d77c111` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:49.953758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d475f2c85b452ba4d32b1d3d77c111)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:49.956945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:50.051887 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2403/4827] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:49 2022] DELETE /identity/v3/users/1883d14d59504977aed98287e48966f4 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:50.056202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:50.056438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:50.056719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:50.079635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:50.080778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:50.116685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d475f2c85b452ba4d32b1d3d77c111', 'request_id': 'req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.126427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d475f2c85b452ba4d32b1d3d77c111', 'request_id': 'req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.133686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d475f2c85b452ba4d32b1d3d77c111', 'request_id': 'req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.155142 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2404/4828] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:50.164047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:50.165555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:50.212165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] The token cache is being invalidate because project 86d475f2c85b452ba4d32b1d3d77c111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:50.212464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.213220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.222670 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2425/4829] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:49 2022] DELETE /identity/v3/projects/86d475f2c85b452ba4d32b1d3d77c111 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:50.226462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:50.228196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:50.232622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56554085-9555-4e22-a9b0-7902df4b3771 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:50.235756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:50.303166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:50.303166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:50.303166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:50.303166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:50.305156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:50.305316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:50.314911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed23e-1e50-4670-9bd4-0df43a2c6967 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:50.318111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:50.319877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:50.320039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:50.320579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:50.320860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:50.321133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] PATH_INFO: `/v3/users/3fc2253a2551449187b3af156b3cf694` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:50.322302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc2253a2551449187b3af156b3cf694)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:50.324260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:50.336753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2405/4830] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:50.488786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc2253a2551449187b3af156b3cf694'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.497827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc2253a2551449187b3af156b3cf694'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.498842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc2253a2551449187b3af156b3cf694'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.502323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc2253a2551449187b3af156b3cf694'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.519254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc2253a2551449187b3af156b3cf694'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:50.597714 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2426/4831] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:50 2022] DELETE /identity/v3/users/3fc2253a2551449187b3af156b3cf694 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:50.836359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:50.838297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:50.851513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327372-f63c-413a-bf01-4475861519f2 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:50.932302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:50.932980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:50.933400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:50.933691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] PATH_INFO: `/v3/projects/f766d7db9bce4d2bad826a2fa55115fe` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:50.934864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f766d7db9bce4d2bad826a2fa55115fe)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:50.936830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.122480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f766d7db9bce4d2bad826a2fa55115fe', 'request_id': 'req-33757be7-54bd-4060-83f7-992b5a07b590'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.129870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f766d7db9bce4d2bad826a2fa55115fe', 'request_id': 'req-33757be7-54bd-4060-83f7-992b5a07b590'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.135957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f766d7db9bce4d2bad826a2fa55115fe', 'request_id': 'req-33757be7-54bd-4060-83f7-992b5a07b590'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.225675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.227399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:51.252599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5fd0-370a-4378-a9ed-1f54805aaae4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.271511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] The token cache is being invalidate because project f766d7db9bce4d2bad826a2fa55115fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:51.271977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.272708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33757be7-54bd-4060-83f7-992b5a07b590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.278971 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2406/4832] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:50 2022] DELETE /identity/v3/projects/f766d7db9bce4d2bad826a2fa55115fe => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:51.280723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328de24-2615-47ab-bf4c-c5cadb5b81b5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.282490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328de24-2615-47ab-bf4c-c5cadb5b81b5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.283436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328de24-2615-47ab-bf4c-c5cadb5b81b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.310172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d328de24-2615-47ab-bf4c-c5cadb5b81b5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:51.311630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d328de24-2615-47ab-bf4c-c5cadb5b81b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:51.320257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.320897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.321177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.321456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] PATH_INFO: `/v3/projects/9d461ac0f7b8451e9541aab71e5711a8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.322582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d461ac0f7b8451e9541aab71e5711a8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.324953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.389834 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2407/4833] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:51.397612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.398033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.398446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.424342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:51.425706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:51.434191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2408/4834] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:51.438514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.448295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba327ee-9fe6-4c6a-a892-90b30a36f3e9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.453308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.453936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.454219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.454493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.455215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:51.455568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.457725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.470870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d461ac0f7b8451e9541aab71e5711a8', 'request_id': 'req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.471788 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2409/4835] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:51.476024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.477063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d461ac0f7b8451e9541aab71e5711a8', 'request_id': 'req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.484165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d461ac0f7b8451e9541aab71e5711a8', 'request_id': 'req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.487385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2d26-8a49-47f2-94a6-65a301ff5239 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.549739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.550664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.550914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.551386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.551847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.553838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.635538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] The token cache is being invalidate because project 9d461ac0f7b8451e9541aab71e5711a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:51.636950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.637892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8d7f89b5-b38d-4bc4-9748-2cb27c862d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:51.646977 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2427/4836] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:51 2022] DELETE /identity/v3/projects/9d461ac0f7b8451e9541aab71e5711a8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:51.648646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa451aa-1a2c-4a2a-a109-30bcc3b81ab2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.649374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa451aa-1a2c-4a2a-a109-30bcc3b81ab2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.650450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa451aa-1a2c-4a2a-a109-30bcc3b81ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.679768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1aa451aa-1a2c-4a2a-a109-30bcc3b81ab2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:51.681516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1aa451aa-1a2c-4a2a-a109-30bcc3b81ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:51.690715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2428/4837] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:51.702004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.702292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.702595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.722948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:51.724342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:51.732860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2429/4838] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:51.736792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.745987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ec03a-f7cd-48bf-96a4-40d3c2798d17 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.753474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2410/4839] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:51.754838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.755388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.756169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.756169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.756391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.757066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:51.757902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.758189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:51.759615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.777536 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2430/4840] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:51.778503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.790951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f04b-09b1-44fe-9ff4-449dc45e9bdc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.850402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b5d3-0fa6-4798-80b1-cfea29442f7b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.855550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.858714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.858714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.858714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.858714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.859968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.869530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:51.872117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.876165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.876165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.889657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.890531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.893539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.942539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2411/4841] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:51.943651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.962160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425d9ce-54ac-49e8-a0d3-27b7be5ac802 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:51.967663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:51.969284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:51.969572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:51.969852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:51.970671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:51.972556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:51.986099 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2412/4842] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:51.987295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:51.998396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28ca0-9bbf-4111-9218-56a6fac8e552 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.003060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2431/4843] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:51 2022] POST /identity/v3/projects => generated 393 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:52.004051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.004663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.004951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.005239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.005880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.007882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.009318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.020140 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2413/4844] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:52.024530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.036015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0deb3a-b827-4dae-a4b6-81b9d7ea61b9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.082533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f8d7-6089-412a-8461-70b5d37a533e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.088983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.089674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.090365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.090751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.091486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.093500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.100829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0e13-2ac5-41a9-b995-4dede7997a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.101598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0e13-2ac5-41a9-b995-4dede7997a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.101885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0e13-2ac5-41a9-b995-4dede7997a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.102165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0e13-2ac5-41a9-b995-4dede7997a71 admin admin] PATH_INFO: `/v3/projects/3aed536dd3ea4226a95198da45e28822/users/1fbd22a33ef64209818c8d58a46bfa42/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.117093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0e13-2ac5-41a9-b995-4dede7997a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aed536dd3ea4226a95198da45e28822, user_id=1fbd22a33ef64209818c8d58a46bfa42, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.123377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0e13-2ac5-41a9-b995-4dede7997a71 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.172438 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2432/4845] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:52 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:52.176662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.186740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eb82a-6746-4480-af47-6ef7bb4a7f7c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.193540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.194164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.194497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.194780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.204515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.206331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2414/4846] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:52 2022] PUT /identity/v3/projects/3aed536dd3ea4226a95198da45e28822/users/1fbd22a33ef64209818c8d58a46bfa42/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:52.206452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.210439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.210737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.211037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.221601 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2433/4847] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:52.222761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.233985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832d6d-1c39-4bd9-b674-67d414234a65 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.249832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] MFA Rules not processed for user `1fbd22a33ef64209818c8d58a46bfa42`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:52.253804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:52.255186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:52.303275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.303726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.304009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.304330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.304984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.306852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.323761 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2434/4848] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:52.325015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.339389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e499a33-43d9-4633-8ca2-3093efe8247a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.347174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4ffb-eaa7-4d38-8da0-d5e8507c29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.348173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4ffb-eaa7-4d38-8da0-d5e8507c29aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.348622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4ffb-eaa7-4d38-8da0-d5e8507c29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.349409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4ffb-eaa7-4d38-8da0-d5e8507c29aa admin admin] PATH_INFO: `/v3/projects/68d910e1900744518e3f12b3ded97a02/users/c90fbe81777d4cfd9376bd1c412c188c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.351724 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2415/4849] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:52.369047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.370187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4ffb-eaa7-4d38-8da0-d5e8507c29aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d910e1900744518e3f12b3ded97a02, user_id=c90fbe81777d4cfd9376bd1c412c188c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.370475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:52.373503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4ffb-eaa7-4d38-8da0-d5e8507c29aa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.474974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2435/4850] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:52 2022] PUT /identity/v3/projects/68d910e1900744518e3f12b3ded97a02/users/c90fbe81777d4cfd9376bd1c412c188c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:52.476690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ce10c-c28e-43ec-b534-50fc06bec9d2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.476811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.477026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.477307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.514448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] MFA Rules not processed for user `c90fbe81777d4cfd9376bd1c412c188c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:52.515833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:52.537815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.538446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.538877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.539218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.589722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2436/4851] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:52.593937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.605530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.607024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.621184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2416/4852] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:52.634457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:52.666287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952a5a-9458-4b4e-943d-774c106bc826 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.672239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.674041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.678003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.678003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.678003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.678003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.716996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.719768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:52.721439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:52.740987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14331ff5-c58d-424b-9e45-77bfb61158d7 service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.748654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.749346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.749681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.749969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] PATH_INFO: `/v3/users/0454b13d38c64d0eb91d7d512a065f45` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.751217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0454b13d38c64d0eb91d7d512a065f45)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.753338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.828892 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2437/4853] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:52 2022] POST /identity/v3/projects => generated 395 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:52.830435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:52.928171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97858be-aba4-44ea-9978-160f36d282e8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:52.934190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:52.935437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:52.935712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:52.935990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:52.936687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:52.938743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:52.997918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0454b13d38c64d0eb91d7d512a065f45'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:53.010191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0454b13d38c64d0eb91d7d512a065f45'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:53.011298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0454b13d38c64d0eb91d7d512a065f45'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:53.026095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0454b13d38c64d0eb91d7d512a065f45'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:53.031232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9a66f-162a-430a-83da-6b0ef50794a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0454b13d38c64d0eb91d7d512a065f45'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:53.044061 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2438/4854] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:52 2022] POST /identity/v3/users => generated 304 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:53.048018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:53.049808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.064647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ac597-7ae4-4520-b0c1-d2a1746a7af5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:53.069735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:53.070432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.076516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.076516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.076516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:53.076516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:53.084369 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2439/4855] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:53.088188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:53.099160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31af1e-b844-4c4c-b4d3-93629ec406b8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:53.104373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:53.105032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.105319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.106142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] PATH_INFO: `/v3/projects/86777d9c479841a8a2958abe165cda9f/users/93a1fdd781394211bbc40f7757d64e43/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.128843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86777d9c479841a8a2958abe165cda9f, user_id=93a1fdd781394211bbc40f7757d64e43, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:53.141438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:53.191654 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2417/4856] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:52 2022] DELETE /identity/v3/users/0454b13d38c64d0eb91d7d512a065f45 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:53.193510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.198293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.198293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.242666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:53.244187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.261575 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2440/4857] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:53 2022] PUT /identity/v3/projects/86777d9c479841a8a2958abe165cda9f/users/93a1fdd781394211bbc40f7757d64e43/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:53.265795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:53.339880 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2418/4858] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:53.347374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:53.356413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.362705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:53.369125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d47a6-4f7b-43b5-8196-c31b7b6b6346 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:53.374856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:53.376326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.377011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.377454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.378264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:53.380137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:53.394952 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2441/4859] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:53.400144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:53.410442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de9159-15d9-4c15-b175-1275135d9a3c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:53.416218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f1653-0674-4dcb-95eb-d30c91a395cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:53.416962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f1653-0674-4dcb-95eb-d30c91a395cf admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.417572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f1653-0674-4dcb-95eb-d30c91a395cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.417937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f1653-0674-4dcb-95eb-d30c91a395cf admin admin] PATH_INFO: `/v3/projects/86777d9c479841a8a2958abe165cda9f/users/93a1fdd781394211bbc40f7757d64e43/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.420236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f1653-0674-4dcb-95eb-d30c91a395cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86777d9c479841a8a2958abe165cda9f, user_id=93a1fdd781394211bbc40f7757d64e43, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:53.423087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f1653-0674-4dcb-95eb-d30c91a395cf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:53.430414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:53.437753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2442/4860] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:53 2022] PUT /identity/v3/projects/86777d9c479841a8a2958abe165cda9f/users/93a1fdd781394211bbc40f7757d64e43/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:53.455315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1973-a75f-4c04-8e57-fc664cf2b526 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.455315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1973-a75f-4c04-8e57-fc664cf2b526 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.455315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1973-a75f-4c04-8e57-fc664cf2b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.492816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf50e1-45ac-4273-be52-5402b071b81c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:53.495714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-835b1973-a75f-4c04-8e57-fc664cf2b526 None None] MFA Rules not processed for user `93a1fdd781394211bbc40f7757d64e43`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:53.497959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-835b1973-a75f-4c04-8e57-fc664cf2b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.565964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:53.566951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.567446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.567928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.595065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2443/4861] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:53.605516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.605879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.606347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.629076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] MFA Rules not processed for user `c90fbe81777d4cfd9376bd1c412c188c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:53.630469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.679273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:53.681397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:53.694633 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2419/4862] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:53.728975 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2444/4863] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:53.746313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:53.747972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.902859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5ad6-7ac7-4cbf-bc96-6734512a6194 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:53.917926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:53.918703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:53.919130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:53.919511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:53.921521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:53.959862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:53.961547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:53.982266 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2420/4864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:54.440944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:54.686861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:54.689083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:54.725512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95c9e8-652a-4028-a269-fd198cbc10f2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:54.757317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:54.757317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:54.757317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:54.757317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] PATH_INFO: `/v3/projects/a1fe32cefcc04db29316568d5e8ddb50` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:54.772345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fe32cefcc04db29316568d5e8ddb50)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:54.774828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:54.881099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:54.884669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:54.904297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62a66b-88bb-4b41-bee3-68ddcf9d9b67 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:54.916840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:54.917743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:54.917924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:54.918338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] PATH_INFO: `/v3/users/1fbd22a33ef64209818c8d58a46bfa42` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:54.919660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbd22a33ef64209818c8d58a46bfa42)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:54.921856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:54.987263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fe32cefcc04db29316568d5e8ddb50', 'request_id': 'req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:54.994529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fe32cefcc04db29316568d5e8ddb50', 'request_id': 'req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.004217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fe32cefcc04db29316568d5e8ddb50', 'request_id': 'req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.040136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:55.147990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] The token cache is being invalidate because project a1fe32cefcc04db29316568d5e8ddb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:55.148307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.148928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54423a8e-691d-494e-9f4f-e5b1a7ac3c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.150496 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2445/4865] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:54 2022] DELETE /identity/v3/projects/a1fe32cefcc04db29316568d5e8ddb50 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:55.155639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110196-f01b-48e6-995e-ea2e9e4be2bd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.155912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110196-f01b-48e6-995e-ea2e9e4be2bd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.156190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110196-f01b-48e6-995e-ea2e9e4be2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.177466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cd110196-f01b-48e6-995e-ea2e9e4be2bd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:55.178701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd110196-f01b-48e6-995e-ea2e9e4be2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:55.210751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbd22a33ef64209818c8d58a46bfa42'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.221457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbd22a33ef64209818c8d58a46bfa42'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.222425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbd22a33ef64209818c8d58a46bfa42'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.252457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbd22a33ef64209818c8d58a46bfa42'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.252457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f697be1e-7728-4560-825f-ecf3ecaad190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbd22a33ef64209818c8d58a46bfa42'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:55.315871 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2446/4866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:55.326837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.327306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.327690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.364033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:55.365673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:55.372718 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2421/4867] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:54 2022] DELETE /identity/v3/users/1fbd22a33ef64209818c8d58a46bfa42 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:55.376911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.378040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.378494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.380521 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2447/4868] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:55.384818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:55.397139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7ca6-0cb8-4895-89f8-2998753b4f1a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:55.410053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:55.411612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:55.471400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:55.471992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.471992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.472279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.477946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:55.477946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:55.477946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:55.494894 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2448/4869] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:04:55.498902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:55.522842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae83d7-c456-490e-8f61-d7185d1f6342 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:55.538691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:55.538691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.538691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.538691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.541105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:55.541105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:55.569254 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2422/4870] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:55.575597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:55.577360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:55.694750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2996d5f-5348-4e68-a5ce-3312ceedc4d6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:55.699870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:55.700786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.701255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.705665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.718080 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2449/4871] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:55 2022] POST /identity/v3/projects => generated 391 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:55.719227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:55.735533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:55.737504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:55.772931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2423/4872] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:55.843093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42076821-8f96-47d7-838f-102b96087758 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:55.857498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:55.858193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:55.858668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:55.860279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:55.862395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:55.865428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.015544 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2450/4873] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:55 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:56.019381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.032006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255796-613a-487f-a515-8a007c799ba4 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.037088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.037762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.044180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.044180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.044180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.044180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.052306 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2424/4874] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:56.056246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.068588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77798ef-300f-4db6-8963-4325074d0f98 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.073995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f89e2-d1c1-4c81-ba19-71aeb7d7c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.074644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f89e2-d1c1-4c81-ba19-71aeb7d7c2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.074889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f89e2-d1c1-4c81-ba19-71aeb7d7c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.075262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f89e2-d1c1-4c81-ba19-71aeb7d7c2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.075913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f89e2-d1c1-4c81-ba19-71aeb7d7c2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.077523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f89e2-d1c1-4c81-ba19-71aeb7d7c2a6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.088198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2451/4875] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:56.095950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.104112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8b129-2c81-4e0b-b23f-f396f2b356cb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.109154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.110348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.110635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.110916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] PATH_INFO: `/v3/projects/c73c9a2dfc994ef4b6a8d7110aeded25/users/d625fadec55145a3b7906e1d90ff183a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.128965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73c9a2dfc994ef4b6a8d7110aeded25, user_id=d625fadec55145a3b7906e1d90ff183a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.131859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.260475 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2425/4876] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:56 2022] PUT /identity/v3/projects/c73c9a2dfc994ef4b6a8d7110aeded25/users/d625fadec55145a3b7906e1d90ff183a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:56.271062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.271446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.273164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.307780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] MFA Rules not processed for user `d625fadec55145a3b7906e1d90ff183a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:56.309238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:56.385075 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2452/4877] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:56.395932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.397826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:56.464204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.465668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:56.466114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52c19a-48b4-49e9-957d-a15bff758606 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.470764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.471415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.471694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.471973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.491629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.493029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.502376 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2426/4878] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:56.538838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.540531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:56.552304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e4e1a-271a-47d2-9b76-c5270b595ad7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.557705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.558473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.558828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.559269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] PATH_INFO: `/v3/projects/3aed536dd3ea4226a95198da45e28822` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.559897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80066d-97cc-4452-932a-d6cf003883d5 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.560553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aed536dd3ea4226a95198da45e28822)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.562571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.565771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.567412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.567986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.568488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] PATH_INFO: `/v3/users/7a1efa8720c8419ba917f0e9220689ac` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.570153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1efa8720c8419ba917f0e9220689ac)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.572231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.628000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:56.697461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aed536dd3ea4226a95198da45e28822', 'request_id': 'req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.703056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aed536dd3ea4226a95198da45e28822', 'request_id': 'req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.709997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aed536dd3ea4226a95198da45e28822', 'request_id': 'req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.783710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] The token cache is being invalidate because project 3aed536dd3ea4226a95198da45e28822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:56.783953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.784631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9974f1b5-4713-40ca-b5cb-dda1a32ffe92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.786180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2453/4879] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:56 2022] DELETE /identity/v3/projects/3aed536dd3ea4226a95198da45e28822 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:56.791243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7edb8-2314-4670-a8ab-3037f181a04c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.791686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7edb8-2314-4670-a8ab-3037f181a04c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.791970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7edb8-2314-4670-a8ab-3037f181a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.801165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1efa8720c8419ba917f0e9220689ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.809477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1efa8720c8419ba917f0e9220689ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.810289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1efa8720c8419ba917f0e9220689ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.815113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-17a7edb8-2314-4670-a8ab-3037f181a04c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:56.816395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-17a7edb8-2314-4670-a8ab-3037f181a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:56.824241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1efa8720c8419ba917f0e9220689ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.825052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1efa8720c8419ba917f0e9220689ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:56.876622 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2454/4880] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:56.887188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.887481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.887764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.912312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:56.913678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:56.923150 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2455/4881] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:56.927450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.936793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100939e-12b4-4939-8e5c-eeb229dc8462 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.942070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.942655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.942936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.943244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.943876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:56.944177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.945752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.956918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2456/4882] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:56.966937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:56.976337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df09bc-8270-44fd-828c-54ca7b0aea6f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:56.980919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:56.987480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:56.987480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:56.987480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:56.987480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:56.987480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:56.989093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2427/4883] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:56 2022] DELETE /identity/v3/users/7a1efa8720c8419ba917f0e9220689ac => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:57.160185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2457/4884] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:56 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:57.164023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.260125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8801f-d80f-4a6d-a8b2-7e3d5d2326c2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.322956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.325012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:57.347250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:57.383086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.383086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.383086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.383086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.384151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.384151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:57.455632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e80e94-eee8-46a6-ba20-6aaa4c7aba9a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.461067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.461848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.462236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.462590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] PATH_INFO: `/v3/projects/dcec28a7e8334187af139cfaa47ec10f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.464128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcec28a7e8334187af139cfaa47ec10f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.465952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:57.495051 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2428/4885] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:57 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:57.497162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.513292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2af91-409d-45f9-a05e-fcd105593b5e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.520993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.521617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.521903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.522371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.523293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.525353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:57.547061 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2429/4886] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:04:57.556883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.564769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592119c7-b3db-48c8-ad03-9b487c07b274 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.570272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.571110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.571521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.571872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.572757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.574632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:57.591500 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2430/4887] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:57.593584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.606929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcec28a7e8334187af139cfaa47ec10f', 'request_id': 'req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:57.609131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e518-1fda-4b39-855d-402ac7647a4c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.613453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcec28a7e8334187af139cfaa47ec10f', 'request_id': 'req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:57.625236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcec28a7e8334187af139cfaa47ec10f', 'request_id': 'req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:57.683673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8fb63-72ba-4020-af8d-2236707e9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.684456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8fb63-72ba-4020-af8d-2236707e9c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.684745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8fb63-72ba-4020-af8d-2236707e9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.685144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8fb63-72ba-4020-af8d-2236707e9c35 admin admin] PATH_INFO: `/v3/projects/ff526d07a20d441bacb9eb0a3da3774d/users/f04b833a7bcc4328af5eb8aa4ba03a95/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.702354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] The token cache is being invalidate because project dcec28a7e8334187af139cfaa47ec10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:04:57.702659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:57.703851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ae09e6b-e0da-47c8-a9b8-e2e8a6b57613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:57.705413 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2458/4888] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:04:57 2022] DELETE /identity/v3/projects/dcec28a7e8334187af139cfaa47ec10f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:57.708134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8fb63-72ba-4020-af8d-2236707e9c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff526d07a20d441bacb9eb0a3da3774d, user_id=f04b833a7bcc4328af5eb8aa4ba03a95, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.710566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca351-c51d-4881-9ee3-da093057c287 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.710924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8fb63-72ba-4020-af8d-2236707e9c35 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:57.711103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca351-c51d-4881-9ee3-da093057c287 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.711391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca351-c51d-4881-9ee3-da093057c287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.733202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6ddca351-c51d-4881-9ee3-da093057c287 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:57.735037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6ddca351-c51d-4881-9ee3-da093057c287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:57.744277 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2459/4889] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:57.752159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.752654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.752943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.776208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:57.777503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:57.791937 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2460/4890] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:57.792619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.803902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f061bd5-c626-4b34-a535-1810feabc2fb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.817583 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2431/4891] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:57 2022] PUT /identity/v3/projects/ff526d07a20d441bacb9eb0a3da3774d/users/f04b833a7bcc4328af5eb8aa4ba03a95/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:57.835098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.835421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.835654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.886353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] MFA Rules not processed for user `f04b833a7bcc4328af5eb8aa4ba03a95`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:57.889482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:57.914803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.915588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.915956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.916303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.917252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:04:57.917740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.919527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:57.946850 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2461/4892] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:04:57.948084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:57.961286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62221ddf-1098-49c6-9c61-1d1eedfb53e0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:57.973460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:57.974088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:57.974375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:57.974670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:57.975498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:57.978142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.017468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2432/4893] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:58.029870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:58.031825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:58.093101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:58.098038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14667c69-076e-4e26-9630-5288a2735c4e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:58.101656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:58.102317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.102598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.102875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.111915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:58.113336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.130387 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2433/4894] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:04:58.156108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2462/4895] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:04:57 2022] POST /identity/v3/projects => generated 395 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:04:58.160193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:58.185579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7b0e4-6291-4668-8387-3369648f377e service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:58.251346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:58.251986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.252658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.252918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.253598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:58.255699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.385747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2434/4896] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:04:58 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:04:58.390115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:58.401177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2380c-9289-4976-b78a-12ae9dad8818 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:58.406215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:58.406822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.407146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.407429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.408102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:58.409711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.420279 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2463/4897] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:58.424983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:58.440132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485c7b-6997-4c1b-9963-d339ad516903 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:58.445269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d8d6-82f9-41db-bf2f-86d4349a2a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:58.446097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d8d6-82f9-41db-bf2f-86d4349a2a36 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.446635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d8d6-82f9-41db-bf2f-86d4349a2a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.447125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d8d6-82f9-41db-bf2f-86d4349a2a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.448188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d8d6-82f9-41db-bf2f-86d4349a2a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:58.459429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d8d6-82f9-41db-bf2f-86d4349a2a36 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.473446 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2435/4898] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:04:58.477670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:58.499529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c60f5-18d4-46a0-a5f6-28c6b27793ae admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:58.510485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692a96-1ba1-49c3-ab4b-57dde7f77236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:58.511196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692a96-1ba1-49c3-ab4b-57dde7f77236 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.511555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692a96-1ba1-49c3-ab4b-57dde7f77236 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.511906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692a96-1ba1-49c3-ab4b-57dde7f77236 admin admin] PATH_INFO: `/v3/projects/3dcf8d9856f048a294fac0db9478b348/users/6a509a511b1e4375b20de5cd6b5897b6/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.534961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692a96-1ba1-49c3-ab4b-57dde7f77236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcf8d9856f048a294fac0db9478b348, user_id=6a509a511b1e4375b20de5cd6b5897b6, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:58.538570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692a96-1ba1-49c3-ab4b-57dde7f77236 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.656943 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2464/4899] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:04:58 2022] PUT /identity/v3/projects/3dcf8d9856f048a294fac0db9478b348/users/6a509a511b1e4375b20de5cd6b5897b6/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:04:58.662259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.662551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.662829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.707327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] MFA Rules not processed for user `6a509a511b1e4375b20de5cd6b5897b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:58.707327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:58.767186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2436/4900] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:58.778861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e62b-6406-42d7-b786-95f28fc5cc24 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.779201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e62b-6406-42d7-b786-95f28fc5cc24 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.779480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3e62b-6406-42d7-b786-95f28fc5cc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.800424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-11c3e62b-6406-42d7-b786-95f28fc5cc24 None None] MFA Rules not processed for user `6a509a511b1e4375b20de5cd6b5897b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:58.801654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-11c3e62b-6406-42d7-b786-95f28fc5cc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:58.809124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2465/4901] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:58.831768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:58.833649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:58.920937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2120-6426-425f-b8e6-98f3f85a726b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:58.927425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16594ccf-f0ba-4147-befc-9aeddc511290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:58.928139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594ccf-f0ba-4147-befc-9aeddc511290 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.928497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594ccf-f0ba-4147-befc-9aeddc511290 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.928850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16594ccf-f0ba-4147-befc-9aeddc511290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.938202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594ccf-f0ba-4147-befc-9aeddc511290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:58.940384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16594ccf-f0ba-4147-befc-9aeddc511290 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:58.949518 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2437/4902] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:58 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:04:58.978215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52d7c-da8a-42d6-b7be-f405ebe4cc7d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:58.978215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52d7c-da8a-42d6-b7be-f405ebe4cc7d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:58.978215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52d7c-da8a-42d6-b7be-f405ebe4cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:58.999152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b0a52d7c-da8a-42d6-b7be-f405ebe4cc7d None None] MFA Rules not processed for user `6a509a511b1e4375b20de5cd6b5897b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:58.999960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0a52d7c-da8a-42d6-b7be-f405ebe4cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.008238 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2466/4903] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:59.052186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.052186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.052186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.062576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] MFA Rules not processed for user `6a509a511b1e4375b20de5cd6b5897b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:59.063839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.071262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2438/4904] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:59.117204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4ec4-13ea-4103-beed-ecb1e96b4ad9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.117204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4ec4-13ea-4103-beed-ecb1e96b4ad9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.117204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4ec4-13ea-4103-beed-ecb1e96b4ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.134678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e90c4ec4-13ea-4103-beed-ecb1e96b4ad9 None None] MFA Rules not processed for user `6a509a511b1e4375b20de5cd6b5897b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:59.148138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e90c4ec4-13ea-4103-beed-ecb1e96b4ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.160715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2467/4905] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:59.196772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:59.196772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.200126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.200634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.200914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.237128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] MFA Rules not processed for user `6a509a511b1e4375b20de5cd6b5897b6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:59.240088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.252159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2468/4906] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:04:59.277796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:59.290721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277c0c-57f6-449a-95a3-83444404aec2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:59.310799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535ec3-57fd-4e10-afca-07b11937c88f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:59.311260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:59.311260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.311260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.311260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] PATH_INFO: `/v3/users/6a509a511b1e4375b20de5cd6b5897b6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.311670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a509a511b1e4375b20de5cd6b5897b6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:59.311670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:59.311867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:04:59.311867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.311867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.311867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] PATH_INFO: `/v3/users/f04b833a7bcc4328af5eb8aa4ba03a95` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.313665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04b833a7bcc4328af5eb8aa4ba03a95)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:04:59.316599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:04:59.576578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04b833a7bcc4328af5eb8aa4ba03a95'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.587690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a509a511b1e4375b20de5cd6b5897b6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.588372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04b833a7bcc4328af5eb8aa4ba03a95'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.591162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04b833a7bcc4328af5eb8aa4ba03a95'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.605166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04b833a7bcc4328af5eb8aa4ba03a95'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.605459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a509a511b1e4375b20de5cd6b5897b6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.606858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-63c24fe5-23b9-4ad6-8066-c1d6c74a0778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04b833a7bcc4328af5eb8aa4ba03a95'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.607435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a509a511b1e4375b20de5cd6b5897b6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.608166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a509a511b1e4375b20de5cd6b5897b6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.649216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:04:59.651610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-780f93e4-fa75-462e-b17d-d2eae284a0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a509a511b1e4375b20de5cd6b5897b6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:04:59.745345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2439/4907] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:59 2022] DELETE /identity/v3/users/f04b833a7bcc4328af5eb8aa4ba03a95 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:59.749727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.751103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.751509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.773407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:59.774929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.840846 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2440/4908] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:04:59.851464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:04:59.853197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.865457 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2469/4909] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:04:59 2022] DELETE /identity/v3/users/6a509a511b1e4375b20de5cd6b5897b6 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:04:59.872782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:04:59.872782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:04:59.872782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:04:59.914310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:04:59.915848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:04:59.936726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12da9d7-06d2-43f1-9064-d43fecf494f8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:04:59.997847 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2470/4910] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:00.000881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:00.001577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:00.001889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:00.002128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:00.010389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:00.015154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:00.024183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:00.027086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:00.029964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e1b80-fead-4d73-ace4-89e41bfd5074 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:00.034939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:00.042214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:00.042214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:00.042214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:00.042914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2441/4911] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:00.049064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:00.050508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:00.060874 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2471/4912] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:00.690153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:00.691834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:00.705751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898822-1dc9-4631-8702-0e0786120227 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:00.714612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:00.718946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:00.718946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:00.718946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] PATH_INFO: `/v3/projects/ff526d07a20d441bacb9eb0a3da3774d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:00.718946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff526d07a20d441bacb9eb0a3da3774d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:00.718946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:00.723643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:00.727683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:00.747882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3830-e519-497c-adee-eecb46e0e7b6 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:00.751086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:00.753325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:00.753827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:00.754160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] PATH_INFO: `/v3/projects/3dcf8d9856f048a294fac0db9478b348` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:00.757051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcf8d9856f048a294fac0db9478b348)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:00.759418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:00.846787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff526d07a20d441bacb9eb0a3da3774d', 'request_id': 'req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.853035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff526d07a20d441bacb9eb0a3da3774d', 'request_id': 'req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.860521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff526d07a20d441bacb9eb0a3da3774d', 'request_id': 'req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.877619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcf8d9856f048a294fac0db9478b348', 'request_id': 'req-4cd7e147-ff1b-4ae4-914d-52588aba43dc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.883953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcf8d9856f048a294fac0db9478b348', 'request_id': 'req-4cd7e147-ff1b-4ae4-914d-52588aba43dc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.890836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcf8d9856f048a294fac0db9478b348', 'request_id': 'req-4cd7e147-ff1b-4ae4-914d-52588aba43dc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.937612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] The token cache is being invalidate because project ff526d07a20d441bacb9eb0a3da3774d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:00.938052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.938642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a310dc3-772e-4f40-bcdd-bc9659a5e2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.940179 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2442/4913] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:00 2022] DELETE /identity/v3/projects/ff526d07a20d441bacb9eb0a3da3774d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:00.944706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1311d2-f85b-41b9-96c2-8310152be7c1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:00.945027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1311d2-f85b-41b9-96c2-8310152be7c1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:00.945306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1311d2-f85b-41b9-96c2-8310152be7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:00.969740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ef1311d2-f85b-41b9-96c2-8310152be7c1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:00.971364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ef1311d2-f85b-41b9-96c2-8310152be7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:00.973683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] The token cache is being invalidate because project 3dcf8d9856f048a294fac0db9478b348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:00.974046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.974709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4cd7e147-ff1b-4ae4-914d-52588aba43dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:00.976457 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2472/4914] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:00 2022] DELETE /identity/v3/projects/3dcf8d9856f048a294fac0db9478b348 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:00.983131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:00.983669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:00.985622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.014506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:01.016905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:01.064804 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2443/4915] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:01.074348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c9a7-0857-4de7-b922-ebf5b8081719 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.074646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c9a7-0857-4de7-b922-ebf5b8081719 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.074927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c9a7-0857-4de7-b922-ebf5b8081719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.081266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:01.103428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ddf3c9a7-0857-4de7-b922-ebf5b8081719 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:01.107623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ddf3c9a7-0857-4de7-b922-ebf5b8081719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:01.115526 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2473/4916] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:01.115834 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2444/4917] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:01.120070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.121929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.122232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.123425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.143815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f14c-d9fe-416d-b646-d82add66674f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.148951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.149888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.150027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.150277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.150997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:01.151445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.153140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.156980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:01.158396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:01.166104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2474/4918] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:05:01.170383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.176148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2445/4919] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:01.182401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.183152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c496-46b9-4fa7-bd7c-c4a5ecb0ab0b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.188496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.189192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.189544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.189906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.190601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.191457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4b48a-fca0-4e67-8543-4312b0713af7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.192913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.202351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.207909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.207909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.207909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.207909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:01.207909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.207909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.225665 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2446/4920] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:05:01.229046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.241958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f6b0c-9716-49f0-a679-12a69d25f85c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.250123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.250797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.251146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.252207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.252855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.254768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.291739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:01.325136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2475/4921] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:01.330972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.353013 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2447/4922] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:01.358304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.449558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fdd2d-55a0-48f7-9a5b-c2fd7c137a59 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.455564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.459791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.459791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.459791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.459791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.460252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b5822-de45-453b-adfc-7aceaa6db6df admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.460375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.463990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.464673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.465637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.465637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.466143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.468195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.581391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2448/4923] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:01.582039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2476/4924] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:01.583090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.583230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.593457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54c07-1386-4c43-aaef-e8d7959b4bf5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.597459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c3dc-7326-4caf-8abb-b59e938cbe04 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.601750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.602613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.602905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.603213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.603357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.603960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.604106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.605144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.605503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.605957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.606331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.608815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.621005 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2449/4925] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:01.624346 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2477/4926] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:01.625431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.626149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.639750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0048f-31a1-499c-8e4b-62620889846f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.646549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.647187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.647486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.647767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.648412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.650036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.657805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f0f50-c440-4b8e-bc96-775729386a56 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.666491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.668418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.669023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.681184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2478/4927] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:01.682799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.685227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.685486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.690007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.702863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf21614-8a64-4759-8e93-fca8d0511dd2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.718487 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2450/4928] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:01.722742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4d3a0-7519-4dfc-8374-5eb0308e7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.729091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d3a0-7519-4dfc-8374-5eb0308e7a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.729091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d3a0-7519-4dfc-8374-5eb0308e7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.729091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d3a0-7519-4dfc-8374-5eb0308e7a97 admin admin] PATH_INFO: `/v3/projects/ccbfa77f07dd4e69acfbea7657a922fd/users/25c807ed86984d78a148b08685b868af/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.740113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.759511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4d3a0-7519-4dfc-8374-5eb0308e7a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbfa77f07dd4e69acfbea7657a922fd, user_id=25c807ed86984d78a148b08685b868af, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.766394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e499c9-a331-4feb-92e6-d777416e3f9b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:01.774359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4d3a0-7519-4dfc-8374-5eb0308e7a97 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.783299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f7ed-4cf9-4bd4-b843-425460601b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:01.788290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f7ed-4cf9-4bd4-b843-425460601b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.788290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f7ed-4cf9-4bd4-b843-425460601b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.788290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f7ed-4cf9-4bd4-b843-425460601b57 admin admin] PATH_INFO: `/v3/projects/bc712095a4874ab295334161f4753efa/users/3cbbb166da6e4578b2714603e809d691/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.809211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739f7ed-4cf9-4bd4-b843-425460601b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc712095a4874ab295334161f4753efa, user_id=3cbbb166da6e4578b2714603e809d691, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:01.812352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739f7ed-4cf9-4bd4-b843-425460601b57 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:01.853589 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2479/4929] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:01 2022] PUT /identity/v3/projects/ccbfa77f07dd4e69acfbea7657a922fd/users/25c807ed86984d78a148b08685b868af/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:01.858580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.858873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.859191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.883163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:01.884650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:01.909961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2451/4930] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:01 2022] PUT /identity/v3/projects/bc712095a4874ab295334161f4753efa/users/3cbbb166da6e4578b2714603e809d691/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:01.912253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:01.915341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:01.915801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:01.951677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] MFA Rules not processed for user `3cbbb166da6e4578b2714603e809d691`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:01.953661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:01.968378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2480/4931] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:01.977863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:01.979338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:02.043059 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2452/4932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:02.045116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.074359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc16d-4baf-4a22-8e02-523057ad4a48 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.118117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb788-3ed6-4537-a9f5-045549ae435b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.122936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.123724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.124320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.124824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.126312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.128345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.143362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.143362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.143362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.143362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.154032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.155557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.166874 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2481/4933] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:02.189828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:02.218532 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2453/4934] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:02 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:02.223116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.233763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e26bc9-d0b4-4425-9eed-16e987210d3d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.303046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.303672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.303957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.304263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.304896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.306888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.431293 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2482/4935] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:02 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:02.433791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.444221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74639ea-a9fd-40c8-8c09-e78f6f478fbf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.448981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.450411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.450411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.451253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.451912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.453557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.464445 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2454/4936] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:02.469524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.482315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8457e1-9cec-4dfe-8d80-250e635e7b4f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.488047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.488729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.489032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.489295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] PATH_INFO: `/v3/projects/86d34621fd104c17a0fcd5053d03c108/users/6886498110a94b319075040621cd16f7/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.511909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d34621fd104c17a0fcd5053d03c108, user_id=6886498110a94b319075040621cd16f7, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.516937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.605618 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2483/4937] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:02 2022] PUT /identity/v3/projects/86d34621fd104c17a0fcd5053d03c108/users/6886498110a94b319075040621cd16f7/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:02.610342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.620167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04e9b-5c6c-4a88-ae6f-5aa8eb26f974 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.676825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17ccb1-cd32-48aa-afb7-2d0c1fd2ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.677451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ccb1-cd32-48aa-afb7-2d0c1fd2ed6b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.677736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ccb1-cd32-48aa-afb7-2d0c1fd2ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.678017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ccb1-cd32-48aa-afb7-2d0c1fd2ed6b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.678663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ccb1-cd32-48aa-afb7-2d0c1fd2ed6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.680407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17ccb1-cd32-48aa-afb7-2d0c1fd2ed6b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.694040 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2455/4938] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:02.695337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.706197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d5770-44e3-434a-af15-a51f72d8db46 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.711231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.711626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.711908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.712197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] PATH_INFO: `/v3/projects/86d34621fd104c17a0fcd5053d03c108/users/6886498110a94b319075040621cd16f7/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.714125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d34621fd104c17a0fcd5053d03c108, user_id=6886498110a94b319075040621cd16f7, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.716805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.727943 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2484/4939] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:02 2022] PUT /identity/v3/projects/86d34621fd104c17a0fcd5053d03c108/users/6886498110a94b319075040621cd16f7/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:02.739455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.739985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.740089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.777433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:02.778378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] MFA Rules not processed for user `6886498110a94b319075040621cd16f7`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:02.779714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:02.856739 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2456/4940] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:02.861282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.872002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518b7fc-886d-44ff-9f4d-5441ccc60316 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.876645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6886498110a94b319075040621cd16f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86d34621fd104c17a0fcd5053d03c108', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.877245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.877563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.877842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.878491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:02.878794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.880445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.893776 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2485/4941] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:02.897900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:02.908170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1919c1-ef38-48fb-9cce-da51b8be3558 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:02.913019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6886498110a94b319075040621cd16f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86d34621fd104c17a0fcd5053d03c108', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:02.913634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:02.913923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:02.914205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:02.914853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:02.916783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:02.938453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:03.041763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2457/4942] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:02 2022] POST /identity/v3/projects => generated 350 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:03.044010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:03.055922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f6622-35cd-4648-b68a-f47876cd02b0 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:03.123956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6886498110a94b319075040621cd16f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86d34621fd104c17a0fcd5053d03c108', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:03.124626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:03.125393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:03.125679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:03.126373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:03.126684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:03.128362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:03.141108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2486/4943] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:03.151378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:03.153337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:03.215380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f10d6-7647-4b39-8ad1-24b497dfaaeb tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:03.219380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:03.220001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:03.220295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:03.220581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:03.231615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:03.233266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:03.243933 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2458/4944] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:03.634915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=12 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:04.604070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:05.908963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:06.052401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:07.140762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:07.142738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:07.248422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381b8c8-c0c3-4eba-a2a4-84cb90ce54d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:07.259068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:07.260334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:07.261234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:07.261530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:07.281972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:07.315675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:07.321723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:07.348341 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2487/4945] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:07.669411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:07.774945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:08.010887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:08.022903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2906d-bff0-448b-9e48-32fc3f474899 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:08.033543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6886498110a94b319075040621cd16f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86d34621fd104c17a0fcd5053d03c108', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:08.035507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:08.036566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:08.037115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] PATH_INFO: `/v3/projects/76c8ce85d9564a6b9dda1ebd36efa79d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:08.039749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76c8ce85d9564a6b9dda1ebd36efa79d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:08.044666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:08.204041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c8ce85d9564a6b9dda1ebd36efa79d', 'request_id': 'req-d0b3253c-109a-4462-8e74-f825613dd4d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.216483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c8ce85d9564a6b9dda1ebd36efa79d', 'request_id': 'req-d0b3253c-109a-4462-8e74-f825613dd4d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.224287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c8ce85d9564a6b9dda1ebd36efa79d', 'request_id': 'req-d0b3253c-109a-4462-8e74-f825613dd4d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.412032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] The token cache is being invalidate because project 76c8ce85d9564a6b9dda1ebd36efa79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:08.412463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.413248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0b3253c-109a-4462-8e74-f825613dd4d6 tempest-QuotasNegativeTest-1545203439 tempest-QuotasNegativeTest-1545203439-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.418661 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2459/4946] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:08 2022] DELETE /identity/v3/projects/76c8ce85d9564a6b9dda1ebd36efa79d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:08.419951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:08.513842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420cb9a-3d7a-4678-b485-fb886735a6e1 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:08.584593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:08.585715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:08.586259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:08.586894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] PATH_INFO: `/v3/users/3cbbb166da6e4578b2714603e809d691` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:08.588941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbbb166da6e4578b2714603e809d691)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:08.592226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:08.807221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbbb166da6e4578b2714603e809d691'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.818400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbbb166da6e4578b2714603e809d691'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.819226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbbb166da6e4578b2714603e809d691'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.819873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbbb166da6e4578b2714603e809d691'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.832529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbbb166da6e4578b2714603e809d691'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:08.905903 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2488/4947] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:08 2022] DELETE /identity/v3/users/3cbbb166da6e4578b2714603e809d691 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:08.909085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:08.909554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:08.909937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:08.958234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:08.959725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:09.077459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2460/4948] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:09.088772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:09.090254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:09.134091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:09.204907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abff9f-3eaf-455a-bb2d-a034b793e8a8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:09.209163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:09.210213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:09.210213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:09.210482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:09.221563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:09.223849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:09.240517 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2489/4949] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:09.606515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:10.445935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:10.445935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:10.451887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513713d2-b425-49c1-946c-fab998ace3f2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:10.457500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:10.458788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:10.459113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:10.459401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] PATH_INFO: `/v3/projects/bc712095a4874ab295334161f4753efa` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:10.460555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc712095a4874ab295334161f4753efa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:10.465855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:10.639464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc712095a4874ab295334161f4753efa', 'request_id': 'req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:10.646240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc712095a4874ab295334161f4753efa', 'request_id': 'req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:10.652701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc712095a4874ab295334161f4753efa', 'request_id': 'req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:10.686785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:10.774162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] The token cache is being invalidate because project bc712095a4874ab295334161f4753efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:10.775089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:10.776057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0d38a9e8-d860-4a8a-87ec-24ebf7f955ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:10.778839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2461/4950] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:10 2022] DELETE /identity/v3/projects/bc712095a4874ab295334161f4753efa => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:10.783541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:10.801336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f2876-33ff-4fd3-b188-1af3ef99ff8f service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:10.930990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:10.931727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:10.932019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:10.932528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] PATH_INFO: `/v3/users/6886498110a94b319075040621cd16f7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:10.933809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6886498110a94b319075040621cd16f7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:10.936279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:11.198617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6886498110a94b319075040621cd16f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:11.207529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6886498110a94b319075040621cd16f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:11.208376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6886498110a94b319075040621cd16f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:11.209168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6886498110a94b319075040621cd16f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:11.224008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6886498110a94b319075040621cd16f7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:11.356471 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2490/4951] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:10 2022] DELETE /identity/v3/users/6886498110a94b319075040621cd16f7 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:11.595766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:11.647501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:11.648353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:11.650350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:11.714510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] MFA Rules not processed for user `25c807ed86984d78a148b08685b868af`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:11.717685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:11.812286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2462/4952] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:11.828775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:11.831609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:11.977372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a72cc-7820-427f-bbdb-8c42f0e2150a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:11.991631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:11.992467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:11.993090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:11.993452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.009001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:12.011593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:12.040011 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2491/4953] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:12.172727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:12.174432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:12.294245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4a8f5-2a02-4d6b-b180-d843832c3ff7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:12.299613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:12.300382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:12.301042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:12.301385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] PATH_INFO: `/v3/projects/86d34621fd104c17a0fcd5053d03c108` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.302630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d34621fd104c17a0fcd5053d03c108)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:12.304750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:12.473184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d34621fd104c17a0fcd5053d03c108', 'request_id': 'req-a93a0b91-b970-46ab-9191-e7b55df681e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.488041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d34621fd104c17a0fcd5053d03c108', 'request_id': 'req-a93a0b91-b970-46ab-9191-e7b55df681e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.497789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d34621fd104c17a0fcd5053d03c108', 'request_id': 'req-a93a0b91-b970-46ab-9191-e7b55df681e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.532918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:12.534994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:12.554691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313df54-1204-4842-8678-8cee4affe044 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:12.642124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:12.642985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:12.643671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:12.644113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] PATH_INFO: `/v3/users/00e93a2f8ed643ba8bc92b4def1ce7f3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.646337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e93a2f8ed643ba8bc92b4def1ce7f3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:12.648878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:12.674061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] The token cache is being invalidate because project 86d34621fd104c17a0fcd5053d03c108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:12.675313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.676285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a93a0b91-b970-46ab-9191-e7b55df681e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.678600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2463/4954] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:12 2022] DELETE /identity/v3/projects/86d34621fd104c17a0fcd5053d03c108 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:12.683521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bebaa-ecbe-4a96-a7ed-2da573d3bfef None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:12.684107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bebaa-ecbe-4a96-a7ed-2da573d3bfef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:12.684674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bebaa-ecbe-4a96-a7ed-2da573d3bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.715502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-da0bebaa-ecbe-4a96-a7ed-2da573d3bfef None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:12.719779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-da0bebaa-ecbe-4a96-a7ed-2da573d3bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:12.738838 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2464/4955] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:12.747487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:12.750974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:12.751678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:12.752183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.774273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:12.776152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:12.787812 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2465/4956] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:12.792384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:12.802616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbbddf-ffa1-4010-9a38-0fdad69edd4c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:12.807677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:12.808297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:12.808582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:12.808858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.810284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:12.810791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:12.813064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:12.831080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2466/4957] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:05:12.834533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:12.847309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472413a-389d-4c55-afda-0e995fe4b170 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:12.853234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:12.854019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:12.854344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:12.854714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:12.855653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:12.858484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:12.868401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e93a2f8ed643ba8bc92b4def1ce7f3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.879581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e93a2f8ed643ba8bc92b4def1ce7f3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.880523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e93a2f8ed643ba8bc92b4def1ce7f3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.881142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e93a2f8ed643ba8bc92b4def1ce7f3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:12.922108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e93a2f8ed643ba8bc92b4def1ce7f3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:13.055298 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2492/4958] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:12 2022] DELETE /identity/v3/users/00e93a2f8ed643ba8bc92b4def1ce7f3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:13.057252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2467/4959] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:12 2022] POST /identity/v3/projects => generated 399 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:13.061301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.063784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:13.200410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93a4a2-b290-419f-aae1-9c71bc05652d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:13.352704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:13.354037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.354281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.354555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.355358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:13.360248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:13.431874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.441025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:13.457471 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2493/4960] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:13 2022] POST /identity/v3/users => generated 300 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:13.459578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.473639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12194035-b7cc-4b88-a1a8-6789afdb0789 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:13.479211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0dc81-b273-46f5-994c-63aaf2011dfc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:13.484730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:13.485832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.485832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.486082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] PATH_INFO: `/v3/projects/0e8540c8171e480b83fd68fbb5f159be` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.489881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8540c8171e480b83fd68fbb5f159be)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:13.491863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:13.493338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:13.495366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.495853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.496295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.497384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:13.505065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:13.537637 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2494/4961] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:13.538921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.560457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d63e-9087-4694-a730-f8f754e09e2c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:13.566900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:13.567679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.568072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.568678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.569435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:13.571397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:13.585571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2495/4962] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:13.590443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.604180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a507c0-ad91-4cb0-9d48-90fd565c6141 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:13.610132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b160af-f1a0-4f37-84f2-13c2d01ac45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:13.610966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b160af-f1a0-4f37-84f2-13c2d01ac45a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.611388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b160af-f1a0-4f37-84f2-13c2d01ac45a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.611773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b160af-f1a0-4f37-84f2-13c2d01ac45a admin admin] PATH_INFO: `/v3/projects/0befedd0156342fc81357fbaaead0657/users/f7c53028ed1f4dae9fe261ba761580ef/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.654543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b160af-f1a0-4f37-84f2-13c2d01ac45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0befedd0156342fc81357fbaaead0657, user_id=f7c53028ed1f4dae9fe261ba761580ef, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:13.664066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b160af-f1a0-4f37-84f2-13c2d01ac45a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:13.664927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8540c8171e480b83fd68fbb5f159be', 'request_id': 'req-fc8d4097-218a-4392-bf08-af3ba1ecf117'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:13.673219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8540c8171e480b83fd68fbb5f159be', 'request_id': 'req-fc8d4097-218a-4392-bf08-af3ba1ecf117'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:13.680301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8540c8171e480b83fd68fbb5f159be', 'request_id': 'req-fc8d4097-218a-4392-bf08-af3ba1ecf117'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:13.756333 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2496/4963] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:13 2022] PUT /identity/v3/projects/0befedd0156342fc81357fbaaead0657/users/f7c53028ed1f4dae9fe261ba761580ef/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:13.768044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.768378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.768807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.784181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] The token cache is being invalidate because project 0e8540c8171e480b83fd68fbb5f159be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:13.785134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:13.785903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc8d4097-218a-4392-bf08-af3ba1ecf117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:13.787841 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2468/4964] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:13 2022] DELETE /identity/v3/projects/0e8540c8171e480b83fd68fbb5f159be => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:13.792566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee264aeb-83e6-4cff-a81b-2a61a4d505f3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.792948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee264aeb-83e6-4cff-a81b-2a61a4d505f3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.793301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee264aeb-83e6-4cff-a81b-2a61a4d505f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.804313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] MFA Rules not processed for user `f7c53028ed1f4dae9fe261ba761580ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:13.805632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:13.816073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ee264aeb-83e6-4cff-a81b-2a61a4d505f3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:13.817294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee264aeb-83e6-4cff-a81b-2a61a4d505f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:13.858110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:13.889191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2497/4965] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:13.895705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.897920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:13.909064 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2469/4966] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:13.917758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.919273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.919840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.920000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0592d9-c778-4643-aa5e-b46dbf3ed14f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:13.925311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ddf6-ba65-46f9-97d6-b0dcb14212bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:13.926102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ddf6-ba65-46f9-97d6-b0dcb14212bb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:13.926454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ddf6-ba65-46f9-97d6-b0dcb14212bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:13.926800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ddf6-ba65-46f9-97d6-b0dcb14212bb admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:13.927543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ddf6-ba65-46f9-97d6-b0dcb14212bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:13.929640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ddf6-ba65-46f9-97d6-b0dcb14212bb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:13.958962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:13.961325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:13.973601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2470/4967] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:13.978204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:13.997777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668addb1-f610-4f4f-9d3a-af24ad51e896 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.003618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.004272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.004539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.004814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.005458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:14.005794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.007728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.020269 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2471/4968] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:14.028511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.040751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f100d1-5f0a-4862-8dc5-611e516f00e2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.047523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.048225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.048584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.048943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.049820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.051941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.074037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2498/4969] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:13 2022] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:14.078280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.079078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.079549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.101706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] MFA Rules not processed for user `25c807ed86984d78a148b08685b868af`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:14.102945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:14.183918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2499/4970] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:14.186803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.196966 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2472/4971] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:14 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:14.209656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.312415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dc89-dcc5-41e7-9c4c-7d4d367036a8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.319305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.320724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.321014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.331218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.331371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5ab5-1390-4ab7-a476-deb26af2f861 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.331509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.331509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.331710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.331710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.331710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.331710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.332102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.332508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.501176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:14.504239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2500/4972] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:14 2022] POST /identity/v3/users => generated 306 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:14.508505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.513838 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2473/4973] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:14 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:14.515189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.529072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc07d-5614-4651-be0f-df0bf3ee2aa4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.535787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.536659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.537311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.537752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229e086-2773-464e-8ebc-f6f2928b457e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.537909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.538702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.540812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.543269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.544596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.544596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.544801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.545530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.547998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.563863 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2474/4974] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:14.563984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2501/4975] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:14.566459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.567524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.580939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490de50-fd66-4076-bca8-fe7fcbf447da admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.581144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80e8a-d0f9-490e-89e1-88b795a20650 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.586195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.591629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.591927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.592051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.592166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.592268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.592367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.592473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] PATH_INFO: `/v3/projects/9eda205f0f2f44cbaec2cf6bf4f38abe/users/c32291e2790145ad80ea1dbfacd42a74/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.592574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.592574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.608717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2475/4976] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:14.611068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.620334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eda205f0f2f44cbaec2cf6bf4f38abe, user_id=c32291e2790145ad80ea1dbfacd42a74, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.620334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.623395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeacdc-3ded-4ede-a057-e24e81541694 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.628579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085f0d-adab-4426-a517-609c3523c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.629280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085f0d-adab-4426-a517-609c3523c551 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.629569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085f0d-adab-4426-a517-609c3523c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.629844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085f0d-adab-4426-a517-609c3523c551 admin admin] PATH_INFO: `/v3/projects/4cd27d5a79694b75923fb286a79dab47/users/c7e6cd5d849746e8b2285ff04a23dfbb/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.646895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085f0d-adab-4426-a517-609c3523c551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd27d5a79694b75923fb286a79dab47, user_id=c7e6cd5d849746e8b2285ff04a23dfbb, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.649749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085f0d-adab-4426-a517-609c3523c551 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.811911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2502/4977] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:14 2022] PUT /identity/v3/projects/9eda205f0f2f44cbaec2cf6bf4f38abe/users/c32291e2790145ad80ea1dbfacd42a74/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:14.824468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.824624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2476/4978] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:14 2022] PUT /identity/v3/projects/4cd27d5a79694b75923fb286a79dab47/users/c7e6cd5d849746e8b2285ff04a23dfbb/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:14.829582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.829879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.830884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.851696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:14.852925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:14.908282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555c48-b06b-4189-8cb5-300a47fded5e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:14.933593 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2477/4979] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:14.952967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:14.954403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:14.978857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:14.979772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:14.980581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:14.981210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:14.981524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:14.983447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:14.995511 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2503/4980] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:14.999610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:15.010212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1766c47-7255-4b71-9e3a-16b7ba2a8c8a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:15.017286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c70282-da78-4629-b93e-3563149300cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:15.017962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70282-da78-4629-b93e-3563149300cc admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:15.018399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70282-da78-4629-b93e-3563149300cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:15.018711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70282-da78-4629-b93e-3563149300cc admin admin] PATH_INFO: `/v3/projects/9eda205f0f2f44cbaec2cf6bf4f38abe/users/c32291e2790145ad80ea1dbfacd42a74/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:15.020809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c70282-da78-4629-b93e-3563149300cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eda205f0f2f44cbaec2cf6bf4f38abe, user_id=c32291e2790145ad80ea1dbfacd42a74, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:15.023607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c70282-da78-4629-b93e-3563149300cc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:15.034746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b1ed1-d32c-4a89-9552-8fc47bb8897b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:15.046135 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2504/4981] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:14 2022] PUT /identity/v3/projects/9eda205f0f2f44cbaec2cf6bf4f38abe/users/c32291e2790145ad80ea1dbfacd42a74/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:15.048733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:15.049450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:15.049450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:15.090053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] MFA Rules not processed for user `c32291e2790145ad80ea1dbfacd42a74`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:15.091519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:15.095805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:15.096331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:15.096622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:15.097046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:15.215341 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2505/4982] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:15.219363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:15.219363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:15.227438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:15.228999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:15.240209 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2478/4983] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:15.275326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae8eaa-65d7-459c-b7de-794acb8afce2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:15.282537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f269d7-6f98-4e26-8d2c-3dec6859e8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:15.282537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f269d7-6f98-4e26-8d2c-3dec6859e8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:15.282537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f269d7-6f98-4e26-8d2c-3dec6859e8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:15.282537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f269d7-6f98-4e26-8d2c-3dec6859e8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:15.349792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:15.353555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:15.381939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ead5d-ab20-4755-9c17-fea78d984527 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:15.393795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:15.393795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:15.394365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:15.395002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] PATH_INFO: `/v3/users/c90fbe81777d4cfd9376bd1c412c188c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:15.397423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90fbe81777d4cfd9376bd1c412c188c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:15.401533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:15.406895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f269d7-6f98-4e26-8d2c-3dec6859e8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:15.408346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f269d7-6f98-4e26-8d2c-3dec6859e8b1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:15.428664 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2506/4984] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:15.635603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90fbe81777d4cfd9376bd1c412c188c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:15.646335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90fbe81777d4cfd9376bd1c412c188c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:15.647129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90fbe81777d4cfd9376bd1c412c188c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:15.682641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90fbe81777d4cfd9376bd1c412c188c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:15.683928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90fbe81777d4cfd9376bd1c412c188c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:15.868605 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2479/4985] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:15 2022] DELETE /identity/v3/users/c90fbe81777d4cfd9376bd1c412c188c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:15.873475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:15.873835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:15.874183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:15.895966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:15.897186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:15.971170 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2507/4986] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:15.998150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:16.001174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:16.071795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b68053-1f79-4594-8f2f-14e324957424 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:16.086231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:16.086869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:16.087193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:16.087582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:16.103541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:16.103541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:16.113689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2480/4987] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:16.257716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:16.261089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:16.361253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25f50-b3e8-4b0f-9e78-e5f5a0ea4e57 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:16.387427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:16.388079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:16.388364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:16.388653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:16.390961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:16.463002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:16.464850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:16.479581 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2508/4988] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:16 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:16.485126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:16.486988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:16.502763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a144-78a3-42c2-b179-9fc358088133 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:16.509053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:16.509878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:16.510167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:16.510443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] PATH_INFO: `/v3/projects/68d910e1900744518e3f12b3ded97a02` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:16.511756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d910e1900744518e3f12b3ded97a02)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:16.513684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:16.698427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d910e1900744518e3f12b3ded97a02', 'request_id': 'req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:16.707971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d910e1900744518e3f12b3ded97a02', 'request_id': 'req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:16.714785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d910e1900744518e3f12b3ded97a02', 'request_id': 'req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:16.779146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:16.815124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] The token cache is being invalidate because project 68d910e1900744518e3f12b3ded97a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:16.815433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:16.816159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:16.817640 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2481/4989] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:16 2022] DELETE /identity/v3/projects/68d910e1900744518e3f12b3ded97a02 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:16.821860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:16.833325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5726a2-2256-48b4-956d-1119d315ffc1 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:16.916366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:16.917295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:16.917707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:16.918088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] PATH_INFO: `/v3/users/93a1fdd781394211bbc40f7757d64e43` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:16.919978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a1fdd781394211bbc40f7757d64e43)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:16.922263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:17.155850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:17.157370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:17.193957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a1fdd781394211bbc40f7757d64e43'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:17.206865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a1fdd781394211bbc40f7757d64e43'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:17.208262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a1fdd781394211bbc40f7757d64e43'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:17.209014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a1fdd781394211bbc40f7757d64e43'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:17.224148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5351657c-1e47-49a3-a2e0-c399734162f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a1fdd781394211bbc40f7757d64e43'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:17.248798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dcbf8-ab0f-4356-8e9f-3e7b7a4c4b29 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:17.256303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:17.256949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:17.257236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:17.257826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:17.260072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:17.352116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:17.352467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:17.366613 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2482/4990] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:17.383416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2509/4991] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:16 2022] DELETE /identity/v3/users/93a1fdd781394211bbc40f7757d64e43 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:18.432717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:18.577482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:18.579693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:18.604208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd4736-ff3e-4d28-892c-57662f8c4d92 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:18.629691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:18.814976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:18.819650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:18.821986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:18.821986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] PATH_INFO: `/v3/projects/86777d9c479841a8a2958abe165cda9f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:18.824256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86777d9c479841a8a2958abe165cda9f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:18.835412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:19.050118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86777d9c479841a8a2958abe165cda9f', 'request_id': 'req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:19.065066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86777d9c479841a8a2958abe165cda9f', 'request_id': 'req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:19.078334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86777d9c479841a8a2958abe165cda9f', 'request_id': 'req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:19.251761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] The token cache is being invalidate because project 86777d9c479841a8a2958abe165cda9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:19.252070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:19.255653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f1a3b0f8-ac93-4815-a27e-7e5b1a53ade3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:19.263079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:19.263626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:19.264170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:19.267385 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2483/4992] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:18 2022] DELETE /identity/v3/projects/86777d9c479841a8a2958abe165cda9f => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:19.286113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:19.288074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:19.408885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:19.409189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:19.409476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:19.412928 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2510/4993] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:19.450315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:19.451608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:19.481189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:19.492064 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2484/4994] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:19.503578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dd95c-4d63-4bb3-8936-52bc84f8d6d6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:19.513085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:19.514093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:19.514376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:19.514678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:19.515712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:19.515712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:19.517341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:19.540172 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2511/4995] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:19.543781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:19.554982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683fae6-830d-4bd5-9bd9-ba4f6bdab814 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:19.562260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:19.563311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:19.563714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:19.564121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:19.565926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:19.568550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:19.692781 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2485/4996] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:19 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:19.697864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:19.714363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8142082-f944-4b30-9861-440a4b70bbdd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:19.795041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:19.796969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:19.797453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:19.797897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:19.798799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:19.801650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:19.973898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2512/4997] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:19 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:19.978060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:19.990856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30817502-c641-4430-b061-41487dd170c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:19.998931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:19.998931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:19.998931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:19.998931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:19.999518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:20.000181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:20.018875 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2486/4998] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:20.020410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:20.031607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656826-4c3b-4823-a1ae-330e7fcfd8c4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:20.038242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb443d-5755-4bea-9626-87b58eed910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:20.038865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb443d-5755-4bea-9626-87b58eed910e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:20.039189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb443d-5755-4bea-9626-87b58eed910e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:20.039468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb443d-5755-4bea-9626-87b58eed910e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:20.040139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb443d-5755-4bea-9626-87b58eed910e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:20.041792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb443d-5755-4bea-9626-87b58eed910e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:20.053721 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2513/4999] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:20.058760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:20.102473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025553-768a-43a4-86ff-83244b659a58 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:20.113341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:20.114855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:20.115208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:20.115493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] PATH_INFO: `/v3/projects/53043c49bd5c4591bbfc72c443cf66ee/users/87109fdea86d40f38dc8dbeb664b9e5c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:20.139407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53043c49bd5c4591bbfc72c443cf66ee, user_id=87109fdea86d40f38dc8dbeb664b9e5c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:20.144658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:20.226397 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2487/5000] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:20 2022] PUT /identity/v3/projects/53043c49bd5c4591bbfc72c443cf66ee/users/87109fdea86d40f38dc8dbeb664b9e5c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:20.237543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:20.238088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:20.238566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:20.280029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] MFA Rules not processed for user `87109fdea86d40f38dc8dbeb664b9e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:20.282351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:20.418921 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2514/5001] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:20.424211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:20.480036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:20.481835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:20.505997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f63d2-b975-40af-a5da-875193629402 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:20.511688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:20.512367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:20.512767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:20.513130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:20.513955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:20.517408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:20.592152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636b122-3da8-4ca6-bae6-1ce892dff4be None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:20.596621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:20.597642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:20.598153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:20.598669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:20.601500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:20.689127 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2488/5002] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:20 2022] POST /identity/v3/projects => generated 391 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:20.691150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:20.724763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:20.729421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:20.734062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:20.752353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2515/5003] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:20.776354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c61a33-72f4-4b19-b2eb-d61eeff68178 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:20.784623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:20.786664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:20.786957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:20.787264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:20.787947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:20.790192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:20.974749 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2489/5004] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:20 2022] POST /identity/v3/users => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:20.981065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:21.000480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8601a-9aa8-431e-9fba-1beb25b160ec service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:21.006664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:21.008400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.008944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.009391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.010320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:21.012485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:21.026986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2516/5005] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:21.028335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:21.041820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701a0c5-c323-410a-9ff4-dd839378e0a6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:21.048561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:21.049410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.049766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.050117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] PATH_INFO: `/v3/projects/3002f241f3f042af80c23ad5a47a795b/users/8e07a83819a04ae2b19ba5c95d236a59/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.069267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3002f241f3f042af80c23ad5a47a795b, user_id=8e07a83819a04ae2b19ba5c95d236a59, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:21.073269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:21.208715 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2490/5006] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:21 2022] PUT /identity/v3/projects/3002f241f3f042af80c23ad5a47a795b/users/8e07a83819a04ae2b19ba5c95d236a59/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:21.212649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:21.238925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1d106-0972-4464-8914-724a0b52ca5b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:21.372809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3c7da-9c3d-4eb2-b6b6-3c39d053f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:21.373439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c7da-9c3d-4eb2-b6b6-3c39d053f08a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.373723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c7da-9c3d-4eb2-b6b6-3c39d053f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.374050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c7da-9c3d-4eb2-b6b6-3c39d053f08a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.376072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3c7da-9c3d-4eb2-b6b6-3c39d053f08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:21.377785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3c7da-9c3d-4eb2-b6b6-3c39d053f08a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:21.393596 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2517/5007] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:21.401234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:21.414310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfd757-d513-4fad-a546-b27fb26e2e60 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:21.426580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ae80f-c8c2-4f51-a299-24405d38d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:21.426580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae80f-c8c2-4f51-a299-24405d38d581 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.426580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae80f-c8c2-4f51-a299-24405d38d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.426580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae80f-c8c2-4f51-a299-24405d38d581 admin admin] PATH_INFO: `/v3/projects/3002f241f3f042af80c23ad5a47a795b/users/8e07a83819a04ae2b19ba5c95d236a59/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.426991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ae80f-c8c2-4f51-a299-24405d38d581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3002f241f3f042af80c23ad5a47a795b, user_id=8e07a83819a04ae2b19ba5c95d236a59, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:21.432315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ae80f-c8c2-4f51-a299-24405d38d581 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:21.447701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2491/5008] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:21 2022] PUT /identity/v3/projects/3002f241f3f042af80c23ad5a47a795b/users/8e07a83819a04ae2b19ba5c95d236a59/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:21.459140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457633c8-edec-4697-becb-4021016c5ffd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.459438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457633c8-edec-4697-becb-4021016c5ffd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.459704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457633c8-edec-4697-becb-4021016c5ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.493663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-457633c8-edec-4697-becb-4021016c5ffd None None] MFA Rules not processed for user `8e07a83819a04ae2b19ba5c95d236a59`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:21.495047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-457633c8-edec-4697-becb-4021016c5ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:21.537520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:21.591307 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2518/5009] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:21.604903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedd1f3-c182-4035-a214-0948a9b470f4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.605083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedd1f3-c182-4035-a214-0948a9b470f4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.605360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedd1f3-c182-4035-a214-0948a9b470f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.635275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9dedd1f3-c182-4035-a214-0948a9b470f4 None None] MFA Rules not processed for user `87109fdea86d40f38dc8dbeb664b9e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:21.636651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9dedd1f3-c182-4035-a214-0948a9b470f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:21.716951 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2492/5010] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:21.726084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457633c8-edec-4697-becb-4021016c5ffd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:21.730207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-457633c8-edec-4697-becb-4021016c5ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:21.865379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457633c8-edec-4697-becb-4021016c5ffd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:21.874828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:21.877365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:21.877826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:21.878366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:21.893593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:21.897879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:21.914876 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2519/5011] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:23.710877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:23.710877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:23.710877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:23.765464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] MFA Rules not processed for user `c7e6cd5d849746e8b2285ff04a23dfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:23.766868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:23.856738 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2493/5012] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:23.869592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:23.869965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:23.899840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1302c-a749-4ce1-982a-5ada5d357576 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:23.919535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:23.924877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:23.924877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:23.924877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:23.932052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:23.933971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:23.949450 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2520/5013] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:24.045133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:25.134232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:25.235882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579680df-a8f9-495a-8a8e-8e5cad59fb03 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:25.244694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:25.245387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:25.245720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:25.245876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:25.247862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:25.287790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:25.289475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:25.309918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2494/5014] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:26.457053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:26.571938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:28.205208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:28.501477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:29.032160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:29.052041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6298be-8eeb-4d37-b0c1-f8bd5e6053cb service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:29.061705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:29.062502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:29.062792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:29.063108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:29.073384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:29.074998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:29.087873 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2521/5015] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:29.219952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:29.221560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:29.302493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:29.304662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:29.384733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec760ec-aed9-40ba-b552-1218f0c8c831 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:29.423303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:29.423303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:29.423303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:29.423303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] PATH_INFO: `/v3/users/f7c53028ed1f4dae9fe261ba761580ef` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:29.424112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c53028ed1f4dae9fe261ba761580ef)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:29.442037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:29.508809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1f3b-7442-49cc-a39f-6f2ec58a8775 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:29.526629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:29.527654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:29.528724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:29.529320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] PATH_INFO: `/v3/users/c7e6cd5d849746e8b2285ff04a23dfbb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:29.531914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e6cd5d849746e8b2285ff04a23dfbb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:29.535077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:29.670884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c53028ed1f4dae9fe261ba761580ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.678009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c53028ed1f4dae9fe261ba761580ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.678675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c53028ed1f4dae9fe261ba761580ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.691570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c53028ed1f4dae9fe261ba761580ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.692251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35bf9645-2f2a-496b-ba84-8b928a059252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c53028ed1f4dae9fe261ba761580ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.721963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e6cd5d849746e8b2285ff04a23dfbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.729209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e6cd5d849746e8b2285ff04a23dfbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.729966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e6cd5d849746e8b2285ff04a23dfbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.730578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e6cd5d849746e8b2285ff04a23dfbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.745432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e6cd5d849746e8b2285ff04a23dfbb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:29.772159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2495/5016] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:29 2022] DELETE /identity/v3/users/f7c53028ed1f4dae9fe261ba761580ef => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:29.776564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:29.776914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:29.777374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:29.798403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:29.799635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:29.868526 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2522/5017] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:29 2022] DELETE /identity/v3/users/c7e6cd5d849746e8b2285ff04a23dfbb => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:29.868690 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2496/5018] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:29.884906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:29.886419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:29.948894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d690ae3-7069-4616-aca8-6191ee9a0308 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:29.953125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:29.953257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:29.953493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:29.953767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.016148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:30.017604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:30.028312 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2523/5019] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:30.312803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:30.388933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:30.388933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:30.398042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0ff5-2201-4569-86ce-e7977b8e4d3a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:30.402800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:30.403670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.403860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.404085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] PATH_INFO: `/v3/projects/4cd27d5a79694b75923fb286a79dab47` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.405860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd27d5a79694b75923fb286a79dab47)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:30.408053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:30.421878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:30.425193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:30.442102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72bd84-ef35-4096-9327-2cbdc8a11af7 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:30.460185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:30.461116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.461586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.461858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] PATH_INFO: `/v3/projects/0befedd0156342fc81357fbaaead0657` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.463548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0befedd0156342fc81357fbaaead0657)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:30.465754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:30.502859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:30.544183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd27d5a79694b75923fb286a79dab47', 'request_id': 'req-576ababc-3428-4752-9686-dad22d18e03f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.550501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd27d5a79694b75923fb286a79dab47', 'request_id': 'req-576ababc-3428-4752-9686-dad22d18e03f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.556339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd27d5a79694b75923fb286a79dab47', 'request_id': 'req-576ababc-3428-4752-9686-dad22d18e03f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.622478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0befedd0156342fc81357fbaaead0657', 'request_id': 'req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.628096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0befedd0156342fc81357fbaaead0657', 'request_id': 'req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.633184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] The token cache is being invalidate because project 4cd27d5a79694b75923fb286a79dab47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:30.637821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.637821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-576ababc-3428-4752-9686-dad22d18e03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.638087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0befedd0156342fc81357fbaaead0657', 'request_id': 'req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.638221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2497/5020] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:30 2022] DELETE /identity/v3/projects/4cd27d5a79694b75923fb286a79dab47 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:30.642522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92536d90-9863-4df8-b500-bedff2884960 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.643604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92536d90-9863-4df8-b500-bedff2884960 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.643604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92536d90-9863-4df8-b500-bedff2884960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.666371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-92536d90-9863-4df8-b500-bedff2884960 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:30.667637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-92536d90-9863-4df8-b500-bedff2884960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:30.724711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] The token cache is being invalidate because project 0befedd0156342fc81357fbaaead0657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:30.725104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.727084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:30.728728 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2524/5021] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:30 2022] DELETE /identity/v3/projects/0befedd0156342fc81357fbaaead0657 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:30.730155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2498/5022] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:30.736764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:30.737555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.738014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.738252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:30.738403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.752448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3dbdd-2f5f-4e25-ae3c-9d61e0d3135c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:30.757912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:30.759542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.759542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.759542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] PATH_INFO: `/v3/users/c32291e2790145ad80ea1dbfacd42a74` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.759993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:30.760428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32291e2790145ad80ea1dbfacd42a74)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:30.761341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:30.762425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:30.770079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2499/5023] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:30.774257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:30.783853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8da96-11cc-46bc-8cf2-26aea570b3f4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:30.789231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:30.789837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.790210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.790491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.791174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:30.791485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:30.793083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:30.804594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2500/5024] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:30.808720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:30.818214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4f4ab-5255-439b-b8ac-5459a892a315 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:30.824227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:30.832150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:30.832150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:30.832150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:30.832150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:30.832150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:30.942588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2501/5025] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:30 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:30.943692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.015839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32291e2790145ad80ea1dbfacd42a74'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.015993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a21a0-42fb-4b19-8f90-61f6e9ef99b2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.021364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.022107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.022302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.022752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.023339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.025354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.033167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32291e2790145ad80ea1dbfacd42a74'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.034821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32291e2790145ad80ea1dbfacd42a74'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.035743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32291e2790145ad80ea1dbfacd42a74'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.049753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32291e2790145ad80ea1dbfacd42a74'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.143047 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2502/5026] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:30 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:31.146509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.148262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:31.162964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f598ee-4114-4caf-8c90-1c5e952381b7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.168277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.168892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.169313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.169602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.170378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.173069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.173459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2525/5027] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:30 2022] DELETE /identity/v3/users/c32291e2790145ad80ea1dbfacd42a74 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:31.184862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2503/5028] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:31.188914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.257159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4286b6-8b97-4353-bb25-831076050ca1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.262655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.263305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.263595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.263875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.265062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.266876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.277652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2526/5029] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:31.282043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.292949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980bdc-28c1-468d-bb11-c92ffb816d93 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.298217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbf132-8c47-484e-acea-f098036f2196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.303445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbf132-8c47-484e-acea-f098036f2196 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.303445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbf132-8c47-484e-acea-f098036f2196 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.303445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbf132-8c47-484e-acea-f098036f2196 admin admin] PATH_INFO: `/v3/projects/ff448bc0ec7c43a38a4b8adb062afca6/users/596b0a6958704e9eb27683ee535a9b60/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.319274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbf132-8c47-484e-acea-f098036f2196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff448bc0ec7c43a38a4b8adb062afca6, user_id=596b0a6958704e9eb27683ee535a9b60, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.322573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbf132-8c47-484e-acea-f098036f2196 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.464346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.465715 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2504/5030] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:31 2022] PUT /identity/v3/projects/ff448bc0ec7c43a38a4b8adb062afca6/users/596b0a6958704e9eb27683ee535a9b60/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:31.470695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:31.471756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.472333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.472892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.485055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7fdae-4d23-43a9-bbdb-ba716e05ea75 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.499437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:31.500676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:31.550231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.551529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.551804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.552084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] PATH_INFO: `/v3/projects/9eda205f0f2f44cbaec2cf6bf4f38abe` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.553213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eda205f0f2f44cbaec2cf6bf4f38abe)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.555220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.562090 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2505/5031] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:31.570270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:31.577315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.577315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:31.648337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73bcf6-8716-419c-97d3-9165076c140d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.652278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59d144-fde1-4a37-9af9-6849d870a163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.652894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59d144-fde1-4a37-9af9-6849d870a163 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.653181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59d144-fde1-4a37-9af9-6849d870a163 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.653461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59d144-fde1-4a37-9af9-6849d870a163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.663145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59d144-fde1-4a37-9af9-6849d870a163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.664578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59d144-fde1-4a37-9af9-6849d870a163 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.681308 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2506/5032] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:31.695375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eda205f0f2f44cbaec2cf6bf4f38abe', 'request_id': 'req-4336c419-663d-482a-92ee-4676b0a5b5a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.699609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eda205f0f2f44cbaec2cf6bf4f38abe', 'request_id': 'req-4336c419-663d-482a-92ee-4676b0a5b5a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.709155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eda205f0f2f44cbaec2cf6bf4f38abe', 'request_id': 'req-4336c419-663d-482a-92ee-4676b0a5b5a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.827628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] The token cache is being invalidate because project 9eda205f0f2f44cbaec2cf6bf4f38abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:31.827929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.828579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4336c419-663d-482a-92ee-4676b0a5b5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:31.830083 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2527/5033] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:31 2022] DELETE /identity/v3/projects/9eda205f0f2f44cbaec2cf6bf4f38abe => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:31.834996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.835315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.835598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.857427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:31.859244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:31.922701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2507/5034] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:31.930619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.933292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.933292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.951954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:31.963610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:31.963610 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2528/5035] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:31.965656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:31.975933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e6f93-83f4-439c-b66f-8b4aa750bae4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:31.980622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:31.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:31.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:31.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:31.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:31.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:31.985803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:31.996481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2508/5036] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:32.000684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:32.010641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306fca9-1971-437d-acf4-1af9fcf4ef71 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:32.016185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:32.016820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.017105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.017380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.018008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:32.019954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:32.118753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2529/5037] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:31 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:32.119894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:32.130029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26047151-1de4-4138-8b98-055c95341c11 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:32.189176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:32.189804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.191220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.191585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.195345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:32.195345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:32.287045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2509/5038] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:32 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:32.290180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:32.300618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309cf2-3ae1-44d8-b00b-18f673a75224 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:32.305650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:32.305947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.306234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.306681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.307188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:32.308797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:32.318866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2530/5039] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:32.323059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:32.330330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:32.334309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77f51-97b6-464d-8455-64907f2a9876 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:32.339106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efde7d0-a41c-442c-8401-6d32e3abd6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:32.339742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efde7d0-a41c-442c-8401-6d32e3abd6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.340027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efde7d0-a41c-442c-8401-6d32e3abd6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.340303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efde7d0-a41c-442c-8401-6d32e3abd6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.340950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efde7d0-a41c-442c-8401-6d32e3abd6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:32.343153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efde7d0-a41c-442c-8401-6d32e3abd6f5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:32.358699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2510/5040] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:32.362978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:32.375403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38173f9-b6b2-4492-921e-605845e413fb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:32.383174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:32.383174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.383174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.383174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] PATH_INFO: `/v3/projects/b21286598cfa410fafab800efe88ab77/users/550d556859de4e19b970b5fb79e02eca/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.398765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21286598cfa410fafab800efe88ab77, user_id=550d556859de4e19b970b5fb79e02eca, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:32.401506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:32.480270 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2531/5041] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:32 2022] PUT /identity/v3/projects/b21286598cfa410fafab800efe88ab77/users/550d556859de4e19b970b5fb79e02eca/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:32.490754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d21b2-6b75-4648-802f-64e69b843264 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.491142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d21b2-6b75-4648-802f-64e69b843264 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.491549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d21b2-6b75-4648-802f-64e69b843264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.522771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f15d21b2-6b75-4648-802f-64e69b843264 None None] MFA Rules not processed for user `550d556859de4e19b970b5fb79e02eca`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:32.524470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f15d21b2-6b75-4648-802f-64e69b843264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:32.593673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2511/5042] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:32.603650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:32.605581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:32.666464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2ec4a-d74e-4b45-93d1-8344052afe72 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:32.670692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba21e-931a-461e-a5f2-afc7c7aa3110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:32.671377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba21e-931a-461e-a5f2-afc7c7aa3110 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:32.674605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba21e-931a-461e-a5f2-afc7c7aa3110 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:32.674605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba21e-931a-461e-a5f2-afc7c7aa3110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:32.680964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba21e-931a-461e-a5f2-afc7c7aa3110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:32.682528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba21e-931a-461e-a5f2-afc7c7aa3110 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:32.692140 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2532/5043] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:33.154279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:33.349954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:35.474130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:36.250408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:37.737809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:38.555197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:39.291658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:39.291951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:39.292450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:39.358763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:39.360328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:39.365145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:39.500656 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2512/5044] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:39.501953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:39.502498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:39.503827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:39.534442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:39.536008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:39.589948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:39.591637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:39.591834 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2533/5045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:39.696872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:39.751523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38061d8f-db90-497f-8466-d55c8ef1eb23 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:39.769888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:39.770761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:39.771366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:39.771826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:39.785496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:39.788136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:39.803147 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2513/5046] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:41.110875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:41.117512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:41.197796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:41.278514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e65a3-f985-4bc7-bcab-ca79d63a778f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:41.287629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:41.288259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:41.289266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:41.289725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:41.291607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:41.305114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:41.307255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:41.321070 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2534/5047] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:41.350961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:43.636295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:43.638826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:43.653089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:43.772146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da63eb-2b19-4fc3-8ff9-f6531bdfe91a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:43.777364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:43.778252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:43.778695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:43.779749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] PATH_INFO: `/v3/users/25c807ed86984d78a148b08685b868af` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:43.781310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c807ed86984d78a148b08685b868af)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:43.783488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:44.050736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:44.084221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c807ed86984d78a148b08685b868af'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.096618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c807ed86984d78a148b08685b868af'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.098947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c807ed86984d78a148b08685b868af'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.117302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c807ed86984d78a148b08685b868af'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.118995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c807ed86984d78a148b08685b868af'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.259407 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2514/5048] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:43 2022] DELETE /identity/v3/users/25c807ed86984d78a148b08685b868af => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:44.273809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:44.295961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42058-0da9-4819-b4ac-082c9b6754c9 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:44.383885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:44.384728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:44.385232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:44.385818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] PATH_INFO: `/v3/users/550d556859de4e19b970b5fb79e02eca` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:44.387599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=550d556859de4e19b970b5fb79e02eca)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:44.390604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:44.606018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:44.609601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:44.614095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550d556859de4e19b970b5fb79e02eca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.621985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550d556859de4e19b970b5fb79e02eca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.623662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550d556859de4e19b970b5fb79e02eca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.624548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550d556859de4e19b970b5fb79e02eca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.625267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ac6a-d5df-4383-9e90-08f90a7b3f15 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:44.631995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:44.632909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:44.634050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:44.634050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] PATH_INFO: `/v3/projects/ccbfa77f07dd4e69acfbea7657a922fd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:44.635754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbfa77f07dd4e69acfbea7657a922fd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:44.637846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:44.653563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bfe23789-f437-403c-bf31-ab0edc6a0d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550d556859de4e19b970b5fb79e02eca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.747730 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2535/5049] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:44 2022] DELETE /identity/v3/users/550d556859de4e19b970b5fb79e02eca => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:44.752600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:44.752905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:44.753190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:44.761198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbfa77f07dd4e69acfbea7657a922fd', 'request_id': 'req-ceee415b-f2cf-4774-8f37-c34378021743'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.767744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbfa77f07dd4e69acfbea7657a922fd', 'request_id': 'req-ceee415b-f2cf-4774-8f37-c34378021743'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.772645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:44.773549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbfa77f07dd4e69acfbea7657a922fd', 'request_id': 'req-ceee415b-f2cf-4774-8f37-c34378021743'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.773900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:44.833298 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2536/5050] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:44.844676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:44.846250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:44.910792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fb57c-f06a-498e-8a9c-96863cc23417 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:44.911092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] The token cache is being invalidate because project ccbfa77f07dd4e69acfbea7657a922fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:44.911201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.911968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ceee415b-f2cf-4774-8f37-c34378021743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:44.913640 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2515/5051] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:44 2022] DELETE /identity/v3/projects/ccbfa77f07dd4e69acfbea7657a922fd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:44.914700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:44.915361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:44.915644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:44.915920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:44.918483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:44.918777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:44.919068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:44.920458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:44.935340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:44.941674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426c86-9a36-46bc-bc03-4436a5aca6bb service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:44.942402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:44.943849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:44.947303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2537/5052] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:44.952252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2516/5053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:44.960649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:44.961104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:44.961387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:44.981694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:44.983688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:44.993121 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2538/5054] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:44.996756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.008650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8400e-7579-40d6-b8b5-7f685ad6d8da None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.013911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.017984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.017984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.017984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.017984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:45.017984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.017984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.032184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2517/5055] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:45.037259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.048069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e1245-d533-429e-8ff8-5a215a6af16c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.053095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.053715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.054000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.054277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.054914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.056882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.167046 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2539/5056] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:45.171397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.181922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e3c5-e2c2-45cb-a07c-f13bed262e3d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.244181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.245066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.245470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.246554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.247464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.250211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.273642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.276378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:45.300588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ddd3-589a-4932-abfb-96d8d4c2c3b1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.300588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.300829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.301179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.301557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] PATH_INFO: `/v3/projects/b21286598cfa410fafab800efe88ab77` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.302921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21286598cfa410fafab800efe88ab77)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.305190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.354642 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2518/5057] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:45.361260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.373176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b5682-4bba-4180-a389-111b0ac9e348 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.380518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.381154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.382054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.382054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.382768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.384729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.405521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2519/5058] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:45.410782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.430167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95e61-0a9b-4ec2-bae7-f134e0e0c186 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.439666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21286598cfa410fafab800efe88ab77', 'request_id': 'req-aa626b78-de80-4825-be69-b3b5397ec1f8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:45.445688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21286598cfa410fafab800efe88ab77', 'request_id': 'req-aa626b78-de80-4825-be69-b3b5397ec1f8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:45.452500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21286598cfa410fafab800efe88ab77', 'request_id': 'req-aa626b78-de80-4825-be69-b3b5397ec1f8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:45.499181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.499918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.500277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.500626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.501379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.503097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.520856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2520/5059] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:45.522496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] The token cache is being invalidate because project b21286598cfa410fafab800efe88ab77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:45.522975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:45.524903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-aa626b78-de80-4825-be69-b3b5397ec1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:45.525325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.527213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:45.531231 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2540/5060] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:45 2022] DELETE /identity/v3/projects/b21286598cfa410fafab800efe88ab77 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:45.533161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0e2d-b313-43b5-a176-258c55d52a75 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.533627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0e2d-b313-43b5-a176-258c55d52a75 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.534075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0e2d-b313-43b5-a176-258c55d52a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.545092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac0882-870a-477e-aa20-54f1748634f3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.551356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23e41-7859-46e1-9084-d1c7e63e0c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.552278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23e41-7859-46e1-9084-d1c7e63e0c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.552741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23e41-7859-46e1-9084-d1c7e63e0c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.553208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23e41-7859-46e1-9084-d1c7e63e0c97 admin admin] PATH_INFO: `/v3/projects/3bce0861528a4891b94d174e964456f0/users/e94103c4c75b4f2d8b2cb1bd4b6bcf6a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.563366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4e6c0e2d-b313-43b5-a176-258c55d52a75 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:45.565633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4e6c0e2d-b313-43b5-a176-258c55d52a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:45.574141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef23e41-7859-46e1-9084-d1c7e63e0c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bce0861528a4891b94d174e964456f0, user_id=e94103c4c75b4f2d8b2cb1bd4b6bcf6a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.577569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef23e41-7859-46e1-9084-d1c7e63e0c97 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.587580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2541/5061] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:45.594156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.594475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.594728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.621092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:45.623132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:45.634710 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2542/5062] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:45.639481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.650283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97efb-b608-4298-a015-e0e225c62709 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.665509 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2521/5063] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:45 2022] PUT /identity/v3/projects/3bce0861528a4891b94d174e964456f0/users/e94103c4c75b4f2d8b2cb1bd4b6bcf6a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:45.666408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.666706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.666989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.688834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:45.690866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:45.733428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.734669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.734669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.734669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.735333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:45.736537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.738176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.755662 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2543/5064] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:45.757199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.760341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2522/5065] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:45.769464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e8c63-faee-478d-8c51-806e4c982426 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.770428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.771910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:45.775379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.778885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.778885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.778885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.780440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.782666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.831901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04812-1539-4ae7-abbb-0cf26f77f3dd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:45.835664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:45.836273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:45.836560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:45.836838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:45.846653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:45.848165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:45.857960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2523/5066] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:45.934324 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2544/5067] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:45.938973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:45.960527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a954a-2409-4662-9b1f-0550a6d71250 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:46.068336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:46.069065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:46.069484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:46.069782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:46.070614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:46.073455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:46.074397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:46.182452 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2524/5068] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:45 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:46.183707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:46.195043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46280de-4063-40b4-8193-cb0ef39d9d66 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:46.199908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:46.200584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:46.200893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:46.201174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:46.201875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:46.203527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:46.214621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2545/5069] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:46.219628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:46.233568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d9dbd-3691-4fe3-9d7f-55195bd7c251 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:46.238779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f18711-fd21-42d7-944c-befa9c2750bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:46.239411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f18711-fd21-42d7-944c-befa9c2750bc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:46.239696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f18711-fd21-42d7-944c-befa9c2750bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:46.239970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f18711-fd21-42d7-944c-befa9c2750bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:46.240613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f18711-fd21-42d7-944c-befa9c2750bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:46.242685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f18711-fd21-42d7-944c-befa9c2750bc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:46.256764 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2525/5070] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:46.261354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:46.273007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a21e4-bb5f-4169-8f06-38655e7ff001 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:46.278783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:46.282506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:46.282506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:46.289216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] PATH_INFO: `/v3/projects/e91305c95350465ea8a59263187d0888/users/4bb9dc04dbd94431814e10122987e57e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:46.314885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91305c95350465ea8a59263187d0888, user_id=4bb9dc04dbd94431814e10122987e57e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:46.318922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:46.445768 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2546/5071] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:46 2022] PUT /identity/v3/projects/e91305c95350465ea8a59263187d0888/users/4bb9dc04dbd94431814e10122987e57e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:46.453463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:46.453756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:46.454045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:46.491681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] MFA Rules not processed for user `4bb9dc04dbd94431814e10122987e57e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:46.492917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:46.506929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:46.601478 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2526/5072] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:46.609212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:46.697111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4c22-ca76-4e89-88b5-06055bfa0874 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:46.706352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:46.706352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:46.706352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:46.706352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:46.714995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:46.716542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:46.726061 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2547/5073] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:47.109701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:47.111393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:47.211854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa276dc-bda1-4feb-ada2-c94ff7b90472 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:47.218166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:47.218786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:47.219103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:47.219384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:47.221250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:47.238232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:47.240130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:47.255244 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2527/5074] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:47.695618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:47.751173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:47.752599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:47.791679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a14109-0370-4cc6-acc8-2fa20935b60c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:47.796544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:47.797128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:47.797410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:47.797691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] PATH_INFO: `/v3/users/4bb9dc04dbd94431814e10122987e57e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:47.798843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb9dc04dbd94431814e10122987e57e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:47.800949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:47.835824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da23e1a-7d64-4f98-8dd3-225f1227cc86 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:47.840554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:47.841219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:47.842108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:47.842395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] PATH_INFO: `/v3/users/d625fadec55145a3b7906e1d90ff183a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:47.843582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d625fadec55145a3b7906e1d90ff183a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:47.845513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:48.047513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb9dc04dbd94431814e10122987e57e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.054530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb9dc04dbd94431814e10122987e57e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.055251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb9dc04dbd94431814e10122987e57e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.055877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb9dc04dbd94431814e10122987e57e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.068093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-add1c619-f8f8-4f77-9a5b-01ab5f387916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb9dc04dbd94431814e10122987e57e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.082080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd625fadec55145a3b7906e1d90ff183a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.090124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd625fadec55145a3b7906e1d90ff183a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.090805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd625fadec55145a3b7906e1d90ff183a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.103813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd625fadec55145a3b7906e1d90ff183a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.104522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7def337f-25e7-4c34-929b-d958b4c5a8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd625fadec55145a3b7906e1d90ff183a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:48.166072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:48.172114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2548/5075] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:47 2022] DELETE /identity/v3/users/4bb9dc04dbd94431814e10122987e57e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:48.176539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:48.176835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:48.177119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:48.196958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:48.198187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:48.261118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2528/5076] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:05:47 2022] DELETE /identity/v3/users/d625fadec55145a3b7906e1d90ff183a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:48.266232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:48.266633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:48.267235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:48.269374 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2549/5077] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:48.279255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:48.280739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:48.291588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:48.293276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:48.349819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e0e28-6c8f-4f87-b76b-2993de00f50d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:48.366699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2529/5078] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:48.377088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:48.419709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:48.420264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:48.420538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:48.420952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:48.432662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:48.444871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:48.445205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:48.446696 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2550/5079] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:48.447175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e0908-0be1-45fa-99a3-c7651490b18b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:48.451785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:48.452729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:48.452729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:48.452971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:48.467144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:48.468565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:48.479140 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2530/5080] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:49.102532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:49.199256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:49.574180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:49.576569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:49.590606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bdf46-5f68-4c1a-b770-6a9e1b20a286 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:49.596349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:49.597397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:49.601280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:49.601280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] PATH_INFO: `/v3/projects/e91305c95350465ea8a59263187d0888` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:49.601280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91305c95350465ea8a59263187d0888)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:49.601280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:49.707380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:49.709535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:49.724497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363f10a-3704-4043-aa1f-11fc76eaba21 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:49.750895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91305c95350465ea8a59263187d0888', 'request_id': 'req-00a780c9-a006-476d-a97b-a94c1aea5245'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:49.759723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91305c95350465ea8a59263187d0888', 'request_id': 'req-00a780c9-a006-476d-a97b-a94c1aea5245'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:49.771458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91305c95350465ea8a59263187d0888', 'request_id': 'req-00a780c9-a006-476d-a97b-a94c1aea5245'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:49.827212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:49.827960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:49.828447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:49.828844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] PATH_INFO: `/v3/projects/c73c9a2dfc994ef4b6a8d7110aeded25` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:49.830098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73c9a2dfc994ef4b6a8d7110aeded25)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:49.832575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:49.907754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] The token cache is being invalidate because project e91305c95350465ea8a59263187d0888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:49.908053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:49.908860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-00a780c9-a006-476d-a97b-a94c1aea5245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:49.911403 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2551/5081] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:49 2022] DELETE /identity/v3/projects/e91305c95350465ea8a59263187d0888 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:49.915874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9816f-2d83-4903-8123-f02374229542 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:49.916839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9816f-2d83-4903-8123-f02374229542 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:49.917204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9816f-2d83-4903-8123-f02374229542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:49.940466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9de9816f-2d83-4903-8123-f02374229542 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:49.941804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9de9816f-2d83-4903-8123-f02374229542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:49.950378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2552/5082] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:49.958940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:49.959320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:49.959667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:49.989618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73c9a2dfc994ef4b6a8d7110aeded25', 'request_id': 'req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:49.990853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:49.994032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:50.004117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73c9a2dfc994ef4b6a8d7110aeded25', 'request_id': 'req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:50.011478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73c9a2dfc994ef4b6a8d7110aeded25', 'request_id': 'req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:50.039958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:50.073242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2553/5083] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:50.077228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.087132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f56bdd-617a-4bf8-9c8e-0459fa073a55 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.092157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.092960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.093244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.093514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.094171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:50.094768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.097102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.122254 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2554/5084] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:50.122254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.136681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2beb8-05d7-4e8c-a1de-10724bc884f9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.142386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.143637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.143933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.144224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.148207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.148207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.173025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:50.178139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] The token cache is being invalidate because project c73c9a2dfc994ef4b6a8d7110aeded25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:05:50.178448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:50.179132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2ad15cd8-7832-49bb-a4e5-2ba4a4178f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:05:50.181257 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2531/5085] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:05:49 2022] DELETE /identity/v3/projects/c73c9a2dfc994ef4b6a8d7110aeded25 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:05:50.188583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeaa27-96c9-4856-a3d0-9d5f09acda9c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.189789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeaa27-96c9-4856-a3d0-9d5f09acda9c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.190093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeaa27-96c9-4856-a3d0-9d5f09acda9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.212972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e2eeaa27-96c9-4856-a3d0-9d5f09acda9c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:50.214213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2eeaa27-96c9-4856-a3d0-9d5f09acda9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:50.233139 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2532/5086] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:50.242936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.249174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.249174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.279250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:50.280922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:50.297019 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2533/5087] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:50.300124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.302005 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2555/5088] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:50.303370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:50.303623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.318817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae131-7615-49b8-ba9d-b4dc5a5796a6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.393390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.396574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.396574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.396574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.396574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.397626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.411657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cf3e-dd78-4e61-879a-3f2a8693ac83 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.417142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.426071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.426071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.426071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.426071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:05:50.426071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.426071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.439311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2556/5089] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:05:50.441732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.454389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f6825-aca3-4df9-a549-aaa82643fd5c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.460428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.461081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.461372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.461664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.462380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.464350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.486926 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2534/5090] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:50.488417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.517759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d6210-bc5a-44c1-a124-791d348a6d85 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.518679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.519593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.520002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.520387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.521256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.524605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.537679 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2535/5091] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:50.541824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.552883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eb200-c7d0-4d13-bc11-e65068b2d1b3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.557899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.558821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.558974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.559293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.560240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.561852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.577418 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2536/5092] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:05:50.586138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.586473 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2557/5093] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:50.588968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.597976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eca58-984f-4fda-ba6e-0d096b8148cc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.662399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18812f-4e39-4215-99d9-aaaaadef3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.663143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18812f-4e39-4215-99d9-aaaaadef3768 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.663813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18812f-4e39-4215-99d9-aaaaadef3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.663813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18812f-4e39-4215-99d9-aaaaadef3768 admin admin] PATH_INFO: `/v3/projects/e098375f7ed940209832dabbd942c924/users/be22fc68222e497f85bcbaaae4710ab5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.681533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18812f-4e39-4215-99d9-aaaaadef3768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e098375f7ed940209832dabbd942c924, user_id=be22fc68222e497f85bcbaaae4710ab5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.682108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296c63-4f40-414e-a0c9-1550c5844ab6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.684478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18812f-4e39-4215-99d9-aaaaadef3768 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.689032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.689654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.689943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.690227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.690866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.693019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.780773 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2558/5094] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:50.781492 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2537/5095] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:50 2022] PUT /identity/v3/projects/e098375f7ed940209832dabbd942c924/users/be22fc68222e497f85bcbaaae4710ab5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:50.784860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.795614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.795901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.796177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.809207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de80f30-6d82-4f79-8fbd-c1b7588dc3a0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.831790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] MFA Rules not processed for user `be22fc68222e497f85bcbaaae4710ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:50.838046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:50.887705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.888866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.889151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.889548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.890191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.891858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.905602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2559/5096] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:50.907820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.910086 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2538/5097] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:50.914315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.924436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1c52f-6824-4486-8dd8-ccd8713c9e57 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.926174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.926891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.927301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.927678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.928408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.930128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.936800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df49c-0c8b-479b-a518-0a43b04fccae None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.941936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.942674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.942810 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2560/5098] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:50.943234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.943582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.946937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.946937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:50.949751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:50.961617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bba2c7-2c92-48f8-86bb-29e1a63a2699 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:50.975569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3e622-868c-4569-8c7c-09254db8cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:50.975569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3e622-868c-4569-8c7c-09254db8cf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:50.975569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3e622-868c-4569-8c7c-09254db8cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:50.975569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3e622-868c-4569-8c7c-09254db8cf90 admin admin] PATH_INFO: `/v3/projects/211370d831d74df2a6c942a011d277fb/users/de8d2470850e4e168d38078abd4bdd07/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:50.989272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3e622-868c-4569-8c7c-09254db8cf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211370d831d74df2a6c942a011d277fb, user_id=de8d2470850e4e168d38078abd4bdd07, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:50.992480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3e622-868c-4569-8c7c-09254db8cf90 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:51.055271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2539/5099] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:50 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:51.056936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:51.075154 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2561/5100] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:50 2022] PUT /identity/v3/projects/211370d831d74df2a6c942a011d277fb/users/de8d2470850e4e168d38078abd4bdd07/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:51.079771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.080126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.080776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.109086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:51.110400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:51.173045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249bf46-cb1a-4311-8318-4afab03b0de3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:51.202802 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2562/5101] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:51.214590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:51.216094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:51.237503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:51.238210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.238561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.238908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.239644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:51.241799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:51.267951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:51.280836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c0c4-eb58-418b-a6fc-b188ef6d3bda None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:51.285029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:51.285779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.286148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.286521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.297275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:51.299111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:51.314385 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2563/5102] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:51.364755 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2540/5103] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:51 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:51.370248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:51.396602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d356fc-ff19-4952-8165-370c4400d9c8 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:51.401839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:51.404216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.404216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.404216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.404216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:51.405546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:51.420028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2564/5104] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:51.421644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:51.458353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5f737-1479-4e07-be22-7376dbf93131 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:51.464106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e89d-8154-4086-beaf-f76b3a009b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:51.464724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e89d-8154-4086-beaf-f76b3a009b6c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.465009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e89d-8154-4086-beaf-f76b3a009b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.465287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e89d-8154-4086-beaf-f76b3a009b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.465929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489e89d-8154-4086-beaf-f76b3a009b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:51.467862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489e89d-8154-4086-beaf-f76b3a009b6c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:51.479221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2541/5105] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:51.484850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:51.496907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16297f-f314-4a18-8190-c4fe72062c33 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:51.502413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:51.503131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.503447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.503687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] PATH_INFO: `/v3/projects/c8c445f289e0475b975ee81421966597/users/280fbc48621242359c2286a87f82f68a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.521499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c445f289e0475b975ee81421966597, user_id=280fbc48621242359c2286a87f82f68a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:51.524950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:51.617298 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2565/5106] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:51 2022] PUT /identity/v3/projects/c8c445f289e0475b975ee81421966597/users/280fbc48621242359c2286a87f82f68a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:51.628940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.629231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.629507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.661956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] MFA Rules not processed for user `280fbc48621242359c2286a87f82f68a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:51.663275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:51.750090 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2542/5107] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:51.755407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:51.881495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777d1ec-fb7c-4e71-9ff0-65cca5a158a3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:51.889798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:51.891982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:51.891982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:51.891982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:51.891982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:51.893988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.003425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2566/5108] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:05:51 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:05:52.006925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.019454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d67900-6214-4af2-889f-45b68e6148bd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.035512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:52.099193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.100160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.100577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.100976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.101779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.104373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.205227 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2543/5109] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:05:52 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:05:52.209711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.226108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b810e2-6f00-4a30-8dbc-1215954cda96 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.244461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.245098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.245382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.248481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.248481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.248481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.263598 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2567/5110] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:52.266553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.281340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9269a-2bd9-4343-bbca-00df68c4756b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.310915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694c3b1-9a87-4888-9fe6-4d3ff5dd9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.311735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c3b1-9a87-4888-9fe6-4d3ff5dd9eee admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.312157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c3b1-9a87-4888-9fe6-4d3ff5dd9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.312550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c3b1-9a87-4888-9fe6-4d3ff5dd9eee admin admin] PATH_INFO: `/v3/projects/91fd265efdb94af5b8a03f6d4fbabed1/users/5ed11ee70f8f40279981f72cc85be0de/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.341052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694c3b1-9a87-4888-9fe6-4d3ff5dd9eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fd265efdb94af5b8a03f6d4fbabed1, user_id=5ed11ee70f8f40279981f72cc85be0de, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.346784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694c3b1-9a87-4888-9fe6-4d3ff5dd9eee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.370841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.373044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:52.470692 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2544/5111] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:52 2022] PUT /identity/v3/projects/91fd265efdb94af5b8a03f6d4fbabed1/users/5ed11ee70f8f40279981f72cc85be0de/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:52.475978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.476281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.476569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.526299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c9932-dfcd-449e-b729-1b095548526e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.526811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] MFA Rules not processed for user `e94103c4c75b4f2d8b2cb1bd4b6bcf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:52.531167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:52.659858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.660448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.660750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.661000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.666657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:52.687718 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2545/5112] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:52.690817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.770774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.772738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af26a2a-1aea-44a2-a282-f9d530d986f8 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.779386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fffbaf-6a57-40e7-92b8-41202f56cab7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.784405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.784891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.785264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.785545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.786607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.788566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.799315 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2546/5113] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:05:52.800194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.801900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:52.807431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2568/5114] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:52.809210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.811516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.812192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.823129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b852-87fb-4825-87f4-c6bb91e65018 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.832859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.833484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.833764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.834039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.835892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:52.851093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.852709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03827266-6a5e-4a19-8132-fd742997b8fd service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.855082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] MFA Rules not processed for user `e94103c4c75b4f2d8b2cb1bd4b6bcf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:52.856403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:52.866401 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2569/5115] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:52.868587 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2547/5116] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:52.868738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.881968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7601eb-1ca2-4f44-a1c3-0fc36d324f86 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:52.887918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:52.889161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.889471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.889769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] PATH_INFO: `/v3/projects/91fd265efdb94af5b8a03f6d4fbabed1/users/5ed11ee70f8f40279981f72cc85be0de/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.891782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fd265efdb94af5b8a03f6d4fbabed1, user_id=5ed11ee70f8f40279981f72cc85be0de, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:52.894568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:52.921382 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2570/5117] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:05:52 2022] PUT /identity/v3/projects/91fd265efdb94af5b8a03f6d4fbabed1/users/5ed11ee70f8f40279981f72cc85be0de/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:05:52.931895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:52.932226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:52.932449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:52.946350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:52.981044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] MFA Rules not processed for user `5ed11ee70f8f40279981f72cc85be0de`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:52.982754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:53.048534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c29f-d22a-4688-9128-5985fe2a0f06 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:53.055532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:53.056236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:53.056524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:53.056803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:53.076659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:53.084342 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2548/5118] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:53.096050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:53.097735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:53.138815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:53.140898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:53.167197 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2571/5119] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:53.201050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464e9c-dee1-466d-8984-53eb947a78c0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:53.206068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfac7-675b-4481-afae-709914527d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:53.206980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfac7-675b-4481-afae-709914527d6c service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:53.207551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfac7-675b-4481-afae-709914527d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:53.208123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfac7-675b-4481-afae-709914527d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:53.220826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcfac7-675b-4481-afae-709914527d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:53.223860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcfac7-675b-4481-afae-709914527d6c service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:53.261879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2549/5120] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:05:53.748561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:54.962206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:55.095437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:05:55.095437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:55.119135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed54bd-4084-4ee8-8f91-d552ba902a3f service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:05:55.123422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eede2-468c-4c40-b355-f9a1380d10f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:05:55.124413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eede2-468c-4c40-b355-f9a1380d10f1 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:55.124928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eede2-468c-4c40-b355-f9a1380d10f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:55.125437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eede2-468c-4c40-b355-f9a1380d10f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:55.306587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eede2-468c-4c40-b355-f9a1380d10f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:05:55.308104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eede2-468c-4c40-b355-f9a1380d10f1 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:05:55.336475 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2572/5121] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:05:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:05:56.125431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2185-5b06-4692-8f9d-262fff11811a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:56.127515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2185-5b06-4692-8f9d-262fff11811a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:56.128420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2185-5b06-4692-8f9d-262fff11811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:56.193547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-296a2185-5b06-4692-8f9d-262fff11811a None None] MFA Rules not processed for user `f16abbf8a68344b68444ff8fc2795c67`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:56.194820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-296a2185-5b06-4692-8f9d-262fff11811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:56.423193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2550/5122] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:56.577439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:56.985347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2e99-9e30-4e20-9af1-570963dad62a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:56.985860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2e99-9e30-4e20-9af1-570963dad62a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:56.985955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2e99-9e30-4e20-9af1-570963dad62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:57.029584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-80fa2e99-9e30-4e20-9af1-570963dad62a None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:57.031126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-80fa2e99-9e30-4e20-9af1-570963dad62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:57.211066 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2573/5123] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:58.457641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f263-3f2c-4f98-b048-2b9136c361d3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:58.458522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f263-3f2c-4f98-b048-2b9136c361d3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:58.458980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621f263-3f2c-4f98-b048-2b9136c361d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:58.486707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a621f263-3f2c-4f98-b048-2b9136c361d3 None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:58.487708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a621f263-3f2c-4f98-b048-2b9136c361d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:58.491147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:58.498945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2551/5124] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:58.526883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b5bb7-9603-4cf3-8e15-37d81e43330f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:58.526883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b5bb7-9603-4cf3-8e15-37d81e43330f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:58.526883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b5bb7-9603-4cf3-8e15-37d81e43330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:58.553999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-989b5bb7-9603-4cf3-8e15-37d81e43330f None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:58.557872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-989b5bb7-9603-4cf3-8e15-37d81e43330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:58.573044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2574/5125] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:58.576720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:05:58.619912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6570d-507f-44ee-b893-79d149fcc229 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:58.620245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6570d-507f-44ee-b893-79d149fcc229 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:58.620526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6570d-507f-44ee-b893-79d149fcc229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:58.651594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e4b6570d-507f-44ee-b893-79d149fcc229 None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:58.654489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e4b6570d-507f-44ee-b893-79d149fcc229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:58.683920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2552/5126] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:05:58.727359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:58.727654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:58.727939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:58.762906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] MFA Rules not processed for user `596b0a6958704e9eb27683ee535a9b60`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:58.763741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:58.788788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2575/5127] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:05:59.544524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:05:59.549180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:05:59.549755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:05:59.601872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:05:59.603072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:05:59.818779 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2553/5128] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:00.062442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:00.064407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:00.226246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26069e11-7df6-4e11-9ab6-6512b090cf0b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:00.241374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97fb11-a3c5-4f7d-ae1f-e3beee6f7bee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:00.242125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97fb11-a3c5-4f7d-ae1f-e3beee6f7bee service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:00.243167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97fb11-a3c5-4f7d-ae1f-e3beee6f7bee service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:00.243562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97fb11-a3c5-4f7d-ae1f-e3beee6f7bee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:00.265134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97fb11-a3c5-4f7d-ae1f-e3beee6f7bee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:00.271665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97fb11-a3c5-4f7d-ae1f-e3beee6f7bee service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:00.306528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2576/5129] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:06:01.102405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:01.304861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661176c-d92d-4d7c-a899-cdec7337640c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:01.317653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:01.319693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:01.319693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:01.321433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:01.326540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:01.354143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:01.439809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:01.439809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:01.439809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:01.525295 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2554/5130] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:02.233963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:02.234452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:02.234899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:02.275306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] MFA Rules not processed for user `de8d2470850e4e168d38078abd4bdd07`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:02.276891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:02.369441 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2577/5131] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:02.375418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:02.584451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97baecd-e624-422e-8085-e6c4780aa62f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:02.591951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:02.593148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:02.593590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:02.594118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:02.595755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:02.598540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:02.761030 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2555/5132] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:06:02 2022] POST /identity/v3/users => generated 287 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:02.765200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:02.777993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6460-11b7-4338-a5b7-cc4f88972bbe None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:02.787818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56970bb5-226b-4ec0-b4b5-5598a7aa8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:02.788460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970bb5-226b-4ec0-b4b5-5598a7aa8582 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:02.790683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970bb5-226b-4ec0-b4b5-5598a7aa8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:02.791002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970bb5-226b-4ec0-b4b5-5598a7aa8582 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:02.796965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56970bb5-226b-4ec0-b4b5-5598a7aa8582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:02.796965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56970bb5-226b-4ec0-b4b5-5598a7aa8582 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:02.808344 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2578/5133] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:02.813186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:02.827834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836495f6-5e8f-4fcf-a414-5ef647f1d881 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:02.835900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:02.837929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:02.838887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:02.839389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] PATH_INFO: `/v3/system/users/36a9376efd404024aa1f60d4832912e0/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:02.841941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:02.889877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36a9376efd404024aa1f60d4832912e0, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:02.891900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:02.983918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2556/5134] 10.222.0.20 () {60 vars in 1378 bytes} [Tue Sep 6 11:06:02 2022] PUT /identity/v3/system/users/36a9376efd404024aa1f60d4832912e0/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:06:03.009114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:03.009426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:03.009709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:03.060112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] MFA Rules not processed for user `36a9376efd404024aa1f60d4832912e0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:03.063427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:03.270838 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2579/5135] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:03 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 11:06:03.275163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:03.479650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:03.704383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8cdc-03da-497f-9dc5-044f9086fe72 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:03.875324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a9376efd404024aa1f60d4832912e0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:03.875952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:03.876237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:03.876513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:03.877128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:03.878725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:03.906431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:03.908983 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2557/5136] 10.222.0.20 () {58 vars in 1110 bytes} [Tue Sep 6 11:06:03 2022] GET /identity/v3/services => generated 2191 bytes in 634 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:04.364797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e148d6e-81fa-4237-b798-70c1c7d34fcc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:04.470511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a9376efd404024aa1f60d4832912e0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:04.471219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:04.477468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:04.477468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] PATH_INFO: `/v3/limits` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:04.477468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:04.477468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Sep 06 11:06:04.545069 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.NoLimitReference Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Sep 06 11:06:04.546916 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:06:04.554331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2580/5137] 10.222.0.20 () {60 vars in 1126 bytes} [Tue Sep 6 11:06:03 2022] POST /identity/v3/limits => generated 124 bytes in 648 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:06:04.554934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:04.729880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b4157-e252-481c-952c-ad51d9f0196a None tempest-ImageQuotaTest-274546168-system-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:04.770262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:04.797321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a9376efd404024aa1f60d4832912e0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:04.798204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:04.798847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:04.799782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:04.800601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:04.802022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:04.813602 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2558/5138] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:06:04 2022] GET /identity/v3/registered_limits => generated 129 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:06:04.827913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:04.994552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e200f-b3ab-4c5f-b3f7-75c5ce4330d2 None tempest-ImageQuotaTest-274546168-system-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:05.042372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a9376efd404024aa1f60d4832912e0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:05.043534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:05.043976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:05.044479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:05.045291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:05.046614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:05.063603 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2581/5139] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 11:06:04 2022] GET /identity/v3/registered_limits => generated 129 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:06:05.376756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:06.736596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:06.980420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:07.667890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:07.670789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:07.696584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c0356-45e4-46dc-a133-49be157194a3 None tempest-ImageQuotaTest-274546168-system-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:07.712300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:07.713759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:07.714252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:07.714707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:07.721629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:07.750061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:07.752034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:07.774214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2559/5140] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:08.289014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:08.488801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:08.732541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:08.785861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa114-b0e4-42e1-a1b4-675a0023f9aa None tempest-ImageQuotaTest-274546168-system-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:08.787213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:08.787992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:08.789431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:08.790409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:08.793401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:08.826084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:08.828960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:08.854095 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2582/5141] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:08.903371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:08.919666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b7a6-3da2-4186-abd3-df6147326d16 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:08.940466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:08.940466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:08.940466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:08.940466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:08.959360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:09.031224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:09.042464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:09.095946 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2560/5142] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:09.518929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:09.564133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:11.149073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:11.228300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:13.181704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:13.227408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:14.381764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:14.798487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:15.455075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:16.266948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:16.677147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:16.679542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:16.706716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30d240-d263-49bc-b41d-5e5b39199b09 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:16.719753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:16.720741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:16.721127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:16.721576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] PATH_INFO: `/v3/users/596b0a6958704e9eb27683ee535a9b60` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:16.723044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] RBAC: Authorizing `identity:delete_user(user_id=596b0a6958704e9eb27683ee535a9b60)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:16.725864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:17.020513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596b0a6958704e9eb27683ee535a9b60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:17.044138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596b0a6958704e9eb27683ee535a9b60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:17.045563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596b0a6958704e9eb27683ee535a9b60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:17.048032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596b0a6958704e9eb27683ee535a9b60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:17.086766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2ce6398-b8d0-4756-bccf-539d7796615f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596b0a6958704e9eb27683ee535a9b60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:17.218250 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2583/5143] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:16 2022] DELETE /identity/v3/users/596b0a6958704e9eb27683ee535a9b60 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:17.940625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:17.946150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:17.958716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10702-d138-4eed-9c53-a127f3844d9f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:18.082248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:18.145827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:18.150359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:18.150359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:18.150359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] PATH_INFO: `/v3/projects/ff448bc0ec7c43a38a4b8adb062afca6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:18.151609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff448bc0ec7c43a38a4b8adb062afca6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:18.153893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:18.368946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff448bc0ec7c43a38a4b8adb062afca6', 'request_id': 'req-a637538f-6fd4-404c-b796-9b8c7898073e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:18.387934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff448bc0ec7c43a38a4b8adb062afca6', 'request_id': 'req-a637538f-6fd4-404c-b796-9b8c7898073e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:18.419760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff448bc0ec7c43a38a4b8adb062afca6', 'request_id': 'req-a637538f-6fd4-404c-b796-9b8c7898073e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:18.525209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] The token cache is being invalidate because project ff448bc0ec7c43a38a4b8adb062afca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:18.526134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:18.527272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:18.529578 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2561/5144] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:17 2022] DELETE /identity/v3/projects/ff448bc0ec7c43a38a4b8adb062afca6 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:18.536173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc16d-7715-48f8-b2b5-9af639b9c21c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:18.537253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc16d-7715-48f8-b2b5-9af639b9c21c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:18.537747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc16d-7715-48f8-b2b5-9af639b9c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:18.640708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-be9bc16d-7715-48f8-b2b5-9af639b9c21c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:18.642553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:18.644256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:18.645520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-be9bc16d-7715-48f8-b2b5-9af639b9c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:18.713091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:18.832462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2584/5145] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:18.839153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:18.839708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:18.840240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:18.850685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637538f-6fd4-404c-b796-9b8c7898073e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:18.866818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:18.867502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:18.867785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:18.868067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] PATH_INFO: `/v3/users/de8d2470850e4e168d38078abd4bdd07` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:18.871937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8d2470850e4e168d38078abd4bdd07)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:18.874650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:18.879851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:18.884612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:18.892402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2585/5146] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:18.897618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:18.922073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ad885-a85f-4c04-a3fd-ef52dbd485c0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:18.936523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:18.937223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:18.937507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:18.937786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:18.938439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:06:18.938801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:18.940447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:18.969272 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2586/5147] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:06:18.973816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:18.989519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3da7-9a5a-40c4-ae67-cf2e82dfaeb0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:18.997573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:18.997573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:18.997573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:18.998258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:18.999131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:19.001309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:19.137104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2587/5148] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:06:18 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:19.137104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:19.146740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:19.207623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8d2470850e4e168d38078abd4bdd07'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:19.225256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8d2470850e4e168d38078abd4bdd07'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:19.232963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8d2470850e4e168d38078abd4bdd07'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:19.258805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8d2470850e4e168d38078abd4bdd07'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:19.260676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8d2470850e4e168d38078abd4bdd07'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:19.311414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b353d-0c8b-4516-b625-3f1e2a519d08 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:19.324081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:19.330748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:19.330748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:19.330748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:19.334109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:19.375588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2562/5149] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:18 2022] DELETE /identity/v3/users/de8d2470850e4e168d38078abd4bdd07 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:06:19.375588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:19.375588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:19.566345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:19.573729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:19.593212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f833fb2-a58b-4aa9-bfdf-6c5a5690d020 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:19.600748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:19.601778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:19.602235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:19.602694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:19.603773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:19.610918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:19.611134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2588/5150] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:19.765775 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2563/5151] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:06:19 2022] POST /identity/v3/users => generated 287 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:19.766795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:19.858995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c1c6-1897-4162-bb24-25462c1b371d service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:19.865713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:19.867919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:19.868862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:19.869331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:19.871582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:19.875505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:19.894997 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2589/5152] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:19.899832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:19.910106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:19.912945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03817112-6f6a-4267-aa2d-dd2888cc1e08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:19.915092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:19.959679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:19.962127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:19.973731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c8a94-0ecb-481a-ae81-7db28a4e3012 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:19.974257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:19.975121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:19.977402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:19.988704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:19.989522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:19.990382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:19.991047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:19.991515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] PATH_INFO: `/v3/projects/211370d831d74df2a6c942a011d277fb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:19.992977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] RBAC: Authorizing `identity:delete_project(project_id=211370d831d74df2a6c942a011d277fb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:19.995472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:20.021505 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2564/5153] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:20.021505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:20.024554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:20.052071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423409a0-627d-4eff-8527-55c8e0dab5ee admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:20.065006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:20.065979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:20.066274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:20.066572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] PATH_INFO: `/v3/users/a880494fb3144a58afd1fbfa8eff6cb4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:20.067908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a880494fb3144a58afd1fbfa8eff6cb4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:20.069946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:20.209781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211370d831d74df2a6c942a011d277fb', 'request_id': 'req-74d64a7b-74a3-4ad7-911a-fec99e2e954e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.217806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211370d831d74df2a6c942a011d277fb', 'request_id': 'req-74d64a7b-74a3-4ad7-911a-fec99e2e954e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.225903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211370d831d74df2a6c942a011d277fb', 'request_id': 'req-74d64a7b-74a3-4ad7-911a-fec99e2e954e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.379297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:20.398277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] The token cache is being invalidate because project 211370d831d74df2a6c942a011d277fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:20.398587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.400569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.403585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a880494fb3144a58afd1fbfa8eff6cb4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.407939 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2590/5154] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:19 2022] DELETE /identity/v3/projects/211370d831d74df2a6c942a011d277fb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:20.410535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:20.412003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:20.418528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a880494fb3144a58afd1fbfa8eff6cb4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.419651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a880494fb3144a58afd1fbfa8eff6cb4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.444415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a880494fb3144a58afd1fbfa8eff6cb4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.446644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a880494fb3144a58afd1fbfa8eff6cb4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:20.511931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64a7b-74a3-4ad7-911a-fec99e2e954e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:20.517598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963c338-409e-4651-87ef-d8690301c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:20.518300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c338-409e-4651-87ef-d8690301c86b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:20.518602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c338-409e-4651-87ef-d8690301c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:20.518929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c338-409e-4651-87ef-d8690301c86b admin admin] PATH_INFO: `/v3/projects/dc50b9ebed5448079b548f6087330aa6/users/6ec3877b92b943dc85a7f656b4db93ca/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:20.560561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c338-409e-4651-87ef-d8690301c86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc50b9ebed5448079b548f6087330aa6, user_id=6ec3877b92b943dc85a7f656b4db93ca, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:20.566797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c338-409e-4651-87ef-d8690301c86b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:20.580664 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2565/5155] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:20 2022] DELETE /identity/v3/users/a880494fb3144a58afd1fbfa8eff6cb4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:20.581972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:20.586505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:20.699848 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2591/5156] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:06:20 2022] PUT /identity/v3/projects/dc50b9ebed5448079b548f6087330aa6/users/6ec3877b92b943dc85a7f656b4db93ca/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:20.711339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05b13-4a8d-44b2-9bea-54f5014629a8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:20.711917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05b13-4a8d-44b2-9bea-54f5014629a8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:20.712381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05b13-4a8d-44b2-9bea-54f5014629a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:20.718408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72583-9d26-4b61-84ba-2a56539f32d8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:20.773330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cad05b13-4a8d-44b2-9bea-54f5014629a8 None None] MFA Rules not processed for user `6ec3877b92b943dc85a7f656b4db93ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:20.775684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cad05b13-4a8d-44b2-9bea-54f5014629a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:20.822928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:20.823249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:20.823585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:20.824086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] PATH_INFO: `/v3/users/36a9376efd404024aa1f60d4832912e0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:20.825812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a9376efd404024aa1f60d4832912e0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:20.828165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:20.883175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2592/5157] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:20.885521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:20.885887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:20.886153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:20.908206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] MFA Rules not processed for user `6ec3877b92b943dc85a7f656b4db93ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:20.909738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:20.922786 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2593/5158] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:20.938649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:20.940128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:21.038903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cdfcc-0ac8-4616-ac24-8bedacc1fb89 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:21.048034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:21.048916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:21.049370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:21.049831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:21.065933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:21.081551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:21.083243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:21.120458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2594/5159] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:06:21.120458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:21.123745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:21.145382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4914-75bb-4c97-9fcd-7ff773241d1f service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:21.154833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:21.154833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:21.154833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:21.155430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] PATH_INFO: `/v3/projects/aa2ed3ceca87459d8b6db473a08b3464` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:21.156356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2ed3ceca87459d8b6db473a08b3464)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:21.158445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:21.194141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a9376efd404024aa1f60d4832912e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.203716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a9376efd404024aa1f60d4832912e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.204773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a9376efd404024aa1f60d4832912e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.223354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a9376efd404024aa1f60d4832912e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.224461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c48ef69f-8959-4ed0-bc46-bb79d7fde1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a9376efd404024aa1f60d4832912e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.338630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2ed3ceca87459d8b6db473a08b3464', 'request_id': 'req-1fae8e0d-6a96-40f6-828f-2085866bdb60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.344994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2ed3ceca87459d8b6db473a08b3464', 'request_id': 'req-1fae8e0d-6a96-40f6-828f-2085866bdb60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.352661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2ed3ceca87459d8b6db473a08b3464', 'request_id': 'req-1fae8e0d-6a96-40f6-828f-2085866bdb60'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.355144 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2566/5160] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:20 2022] DELETE /identity/v3/users/36a9376efd404024aa1f60d4832912e0 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:21.792094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] The token cache is being invalidate because project aa2ed3ceca87459d8b6db473a08b3464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:21.792094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.792094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fae8e0d-6a96-40f6-828f-2085866bdb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:21.800006 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2595/5161] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:21 2022] DELETE /identity/v3/projects/aa2ed3ceca87459d8b6db473a08b3464 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:21.804911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383332-26ed-458c-82d8-f6423f4b681b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:21.805444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383332-26ed-458c-82d8-f6423f4b681b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:21.805542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383332-26ed-458c-82d8-f6423f4b681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:21.837908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ec383332-26ed-458c-82d8-f6423f4b681b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:21.840891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec383332-26ed-458c-82d8-f6423f4b681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:21.938488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:21.938809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:21.940158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:21.997608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] MFA Rules not processed for user `6ec3877b92b943dc85a7f656b4db93ca`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:21.997737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:22.011060 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2567/5162] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:22.019223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.019917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.020672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.068543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:22.071642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:22.114066 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2568/5163] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:22.124864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:22.146343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3a0bc-69ba-4864-9d08-f2a1495d289a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:22.183319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:22.185579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.185783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.186296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.187220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:06:22.191374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:22.191374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:22.207409 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2569/5164] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:06:22.210625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:22.224185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdec873-6f08-43b4-bfe7-bd2a1c471cb2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:22.241242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:22.243068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.243068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.243265 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2596/5165] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:22.243758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.244120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:22.247130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:22.401031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:22.422642 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2570/5166] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:06:22 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:22.430277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebac13-1791-4fc9-a775-f69739d65c1b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:22.526376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:22.527000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.527554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.527865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.528487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:22.531048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:22.683104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2597/5167] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:06:22 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:22.683485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:22.692519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9547b-2f1b-4261-9369-732892157df8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:22.698480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:22.699312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.699797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.700249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.701364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:22.703190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:22.747159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2571/5168] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:22.748845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:22.762199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27c75-0fe3-4342-bb8e-d66e0f53f437 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:22.775288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ed2e-3e77-436e-aa34-b7a0ff6a2ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:22.775288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ed2e-3e77-436e-aa34-b7a0ff6a2ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.775288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ed2e-3e77-436e-aa34-b7a0ff6a2ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.775288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ed2e-3e77-436e-aa34-b7a0ff6a2ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.775685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ed2e-3e77-436e-aa34-b7a0ff6a2ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:22.775685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ed2e-3e77-436e-aa34-b7a0ff6a2ba7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:22.792903 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2598/5169] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:22.797372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:22.815793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a089-5d80-4588-8bc0-e96f97de1d99 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:22.822595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:22.823882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.825667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.826179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] PATH_INFO: `/v3/projects/3ae9ee2e2f5d439786309f06030582b9/users/d0db5bafa61d44b981696fdae685d811/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:22.846126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae9ee2e2f5d439786309f06030582b9, user_id=d0db5bafa61d44b981696fdae685d811, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:22.864462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:22.979149 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2572/5170] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:06:22 2022] PUT /identity/v3/projects/3ae9ee2e2f5d439786309f06030582b9/users/d0db5bafa61d44b981696fdae685d811/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:22.981730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275338a-9957-41da-9fc7-276ae6b044ad None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:22.982145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275338a-9957-41da-9fc7-276ae6b044ad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:22.982673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275338a-9957-41da-9fc7-276ae6b044ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:23.016043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2275338a-9957-41da-9fc7-276ae6b044ad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:23.017136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2275338a-9957-41da-9fc7-276ae6b044ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:23.084089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2599/5171] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:23.094789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:23.096591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:23.192643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1ff0-bd9d-4a92-bf73-b0bdcaf0974c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:23.196792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:23.197456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:23.197886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:23.198170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:23.208637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:23.210089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:23.220917 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2573/5172] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:23.369922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:23.548089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:24.176059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:24.723895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:24.724991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:24.725434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:24.745428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] MFA Rules not processed for user `f16abbf8a68344b68444ff8fc2795c67`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:24.747589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:24.826068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2600/5173] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:25.723705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:25.793474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:27.656333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:28.059305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:28.060781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:28.186783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef27b-cd17-4011-9380-59a04fb022b7 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:28.186783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:28.186783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:28.186783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:28.187980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:28.189585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:28.323496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:28.328402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76fb6-7a8f-42c4-8883-174a3f92b818 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:28.349932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2574/5174] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:28.621942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:28.638227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b09a8-a75f-4660-b41f-f4edcc5bba14 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:28.653429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:28.654060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:28.654343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:28.654651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:28.658735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:28.678386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:28.689483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:28.691844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faf280-e957-46a2-86b2-b944856449b2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:28.709222 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2601/5175] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:31.068327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:31.699216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:31.699740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:31.700204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:31.727510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:31.729189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:31.832703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40867bb-e878-4256-927d-85784c97bd53 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:31.833323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40867bb-e878-4256-927d-85784c97bd53 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:31.839896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40867bb-e878-4256-927d-85784c97bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:31.867040 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2575/5176] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:06:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:31.896326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:31.897907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:31.899969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:31.901583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f40867bb-e878-4256-927d-85784c97bd53 None None] MFA Rules not processed for user `d0db5bafa61d44b981696fdae685d811`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:31.904112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f40867bb-e878-4256-927d-85784c97bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:32.043193 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2602/5177] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:32.054284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:32.055372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:32.055927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:32.064329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee6ff-89df-445e-8c4b-cc4a3fd574c6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:32.073537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:32.074750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:32.075043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:32.075544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:32.086674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:32.092860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:32.093880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] MFA Rules not processed for user `d0db5bafa61d44b981696fdae685d811`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:32.095440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:32.106128 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2576/5178] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:06:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:06:32.126719 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2603/5179] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:06:32.253023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:32.254897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:32.277585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519da7b-e195-4315-bf26-6dfcfdbd5566 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:32.284009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edd95c-ae9c-45be-851b-b1d6931c255a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:32.284798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edd95c-ae9c-45be-851b-b1d6931c255a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:32.284982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edd95c-ae9c-45be-851b-b1d6931c255a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:32.285392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edd95c-ae9c-45be-851b-b1d6931c255a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:32.294521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edd95c-ae9c-45be-851b-b1d6931c255a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:32.296198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edd95c-ae9c-45be-851b-b1d6931c255a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:32.306910 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2577/5180] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:06:33.953208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:34.238594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:34.241011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:34.259099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba976b-71c2-429d-a641-b7209aa94b28 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:34.264317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:34.264951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:34.265233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:34.265514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] PATH_INFO: `/v3/users/be22fc68222e497f85bcbaaae4710ab5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:34.266687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=be22fc68222e497f85bcbaaae4710ab5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:34.268652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:34.506461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be22fc68222e497f85bcbaaae4710ab5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:34.519362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be22fc68222e497f85bcbaaae4710ab5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:34.523573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be22fc68222e497f85bcbaaae4710ab5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:34.525427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be22fc68222e497f85bcbaaae4710ab5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:34.564797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be22fc68222e497f85bcbaaae4710ab5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:34.680110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2604/5181] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:34 2022] DELETE /identity/v3/users/be22fc68222e497f85bcbaaae4710ab5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:34.684860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:34.685159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:34.685450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:34.718763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:34.723193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:34.949885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2578/5182] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:34.961521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:34.963745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:35.095546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:35.135404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68123532-eafc-4ce6-9d76-3121de45f7dd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:35.156898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:35.157661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:35.159400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:35.160257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:35.185147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:35.191707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:35.213303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2605/5183] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:36.245103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:36.248423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:36.279732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03d306-5046-4fae-b8c7-ee882165a1e2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:36.285881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:36.287356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:36.293089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:36.293089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] PATH_INFO: `/v3/projects/e098375f7ed940209832dabbd942c924` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:36.293089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e098375f7ed940209832dabbd942c924)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:36.293089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:36.566949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e098375f7ed940209832dabbd942c924', 'request_id': 'req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:36.575887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e098375f7ed940209832dabbd942c924', 'request_id': 'req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:36.603537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e098375f7ed940209832dabbd942c924', 'request_id': 'req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:36.790707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] The token cache is being invalidate because project e098375f7ed940209832dabbd942c924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:36.791790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:36.794089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:36.799045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2579/5184] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:36 2022] DELETE /identity/v3/projects/e098375f7ed940209832dabbd942c924 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:36.804305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:36.818469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44a449-2584-4940-8bae-8034a9a0f2a3 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:36.922919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:36.924873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:36.925279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:36.926707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] PATH_INFO: `/v3/users/280fbc48621242359c2286a87f82f68a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:36.931271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280fbc48621242359c2286a87f82f68a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:36.934967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:36.965509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:37.173559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280fbc48621242359c2286a87f82f68a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:37.197994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280fbc48621242359c2286a87f82f68a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:37.202863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280fbc48621242359c2286a87f82f68a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:37.202863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280fbc48621242359c2286a87f82f68a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:37.218142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280fbc48621242359c2286a87f82f68a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:37.326259 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2606/5185] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:36 2022] DELETE /identity/v3/users/280fbc48621242359c2286a87f82f68a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:37.583035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:38.280597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:38.282739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:38.314051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b11cd-3ea4-4174-b8ad-73c0810c8bf6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:38.417852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:38.419089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:38.419787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:38.420296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] PATH_INFO: `/v3/projects/c8c445f289e0475b975ee81421966597` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:38.421833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c445f289e0475b975ee81421966597)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:38.424257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:38.495415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:38.546410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c445f289e0475b975ee81421966597', 'request_id': 'req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:38.554294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c445f289e0475b975ee81421966597', 'request_id': 'req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:38.565773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c445f289e0475b975ee81421966597', 'request_id': 'req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:38.682576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] The token cache is being invalidate because project c8c445f289e0475b975ee81421966597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:38.682954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:38.683651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:38.690562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:38.691805 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2580/5186] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:38 2022] DELETE /identity/v3/projects/c8c445f289e0475b975ee81421966597 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:38.692935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:38.709660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fec796-13dd-4beb-b254-903c7847b9f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:38.791745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:38.793496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:38.794019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:38.794308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] PATH_INFO: `/v3/users/5ed11ee70f8f40279981f72cc85be0de` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:38.795622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed11ee70f8f40279981f72cc85be0de)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:38.797579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:39.677856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed11ee70f8f40279981f72cc85be0de'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:39.687453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed11ee70f8f40279981f72cc85be0de'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:39.691536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed11ee70f8f40279981f72cc85be0de'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:39.691536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed11ee70f8f40279981f72cc85be0de'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:39.707490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-de84dcc7-a0b7-40be-b733-1aa7c87af413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed11ee70f8f40279981f72cc85be0de'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:39.975531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2607/5187] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:38 2022] DELETE /identity/v3/users/5ed11ee70f8f40279981f72cc85be0de => generated 0 bytes in 1285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:40.568878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:40.570314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:40.597121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf427ac-a18c-446e-9fd4-cb42aab0cc10 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:40.660149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:40.681022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:40.687912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:40.687912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:40.687912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] PATH_INFO: `/v3/projects/91fd265efdb94af5b8a03f6d4fbabed1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:40.687912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fd265efdb94af5b8a03f6d4fbabed1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:40.687912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:40.831388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fd265efdb94af5b8a03f6d4fbabed1', 'request_id': 'req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:40.832221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fd265efdb94af5b8a03f6d4fbabed1', 'request_id': 'req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:40.837836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fd265efdb94af5b8a03f6d4fbabed1', 'request_id': 'req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:40.917971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] The token cache is being invalidate because project 91fd265efdb94af5b8a03f6d4fbabed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:40.918319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:40.918966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-caf11ce7-2aee-40c8-9955-4c5bcad3e47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:40.920747 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2581/5188] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:40 2022] DELETE /identity/v3/projects/91fd265efdb94af5b8a03f6d4fbabed1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:40.927459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:40.928403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:40.928980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:40.954841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:40.956149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:41.031225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2608/5189] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:41.040503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.041011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.041208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.047771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:41.075906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:41.077987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:41.086891 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2582/5190] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:41.094062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.109279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024bbb9-ae80-4a79-a092-caf164e12603 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:41.127116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:41.127887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.128252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.128628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.129383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:06:41.129784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:41.131684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:41.148140 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2609/5191] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:06:41.152736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.162697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0d5d9-9427-4785-a588-f441001b8390 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:41.169805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:41.174354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.174354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.174354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.174354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:41.176273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:41.192842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:41.270774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2583/5192] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:06:41 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:06:41.277469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.310330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b376-3914-4806-8dc0-cbf05166bdc9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:41.422283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:41.426137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.426137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.426137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.426137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:41.427380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:41.541409 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2610/5193] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:06:41 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:41.545964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.560070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781633-7736-4453-866b-96600f8e8b03 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:41.566175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:41.568430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.568430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.568430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.568430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:41.569946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:41.585484 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2584/5194] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:06:41.586525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.613992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda57a7-7c19-4b76-9392-af41cfb06bfd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:41.630489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae593e17-8922-42e4-9d0e-cd8e048babd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:41.631256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae593e17-8922-42e4-9d0e-cd8e048babd4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.631542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae593e17-8922-42e4-9d0e-cd8e048babd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.631819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae593e17-8922-42e4-9d0e-cd8e048babd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.632731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae593e17-8922-42e4-9d0e-cd8e048babd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:41.634381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae593e17-8922-42e4-9d0e-cd8e048babd4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:41.655260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.656281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2611/5195] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:41.693446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411aff3-c8f6-4aaf-a48c-167bd6919e27 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:41.699350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:41.700034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.700323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.700605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] PATH_INFO: `/v3/projects/e5ff4f14a2994086851c71da817aed19/users/d8d83a8fa74f4b1885f6162b084b4f20/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.719063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ff4f14a2994086851c71da817aed19, user_id=d8d83a8fa74f4b1885f6162b084b4f20, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:41.721505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:41.810133 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2585/5196] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:06:41 2022] PUT /identity/v3/projects/e5ff4f14a2994086851c71da817aed19/users/d8d83a8fa74f4b1885f6162b084b4f20/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:41.827616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:41.828048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:41.828589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:41.877631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:41.889180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] MFA Rules not processed for user `d8d83a8fa74f4b1885f6162b084b4f20`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:41.890508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:41.989570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:41.990102 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2612/5197] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:42.085496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310416cb-a081-4c97-b30a-9cab02782b41 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:42.095715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:42.096359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.096650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.096926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.097574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:42.099947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:42.109546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:42.204500 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2586/5198] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:06:41 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:42.205658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:42.218125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b59f-7f87-4157-b4f1-a97f18ddbfa3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:42.287356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:42.288324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.288465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.288789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.289410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:42.291425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:42.393492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2613/5199] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:06:42 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:06:42.394513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:42.407732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dce211-1256-4e82-911b-d1bb812e13b3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:42.417672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:42.419177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.420013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.421361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.422450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:42.425794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:42.470602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:42.471856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2587/5200] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:06:42.490183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b4fb7-e1bc-4fea-901c-13df423dcd57 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:42.496485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:42.497726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.498326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.498835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] PATH_INFO: `/v3/projects/0b8f7fe53ad8470babe509d314d351b5/users/63136b1c51c14c1c95777e48aa888035/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.520767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8f7fe53ad8470babe509d314d351b5, user_id=63136b1c51c14c1c95777e48aa888035, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:42.524244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:42.659366 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2614/5201] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:06:42 2022] PUT /identity/v3/projects/0b8f7fe53ad8470babe509d314d351b5/users/63136b1c51c14c1c95777e48aa888035/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:42.663370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:42.672779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:42.676571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f300d-50a2-4f7f-ae2e-d4d7e8d2a139 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:42.737678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811b16-57cf-4a3d-b17a-537c088a6ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:42.738200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811b16-57cf-4a3d-b17a-537c088a6ebb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.738526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811b16-57cf-4a3d-b17a-537c088a6ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.740148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811b16-57cf-4a3d-b17a-537c088a6ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.744089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811b16-57cf-4a3d-b17a-537c088a6ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:42.744089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811b16-57cf-4a3d-b17a-537c088a6ebb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:42.756822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2588/5202] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:06:42.763770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:42.775319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5892d-ece2-478d-babd-871b95d7af34 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:42.781567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:42.782237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.782525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.783081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] PATH_INFO: `/v3/projects/0b8f7fe53ad8470babe509d314d351b5/users/63136b1c51c14c1c95777e48aa888035/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.789571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8f7fe53ad8470babe509d314d351b5, user_id=63136b1c51c14c1c95777e48aa888035, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:42.792357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:42.804253 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2615/5203] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:06:42 2022] PUT /identity/v3/projects/0b8f7fe53ad8470babe509d314d351b5/users/63136b1c51c14c1c95777e48aa888035/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:42.818539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dd354-c1f6-4da4-a9a7-f183a6b6bfb4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:42.818539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dd354-c1f6-4da4-a9a7-f183a6b6bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:42.818539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dd354-c1f6-4da4-a9a7-f183a6b6bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:42.849683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-833dd354-c1f6-4da4-a9a7-f183a6b6bfb4 None None] MFA Rules not processed for user `63136b1c51c14c1c95777e48aa888035`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:42.850436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-833dd354-c1f6-4da4-a9a7-f183a6b6bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:42.961932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2589/5204] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:42.974392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:42.976062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:43.054223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dacff5-3230-417c-a9c0-79c214d2fea9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:43.060667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:43.061450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:43.061840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:43.062341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:43.127575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:43.129305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:43.139671 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2616/5205] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:06:43.626241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:43.689053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:45.380121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:45.494705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:45.982537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d730e-8dd9-49f8-8204-3270f8fc249d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:45.982833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d730e-8dd9-49f8-8204-3270f8fc249d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:45.984617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d730e-8dd9-49f8-8204-3270f8fc249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:46.015540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-813d730e-8dd9-49f8-8204-3270f8fc249d None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:46.016798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-813d730e-8dd9-49f8-8204-3270f8fc249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:46.149279 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2590/5206] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:46.165927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:46.167891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:46.301702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1302-486d-4dbe-b765-bd6011069ad6 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:46.308033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:46.310268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:46.310268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:46.310268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:46.319548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:46.321304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:46.341262 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2617/5207] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:06:47.071858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:47.643335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:47.905942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:48.391889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:48.637446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:48.807933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:48.843225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:48.957452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:49.352190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:49.477856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:49.853099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:49.877247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.071478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.163218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.334893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.535394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.670638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:50.951841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:51.201588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:51.522963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:51.718426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:51.887170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:51.978255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8332-d1d3-4595-96eb-011a0dd30199 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:51.978850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8332-d1d3-4595-96eb-011a0dd30199 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:51.979276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8332-d1d3-4595-96eb-011a0dd30199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:52.000631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-18ac8332-d1d3-4595-96eb-011a0dd30199 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:52.002516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-18ac8332-d1d3-4595-96eb-011a0dd30199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:52.013337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2591/5208] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:52.031319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:52.045884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c1f71-d62e-4883-84ca-34cdc2fe8615 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:52.066148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:52.066707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:52.066991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:52.067325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:52.078712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:52.080486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:52.088845 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2618/5209] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:06:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:06:52.366809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580c226-0655-4120-a5a4-1e46afbc3174 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:52.367370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580c226-0655-4120-a5a4-1e46afbc3174 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:52.367370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580c226-0655-4120-a5a4-1e46afbc3174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:52.395804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c580c226-0655-4120-a5a4-1e46afbc3174 None None] MFA Rules not processed for user `e94103c4c75b4f2d8b2cb1bd4b6bcf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:52.397447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c580c226-0655-4120-a5a4-1e46afbc3174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:52.483410 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2592/5210] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:06:52.541757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:52.668022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:53.009201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:53.129079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:53.688032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:53.757794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:54.807788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:55.014358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:55.053992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:55.138664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a713341-14cc-4266-8be5-15ae84c7a6a5 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:55.143819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:55.144800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:55.145244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:55.145841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] PATH_INFO: `/v3/users/d8d83a8fa74f4b1885f6162b084b4f20` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:55.150532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d83a8fa74f4b1885f6162b084b4f20)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:55.150532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:55.406640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d83a8fa74f4b1885f6162b084b4f20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:55.416971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d83a8fa74f4b1885f6162b084b4f20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:55.418008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d83a8fa74f4b1885f6162b084b4f20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:55.418808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d83a8fa74f4b1885f6162b084b4f20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:55.437443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d83a8fa74f4b1885f6162b084b4f20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:55.793412 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2619/5211] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:55 2022] DELETE /identity/v3/users/d8d83a8fa74f4b1885f6162b084b4f20 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:55.798059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a57743-e451-4c50-b21c-fabee150858a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:55.798583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a57743-e451-4c50-b21c-fabee150858a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:55.798866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a57743-e451-4c50-b21c-fabee150858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:55.820510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-26a57743-e451-4c50-b21c-fabee150858a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:55.822431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26a57743-e451-4c50-b21c-fabee150858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:55.950254 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2593/5212] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:55.959681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:55.961433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:56.102625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9618-7f8e-4628-9cb3-397d8c940dce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:56.109746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:56.111636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:56.111636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:56.111636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:56.111980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:56.131490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:56.131490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:56.161642 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2620/5213] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:06:56.947257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a57743-e451-4c50-b21c-fabee150858a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:56.949836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26a57743-e451-4c50-b21c-fabee150858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:56.966119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a57743-e451-4c50-b21c-fabee150858a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:56.972340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:56.973935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:56.974386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:56.974824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] PATH_INFO: `/v3/projects/e5ff4f14a2994086851c71da817aed19` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:56.976227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ff4f14a2994086851c71da817aed19)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:56.978399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:57.204437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:57.253996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ff4f14a2994086851c71da817aed19', 'request_id': 'req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.262099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ff4f14a2994086851c71da817aed19', 'request_id': 'req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.268607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ff4f14a2994086851c71da817aed19', 'request_id': 'req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.437536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] The token cache is being invalidate because project e5ff4f14a2994086851c71da817aed19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:57.437969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.442371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.446565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2594/5214] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:56 2022] DELETE /identity/v3/projects/e5ff4f14a2994086851c71da817aed19 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:06:57.451152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:57.456180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:57.463411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65a5b-d2ba-4a1c-97b2-2c97a2f4303c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:57.574724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:57.576441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:57.576925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:57.577376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] PATH_INFO: `/v3/users/63136b1c51c14c1c95777e48aa888035` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:57.579129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63136b1c51c14c1c95777e48aa888035)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:57.581521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:57.929784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63136b1c51c14c1c95777e48aa888035'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.960232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63136b1c51c14c1c95777e48aa888035'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.966294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63136b1c51c14c1c95777e48aa888035'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:57.967249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63136b1c51c14c1c95777e48aa888035'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:58.003626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6bb7c275-851f-436e-94c9-1977fc517460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63136b1c51c14c1c95777e48aa888035'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:58.192646 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2621/5215] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:06:57 2022] DELETE /identity/v3/users/63136b1c51c14c1c95777e48aa888035 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:59.013483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:59.013483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:59.032077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba061-39d4-4a9f-bfcc-b0cc22ec5b80 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:59.132036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:06:59.145710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:59.147207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:59.147460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:59.147743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] PATH_INFO: `/v3/projects/0b8f7fe53ad8470babe509d314d351b5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:59.148899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8f7fe53ad8470babe509d314d351b5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:59.151100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:59.352004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8f7fe53ad8470babe509d314d351b5', 'request_id': 'req-18a11272-8e49-487c-a202-8d3b44efa0d3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:59.372754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8f7fe53ad8470babe509d314d351b5', 'request_id': 'req-18a11272-8e49-487c-a202-8d3b44efa0d3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:59.389152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8f7fe53ad8470babe509d314d351b5', 'request_id': 'req-18a11272-8e49-487c-a202-8d3b44efa0d3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:59.483629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] The token cache is being invalidate because project 0b8f7fe53ad8470babe509d314d351b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:06:59.484339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:59.486449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-18a11272-8e49-487c-a202-8d3b44efa0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:06:59.488579 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2595/5216] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:06:59 2022] DELETE /identity/v3/projects/0b8f7fe53ad8470babe509d314d351b5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:06:59.495270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:59.495782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:59.498635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:59.581187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:59.583388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:59.695044 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2622/5217] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:59.703873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:59.704626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:59.705082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:59.727639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:06:59.728990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:06:59.739846 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2596/5218] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:06:59.744541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:59.756324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90c0c-76bd-4cde-a2cb-8e4e083a2559 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:59.764895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:59.765612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:59.765972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:59.766254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:59.767161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:06:59.767594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:59.769531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:59.784325 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2623/5219] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:06:59.789238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:06:59.801031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084828a-62fa-48f4-b6c0-0d06157a7a54 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:06:59.807315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:06:59.808035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:06:59.808370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:06:59.808652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:06:59.809301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:06:59.811625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:06:59.999897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:00.053444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2597/5220] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:06:59 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:00.056836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:00.080489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4321f-484a-4962-8fa2-38581104213b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:00.087211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:00.277800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:00.278443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:00.278731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:00.279031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:00.279825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:00.281855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:00.441340 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2624/5221] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:00 2022] POST /identity/v3/users => generated 286 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:00.445832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:00.462378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692cdef-5a03-4506-ae7f-114d1976304d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:00.474407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:00.475500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:00.475892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:00.476273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:00.477583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:00.480539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:00.494486 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2598/5222] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:00.498682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:00.516514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749f14-57e8-404f-a247-fa90f9603204 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:00.531419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0017c-8303-4a81-9013-7b38f092927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:00.532593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0017c-8303-4a81-9013-7b38f092927e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:00.532975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0017c-8303-4a81-9013-7b38f092927e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:00.533736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0017c-8303-4a81-9013-7b38f092927e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:00.534620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0017c-8303-4a81-9013-7b38f092927e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:00.536727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0017c-8303-4a81-9013-7b38f092927e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:00.552136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2625/5223] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:00.556898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:00.575510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f1ea-9cdb-4a7a-83a6-3b1660572c7e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:00.582611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:00.583883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:00.584590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:00.585227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] PATH_INFO: `/v3/projects/534a6b8f7bb04d4e9e3493388bd1d86e/users/86e756626ac4446e907deba71a0ebeb2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:00.609339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534a6b8f7bb04d4e9e3493388bd1d86e, user_id=86e756626ac4446e907deba71a0ebeb2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:00.612877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:00.718269 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2599/5224] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:00 2022] PUT /identity/v3/projects/534a6b8f7bb04d4e9e3493388bd1d86e/users/86e756626ac4446e907deba71a0ebeb2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:00.723941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defa4c8-88d9-4e47-8a38-0be0a9b3a10c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:00.724365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defa4c8-88d9-4e47-8a38-0be0a9b3a10c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:00.724744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defa4c8-88d9-4e47-8a38-0be0a9b3a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:00.749346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9defa4c8-88d9-4e47-8a38-0be0a9b3a10c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:00.751163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9defa4c8-88d9-4e47-8a38-0be0a9b3a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:00.863119 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2626/5225] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:00.873484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:00.876169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:00.973916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac764c8-8bc9-4a96-aaf4-3d10c9558f41 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:00.977924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:00.978655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:00.979034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:00.980235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:00.996555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:00.998474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:01.012276 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2600/5226] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:03.804088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:03.805076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:03.805557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:03.847782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] MFA Rules not processed for user `86e756626ac4446e907deba71a0ebeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:03.849318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:03.939297 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2627/5227] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:03.954226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:03.956972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:04.015400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:04.058995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529a61c-308d-4d82-8982-e15f6ea5b7bf service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:04.063641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d5caa-9789-4f64-b598-d4dc54141f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:04.064490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d5caa-9789-4f64-b598-d4dc54141f66 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:04.065077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d5caa-9789-4f64-b598-d4dc54141f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:04.065531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d5caa-9789-4f64-b598-d4dc54141f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:04.076729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d5caa-9789-4f64-b598-d4dc54141f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:04.078514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d5caa-9789-4f64-b598-d4dc54141f66 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:04.110526 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2601/5228] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:07:07.107083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:07.108565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:07.123372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52922c3-3308-4f32-b21c-c3239a72ae9f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:07.128255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:07.131182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:07.131182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:07.131182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] PATH_INFO: `/v3/users/d0db5bafa61d44b981696fdae685d811` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:07.133462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0db5bafa61d44b981696fdae685d811)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:07.135602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:07.150401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:07.222708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:07.223285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:07.223358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:07.245114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] MFA Rules not processed for user `86e756626ac4446e907deba71a0ebeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:07.246403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:07.259420 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2602/5229] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:07.379681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0db5bafa61d44b981696fdae685d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:07.389222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0db5bafa61d44b981696fdae685d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:07.390181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0db5bafa61d44b981696fdae685d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:07.390807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0db5bafa61d44b981696fdae685d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:07.406029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bdc7f4fe-764d-4666-92b7-dac3f53eb5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0db5bafa61d44b981696fdae685d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:07.507342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2628/5230] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:07 2022] DELETE /identity/v3/users/d0db5bafa61d44b981696fdae685d811 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:07.838319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:07.854538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ed52e-15c8-42c2-9dfa-99f95a5209bc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:07.921383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:07.922067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:07.922525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:07.922836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] PATH_INFO: `/v3/projects/3ae9ee2e2f5d439786309f06030582b9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:07.924300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae9ee2e2f5d439786309f06030582b9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:07.926233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:08.067316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae9ee2e2f5d439786309f06030582b9', 'request_id': 'req-4f4f2229-22ea-40ff-a431-8328d1780364'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:08.074520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae9ee2e2f5d439786309f06030582b9', 'request_id': 'req-4f4f2229-22ea-40ff-a431-8328d1780364'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:08.084487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae9ee2e2f5d439786309f06030582b9', 'request_id': 'req-4f4f2229-22ea-40ff-a431-8328d1780364'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:08.165014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] The token cache is being invalidate because project 3ae9ee2e2f5d439786309f06030582b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:08.165129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:08.165783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f4f2229-22ea-40ff-a431-8328d1780364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:08.171927 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2603/5231] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:07 2022] DELETE /identity/v3/projects/3ae9ee2e2f5d439786309f06030582b9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:08.173834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.174282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.174467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.196500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:08.199098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:08.292824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2629/5232] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:08.301104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.301590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.301794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.322636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:08.324168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:08.332539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2604/5233] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:08.336981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:08.347944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b5bc6-9db8-4afb-a7cd-42a3e957a155 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:08.355470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:08.355470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.355470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.355701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.356317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:08.356782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:08.358800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:08.389118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2630/5234] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:08.399969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:08.413826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550573-a77b-45cc-a65f-0766896e122d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:08.419650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:08.420318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.420630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.420881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.421518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:08.424554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:08.572068 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2605/5235] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:08 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:08.576280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:08.586847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb89b8-a572-4c3d-ab23-1dee3af3778a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:08.648326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:08.648967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.649248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.649694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.650347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:08.652815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:08.791466 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2631/5236] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:08 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:08.796016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:08.808061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0f9fd-27db-451a-ac52-6118c8123ab2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:08.826494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:08.827413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.827788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.828031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.828689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:08.830387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:08.842847 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2606/5237] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:08.846771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:08.861092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a4862-0bda-45cf-9355-98b9a2e76024 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:08.870157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f932fb3-aef1-4cb4-a8f6-4939152a789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:08.871001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f932fb3-aef1-4cb4-a8f6-4939152a789a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.871422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f932fb3-aef1-4cb4-a8f6-4939152a789a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.871791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f932fb3-aef1-4cb4-a8f6-4939152a789a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.872666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f932fb3-aef1-4cb4-a8f6-4939152a789a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:08.874492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f932fb3-aef1-4cb4-a8f6-4939152a789a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:08.879434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:08.913831 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2632/5238] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:08.917830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:08.932133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae19a67-795f-460b-b92a-011f2cd971ac admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:08.937400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:08.938178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:08.938465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:08.938747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] PATH_INFO: `/v3/projects/e2f1118744894767a4ab5c9bddc8e5fb/users/2b51397c5872403c86210c2dc7f85735/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:08.954344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:08.967206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f1118744894767a4ab5c9bddc8e5fb, user_id=2b51397c5872403c86210c2dc7f85735, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:08.970565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:09.060592 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2607/5239] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:08 2022] PUT /identity/v3/projects/e2f1118744894767a4ab5c9bddc8e5fb/users/2b51397c5872403c86210c2dc7f85735/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:09.065911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:09.066203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:09.066473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:09.086454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:09.087685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:09.155108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2633/5240] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:09.171533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:09.173246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:09.237535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10eb80-f40b-4e62-bca0-5c53b1f264a3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:09.241265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39635e4d-4f73-47f1-9a5d-4ae925bc0f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:09.241870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635e4d-4f73-47f1-9a5d-4ae925bc0f6a service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:09.242161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635e4d-4f73-47f1-9a5d-4ae925bc0f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:09.242441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39635e4d-4f73-47f1-9a5d-4ae925bc0f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:09.251974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635e4d-4f73-47f1-9a5d-4ae925bc0f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:09.253409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39635e4d-4f73-47f1-9a5d-4ae925bc0f6a service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:09.263835 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2608/5241] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:14.184012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:14.185879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:14.216980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5b02-4e4a-4d07-b47a-1c6d703d8492 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:14.227559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:14.229286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:14.229667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:14.229951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] PATH_INFO: `/v3/users/6ec3877b92b943dc85a7f656b4db93ca` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:14.234636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec3877b92b943dc85a7f656b4db93ca)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:14.236767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:14.488855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec3877b92b943dc85a7f656b4db93ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:14.498314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec3877b92b943dc85a7f656b4db93ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:14.499951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec3877b92b943dc85a7f656b4db93ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:14.501239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec3877b92b943dc85a7f656b4db93ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:14.532840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec3877b92b943dc85a7f656b4db93ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:14.688736 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2634/5242] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:14 2022] DELETE /identity/v3/users/6ec3877b92b943dc85a7f656b4db93ca => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:14.694717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:14.696003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:14.696959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:14.733732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:14.735552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:14.841090 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2609/5243] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:14.858644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:14.860600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:14.952744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06e769-11a5-471f-a571-c2cd94dffa27 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:14.957133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ced590-38e5-451a-8595-49e2495023bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:14.958306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ced590-38e5-451a-8595-49e2495023bd service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:14.958688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ced590-38e5-451a-8595-49e2495023bd service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:14.958977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ced590-38e5-451a-8595-49e2495023bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:14.970835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ced590-38e5-451a-8595-49e2495023bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:14.972765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ced590-38e5-451a-8595-49e2495023bd service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:14.984822 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2635/5244] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:16.013652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:16.015595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:16.029183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289db4bc-3861-4522-9894-bfa772fe48e2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:16.034114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:16.034789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.035100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.035378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] PATH_INFO: `/v3/projects/dc50b9ebed5448079b548f6087330aa6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.036678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc50b9ebed5448079b548f6087330aa6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:16.038700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:16.174406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc50b9ebed5448079b548f6087330aa6', 'request_id': 'req-a8ecedfe-44d1-4dc5-a3c6-163affc51654'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:16.181970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc50b9ebed5448079b548f6087330aa6', 'request_id': 'req-a8ecedfe-44d1-4dc5-a3c6-163affc51654'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:16.192013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc50b9ebed5448079b548f6087330aa6', 'request_id': 'req-a8ecedfe-44d1-4dc5-a3c6-163affc51654'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:16.305479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] The token cache is being invalidate because project dc50b9ebed5448079b548f6087330aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:16.306235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:16.308211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8ecedfe-44d1-4dc5-a3c6-163affc51654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:16.315261 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2610/5245] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:16 2022] DELETE /identity/v3/projects/dc50b9ebed5448079b548f6087330aa6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:16.316053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.316520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.316605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.341514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:16.342808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:16.350368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:16.421900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2636/5246] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:16.431389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.432115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.432825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.470534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:16.471803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:16.481658 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2611/5247] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:16.485936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:16.497101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d61ac-36e8-4839-9149-ab5ac8c8c157 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:16.502752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:16.503487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.503881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.504285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.505195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:16.505959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:16.507697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:16.526829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2637/5248] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:16.527994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:16.540882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4542a29-ac3b-4fc9-b39f-4dea1b08c931 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:16.546333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:16.547996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.548394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.548833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.550059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:16.552894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:16.561564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:16.694670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:16.696256 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2612/5249] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:16 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:16.707947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67cba-8c22-45b7-b925-0b086bc10af0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:16.796802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:16.797803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.798289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.798815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.799739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:16.803115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:16.912621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2638/5250] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:16 2022] POST /identity/v3/users => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:16.917372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:16.928459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c43a7-2f01-45e9-bbfd-dbe322e9f699 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:16.934017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:16.965101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:16.966841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:16.966841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:16.967112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:16.969479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:16.992894 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2613/5251] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:16.996894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:17.013056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79014-e168-47ce-acf8-767f24682d6d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:17.022900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207b24e-a4d4-4d74-b65d-c165ee7328b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:17.023677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b24e-a4d4-4d74-b65d-c165ee7328b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:17.024015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b24e-a4d4-4d74-b65d-c165ee7328b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:17.024295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b24e-a4d4-4d74-b65d-c165ee7328b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:17.025118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207b24e-a4d4-4d74-b65d-c165ee7328b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:17.028927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207b24e-a4d4-4d74-b65d-c165ee7328b2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:17.058498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2639/5252] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:17.059624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:17.071378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92687-26ea-4985-9361-9c86875dfaf4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:17.081440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:17.082331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:17.082620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:17.082906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] PATH_INFO: `/v3/projects/70b39afb9f3740db8df9b5adcb1db3ef/users/61ae12487ae74af897b7274a7d0a3209/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:17.108715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b39afb9f3740db8df9b5adcb1db3ef, user_id=61ae12487ae74af897b7274a7d0a3209, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:17.111525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:17.219588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2614/5253] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:17 2022] PUT /identity/v3/projects/70b39afb9f3740db8df9b5adcb1db3ef/users/61ae12487ae74af897b7274a7d0a3209/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:17.229894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7691e-dceb-4869-8efa-4aaccdc8a11d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:17.230317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7691e-dceb-4869-8efa-4aaccdc8a11d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:17.230692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7691e-dceb-4869-8efa-4aaccdc8a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:17.281797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3eb7691e-dceb-4869-8efa-4aaccdc8a11d None None] MFA Rules not processed for user `61ae12487ae74af897b7274a7d0a3209`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:17.282890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3eb7691e-dceb-4869-8efa-4aaccdc8a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:17.388950 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2640/5254] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:17.401090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:17.528105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb13589-c83b-4fd0-9416-edf8cf519d8c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:17.534996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:17.536000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:17.536458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:17.536756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] PATH_INFO: `/v3/users/61ae12487ae74af897b7274a7d0a3209` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:17.538199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ae12487ae74af897b7274a7d0a3209)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:17.540432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:17.897183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ae12487ae74af897b7274a7d0a3209'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:17.918207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ae12487ae74af897b7274a7d0a3209'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:17.919407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ae12487ae74af897b7274a7d0a3209'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:17.941168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ae12487ae74af897b7274a7d0a3209'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:17.942026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e3f84d3e-67ca-481e-bd06-678a30395fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ae12487ae74af897b7274a7d0a3209'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:17.972765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795c611-1482-49f3-8680-323f59c10014 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:17.973059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795c611-1482-49f3-8680-323f59c10014 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:17.973343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795c611-1482-49f3-8680-323f59c10014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:18.005251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2795c611-1482-49f3-8680-323f59c10014 None None] MFA Rules not processed for user `2b51397c5872403c86210c2dc7f85735`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:18.006759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2795c611-1482-49f3-8680-323f59c10014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:18.030639 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2615/5255] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:17 2022] DELETE /identity/v3/users/61ae12487ae74af897b7274a7d0a3209 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:18.035726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:18.035910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:18.036264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:18.058012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:18.063393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:18.104429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2641/5256] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:18.114836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:18.115287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:18.115443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:18.142413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] MFA Rules not processed for user `2b51397c5872403c86210c2dc7f85735`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:18.142413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:18.145797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2616/5257] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:18.152082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:18.153530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:18.231535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2642/5258] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:18.241313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974d61-0ceb-4906-9f2e-a34aca50fbb9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:18.243862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:18.245527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:18.245677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:18.246179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:18.247388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:18.247388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:18.259356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:18.261146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:18.271785 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2617/5259] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:18.333131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54173723-c1ee-4332-8a52-d943dae517e3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:18.348518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dff3a-31f5-43f8-adbd-4c7a7e2b61a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:18.349199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dff3a-31f5-43f8-adbd-4c7a7e2b61a6 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:18.349505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dff3a-31f5-43f8-adbd-4c7a7e2b61a6 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:18.349931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dff3a-31f5-43f8-adbd-4c7a7e2b61a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:18.359967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dff3a-31f5-43f8-adbd-4c7a7e2b61a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:18.361656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dff3a-31f5-43f8-adbd-4c7a7e2b61a6 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:18.371821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2643/5260] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:18.460001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:18.738550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:18.741641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:18.742847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:18.785263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1326c3-63aa-473e-b1eb-8abe27406bcc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:18.792963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:18.797308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:18.797308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:18.797308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] PATH_INFO: `/v3/projects/70b39afb9f3740db8df9b5adcb1db3ef` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:18.797308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b39afb9f3740db8df9b5adcb1db3ef)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:18.797604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:18.933525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b39afb9f3740db8df9b5adcb1db3ef', 'request_id': 'req-cda02f88-36cd-4e9b-9527-cb9e25c2565b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:18.940548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b39afb9f3740db8df9b5adcb1db3ef', 'request_id': 'req-cda02f88-36cd-4e9b-9527-cb9e25c2565b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:18.946812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b39afb9f3740db8df9b5adcb1db3ef', 'request_id': 'req-cda02f88-36cd-4e9b-9527-cb9e25c2565b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:19.060064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] The token cache is being invalidate because project 70b39afb9f3740db8df9b5adcb1db3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:19.060459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:19.061178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cda02f88-36cd-4e9b-9527-cb9e25c2565b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:19.063408 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2618/5261] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:18 2022] DELETE /identity/v3/projects/70b39afb9f3740db8df9b5adcb1db3ef => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:19.068488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.069029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.069461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.095107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:19.095107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:19.195384 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2644/5262] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:19.204828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.205249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.205625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.231250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:19.232798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:19.241914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2619/5263] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:19.246900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:19.257902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d84ed-1656-45de-85a8-25eefe9c6cd7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:19.271899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:19.274332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.274454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.278496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.280691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:19.281010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:19.282768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:19.316906 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2645/5264] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:07:19.321664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:19.333318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a5088-23fc-4195-882f-a783a85e9d92 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:19.345727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:19.346951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.348302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.348680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.349503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:19.351978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:19.506019 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2620/5265] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:19 2022] POST /identity/v3/projects => generated 359 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:19.506768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:19.518950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d34b92-e849-4cf9-8324-1dda77997129 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:19.673302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:19.673566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.673869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.674189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.675207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:19.679559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:19.830310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2646/5266] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:19 2022] POST /identity/v3/users => generated 280 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:19.834016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:19.860163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d8dd4-80d2-479f-8f1c-9f802c728da4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:19.895477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:19.898043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.898335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.898614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.901087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:19.904418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:19.929811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:19.957226 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2621/5267] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:19.957358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d7ae7-7c8b-4537-967d-a36545206d45 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:19.967755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84423df0-a2e2-4c66-8e42-9b84ff7e3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:19.968383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423df0-a2e2-4c66-8e42-9b84ff7e3024 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:19.968668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423df0-a2e2-4c66-8e42-9b84ff7e3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:19.968944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423df0-a2e2-4c66-8e42-9b84ff7e3024 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:19.969599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423df0-a2e2-4c66-8e42-9b84ff7e3024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:19.971254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423df0-a2e2-4c66-8e42-9b84ff7e3024 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:19.995200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2647/5268] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:19.996775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:20.007881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14d14-f8ca-424b-99df-d575f3afdc14 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:20.013160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bb988-6db8-4002-82f3-0256587a3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:20.013823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb988-6db8-4002-82f3-0256587a3386 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:20.014106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb988-6db8-4002-82f3-0256587a3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:20.014467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb988-6db8-4002-82f3-0256587a3386 admin admin] PATH_INFO: `/v3/projects/d92a39750a3c408b94f8ad71fa1be0b5/users/222090aa9ebb485b913a00549c7c5963/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:20.029200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:20.033011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb988-6db8-4002-82f3-0256587a3386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92a39750a3c408b94f8ad71fa1be0b5, user_id=222090aa9ebb485b913a00549c7c5963, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:20.035782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb988-6db8-4002-82f3-0256587a3386 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:20.102471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:20.102750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:20.103071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:20.115927 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2622/5269] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:19 2022] PUT /identity/v3/projects/d92a39750a3c408b94f8ad71fa1be0b5/users/222090aa9ebb485b913a00549c7c5963/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:20.126959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:20.127564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:20.128024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:20.129956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:20.131305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:20.175245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] MFA Rules not processed for user `222090aa9ebb485b913a00549c7c5963`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:20.178763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:20.229070 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2648/5270] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:20.247249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:20.248768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:20.296950 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2623/5271] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:20.354509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:20.374958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c816f57-bdc7-4a83-b605-41ff27c7b977 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:20.386412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971af0da-d2ba-42ef-87a2-311c6a6ac4a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:20.387448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af0da-d2ba-42ef-87a2-311c6a6ac4a7 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:20.392089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af0da-d2ba-42ef-87a2-311c6a6ac4a7 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:20.392089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971af0da-d2ba-42ef-87a2-311c6a6ac4a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:20.416150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af0da-d2ba-42ef-87a2-311c6a6ac4a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:20.421645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971af0da-d2ba-42ef-87a2-311c6a6ac4a7 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:20.435123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2649/5272] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:07:20.475850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377a2ff-c167-483a-900c-de8551b16074 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:20.490843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:20.497960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:20.497960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:20.497960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] PATH_INFO: `/v3/users/222090aa9ebb485b913a00549c7c5963` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:20.499180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222090aa9ebb485b913a00549c7c5963)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:20.501685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:20.809726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222090aa9ebb485b913a00549c7c5963'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:20.814809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222090aa9ebb485b913a00549c7c5963'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:20.817906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222090aa9ebb485b913a00549c7c5963'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:20.841542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222090aa9ebb485b913a00549c7c5963'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:20.842896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222090aa9ebb485b913a00549c7c5963'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:21.018313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:21.070846 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2624/5273] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:20 2022] DELETE /identity/v3/users/222090aa9ebb485b913a00549c7c5963 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:21.075547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:21.075843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:21.076131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:21.125111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:21.127170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:21.251476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2650/5274] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:21.262148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:21.263701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:21.349718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070659-f442-403c-a7f5-3219b0433e37 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:21.353773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6808bcf-7f23-4d4b-a7bb-c3cb34606fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:21.354494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808bcf-7f23-4d4b-a7bb-c3cb34606fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:21.354851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808bcf-7f23-4d4b-a7bb-c3cb34606fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:21.355234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808bcf-7f23-4d4b-a7bb-c3cb34606fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:21.366141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6808bcf-7f23-4d4b-a7bb-c3cb34606fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:21.368347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6808bcf-7f23-4d4b-a7bb-c3cb34606fd9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:21.388214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2625/5275] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:21.574125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:22.131385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:22.133225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:22.162714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eebdf-ace0-4ec1-822f-b485fc039ba4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:22.193234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:22.193979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:22.198060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:22.198060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] PATH_INFO: `/v3/projects/d92a39750a3c408b94f8ad71fa1be0b5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:22.199389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92a39750a3c408b94f8ad71fa1be0b5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:22.205847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:22.468977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92a39750a3c408b94f8ad71fa1be0b5', 'request_id': 'req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:22.482425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92a39750a3c408b94f8ad71fa1be0b5', 'request_id': 'req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:22.495575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92a39750a3c408b94f8ad71fa1be0b5', 'request_id': 'req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:22.597484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] The token cache is being invalidate because project d92a39750a3c408b94f8ad71fa1be0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:22.597786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:22.598742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98dde5b2-5d1f-4c80-a37a-f8de8f2bb195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:22.600468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2651/5276] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:22 2022] DELETE /identity/v3/projects/d92a39750a3c408b94f8ad71fa1be0b5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:22.607936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:22.608891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:22.609922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:22.655910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:22.666991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:22.756411 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2626/5277] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:22.765254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:22.765543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:22.765820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:22.788233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:22.789591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:22.803268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2652/5278] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:22.804164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:22.823889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c237a5-f836-42c7-9703-ebe93dcbfd3b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:22.838705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:22.839462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:22.839847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:22.840515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:22.841517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:22.841835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:22.844751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:22.860975 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2627/5279] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:07:22.865645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:22.878625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e50bb7-85f9-4aa3-ad19-e63da8254dc8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:22.884077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:22.885658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:22.886099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:22.886559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:22.892784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:22.892784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:23.011490 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2653/5280] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:22 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:23.016458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:23.030504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbeea3-21ba-463a-9111-13dbac001d4d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:23.155763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:23.157684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:23.158130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:23.158623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:23.159764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:23.167061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:23.335490 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2628/5281] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:23 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:23.340009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:23.353523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523d8af-42d1-4316-a877-1cea26d5a58b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:23.357781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:23.359110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:23.359567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:23.360018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:23.361035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:23.363247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:23.382700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:23.390564 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2654/5282] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:23.396665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c642fa-ed6f-4b15-88b1-64f699a19467 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:23.404565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8af8e-a5aa-4add-9662-37997b3aca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:23.405488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8af8e-a5aa-4add-9662-37997b3aca68 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:23.405923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8af8e-a5aa-4add-9662-37997b3aca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:23.406372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8af8e-a5aa-4add-9662-37997b3aca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:23.407444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8af8e-a5aa-4add-9662-37997b3aca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:23.411299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8af8e-a5aa-4add-9662-37997b3aca68 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:23.437259 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2629/5283] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:23.438791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:23.452743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f62ab-e353-4144-a9cd-70bc4901d4ae admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:23.468214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:23.469150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:23.469569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:23.470032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] PATH_INFO: `/v3/projects/a127c6128ae54385a40f0f3114b53656/users/22c835dc32434f62b29d3b7dfbffcca5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:23.485159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:23.492752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a127c6128ae54385a40f0f3114b53656, user_id=22c835dc32434f62b29d3b7dfbffcca5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:23.496780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:23.634558 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2655/5284] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:23 2022] PUT /identity/v3/projects/a127c6128ae54385a40f0f3114b53656/users/22c835dc32434f62b29d3b7dfbffcca5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:23.646900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:23.647457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:23.647668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:23.723580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] MFA Rules not processed for user `22c835dc32434f62b29d3b7dfbffcca5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:23.725574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:23.878537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2630/5285] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:23.883273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:24.012771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2f9d2-af29-41f1-b18e-f7ee09b325ff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:24.022455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:24.025222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:24.025222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:24.025222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:24.025222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:24.027217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:24.165740 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2656/5286] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:23 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:24.171151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:24.189309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf0bd-b702-4a57-988a-7051d3a2f977 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:24.294565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:24.295592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:24.295943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:24.296299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:24.296972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:24.299336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:24.409265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:24.422711 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2631/5287] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:24 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:24.427341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:24.455463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a445f2f-dc91-46fe-aee1-938fb10fad19 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:24.510974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:24.512541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:24.513033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:24.513752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:24.514758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:24.517987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:24.557576 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2657/5288] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:07:24.558478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:24.571639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b52bca-e073-42b4-bc78-3b9a8bb0b1f2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:24.583799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:24.586106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:24.586512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:24.589103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] PATH_INFO: `/v3/projects/733b1ed7d9aa4041a8b40f3ccea83785/users/11a41a18460e4f9a80d82b7b3125c34b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:24.626043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=733b1ed7d9aa4041a8b40f3ccea83785, user_id=11a41a18460e4f9a80d82b7b3125c34b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:24.628979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:24.712027 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2632/5289] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:24 2022] PUT /identity/v3/projects/733b1ed7d9aa4041a8b40f3ccea83785/users/11a41a18460e4f9a80d82b7b3125c34b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:24.716063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:24.734201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ff0fd-9c2b-4921-9ccf-c1add34eb301 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:24.891823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed98a77-8b78-4891-b0bb-610fb9cff776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:24.892728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed98a77-8b78-4891-b0bb-610fb9cff776 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:24.893174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed98a77-8b78-4891-b0bb-610fb9cff776 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:24.893594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed98a77-8b78-4891-b0bb-610fb9cff776 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:24.894394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed98a77-8b78-4891-b0bb-610fb9cff776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:24.896220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed98a77-8b78-4891-b0bb-610fb9cff776 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:24.924305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:24.924754 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2658/5290] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:07:24.937184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53335894-1145-43d1-a4bf-4fb621dc39ae admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:24.951794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:24.952736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:24.953200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:24.957290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] PATH_INFO: `/v3/projects/733b1ed7d9aa4041a8b40f3ccea83785/users/11a41a18460e4f9a80d82b7b3125c34b/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:24.965408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=733b1ed7d9aa4041a8b40f3ccea83785, user_id=11a41a18460e4f9a80d82b7b3125c34b, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:24.972254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:25.013241 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2633/5291] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:24 2022] PUT /identity/v3/projects/733b1ed7d9aa4041a8b40f3ccea83785/users/11a41a18460e4f9a80d82b7b3125c34b/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:25.023667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:25.023958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:25.024239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:25.083039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] MFA Rules not processed for user `11a41a18460e4f9a80d82b7b3125c34b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:25.084293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:25.237569 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2659/5292] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:25.242495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:25.305142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3867463-7556-43aa-9877-ec66afb3cb6d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:25.334484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:25.334897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:25.338544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:25.343824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:25.343824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:25.343824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:25.556955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:25.567465 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2634/5293] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:25 2022] POST /identity/v3/projects => generated 359 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:25.572549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e41393-6dd0-4baa-8ff1-2adeb1fc35e4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:25.732881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:25.733534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:25.733821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:25.734108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:25.737085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:25.748853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:26.073648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:26.245635 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2660/5294] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:25 2022] POST /identity/v3/users => generated 371 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:26.249381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:26.272678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e319c1-1ef0-4d56-ace4-32b07da7bfc1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:26.288829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:26.289491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:26.289779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:26.290058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/7f690fa258cd4e0787632c5a865aadb0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:26.331735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:get_user(user_id=7f690fa258cd4e0787632c5a865aadb0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:26.334629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:26.341529 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2635/5295] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:07:26 2022] GET /identity/v3/users/7f690fa258cd4e0787632c5a865aadb0 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:26.345545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:26.364703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd2f2-54e4-4a0f-91f6-6099119495cf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:26.372089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:26.377945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:26.377945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:26.377945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/7f690fa258cd4e0787632c5a865aadb0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:26.377945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7f690fa258cd4e0787632c5a865aadb0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:26.377945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:26.649386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f690fa258cd4e0787632c5a865aadb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:26.682141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f690fa258cd4e0787632c5a865aadb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:26.683106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f690fa258cd4e0787632c5a865aadb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:26.686752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f690fa258cd4e0787632c5a865aadb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:26.737384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f690fa258cd4e0787632c5a865aadb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:26.873715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2661/5296] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:26 2022] DELETE /identity/v3/users/7f690fa258cd4e0787632c5a865aadb0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:26.878142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:26.885397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:26.921851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd7c76-728c-4a77-afa9-77e550ba5304 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:27.101299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:27.101964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:27.102254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:27.102537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/4bbf81f854d24948a5e3d1e4bca8bbaf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:27.110144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bbf81f854d24948a5e3d1e4bca8bbaf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:27.115147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:27.408841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bbf81f854d24948a5e3d1e4bca8bbaf', 'request_id': 'req-7b1afb20-90e2-4b27-9670-55eeb7adada1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:27.424305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bbf81f854d24948a5e3d1e4bca8bbaf', 'request_id': 'req-7b1afb20-90e2-4b27-9670-55eeb7adada1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:27.439433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bbf81f854d24948a5e3d1e4bca8bbaf', 'request_id': 'req-7b1afb20-90e2-4b27-9670-55eeb7adada1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:27.563054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] The token cache is being invalidate because project 4bbf81f854d24948a5e3d1e4bca8bbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:27.563726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:27.565574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:27.566513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:27.569529 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2636/5297] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:26 2022] DELETE /identity/v3/projects/4bbf81f854d24948a5e3d1e4bca8bbaf => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:27.574841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:27.608290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317e551-ce1b-4277-b18b-fdb9fdcd08e1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:27.710948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:27.712302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:27.712853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:27.713339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:27.715260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:27.717641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:27.881211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:27.882972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:27.892791 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2662/5298] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:27 2022] POST /identity/v3/projects => generated 360 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:27.911957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1afb20-90e2-4b27-9670-55eeb7adada1 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.018651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.019639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.021104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.021575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.022497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.025084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.031439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:28.161180 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2637/5299] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:27 2022] POST /identity/v3/users => generated 414 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:28.165251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.179978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e29cb-ccfa-40a8-916a-f4f466b88319 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.191727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.192426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.192725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.193013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.193692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.198461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.302784 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2663/5300] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:07:28 2022] POST /identity/v3/roles => generated 239 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:28.304262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.319595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b40a6-15c3-4ca6-b894-8a7736c19269 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.327774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.328967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.329516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.330384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/ca861529e7e34e028072a4709fb61ddd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.362300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:get_user(user_id=ca861529e7e34e028072a4709fb61ddd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.366758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.370894 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2638/5301] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:07:28 2022] GET /identity/v3/users/ca861529e7e34e028072a4709fb61ddd => generated 414 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:28.374682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.390893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a92df-dde3-4957-91b5-839c9be0fe85 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.409392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.410512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.410960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.411436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/roles/b1411461e7c147ef9a24f6fe7c27247e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.421195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:get_role(role_id=b1411461e7c147ef9a24f6fe7c27247e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.422478 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:07:28.422478 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:07:28.422478 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:07:28.424354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.429656 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2664/5302] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:07:28 2022] GET /identity/v3/roles/b1411461e7c147ef9a24f6fe7c27247e => generated 239 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:28.433248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.456422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c2385-0550-4f6b-8808-ff97e3a91231 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.479896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.487140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.487140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.487140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.487140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.491155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.639122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2639/5303] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:28 2022] POST /identity/v3/projects => generated 359 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:28.642757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.664513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73306953-e497-46aa-a4f0-251c759d8316 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.758134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.758797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.759091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.759461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/a8bd6262260c4e309d6f75260305d11e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.760743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:get_project(project_id=a8bd6262260c4e309d6f75260305d11e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.762812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.764515 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2665/5304] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:07:28 2022] GET /identity/v3/projects/a8bd6262260c4e309d6f75260305d11e => generated 359 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:28.769559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.787598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:28.796151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666661-a8a6-40e2-9f90-873a4e6978e6 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:28.805651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:28.805651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:28.806345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:28.806840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/a8bd6262260c4e309d6f75260305d11e/users/ca861529e7e34e028072a4709fb61ddd/roles/b1411461e7c147ef9a24f6fe7c27247e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:28.809733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a8bd6262260c4e309d6f75260305d11e, user_id=ca861529e7e34e028072a4709fb61ddd, role_id=b1411461e7c147ef9a24f6fe7c27247e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:28.814252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:28.939805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:28.940506 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2640/5305] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:28 2022] PUT /identity/v3/projects/a8bd6262260c4e309d6f75260305d11e/users/ca861529e7e34e028072a4709fb61ddd/roles/b1411461e7c147ef9a24f6fe7c27247e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:28.953753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c381-bc44-4c95-b556-42734395bd87 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:29.070964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:29.072497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:29.072996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:29.073474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:29.074435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:29.076880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:29.254082 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2666/5306] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:28 2022] POST /identity/v3/projects => generated 358 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:29.258460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:29.280863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2538b6-ff6c-421b-bb5b-6697628fb791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:29.403892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:29.404567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:29.404885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:29.405147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/e2be84861f204ca387988374e4278b7d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:29.406606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2be84861f204ca387988374e4278b7d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:29.409373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:29.416169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2641/5307] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:07:29 2022] GET /identity/v3/projects/e2be84861f204ca387988374e4278b7d => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:29.419988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:29.443251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc735-9270-4c3c-bdf4-4680364588ac tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:29.460608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:29.461454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:29.461756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:29.462053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/e2be84861f204ca387988374e4278b7d/users/ca861529e7e34e028072a4709fb61ddd/roles/b1411461e7c147ef9a24f6fe7c27247e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:29.467547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e2be84861f204ca387988374e4278b7d, user_id=ca861529e7e34e028072a4709fb61ddd, role_id=b1411461e7c147ef9a24f6fe7c27247e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:29.475764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:29.627774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:29.628697 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2667/5308] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:29 2022] PUT /identity/v3/projects/e2be84861f204ca387988374e4278b7d/users/ca861529e7e34e028072a4709fb61ddd/roles/b1411461e7c147ef9a24f6fe7c27247e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:29.643699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b50edb-3783-47ff-8486-8e67f96c76d7 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:29.783770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:29.784972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:29.787239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:29.789562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/ca861529e7e34e028072a4709fb61ddd/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:29.794375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ca861529e7e34e028072a4709fb61ddd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:29.797091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:29.919347 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2642/5309] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:07:29 2022] GET /identity/v3/users/ca861529e7e34e028072a4709fb61ddd/projects => generated 841 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:29.919643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:29.948327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990c00-b46b-4832-a316-b5b4f9140ee9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:29.967192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:29.967782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:29.968076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:29.968361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/e2be84861f204ca387988374e4278b7d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:29.970057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2be84861f204ca387988374e4278b7d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:29.975394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:30.021439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:30.025520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:30.303580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2be84861f204ca387988374e4278b7d', 'request_id': 'req-6759b824-3e10-40f1-8114-1c089e33e6e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.323799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2be84861f204ca387988374e4278b7d', 'request_id': 'req-6759b824-3e10-40f1-8114-1c089e33e6e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.333092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2be84861f204ca387988374e4278b7d', 'request_id': 'req-6759b824-3e10-40f1-8114-1c089e33e6e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.432728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] The token cache is being invalidate because project e2be84861f204ca387988374e4278b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:30.433133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.442505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.450337 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2668/5310] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:29 2022] DELETE /identity/v3/projects/e2be84861f204ca387988374e4278b7d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:30.460826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:30.475427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:30.515331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6eb2-85d3-4821-a511-88309f36111d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:30.724713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:30.730823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:30.730823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:30.730823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/a8bd6262260c4e309d6f75260305d11e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:30.731684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8bd6262260c4e309d6f75260305d11e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:30.735974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:30.962523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8bd6262260c4e309d6f75260305d11e', 'request_id': 'req-6cd54bf6-c91e-4968-8b16-51e50b791474'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.977548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8bd6262260c4e309d6f75260305d11e', 'request_id': 'req-6cd54bf6-c91e-4968-8b16-51e50b791474'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:30.993187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8bd6262260c4e309d6f75260305d11e', 'request_id': 'req-6cd54bf6-c91e-4968-8b16-51e50b791474'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:31.120310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] The token cache is being invalidate because project a8bd6262260c4e309d6f75260305d11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:31.120988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:31.122280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:31.127159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2643/5311] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:30 2022] DELETE /identity/v3/projects/a8bd6262260c4e309d6f75260305d11e => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:31.128483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:31.143198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759b824-3e10-40f1-8114-1c089e33e6e0 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:31.281227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:31.281227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:31.281227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:31.282105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/roles/b1411461e7c147ef9a24f6fe7c27247e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:31.282105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b1411461e7c147ef9a24f6fe7c27247e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:31.282105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:31.615095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invalidating the token cache because role b1411461e7c147ef9a24f6fe7c27247e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:31.615678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:31.616786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:31.619696 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2669/5312] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:31 2022] DELETE /identity/v3/roles/b1411461e7c147ef9a24f6fe7c27247e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:31.624754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:31.626231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:31.645982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd54bf6-c91e-4968-8b16-51e50b791474 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:31.758516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:31.759231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:31.759520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:31.759799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/ca861529e7e34e028072a4709fb61ddd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:31.762079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ca861529e7e34e028072a4709fb61ddd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:31.764928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:32.016034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca861529e7e34e028072a4709fb61ddd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.035935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca861529e7e34e028072a4709fb61ddd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.035935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca861529e7e34e028072a4709fb61ddd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.050367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca861529e7e34e028072a4709fb61ddd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.051466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca861529e7e34e028072a4709fb61ddd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.193856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2644/5313] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:31 2022] DELETE /identity/v3/users/ca861529e7e34e028072a4709fb61ddd => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:32.198379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:32.200299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:32.216600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21ceef-0234-47c1-9ba1-5e4f9b37444a tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:32.316187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:32.316923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:32.317285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:32.317655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/c89294ca61e4424eae9d5b151ee8cef8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:32.319394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c89294ca61e4424eae9d5b151ee8cef8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:32.322314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:32.352738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:32.484820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89294ca61e4424eae9d5b151ee8cef8', 'request_id': 'req-e3ded346-f6f4-401a-86d3-72d7f16e5791'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.491593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89294ca61e4424eae9d5b151ee8cef8', 'request_id': 'req-e3ded346-f6f4-401a-86d3-72d7f16e5791'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.512827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89294ca61e4424eae9d5b151ee8cef8', 'request_id': 'req-e3ded346-f6f4-401a-86d3-72d7f16e5791'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.638895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] The token cache is being invalidate because project c89294ca61e4424eae9d5b151ee8cef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:32.693158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.693158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3ded346-f6f4-401a-86d3-72d7f16e5791 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:32.693158 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2670/5314] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:32 2022] DELETE /identity/v3/projects/c89294ca61e4424eae9d5b151ee8cef8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:32.693455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:32.693455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:32.693455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923af58-a4df-437d-a341-b89f42b1cba4 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:32.791696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:32.792847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:32.793138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:32.793424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/22c835dc32434f62b29d3b7dfbffcca5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:32.795697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:update_user(user_id=22c835dc32434f62b29d3b7dfbffcca5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:32.800774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:32.954372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.088796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:33.150705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:33.150705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:33.150705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:33.156439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invalidating the token cache because user 22c835dc32434f62b29d3b7dfbffcca5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:33.156786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.157465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e6156bd-01c5-4d8e-92a1-44efe70afd26 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.159660 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2645/5315] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Sep 6 11:07:32 2022] PATCH /identity/v3/users/22c835dc32434f62b29d3b7dfbffcca5 => generated 296 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:33.164908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:33.165189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:33.166035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:33.211153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] MFA Rules not processed for user `86e756626ac4446e907deba71a0ebeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:33.213138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:33.285118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] MFA Rules not processed for user `22c835dc32434f62b29d3b7dfbffcca5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:33.292683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:33.298295 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2646/5316] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:33 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:33.303521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:33.314768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:33.348164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b91501-76fe-4608-8d04-89a196cae431 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:33.357825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2671/5317] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:33.369776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:33.370458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:33.370755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:33.371045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/22c835dc32434f62b29d3b7dfbffcca5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:33.375500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:update_user(user_id=22c835dc32434f62b29d3b7dfbffcca5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:33.377611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:33.488797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.567390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invalidating the token cache because user 22c835dc32434f62b29d3b7dfbffcca5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:33.568006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.568935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0143713b-6cb4-4b9b-b287-030d29cef94c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.572468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2647/5318] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Sep 6 11:07:33 2022] PATCH /identity/v3/users/22c835dc32434f62b29d3b7dfbffcca5 => generated 296 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:33.576646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:33.592980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04690a8-32e8-40f0-8749-138e7842f153 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:33.608682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:33.609357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:33.609647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:33.609927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/22c835dc32434f62b29d3b7dfbffcca5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:33.650798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:update_user(user_id=22c835dc32434f62b29d3b7dfbffcca5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:33.652067 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:07:33.652067 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:07:33.652067 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:07:33.656019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:33.808200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.899539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invalidating the token cache because user 22c835dc32434f62b29d3b7dfbffcca5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:33.900977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.906621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:33.909160 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2672/5319] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Sep 6 11:07:33 2022] PATCH /identity/v3/users/22c835dc32434f62b29d3b7dfbffcca5 => generated 296 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:33.914729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:33.914729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:33.914729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:33.988008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] MFA Rules not processed for user `22c835dc32434f62b29d3b7dfbffcca5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:33.989381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:34.004389 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2648/5320] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:33 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:34.009569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:34.011087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:34.040012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f64e-d0c1-405f-b0c5-1a38dfa7b348 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:34.058649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:34.059676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:34.059945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:34.060234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/22c835dc32434f62b29d3b7dfbffcca5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:34.061544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:update_user(user_id=22c835dc32434f62b29d3b7dfbffcca5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:34.065232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:34.235207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:34.238907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:34.259936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:34.353822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050296f-a4ba-406c-9302-18af7c9b2343 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:34.356441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invalidating the token cache because user 22c835dc32434f62b29d3b7dfbffcca5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:34.356750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:34.357388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:34.360155 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2673/5321] 10.222.0.20 () {60 vars in 1243 bytes} [Tue Sep 6 11:07:34 2022] PATCH /identity/v3/users/22c835dc32434f62b29d3b7dfbffcca5 => generated 296 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:34.361134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:34.363386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:34.363386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:34.363386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:34.365921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:34.367361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:34.368959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:34.387871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:34.389416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:34.399693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eac9e-7255-491e-910e-a9b45fa09aaa tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:34.418334 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2649/5322] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:07:34.420522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:34.422723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656d03b-20db-421c-99fb-d228dd2416bf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:34.423574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d03b-20db-421c-99fb-d228dd2416bf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:34.424013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d03b-20db-421c-99fb-d228dd2416bf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:34.435381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656d03b-20db-421c-99fb-d228dd2416bf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:34.435381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656d03b-20db-421c-99fb-d228dd2416bf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:34.435381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656d03b-20db-421c-99fb-d228dd2416bf tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:34.600030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2674/5323] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:07:34 2022] POST /identity/v3/users => generated 265 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:34.604526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:34.619197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1926d-c764-4934-a2cd-523abf8a4ca6 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:34.625620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:34.626211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:34.626512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:34.626799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/b40df033f8c74f2b83e08d442c48f71e/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:34.840843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b40df033f8c74f2b83e08d442c48f71e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:34.961224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2650/5324] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:07:34 2022] POST /identity/v3/users/b40df033f8c74f2b83e08d442c48f71e/password => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:35.966190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:35.966744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:35.966744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:35.990840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] MFA Rules not processed for user `b40df033f8c74f2b83e08d442c48f71e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:35.993171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:36.035056 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2675/5325] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:35 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:07:36.039377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:36.051136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233843f9-fc33-48a0-8cf5-1354fa716a6c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:36.070034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:36.070702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:36.070997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:36.071307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:36.093561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:36.099209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:36.131384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2651/5326] 10.222.0.20 () {56 vars in 1263 bytes} [Tue Sep 6 11:07:36 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:07:36.135527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:36.161313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155374b0-8010-484c-82a2-1971aa30ab1b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:36.169272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:36.169949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:36.170310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:36.170912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/b40df033f8c74f2b83e08d442c48f71e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:36.172630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b40df033f8c74f2b83e08d442c48f71e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:36.176261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:36.181523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=79,keystone:DELETE=11,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:36.386780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40df033f8c74f2b83e08d442c48f71e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:36.402964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40df033f8c74f2b83e08d442c48f71e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:36.404915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40df033f8c74f2b83e08d442c48f71e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:36.406071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40df033f8c74f2b83e08d442c48f71e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:36.429430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40df033f8c74f2b83e08d442c48f71e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:36.821117 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2676/5327] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:36 2022] DELETE /identity/v3/users/b40df033f8c74f2b83e08d442c48f71e => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:36.828651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:36.842758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961b98a-ff9c-4cc0-b69e-bf0d674a2a6d tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:36.968419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:36.969153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:36.969577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:36.969945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:36.970683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:36.977257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:37.225612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2652/5328] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:36 2022] POST /identity/v3/users => generated 364 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:37.230227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:37.232270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:37.249238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29347f-3f47-459d-8430-7071005de130 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:37.254707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:37.255641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:37.256037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:37.257733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:37.258987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:37.261850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:37.510057 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2677/5329] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:37 2022] POST /identity/v3/projects => generated 358 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:37.514770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:37.525821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652d93-1802-4abe-b59d-bbf48a6ec6ea tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:37.601663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:37.602364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:37.603611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:37.603611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/60da0778a2ee4e28bb079a379e20942b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:37.622938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:update_user(user_id=60da0778a2ee4e28bb079a379e20942b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:37.625683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:37.754151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2653/5330] 10.222.0.20 () {60 vars in 1244 bytes} [Tue Sep 6 11:07:37 2022] PATCH /identity/v3/users/60da0778a2ee4e28bb079a379e20942b => generated 522 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:37.754868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:37.773910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308c0be-ee53-4d28-a97f-e1f025353127 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:37.786326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:37.787173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:37.789055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:37.789458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/60da0778a2ee4e28bb079a379e20942b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:37.811751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:get_user(user_id=60da0778a2ee4e28bb079a379e20942b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:37.817938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:37.817938 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2678/5331] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:07:37 2022] GET /identity/v3/users/60da0778a2ee4e28bb079a379e20942b => generated 389 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:37.820854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:37.832222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c3a71-16f0-4fc7-bfdc-87624da13f94 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:37.838229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:37.839041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:37.839366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:37.839824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/projects/99c5dca5ab924147844a94a3f505ea39` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:37.840971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_project(project_id=99c5dca5ab924147844a94a3f505ea39)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:37.842926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:38.075040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c5dca5ab924147844a94a3f505ea39', 'request_id': 'req-87cfe5c5-c915-4d99-95b8-34ea0106fae9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.082248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c5dca5ab924147844a94a3f505ea39', 'request_id': 'req-87cfe5c5-c915-4d99-95b8-34ea0106fae9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.091373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c5dca5ab924147844a94a3f505ea39', 'request_id': 'req-87cfe5c5-c915-4d99-95b8-34ea0106fae9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.247270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] The token cache is being invalidate because project 99c5dca5ab924147844a94a3f505ea39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:38.247930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.248328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.249915 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2654/5332] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:37 2022] DELETE /identity/v3/projects/99c5dca5ab924147844a94a3f505ea39 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:38.254270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:38.256748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:38.271050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3232-42fe-46ea-ad3b-f54872214c2c tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:38.329915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a41a18460e4f9a80d82b7b3125c34b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '733b1ed7d9aa4041a8b40f3ccea83785', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:38.330994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:38.330994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:38.331309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] PATH_INFO: `/v3/users/60da0778a2ee4e28bb079a379e20942b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:38.332521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorizing `identity:delete_user(user_id=60da0778a2ee4e28bb079a379e20942b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:38.334519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:38.475933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60da0778a2ee4e28bb079a379e20942b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.482967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60da0778a2ee4e28bb079a379e20942b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.483765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60da0778a2ee4e28bb079a379e20942b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.484505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60da0778a2ee4e28bb079a379e20942b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.497103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8979b1ab-ab4f-49e0-b3ce-a570ece74a16 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60da0778a2ee4e28bb079a379e20942b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:38.527752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:38.578134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2679/5333] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:38 2022] DELETE /identity/v3/users/60da0778a2ee4e28bb079a379e20942b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:38.582916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:38.584770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:38.656655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfe5c5-c915-4d99-95b8-34ea0106fae9 tempest-UsersV3TestJSON-719115964 tempest-UsersV3TestJSON-719115964-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:38.734817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:38.735688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:38.735966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:38.736243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] PATH_INFO: `/v3/users/22c835dc32434f62b29d3b7dfbffcca5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:38.756134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c835dc32434f62b29d3b7dfbffcca5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:38.758583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:39.041620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:39.050145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:39.051107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:39.066780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:39.067565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c835dc32434f62b29d3b7dfbffcca5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:39.177919 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2655/5334] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:38 2022] DELETE /identity/v3/users/22c835dc32434f62b29d3b7dfbffcca5 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:39.182626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f9a2-2f3f-44be-9355-b2ca66406f1b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:39.183896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f9a2-2f3f-44be-9355-b2ca66406f1b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:39.184627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f9a2-2f3f-44be-9355-b2ca66406f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:39.228702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f159f9a2-2f3f-44be-9355-b2ca66406f1b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:39.230538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f159f9a2-2f3f-44be-9355-b2ca66406f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:39.354957 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2680/5335] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:39.374034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:39.377610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:39.471454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614ff82-1a94-4ca8-893d-75d3c6b6c03a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:39.475617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:39.476287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:39.476752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:39.477187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:39.490340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:39.492000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:39.502936 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2656/5336] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:39.519430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:39.519843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:39.520223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:39.542142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:39.543550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:39.614280 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2681/5337] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:39.626473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:39.627948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:39.699793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beed4b-ff2d-4066-beef-b494508ebe16 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:39.705369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:39.705982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:39.706259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:39.706535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:39.718657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:39.720474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:39.730772 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2657/5338] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:07:39.974603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:39.976876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:39.997812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574b0d0-7956-4fe2-a972-eb7a4f0bf477 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:40.004626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:40.005193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:40.005525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:40.005812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] PATH_INFO: `/v3/projects/a127c6128ae54385a40f0f3114b53656` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:40.006976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a127c6128ae54385a40f0f3114b53656)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:40.010171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:40.156184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a127c6128ae54385a40f0f3114b53656', 'request_id': 'req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.161808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a127c6128ae54385a40f0f3114b53656', 'request_id': 'req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.168419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a127c6128ae54385a40f0f3114b53656', 'request_id': 'req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.270195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] The token cache is being invalidate because project a127c6128ae54385a40f0f3114b53656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:40.270389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.271090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.276024 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2682/5339] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:39 2022] DELETE /identity/v3/projects/a127c6128ae54385a40f0f3114b53656 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:40.276705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:40.289354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149caf5-f03f-41d5-9abe-35766b980180 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:40.361521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:40.362157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:40.362440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:40.362742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] PATH_INFO: `/v3/users/11a41a18460e4f9a80d82b7b3125c34b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:40.363995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a41a18460e4f9a80d82b7b3125c34b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:40.367412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:40.599082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a41a18460e4f9a80d82b7b3125c34b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.623822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a41a18460e4f9a80d82b7b3125c34b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.623822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a41a18460e4f9a80d82b7b3125c34b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.623822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a41a18460e4f9a80d82b7b3125c34b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.623822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-86010d5a-e94e-49b6-87a5-9d0386d9e2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a41a18460e4f9a80d82b7b3125c34b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:40.767776 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2658/5340] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:40 2022] DELETE /identity/v3/users/11a41a18460e4f9a80d82b7b3125c34b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:40.883462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:41.595417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:41.597522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:41.611995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4bc31-8bdb-4b3d-bf88-2fc9c8f12c70 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:41.674820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:41.675495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:41.675781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:41.676059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] PATH_INFO: `/v3/projects/733b1ed7d9aa4041a8b40f3ccea83785` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:41.677200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733b1ed7d9aa4041a8b40f3ccea83785)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:41.679238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:41.953470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733b1ed7d9aa4041a8b40f3ccea83785', 'request_id': 'req-b450757b-6d17-4ef0-acae-056508b5fe19'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:41.959868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733b1ed7d9aa4041a8b40f3ccea83785', 'request_id': 'req-b450757b-6d17-4ef0-acae-056508b5fe19'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:41.967516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733b1ed7d9aa4041a8b40f3ccea83785', 'request_id': 'req-b450757b-6d17-4ef0-acae-056508b5fe19'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:42.094375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] The token cache is being invalidate because project 733b1ed7d9aa4041a8b40f3ccea83785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:42.094712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:42.095390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b450757b-6d17-4ef0-acae-056508b5fe19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:42.097251 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2683/5341] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:41 2022] DELETE /identity/v3/projects/733b1ed7d9aa4041a8b40f3ccea83785 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:42.107091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.109389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.109996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.144553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:42.148101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:42.234477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2659/5342] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:42.242988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.243308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.243589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.265669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:42.267438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:42.276258 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2684/5343] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:42.280538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:42.291091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884968-cb84-467d-b645-2ef3d86278a2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:42.297578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:42.298284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.301393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.301393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.301393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:42.301393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:42.301854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:42.317989 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2660/5344] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:42.319121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:42.322762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:UPDATE=3,keystone:INSERT=5,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:42.331104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cbb84-3b77-43fe-8e98-dc2e05ab6dec None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:42.349676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:42.350449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.350929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.351449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.354587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:42.356791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:42.489723 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2685/5345] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:42 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:42.493784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:42.505094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8011b-fb43-4e27-b99f-7fa2d3dce048 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:42.583833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:42.584805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.585089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.585640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.586288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:42.589275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:42.671810 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2661/5346] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:42 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:42.671943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:42.687154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62932e-e930-457b-9f94-0e372e40eece admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:42.691279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:42.691912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.692197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.692584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.693236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:42.695376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:42.713796 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2686/5347] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:07:42.714320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:42.726767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54bea8-e2e9-4420-9dbe-4424b6b3debf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:42.732826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cb7f2-872a-4774-873f-7a2676b0a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:42.733918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cb7f2-872a-4774-873f-7a2676b0a310 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.734407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cb7f2-872a-4774-873f-7a2676b0a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.734835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cb7f2-872a-4774-873f-7a2676b0a310 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.735681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cb7f2-872a-4774-873f-7a2676b0a310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:42.737481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cb7f2-872a-4774-873f-7a2676b0a310 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:42.753885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2662/5348] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:07:42.755219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:42.772023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c87e-f612-49c0-9848-ce7e6cfb8403 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:42.781872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:42.782620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.782908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.783233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] PATH_INFO: `/v3/projects/8f324ef152c946678a901589607bc492/users/80f87714a6d64c4fa3064b097ce24dfa/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.806715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f324ef152c946678a901589607bc492, user_id=80f87714a6d64c4fa3064b097ce24dfa, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:42.810867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:42.935749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2687/5349] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:42 2022] PUT /identity/v3/projects/8f324ef152c946678a901589607bc492/users/80f87714a6d64c4fa3064b097ce24dfa/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:42.945989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:42.947049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:42.947551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:42.975720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] MFA Rules not processed for user `80f87714a6d64c4fa3064b097ce24dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:42.977335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:43.059705 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2663/5350] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:43.065297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.077300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a4695-c2c9-4658-b3d9-4d0b633cd24d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.081820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.082454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.082747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.083042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.083719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.085135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.116711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.118774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:43.211142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c7d32-1e5e-4159-8456-2c483a0c8099 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.218088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.218979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.220648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.220979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.222825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:43.241820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.244194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41b201-5ec7-47be-99cd-178ab34ad57d service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.263944 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2688/5351] 10.222.0.20 () {60 vars in 1314 bytes} [Tue Sep 6 11:07:43 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 789 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:43.267987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.270869 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2664/5352] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:43.293466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2585c8c-91d2-4618-bdb7-f9afcbd058ea tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.298449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.299159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.299501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.299782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/494dee215ab34ab2983069353ec7e006` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.317857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:get_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=494dee215ab34ab2983069353ec7e006)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.319652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.324110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2689/5353] 10.222.0.20 () {58 vars in 1392 bytes} [Tue Sep 6 11:07:43 2022] GET /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/494dee215ab34ab2983069353ec7e006 => generated 689 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:07:43.325753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.326046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.326319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.345372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] MFA Rules not processed for user `80f87714a6d64c4fa3064b097ce24dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:43.346685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:43.494310 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2665/5354] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:43 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 06 11:07:43.494841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.509186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce0375-5b1e-4359-99d8-03260fbdfadf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.515236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.516061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.516354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.516639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/494dee215ab34ab2983069353ec7e006` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.517833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=494dee215ab34ab2983069353ec7e006)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.520141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.612111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:43.626896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.629782 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2690/5355] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:43 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/494dee215ab34ab2983069353ec7e006 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:43.639253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549929a-6c34-435a-be75-b86281f674b0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.649987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.650659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.655200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.655200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.655200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.655200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.816532 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2666/5356] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Sep 6 11:07:43 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 920 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:43.820695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.837681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136df4-37b6-4190-97de-79552c849827 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.842621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.843694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.844075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.844451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/2541d64ebeb74ddaae3eece1aebd760a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.860638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=2541d64ebeb74ddaae3eece1aebd760a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.862469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.923924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.925650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:43.943062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2691/5357] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:43 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/2541d64ebeb74ddaae3eece1aebd760a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:43.946846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:43.957047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2138b5-8bf8-4505-b905-392e7d110402 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.961641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.963000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.963473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.968420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:43.968420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:43.968420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:43.993195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058a509-ce8c-4444-9375-f53048ffdf08 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:43.997281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:43.998030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:43.998580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:43.999041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.000900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:44.083056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.084702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.098508 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2667/5358] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:07:44.148914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2692/5359] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Sep 6 11:07:43 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 813 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:44.151590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:44.162146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2cfae-b5bd-40a9-a98c-ad0e269bba2d service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:44.171002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:44.171002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:44.171002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:44.171321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/2d57ab2a05c24d2e8ebe16c65e1d527d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.202299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=2d57ab2a05c24d2e8ebe16c65e1d527d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.204244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.299965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2668/5360] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:44 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/2d57ab2a05c24d2e8ebe16c65e1d527d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:44.306268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:44.316863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324febae-a069-4b4d-92a5-3e0cb63f6ef6 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:44.322054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:44.322704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:44.322990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:44.323305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.323963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.325138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.351940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:44.354275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:44.492817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a6cdd-5958-4f08-92a9-5f70e2ebbf60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:44.497278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:44.497994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:44.498346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:44.498698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.500619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:44.513731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.515311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.525569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2669/5361] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:07:44.537498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2693/5362] 10.222.0.20 () {60 vars in 1314 bytes} [Tue Sep 6 11:07:44 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 788 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:44.538551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:44.549543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d2d1d-34d0-443c-9a33-1c546e226ffc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:44.554765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:44.554765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:44.554961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:44.555226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.556547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.557776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.763784 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2670/5363] 10.222.0.20 () {60 vars in 1314 bytes} [Tue Sep 6 11:07:44 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 789 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:44.768599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:44.783451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7255e-2770-41b4-9833-475d2edb6d09 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:44.794349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:44.794349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:44.794349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:44.794718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.794718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:list_application_credentials(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.794718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.815224 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2694/5364] 10.222.0.20 () {58 vars in 1293 bytes} [Tue Sep 6 11:07:44 2022] GET /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 1501 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:07:44.817177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:44.827850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1be3d-27c4-4236-8a69-db365df2fe60 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:44.832074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:44.832726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:44.833060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:44.833299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/21a28bb0d24d48e1838e7148f68743fc` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:44.846327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=21a28bb0d24d48e1838e7148f68743fc)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:44.847881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:44.992080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2671/5365] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:44 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/21a28bb0d24d48e1838e7148f68743fc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:44.999725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:45.017485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5709ba-84af-4cb1-9007-72ac8f5f10c3 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:45.024162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:45.025604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:45.026356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:45.027085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/61e0ae5ae23a45a6b38355547a15fd4a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:45.043224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=61e0ae5ae23a45a6b38355547a15fd4a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:45.044933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:45.177836 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2695/5366] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:44 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/61e0ae5ae23a45a6b38355547a15fd4a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:45.185486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:45.200449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefc9d7-aa61-4ba3-8eff-ab29fe0999fc tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:45.206192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:45.206843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:45.207197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:45.207805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:45.208475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:45.209634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:45.249009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:45.379821 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2672/5367] 10.222.0.20 () {60 vars in 1314 bytes} [Tue Sep 6 11:07:45 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 788 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:45.384447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:45.394975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96117-8927-44b8-be7b-6a8d40f59a97 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:45.401582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:45.402221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:45.402511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:45.402791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:45.403516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:create_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:45.404684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:45.543114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2696/5368] 10.222.0.20 () {60 vars in 1314 bytes} [Tue Sep 6 11:07:45 2022] POST /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials => generated 789 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:45.544753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:45.554758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3565-55c1-4aa4-8c80-16c235d1c577 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:45.559430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:45.560371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:45.562668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:45.562668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:45.562668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Adding query filter params (name=tempest-application_credential-1187494436) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:45.562913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:45.563034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:list_application_credentials(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:45.563735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:45.579359 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2673/5369] 10.222.0.20 () {58 vars in 1386 bytes} [Tue Sep 6 11:07:45 2022] GET /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials?name=tempest-application_credential-1187494436 => generated 887 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:45.580534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:45.590785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c11b-b003-45f6-bfe1-5b0bdf118780 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:45.595127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:45.595807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:45.596096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:45.596381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/a9b3362cf5ef4a49bb93a63d89681e23` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:45.605447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=a9b3362cf5ef4a49bb93a63d89681e23)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:45.606977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:45.701485 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2697/5370] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:45 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/a9b3362cf5ef4a49bb93a63d89681e23 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:45.703309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:45.714709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a4911-81f3-488e-a2ad-e15e2716d316 tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:45.720267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dd815-0fc3-41e9-87c7-f2179424bf9e tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f87714a6d64c4fa3064b097ce24dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f324ef152c946678a901589607bc492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:45.721274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd815-0fc3-41e9-87c7-f2179424bf9e tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:45.721743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd815-0fc3-41e9-87c7-f2179424bf9e tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:45.722039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dd815-0fc3-41e9-87c7-f2179424bf9e tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/d2e0ee7e00af49bc9f1de42aa606ddd5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:45.733236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd815-0fc3-41e9-87c7-f2179424bf9e tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80f87714a6d64c4fa3064b097ce24dfa, application_credential_id=d2e0ee7e00af49bc9f1de42aa606ddd5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:45.734835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dd815-0fc3-41e9-87c7-f2179424bf9e tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:45.952670 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2674/5371] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:07:45 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa/application_credentials/d2e0ee7e00af49bc9f1de42aa606ddd5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:45.957636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:46.023675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a58cda-f652-471b-8a8c-7cb6b64482bf tempest-ApplicationCredentialsV3Test-563421280 tempest-ApplicationCredentialsV3Test-563421280-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:46.028233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:46.028861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:46.029142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:46.029418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] PATH_INFO: `/v3/users/80f87714a6d64c4fa3064b097ce24dfa` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:46.030599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f87714a6d64c4fa3064b097ce24dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:46.032595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:46.229886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f87714a6d64c4fa3064b097ce24dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:46.243708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f87714a6d64c4fa3064b097ce24dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:46.244728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f87714a6d64c4fa3064b097ce24dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:46.245445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f87714a6d64c4fa3064b097ce24dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:46.411656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f87714a6d64c4fa3064b097ce24dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:46.549883 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2698/5372] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:45 2022] DELETE /identity/v3/users/80f87714a6d64c4fa3064b097ce24dfa => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:46.554561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:46.555177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:46.555177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:46.575658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:46.576882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:46.636819 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2675/5373] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:46.646553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:46.648098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:46.718405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fac88-ab18-4fce-ae58-fc033595c2b2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:46.723981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d102fc8-7df8-45aa-86f4-1099eb5da34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:46.725076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102fc8-7df8-45aa-86f4-1099eb5da34c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:46.725400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102fc8-7df8-45aa-86f4-1099eb5da34c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:46.725683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d102fc8-7df8-45aa-86f4-1099eb5da34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:46.738039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d102fc8-7df8-45aa-86f4-1099eb5da34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:46.739827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d102fc8-7df8-45aa-86f4-1099eb5da34c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:46.750908 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2699/5374] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:47.073099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:47.334687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:47.539962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:47.541608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:47.559092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875edf9-ee3e-4ae7-883b-a0b00b9ace7b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:47.568200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:47.568200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:47.568200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:47.568200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] PATH_INFO: `/v3/projects/8f324ef152c946678a901589607bc492` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:47.568634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f324ef152c946678a901589607bc492)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:47.569539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:47.705376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f324ef152c946678a901589607bc492', 'request_id': 'req-6cb175db-ed9c-43d5-98f4-30ebcd290b06'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:47.711652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f324ef152c946678a901589607bc492', 'request_id': 'req-6cb175db-ed9c-43d5-98f4-30ebcd290b06'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:47.717179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f324ef152c946678a901589607bc492', 'request_id': 'req-6cb175db-ed9c-43d5-98f4-30ebcd290b06'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:47.818165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] The token cache is being invalidate because project 8f324ef152c946678a901589607bc492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:47.818463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:47.819134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb175db-ed9c-43d5-98f4-30ebcd290b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:47.820718 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2676/5375] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:47 2022] DELETE /identity/v3/projects/8f324ef152c946678a901589607bc492 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:47.826236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:47.826523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:47.826799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:47.846679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:47.847915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:47.909740 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2700/5376] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:47.917920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:47.918214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:47.918497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:47.938771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:47.940013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:47.947926 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2677/5377] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:47.957200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:47.967208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538ea1-e7db-4d29-80aa-3e32a4015a69 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:47.971911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:47.972509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:47.972789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:47.973063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:47.973699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:47.973998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:47.975633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:47.988381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2701/5378] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:47.992773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.003597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee371b-d90e-4b8b-9a0f-db2aabffc3d8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.008352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.009047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.009720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.009720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.010530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.012571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:48.019757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:48.112130 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2678/5379] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:47 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:48.116520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.129153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba2891-a3bd-43d3-8680-cd61ca3dd3c4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.194040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.194657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.195225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.195683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.197039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:48.197952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.200361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:48.293908 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2702/5380] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:48 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:48.298390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.312331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b9dd1-d989-4ca5-8e9c-21c30215bfe3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.317934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.318686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.319112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.319482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.320266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.322230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:48.334955 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2679/5381] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:48.345451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.358324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba3c1c-4a2c-4df4-80a2-c40eba787d2b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.362485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00e784-217c-4a26-8ddf-f4529630dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.363163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e784-217c-4a26-8ddf-f4529630dcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.363763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e784-217c-4a26-8ddf-f4529630dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.364115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00e784-217c-4a26-8ddf-f4529630dcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.364825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00e784-217c-4a26-8ddf-f4529630dcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.368661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00e784-217c-4a26-8ddf-f4529630dcd3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:48.544476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2703/5382] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:48.548566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.562403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69ac4-9740-4013-a2a2-dea3e860bbf0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.569664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.570569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.571537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.572092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] PATH_INFO: `/v3/projects/aa30c285f3a64393b339a7307bd34f27/users/25a14e3e1129424c8ebd96f04fae49a4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.588255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa30c285f3a64393b339a7307bd34f27, user_id=25a14e3e1129424c8ebd96f04fae49a4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.591336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:48.602565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:48.663937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2680/5383] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:48 2022] PUT /identity/v3/projects/aa30c285f3a64393b339a7307bd34f27/users/25a14e3e1129424c8ebd96f04fae49a4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:48.685363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.685653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.686078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.715188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] MFA Rules not processed for user `25a14e3e1129424c8ebd96f04fae49a4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:48.716470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:48.782672 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2704/5384] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:48.787605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.797838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbca35a-f3af-48a7-a8ba-cfa6337c805e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.802198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.802900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.803276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.803598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.804316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.806037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:48.892358 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2681/5385] 10.222.0.20 () {60 vars in 1299 bytes} [Tue Sep 6 11:07:48 2022] POST /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2 => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:48.893483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:48.902214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c7ae-6570-4776-a969-94c5138f104a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:48.907243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:48.907984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:48.908266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:48.908552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/1faf4eb23c27416e9e0215c9056c2501` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:48.910759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4, credential_id=1faf4eb23c27416e9e0215c9056c2501)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:48.912360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.031428 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2705/5386] 10.222.0.20 () {58 vars in 1380 bytes} [Tue Sep 6 11:07:48 2022] DELETE /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/1faf4eb23c27416e9e0215c9056c2501 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:49.036372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.045773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00c9fa-79c9-4f30-90c1-1dbbe78805d8 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.050095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.050790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.051114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.051393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.052028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.053521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.137840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:49.144582 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2682/5387] 10.222.0.20 () {60 vars in 1299 bytes} [Tue Sep 6 11:07:49 2022] POST /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2 => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:49.148638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.158548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a1c2-7f89-4d39-a97a-dde1edc7801f tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.162755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.163428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.163715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.163994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/8fcaaa935c384065b3005bd2647cfdb0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.166970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4, credential_id=8fcaaa935c384065b3005bd2647cfdb0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.168472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.274317 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2706/5388] 10.222.0.20 () {58 vars in 1380 bytes} [Tue Sep 6 11:07:49 2022] DELETE /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/8fcaaa935c384065b3005bd2647cfdb0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:49.277212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:49.278664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.288202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43993b-a09c-42ac-9aaf-f9c77b13c040 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.298083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.299274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.299669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.300052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/8fcaaa935c384065b3005bd2647cfdb0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Could not find credential: 64706dad6ae54a7d39107366941d4aafc25c9a5c7d7ac8bff34f3c7a45525a1e.: keystone.exception.CredentialNotFound: Could not find credential: 64706dad6ae54a7d39107366941d4aafc25c9a5c7d7ac8bff34f3c7a45525a1e. Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Sep 06 11:07:49.343869 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:07:49.344968 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 64706dad6ae54a7d39107366941d4aafc25c9a5c7d7ac8bff34f3c7a45525a1e. Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:07:49.345899 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2683/5389] 10.222.0.20 () {58 vars in 1377 bytes} [Tue Sep 6 11:07:49 2022] GET /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/8fcaaa935c384065b3005bd2647cfdb0 => generated 148 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:07:49.351037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.361056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f9868-c97c-41c4-8746-9f3843406727 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.365780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.366475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.366755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.367045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.367728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.369240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.433269 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2707/5390] 10.222.0.20 () {60 vars in 1299 bytes} [Tue Sep 6 11:07:49 2022] POST /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2 => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:49.437549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.450632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950311b-b499-4ff1-92a8-45254dd95a32 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.458797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.459613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.459937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.460196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.460824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.462945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.527971 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2684/5391] 10.222.0.20 () {60 vars in 1299 bytes} [Tue Sep 6 11:07:49 2022] POST /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2 => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:49.532089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.541802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f73d9-17ca-4603-b4a1-a84fcba3f6d0 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.545978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.546596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.546878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.547258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.547838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.549582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.560525 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2708/5392] 10.222.0.20 () {58 vars in 1278 bytes} [Tue Sep 6 11:07:49 2022] GET /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2 => generated 865 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:49.564981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.575399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789b0ac-f7bb-4852-849f-2e99cc874343 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.580591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.581133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.581423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.581709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/053a50c89f8846e8beb062aadadedea7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.583811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4, credential_id=053a50c89f8846e8beb062aadadedea7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.585268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.675043 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2685/5393] 10.222.0.20 () {58 vars in 1380 bytes} [Tue Sep 6 11:07:49 2022] DELETE /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/053a50c89f8846e8beb062aadadedea7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:49.679429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.704411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e17cc-400d-4758-85e9-9653e678e141 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.711042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.711557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.711841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.712162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/93c4440c0a874402b877f139f3b12519` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.714325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4, credential_id=93c4440c0a874402b877f139f3b12519)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.715790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.814113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2709/5394] 10.222.0.20 () {58 vars in 1380 bytes} [Tue Sep 6 11:07:49 2022] DELETE /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/93c4440c0a874402b877f139f3b12519 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:49.821940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.832039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f80cf5-32c9-4818-8a72-54adb524d14a tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.836622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.837253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.837544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.837826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.838458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.840007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.927372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:49.937491 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2686/5395] 10.222.0.20 () {60 vars in 1299 bytes} [Tue Sep 6 11:07:49 2022] POST /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2 => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:49.941724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.952833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9711ff5-14fa-4e0c-9512-d0bdfccebdbf tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.958014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.958862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.959184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.959466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/e91f1c1196d648a19703c08ac00577bd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.961629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4, credential_id=e91f1c1196d648a19703c08ac00577bd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.963219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:49.969426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2710/5396] 10.222.0.20 () {58 vars in 1377 bytes} [Tue Sep 6 11:07:49 2022] GET /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/e91f1c1196d648a19703c08ac00577bd => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:49.970663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:49.981016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c1212-b9a5-4dad-b0c2-265eb412618d tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:49.985541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1ad94-c81e-40e3-b83c-994a384959b6 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a14e3e1129424c8ebd96f04fae49a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa30c285f3a64393b339a7307bd34f27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:49.986208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ad94-c81e-40e3-b83c-994a384959b6 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:49.986500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ad94-c81e-40e3-b83c-994a384959b6 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:49.986785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ad94-c81e-40e3-b83c-994a384959b6 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/e91f1c1196d648a19703c08ac00577bd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:49.988921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ad94-c81e-40e3-b83c-994a384959b6 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=25a14e3e1129424c8ebd96f04fae49a4, credential_id=e91f1c1196d648a19703c08ac00577bd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:49.990368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ad94-c81e-40e3-b83c-994a384959b6 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:50.075820 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2687/5397] 10.222.0.20 () {58 vars in 1380 bytes} [Tue Sep 6 11:07:49 2022] DELETE /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4/credentials/OS-EC2/e91f1c1196d648a19703c08ac00577bd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:50.080618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:50.143389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63297d-029b-4d0c-ac34-c7363038e598 tempest-EC2CredentialsTest-715085105 tempest-EC2CredentialsTest-715085105-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:50.148058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:50.148688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:50.148969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:50.149244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] PATH_INFO: `/v3/users/25a14e3e1129424c8ebd96f04fae49a4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:50.150373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a14e3e1129424c8ebd96f04fae49a4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:50.152400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:50.340305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:50.348071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a14e3e1129424c8ebd96f04fae49a4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:50.355628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a14e3e1129424c8ebd96f04fae49a4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:50.356308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a14e3e1129424c8ebd96f04fae49a4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:50.356930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a14e3e1129424c8ebd96f04fae49a4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:50.368592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a14e3e1129424c8ebd96f04fae49a4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:50.463329 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2711/5398] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:50 2022] DELETE /identity/v3/users/25a14e3e1129424c8ebd96f04fae49a4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:50.467838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:50.468142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:50.468413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:50.491872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:50.493325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:50.558880 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2688/5399] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:50.568921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:50.570446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:50.636770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e85f7b-da3b-41fd-bd78-a7ae2d122b5f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:50.641064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297efd-7168-4375-8659-2fddcb0602dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:50.641792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297efd-7168-4375-8659-2fddcb0602dc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:50.642175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297efd-7168-4375-8659-2fddcb0602dc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:50.642551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297efd-7168-4375-8659-2fddcb0602dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:50.652842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3297efd-7168-4375-8659-2fddcb0602dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:50.662622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3297efd-7168-4375-8659-2fddcb0602dc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:50.666175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2712/5400] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:51.115966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:51.117473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:51.135086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec163-73a7-44ee-ac34-72c9954518f4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:51.141541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:51.142203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.142486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.142764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] PATH_INFO: `/v3/projects/aa30c285f3a64393b339a7307bd34f27` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.144110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa30c285f3a64393b339a7307bd34f27)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:51.146088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:51.253555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:51.266855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa30c285f3a64393b339a7307bd34f27', 'request_id': 'req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:51.273774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa30c285f3a64393b339a7307bd34f27', 'request_id': 'req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:51.280823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa30c285f3a64393b339a7307bd34f27', 'request_id': 'req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:51.361392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] The token cache is being invalidate because project aa30c285f3a64393b339a7307bd34f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:51.361827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:51.362535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3513a5e-786c-4c3b-bcc1-2f1d1ccd6eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:51.364168 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2689/5401] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:51 2022] DELETE /identity/v3/projects/aa30c285f3a64393b339a7307bd34f27 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:51.371280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.371737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.371926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.392328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:51.393585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:51.405905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:51.456937 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2713/5402] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:51.465694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.465991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.466278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.493765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:51.494965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:51.503503 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2690/5403] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:51.507684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:51.518052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43226d5-c8de-4912-9223-cb81684e6cb1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:51.522639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:51.523297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.523633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.524492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.525138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:51.525444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:51.530333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:51.538867 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2714/5404] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:51.543258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:51.553164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235311ce-a653-4d4f-b55c-c6085f83de98 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:51.558179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:51.558795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.559104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.559389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.560034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:51.562017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:51.665242 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2691/5405] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:51 2022] POST /identity/v3/projects => generated 395 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:51.665831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:51.676685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83271060-7ef9-42ab-963a-09c89f0250c9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:51.743628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:51.746511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.746511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.746511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.746511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:51.748597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:51.851310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2715/5406] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:51 2022] POST /identity/v3/users => generated 304 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:51.860292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:51.871642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aaf5e0-59d3-4ea1-8350-eea0c8d92c9f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:51.876508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:51.877165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.879048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.879048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.879048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:51.880140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:51.895041 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2692/5407] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:51.896425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:51.910774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15535f7-de40-42b3-baa5-d12e705d6733 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:51.916245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:51.918578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:51.918578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:51.918578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] PATH_INFO: `/v3/projects/11aaae1f5faf4345a43ce88b708a2248/users/ff3bcba7fc0143b79fb8dc58837ca9d9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:51.933380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11aaae1f5faf4345a43ce88b708a2248, user_id=ff3bcba7fc0143b79fb8dc58837ca9d9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:51.936062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.064166 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2716/5408] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:51 2022] PUT /identity/v3/projects/11aaae1f5faf4345a43ce88b708a2248/users/ff3bcba7fc0143b79fb8dc58837ca9d9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:52.068132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.079398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd0f98-e081-46fe-9028-3febe61aa64d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.104722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=4,keystone:SELECT=89,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:52.137207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a44cf-d4cf-4c7e-b979-89fe9fbdaaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.137850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a44cf-d4cf-4c7e-b979-89fe9fbdaaec admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.138078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a44cf-d4cf-4c7e-b979-89fe9fbdaaec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.138353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a44cf-d4cf-4c7e-b979-89fe9fbdaaec admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.138984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a44cf-d4cf-4c7e-b979-89fe9fbdaaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.140903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a44cf-d4cf-4c7e-b979-89fe9fbdaaec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.150309 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2693/5409] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:52.154529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.164909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94888f-d155-48ce-9d3b-14d8453311e5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.169912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.170568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.170917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.171214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] PATH_INFO: `/v3/projects/11aaae1f5faf4345a43ce88b708a2248/users/ff3bcba7fc0143b79fb8dc58837ca9d9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.176384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=11aaae1f5faf4345a43ce88b708a2248, user_id=ff3bcba7fc0143b79fb8dc58837ca9d9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.176384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.187252 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2717/5410] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:52 2022] PUT /identity/v3/projects/11aaae1f5faf4345a43ce88b708a2248/users/ff3bcba7fc0143b79fb8dc58837ca9d9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:52.198423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.198719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.198997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.226986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] MFA Rules not processed for user `ff3bcba7fc0143b79fb8dc58837ca9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:52.228767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:52.298290 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2694/5411] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:52.302919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.333560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:52.369352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:52.374385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5df77f-e1fd-4906-836f-d88f2ddd4cbb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.379194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.379813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.380098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.380375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.381164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.383543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.490692 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2718/5412] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:52 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:52.495509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.508729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9394448-d050-4109-bf2f-8d88a98583ff None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.571131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.571802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.572093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.572374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.573008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.574956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.690518 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2695/5413] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:52 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:52.695306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.709793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb67bd-51b2-4202-be37-44983f9e7fca admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.723042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.723042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.723042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.723042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.723426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.723426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.732783 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2719/5414] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:52.738705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.749805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705549c3-3f36-4c6c-8266-1610d1234ae1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.759535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a836ea-4c25-4773-9af9-f24c1a94b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.762151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a836ea-4c25-4773-9af9-f24c1a94b080 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.762701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a836ea-4c25-4773-9af9-f24c1a94b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.763185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a836ea-4c25-4773-9af9-f24c1a94b080 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.764205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a836ea-4c25-4773-9af9-f24c1a94b080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.768917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a836ea-4c25-4773-9af9-f24c1a94b080 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.785281 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2696/5415] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:52.786895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:52.801212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98008a-dec2-4c7c-9d1b-1d6e4d10583c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:52.810565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:52.812392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.812690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.813024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] PATH_INFO: `/v3/projects/e4108788c7074643811b5774b07d5eb0/users/1fbd7783c333447382d578b5931c1940/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.831599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4108788c7074643811b5774b07d5eb0, user_id=1fbd7783c333447382d578b5931c1940, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:52.834330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:52.923067 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2720/5416] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:52 2022] PUT /identity/v3/projects/e4108788c7074643811b5774b07d5eb0/users/1fbd7783c333447382d578b5931c1940/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:52.931378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cce2-e34f-4c54-a8f1-82e5872bf33d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:52.932125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cce2-e34f-4c54-a8f1-82e5872bf33d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:52.932545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cce2-e34f-4c54-a8f1-82e5872bf33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:52.982155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9248cce2-e34f-4c54-a8f1-82e5872bf33d None None] MFA Rules not processed for user `1fbd7783c333447382d578b5931c1940`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:52.984365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9248cce2-e34f-4c54-a8f1-82e5872bf33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:53.106562 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2697/5417] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:07:53.114722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:53.116726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:53.212218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab7dc-f257-4930-8510-a9a8cad2989d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:53.231393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:53.232402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:53.234477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:53.234871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:53.340880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:53.346695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:53.362176 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2721/5418] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:54.465647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:54.466167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:54.466408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:54.487638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:54.488879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:54.510920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:54.561546 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2698/5419] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:07:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:54.579459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:54.579459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:54.664215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:54.683719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e650-17e9-463b-a7be-4fccd8e9861b service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:54.691155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299bc5-d9d8-47b2-9663-65bef9f6309f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:54.691841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299bc5-d9d8-47b2-9663-65bef9f6309f service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:54.692133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299bc5-d9d8-47b2-9663-65bef9f6309f service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:54.692465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299bc5-d9d8-47b2-9663-65bef9f6309f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:54.708254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299bc5-d9d8-47b2-9663-65bef9f6309f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:54.708254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299bc5-d9d8-47b2-9663-65bef9f6309f service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:54.718975 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2722/5420] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:07:54.741980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:54.840507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3d51d-d8fc-4bd3-a0e6-4e3eab8c05d3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:54.848761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:54.848761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:54.848761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:54.848997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] PATH_INFO: `/v3/users/ff3bcba7fc0143b79fb8dc58837ca9d9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:54.850157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3bcba7fc0143b79fb8dc58837ca9d9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:54.852151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:55.140701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3bcba7fc0143b79fb8dc58837ca9d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:55.150141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3bcba7fc0143b79fb8dc58837ca9d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:55.151322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3bcba7fc0143b79fb8dc58837ca9d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:55.169276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3bcba7fc0143b79fb8dc58837ca9d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:55.170062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3bcba7fc0143b79fb8dc58837ca9d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:55.276518 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2699/5421] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:54 2022] DELETE /identity/v3/users/ff3bcba7fc0143b79fb8dc58837ca9d9 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:55.280745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:55.281030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:55.281302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:55.313272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:55.314628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:55.455434 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2723/5422] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:55.468613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:55.470310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:55.570902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:55.577726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d4a5-5d08-485d-9c14-b5576851e7c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:55.581710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:55.582422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:55.582785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:55.583357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:55.594296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:55.595923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:55.627173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2700/5423] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:07:56.216017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:56.217742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:56.240986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb89e-d372-4212-96d9-c3f5357c16a4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:56.244422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:56.246434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:56.246967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:56.247528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] PATH_INFO: `/v3/projects/11aaae1f5faf4345a43ce88b708a2248` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:56.248843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11aaae1f5faf4345a43ce88b708a2248)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:56.251432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:56.389933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11aaae1f5faf4345a43ce88b708a2248', 'request_id': 'req-274f463e-9e7e-4e0b-89c5-349bd7fa3155'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.396182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11aaae1f5faf4345a43ce88b708a2248', 'request_id': 'req-274f463e-9e7e-4e0b-89c5-349bd7fa3155'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.404707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11aaae1f5faf4345a43ce88b708a2248', 'request_id': 'req-274f463e-9e7e-4e0b-89c5-349bd7fa3155'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.511001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] The token cache is being invalidate because project 11aaae1f5faf4345a43ce88b708a2248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:56.511317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.514335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.516000 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2724/5424] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:56 2022] DELETE /identity/v3/projects/11aaae1f5faf4345a43ce88b708a2248 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:56.520103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:56.532036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd2463-936e-49b6-b730-6acc81adb144 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:56.604791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:56.605443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:56.605744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:56.606012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] PATH_INFO: `/v3/users/1fbd7783c333447382d578b5931c1940` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:56.607342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbd7783c333447382d578b5931c1940)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:56.619469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:56.883664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbd7783c333447382d578b5931c1940'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.892922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbd7783c333447382d578b5931c1940'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.893658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbd7783c333447382d578b5931c1940'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.912307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbd7783c333447382d578b5931c1940'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.913114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea099748-39d1-41d1-9d22-1b5599c5303d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbd7783c333447382d578b5931c1940'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:56.996830 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2701/5425] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:07:56 2022] DELETE /identity/v3/users/1fbd7783c333447382d578b5931c1940 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:07:58.131642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:58.133571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:58.174730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f463e-9e7e-4e0b-89c5-349bd7fa3155 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:58.246735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:58.247437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:58.247723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:58.248001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] PATH_INFO: `/v3/projects/e4108788c7074643811b5774b07d5eb0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:58.249153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4108788c7074643811b5774b07d5eb0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:58.251223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:58.270093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:58.410092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4108788c7074643811b5774b07d5eb0', 'request_id': 'req-1262f125-b586-446a-b953-fa255e6850ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:58.421542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4108788c7074643811b5774b07d5eb0', 'request_id': 'req-1262f125-b586-446a-b953-fa255e6850ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:58.430845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4108788c7074643811b5774b07d5eb0', 'request_id': 'req-1262f125-b586-446a-b953-fa255e6850ac'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:58.528024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] The token cache is being invalidate because project e4108788c7074643811b5774b07d5eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:07:58.528315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:58.529039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1262f125-b586-446a-b953-fa255e6850ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:07:58.530555 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2725/5426] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:07:58 2022] DELETE /identity/v3/projects/e4108788c7074643811b5774b07d5eb0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:58.535811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:58.536286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:58.536532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:58.612242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:58.614531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:58.734212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2702/5427] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:58.742153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:58.742622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:58.742909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:58.797945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:58.799819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:58.810106 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2726/5428] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:58.819318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:58.826597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e5bc8-558f-42ef-becf-fd75509091ff None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:58.831956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:58.832611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:58.832897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:58.833214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:58.833879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:07:58.834181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:58.835874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:58.846095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:58.857869 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2703/5429] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:07:58.864334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:58.878095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b989e-0be6-41b5-bc92-a032f521509e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:58.888294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:58.888294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:58.888294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:58.888294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:58.888906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:58.888906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:59.044733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2727/5430] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:58 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:07:59.046756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:59.057462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f863dc-ce1e-4955-ad13-8c0f7801bc87 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:59.134584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:59.135273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:59.135868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:59.136002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:59.136618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:59.138780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:59.289222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2704/5431] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:07:59 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:07:59.296826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:59.314320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65041c-b4c7-42c2-8485-56bdac911c9a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:59.324931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:59.325784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:59.326068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:59.326348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:59.327504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:59.330920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:59.366295 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2728/5432] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:07:59.371138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:59.386549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc55af-5df1-4b4e-826b-bd80d1abd258 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:59.402420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:59.402420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:59.402420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:59.403315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] PATH_INFO: `/v3/projects/29331133a8d442bfaabe8b0230a07087/users/cf9c0a0a296f47ed90ccda98e649367d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:59.424751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29331133a8d442bfaabe8b0230a07087, user_id=cf9c0a0a296f47ed90ccda98e649367d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:59.439881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:59.538901 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2705/5433] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:59 2022] PUT /identity/v3/projects/29331133a8d442bfaabe8b0230a07087/users/cf9c0a0a296f47ed90ccda98e649367d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:59.543726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:59.555278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27d0a2-ecb0-461b-b08a-96155e257747 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:59.665233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a75d-b776-4da9-b5fd-278e2f0073ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:59.665954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a75d-b776-4da9-b5fd-278e2f0073ca admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:59.666295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a75d-b776-4da9-b5fd-278e2f0073ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:59.666640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a75d-b776-4da9-b5fd-278e2f0073ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:59.667408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a75d-b776-4da9-b5fd-278e2f0073ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:59.669447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a75d-b776-4da9-b5fd-278e2f0073ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:59.681451 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2729/5434] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:07:59.685890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:07:59.699156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eeda-4351-4cc4-9d5e-eb4e10a6e39f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:07:59.706848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:07:59.707631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:59.708005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:59.708409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] PATH_INFO: `/v3/projects/29331133a8d442bfaabe8b0230a07087/users/cf9c0a0a296f47ed90ccda98e649367d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:59.713970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29331133a8d442bfaabe8b0230a07087, user_id=cf9c0a0a296f47ed90ccda98e649367d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:07:59.713970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:07:59.740184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2706/5435] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:07:59 2022] PUT /identity/v3/projects/29331133a8d442bfaabe8b0230a07087/users/cf9c0a0a296f47ed90ccda98e649367d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:07:59.754423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:07:59.758026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:07:59.758026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:07:59.799070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] MFA Rules not processed for user `cf9c0a0a296f47ed90ccda98e649367d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:07:59.800469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:07:59.901108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:07:59.959069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2730/5436] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:07:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:07:59.961110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:00.174399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2cb7e-3ce1-4721-91a2-c846033b8829 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:00.197078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:00.197727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:00.198015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:00.198295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:00.198957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:00.201045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:00.490600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2707/5437] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:07:59 2022] POST /identity/v3/projects => generated 381 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:00.491855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:00.503676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07c621-0710-4c60-96d4-6b34e5c0f6cc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:00.615671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:00.618647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:00.618950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:00.619302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:00.619974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:00.621986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:00.740006 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2731/5438] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:00 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:00.741207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:00.760936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daae7a-f35d-4520-a3e1-534dcd701658 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:00.769131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:00.771189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:00.771189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:00.771189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:00.771189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:00.772652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:00.811902 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2708/5439] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:00.815979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:00.843272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd37ded-83b3-4eb5-911b-e31041ac2bc0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:00.843272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b319c0-6508-43b3-aa6c-2a4bd8949759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:00.844540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b319c0-6508-43b3-aa6c-2a4bd8949759 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:00.856387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b319c0-6508-43b3-aa6c-2a4bd8949759 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:00.856387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b319c0-6508-43b3-aa6c-2a4bd8949759 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:00.856387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b319c0-6508-43b3-aa6c-2a4bd8949759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:00.856387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b319c0-6508-43b3-aa6c-2a4bd8949759 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:00.887361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:00.887629 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2732/5440] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:08:00.921389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f2e8f-d7f3-4fb5-8846-b3eb818c4904 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:00.927471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:00.928325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:00.928731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:00.929247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] PATH_INFO: `/v3/projects/4a1d6bf4c93147708fb621bf88ef0c14/users/987877531e714344a4d817c3bc013e8f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:00.960458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1d6bf4c93147708fb621bf88ef0c14, user_id=987877531e714344a4d817c3bc013e8f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:00.968372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:01.085148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2709/5441] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:00 2022] PUT /identity/v3/projects/4a1d6bf4c93147708fb621bf88ef0c14/users/987877531e714344a4d817c3bc013e8f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:01.094331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:01.202126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:01.202416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:01.202698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:01.248543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] MFA Rules not processed for user `987877531e714344a4d817c3bc013e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:01.250627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:01.394536 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2733/5442] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:01.425974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:01.429493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:01.552704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2ee9-0927-4dd5-b1eb-eae0688b718e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:01.557796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954302f2-39e3-441d-aa54-58916fc4ea4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:01.558437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954302f2-39e3-441d-aa54-58916fc4ea4e service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:01.558767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954302f2-39e3-441d-aa54-58916fc4ea4e service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:01.559111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954302f2-39e3-441d-aa54-58916fc4ea4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:01.682981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954302f2-39e3-441d-aa54-58916fc4ea4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:01.684535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954302f2-39e3-441d-aa54-58916fc4ea4e service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:01.697597 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2710/5443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:03.729674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:03.830964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:03.865110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c89324-5123-4639-9864-24efb559ffc1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:03.875785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:03.876498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:03.876748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:03.877023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] PATH_INFO: `/v3/users/cf9c0a0a296f47ed90ccda98e649367d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:03.879991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9c0a0a296f47ed90ccda98e649367d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:03.882218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:04.139986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9c0a0a296f47ed90ccda98e649367d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:04.155716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9c0a0a296f47ed90ccda98e649367d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:04.156559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9c0a0a296f47ed90ccda98e649367d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:04.157852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9c0a0a296f47ed90ccda98e649367d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:04.175115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c4d1578d-4843-4a17-8949-db825514355c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9c0a0a296f47ed90ccda98e649367d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:04.286587 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2734/5444] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:03 2022] DELETE /identity/v3/users/cf9c0a0a296f47ed90ccda98e649367d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:04.291473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:04.292034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:04.292034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:04.317229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:04.317506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:04.317781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:04.328991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:04.328991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:04.340613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:04.341864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:04.398400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2711/5445] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:04.408280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:04.413025 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2735/5446] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:04.413176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:04.443309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:04.447392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:04.483151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204cf6c-031e-4a8c-9d2f-7552ea0e122f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:04.486933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:04.487658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:04.488047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:04.488737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:04.496034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:04.500161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:04.510547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:04.513903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2712/5447] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:08:04.558376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beb30b-21ae-411a-8c52-e0f889a1f44d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:04.564891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:04.565766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:04.566274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:04.566711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:04.576093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:04.577673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:04.586173 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2736/5448] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:08:05.262593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:05.264510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:05.297870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f019230-38cd-4cae-a2e9-84fd7fd18220 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:05.311695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:05.313031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:05.313515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:05.314728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] PATH_INFO: `/v3/projects/29331133a8d442bfaabe8b0230a07087` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:05.316499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29331133a8d442bfaabe8b0230a07087)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:05.319339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:05.457088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29331133a8d442bfaabe8b0230a07087', 'request_id': 'req-bfd83ef2-6071-4053-b20d-abb9712eb273'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.466300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29331133a8d442bfaabe8b0230a07087', 'request_id': 'req-bfd83ef2-6071-4053-b20d-abb9712eb273'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.475500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29331133a8d442bfaabe8b0230a07087', 'request_id': 'req-bfd83ef2-6071-4053-b20d-abb9712eb273'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.582191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] The token cache is being invalidate because project 29331133a8d442bfaabe8b0230a07087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:05.582504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.590491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.592376 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2713/5449] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:05 2022] DELETE /identity/v3/projects/29331133a8d442bfaabe8b0230a07087 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:05.596367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:05.605665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:05.613998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3281e-8bfe-4bd8-bcb6-a865842fa143 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:05.731238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:05.732354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:05.732804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:05.733368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] PATH_INFO: `/v3/users/987877531e714344a4d817c3bc013e8f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:05.735868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=987877531e714344a4d817c3bc013e8f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:05.747235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:05.979405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987877531e714344a4d817c3bc013e8f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.993784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987877531e714344a4d817c3bc013e8f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.997706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987877531e714344a4d817c3bc013e8f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:05.999054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987877531e714344a4d817c3bc013e8f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:06.026959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16893704-2c95-4d84-a793-6f46612366ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987877531e714344a4d817c3bc013e8f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:06.162417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2737/5450] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:05 2022] DELETE /identity/v3/users/987877531e714344a4d817c3bc013e8f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:06.813631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:06.815310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:06.849167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd83ef2-6071-4053-b20d-abb9712eb273 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:06.936471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:06.937413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:06.937772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:06.938106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] PATH_INFO: `/v3/projects/4a1d6bf4c93147708fb621bf88ef0c14` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:06.939614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1d6bf4c93147708fb621bf88ef0c14)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:06.941707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:07.119854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1d6bf4c93147708fb621bf88ef0c14', 'request_id': 'req-58a03aaf-e840-4266-8c74-38ed43736cf7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:07.130195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1d6bf4c93147708fb621bf88ef0c14', 'request_id': 'req-58a03aaf-e840-4266-8c74-38ed43736cf7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:07.145289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1d6bf4c93147708fb621bf88ef0c14', 'request_id': 'req-58a03aaf-e840-4266-8c74-38ed43736cf7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:07.272239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] The token cache is being invalidate because project 4a1d6bf4c93147708fb621bf88ef0c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:07.272614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:07.273342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58a03aaf-e840-4266-8c74-38ed43736cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:07.278197 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2714/5451] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:06 2022] DELETE /identity/v3/projects/4a1d6bf4c93147708fb621bf88ef0c14 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:07.283034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed28d-93f7-4f00-86a4-f150b25f9254 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:07.283565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed28d-93f7-4f00-86a4-f150b25f9254 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:07.283777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed28d-93f7-4f00-86a4-f150b25f9254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:07.327187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bb6ed28d-93f7-4f00-86a4-f150b25f9254 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:07.328667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bb6ed28d-93f7-4f00-86a4-f150b25f9254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:07.385408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:07.385649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:07.385926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:07.415591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:07.432636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:07.434542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:07.441918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2738/5452] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:07.452078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:07.452843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:07.453323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:07.489715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:07.491559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:07.503849 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2739/5453] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:08:07.510321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:07.538708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1294-9e65-45f6-861b-4c6e732ea8d8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:07.564338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:07.566971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:07.567400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:07.567785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:07.572601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:07.573074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:07.575141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:07.609010 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2740/5454] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:08:07.610537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:07.622272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:07.640784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68706-1bc7-4c3b-8954-955657381cd9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:07.649769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:07.650576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:07.651102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:07.651919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:07.652756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:07.655380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:07.716844 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2715/5455] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:07.731282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:07.733185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:07.828738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2741/5456] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:07 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:07.833584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:07.941833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a56383-e13e-4a4f-9669-ac8b3df5a1bc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:07.985841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6ca6-ab3e-4fbe-9d76-6f52d2c04bec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:07.992555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:07.993570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:07.994037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:07.994558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:07.995465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:08.002932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:08.045458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:08.046514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:08.046811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:08.047148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:08.105925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2742/5457] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:07 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:08.113414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:08.159744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb41c7-0184-4fae-9499-777250c82209 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:08.170492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:08.180522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:08.184304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:08.198812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:08.199842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:08.202792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:08.202792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:08.202792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:08.205364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:08.226694 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2716/5458] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:08:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:08.246661 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2743/5459] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:08.247410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:08.281473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57201-c9cd-40c5-9b7f-051e01e35ac2 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:08.302036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:08.302036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:08.302036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:08.302036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] PATH_INFO: `/v3/projects/ad830a6442e2475387c4e69e3583d205/users/538f1feaa43a46a5901fbccac94906c3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:08.365103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad830a6442e2475387c4e69e3583d205, user_id=538f1feaa43a46a5901fbccac94906c3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:08.369708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:08.528373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2717/5460] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:08 2022] PUT /identity/v3/projects/ad830a6442e2475387c4e69e3583d205/users/538f1feaa43a46a5901fbccac94906c3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:08.529258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:08.540948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f2349-f511-45e7-9482-0f217b0e05f8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:08.625276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcd51c-577a-45fa-866f-af4d1ba3a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:08.626179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcd51c-577a-45fa-866f-af4d1ba3a5ce admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:08.626673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcd51c-577a-45fa-866f-af4d1ba3a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:08.627192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcd51c-577a-45fa-866f-af4d1ba3a5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:08.628206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcd51c-577a-45fa-866f-af4d1ba3a5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:08.639042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcd51c-577a-45fa-866f-af4d1ba3a5ce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:08.658469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2744/5461] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:08.660718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:08.680763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f26389-fb9b-4cf9-bafc-1dda2bba97c0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:08.698138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:08.699119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:08.699747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:08.700546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] PATH_INFO: `/v3/projects/ad830a6442e2475387c4e69e3583d205/users/538f1feaa43a46a5901fbccac94906c3/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:08.703721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad830a6442e2475387c4e69e3583d205, user_id=538f1feaa43a46a5901fbccac94906c3, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:08.706503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:08.722853 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2718/5462] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:08 2022] PUT /identity/v3/projects/ad830a6442e2475387c4e69e3583d205/users/538f1feaa43a46a5901fbccac94906c3/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:08.742666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:08.743709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:08.743995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:08.776805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] MFA Rules not processed for user `538f1feaa43a46a5901fbccac94906c3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:08.778055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:08.912891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:08.963110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2745/5463] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:08.970760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:09.090220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed559-d661-4552-8094-ce3a73da171c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:09.095354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:09.097479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:09.097479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:09.097479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:09.097479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:09.100174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:09.229110 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2719/5464] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:08 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:09.234855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:09.247636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0f52a-cfdb-427c-b602-a0244576e4cf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:09.309251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:09.310081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:09.310463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:09.310855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:09.311639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:09.313761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:09.438726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2746/5465] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:09 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:09.439981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:09.451972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d646458-4899-4c92-96b4-7d200915f19f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:09.458157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:09.458829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:09.459147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:09.459417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:09.460232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:09.462938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:09.475829 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2720/5466] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:09.480206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:09.491302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf30ba4-f64b-46e3-947c-ae9cdc150508 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:09.497871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24e42-7965-4e75-8a99-ef09facbf332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:09.498104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24e42-7965-4e75-8a99-ef09facbf332 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:09.498564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24e42-7965-4e75-8a99-ef09facbf332 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:09.498564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24e42-7965-4e75-8a99-ef09facbf332 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:09.499335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24e42-7965-4e75-8a99-ef09facbf332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:09.500957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24e42-7965-4e75-8a99-ef09facbf332 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:09.514457 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2747/5467] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:08:09.518692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:09.533672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a5dc9-c583-4534-9ca4-397379b6893a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:09.538626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:09.539516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:09.539982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:09.540294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] PATH_INFO: `/v3/projects/7ad01ae831a145dda018d758503a77b1/users/aea2908cceae4e2b9d0e350ed94efbc1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:09.566132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad01ae831a145dda018d758503a77b1, user_id=aea2908cceae4e2b9d0e350ed94efbc1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:09.569437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:09.661339 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2721/5468] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:09 2022] PUT /identity/v3/projects/7ad01ae831a145dda018d758503a77b1/users/aea2908cceae4e2b9d0e350ed94efbc1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:09.667025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:09.668185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:09.668834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:09.713857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] MFA Rules not processed for user `aea2908cceae4e2b9d0e350ed94efbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:09.717768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:09.835060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2748/5469] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:10.891894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:10.894380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:10.979889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b094-36f0-4b2a-955f-6cc786622717 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:10.984300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b238-0d22-4839-9d46-b721df70674a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:10.985218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b238-0d22-4839-9d46-b721df70674a service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:10.985607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b238-0d22-4839-9d46-b721df70674a service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:10.987519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b238-0d22-4839-9d46-b721df70674a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:11.017099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:11.076118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b238-0d22-4839-9d46-b721df70674a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:11.080394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b238-0d22-4839-9d46-b721df70674a service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:11.092915 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2722/5470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:11.964801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:12.160425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:12.188365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a667c4-4601-4683-b443-40604427e8cf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:12.194760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:12.194909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:12.195262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:12.195551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] PATH_INFO: `/v3/users/538f1feaa43a46a5901fbccac94906c3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:12.198249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538f1feaa43a46a5901fbccac94906c3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:12.200435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:12.529188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538f1feaa43a46a5901fbccac94906c3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:12.566243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538f1feaa43a46a5901fbccac94906c3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:12.568892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538f1feaa43a46a5901fbccac94906c3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:12.575886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538f1feaa43a46a5901fbccac94906c3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:12.607946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538f1feaa43a46a5901fbccac94906c3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:12.703237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2749/5471] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:11 2022] DELETE /identity/v3/users/538f1feaa43a46a5901fbccac94906c3 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:12.709819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:12.710413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:12.710413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:12.739328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:12.741657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:12.934650 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2723/5472] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:13.022089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:13.025988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:13.179478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c739-ce91-47b6-87ab-d54c1c1d8184 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:13.187054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:13.188302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:13.188800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:13.189142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:13.224817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:13.230997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:13.255314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2750/5473] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:08:13.673829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:13.676810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:13.765802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:13.769520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:13.854705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f293ea-96e1-4943-8ee3-4a67358a1b5d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:13.873738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:13.878888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:13.878888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:13.878888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:13.884897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:13.908267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:13.908267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:13.926444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2724/5474] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:13.967179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003553-0474-4636-b6dd-aedb618685d8 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:13.976170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:13.976966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:13.977388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:13.977673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:13.998340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:14.001509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:14.019382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:14.039969 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2751/5475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:14.329131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:14.330819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:14.374529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eef19a-79c0-4f14-a75d-8060aba0d46e service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:14.390087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:14.391089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:14.391498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:14.391889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] PATH_INFO: `/v3/projects/ad830a6442e2475387c4e69e3583d205` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:14.394555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad830a6442e2475387c4e69e3583d205)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:14.400722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:14.646242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:14.663820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad830a6442e2475387c4e69e3583d205', 'request_id': 'req-82dd9a79-2315-4dd5-ab7d-debe7857b0da'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:14.675684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad830a6442e2475387c4e69e3583d205', 'request_id': 'req-82dd9a79-2315-4dd5-ab7d-debe7857b0da'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:14.702773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad830a6442e2475387c4e69e3583d205', 'request_id': 'req-82dd9a79-2315-4dd5-ab7d-debe7857b0da'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:14.837880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] The token cache is being invalidate because project ad830a6442e2475387c4e69e3583d205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:14.837880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:14.837880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:14.837880 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2725/5476] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:14 2022] DELETE /identity/v3/projects/ad830a6442e2475387c4e69e3583d205 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:14.840275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:14.861180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07bd2-df32-4103-8106-82e36d552925 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:14.957689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:14.958353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:14.958636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:14.958912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] PATH_INFO: `/v3/users/aea2908cceae4e2b9d0e350ed94efbc1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:14.961454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea2908cceae4e2b9d0e350ed94efbc1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:14.963785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:15.358371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea2908cceae4e2b9d0e350ed94efbc1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:15.374085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea2908cceae4e2b9d0e350ed94efbc1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:15.375308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea2908cceae4e2b9d0e350ed94efbc1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:15.381527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea2908cceae4e2b9d0e350ed94efbc1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:15.435368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ab8db60-6522-416e-8c04-5ea24c557a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea2908cceae4e2b9d0e350ed94efbc1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:15.555746 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2752/5477] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:14 2022] DELETE /identity/v3/users/aea2908cceae4e2b9d0e350ed94efbc1 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:16.298600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:16.300459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:16.331815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd9a79-2315-4dd5-ab7d-debe7857b0da admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:16.454963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:16.455914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:16.456409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:16.457117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] PATH_INFO: `/v3/projects/7ad01ae831a145dda018d758503a77b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:16.458826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad01ae831a145dda018d758503a77b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:16.462272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:16.669488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad01ae831a145dda018d758503a77b1', 'request_id': 'req-b95154e8-c205-4002-8946-aa602b51f172'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:16.681583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad01ae831a145dda018d758503a77b1', 'request_id': 'req-b95154e8-c205-4002-8946-aa602b51f172'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:16.689865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad01ae831a145dda018d758503a77b1', 'request_id': 'req-b95154e8-c205-4002-8946-aa602b51f172'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:16.798876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] The token cache is being invalidate because project 7ad01ae831a145dda018d758503a77b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:16.799340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:16.800794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b95154e8-c205-4002-8946-aa602b51f172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:16.804741 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2726/5478] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:16 2022] DELETE /identity/v3/projects/7ad01ae831a145dda018d758503a77b1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:16.812078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:16.812605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:16.813233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:16.863261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:16.867120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:16.963062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2753/5479] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:16.969193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:16.973378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:16.973378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:16.997043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:16.998851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:17.015937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2727/5480] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:17.016668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:17.034349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10993671-23c6-4110-8900-ba2942c84b39 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:17.041307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:17.042665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.043083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.043317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:17.044223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:17.044988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:17.047639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:17.067843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2754/5481] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:08:17.073289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:17.085796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7d83-5c40-43eb-9c83-66e77b46eee0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:17.095734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:17.096421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.096707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.097020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:17.097669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:17.099632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:17.227439 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2728/5482] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:17 2022] POST /identity/v3/projects => generated 409 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:17.228631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:17.241973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c729f-acc8-4166-812d-7742665119c0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:17.246334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:17.410927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:17.412536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.414205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.414678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:17.415390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:17.417511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:17.548197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:17.556189 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2755/5483] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:17 2022] POST /identity/v3/users => generated 305 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:17.567890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b59777-8602-4796-b944-1f63b36ce3f8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:17.576501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:17.577406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.577958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.578184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:17.579036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:17.581023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:17.596393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2729/5484] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:08:17.597671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:17.609118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2825185-6652-4b64-a1f7-e470a3f4ac62 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:17.624241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99272bc4-9073-4ea7-adb9-13b1eb4c9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:17.625270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99272bc4-9073-4ea7-adb9-13b1eb4c9e1e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.625650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99272bc4-9073-4ea7-adb9-13b1eb4c9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.626115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99272bc4-9073-4ea7-adb9-13b1eb4c9e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:17.626883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99272bc4-9073-4ea7-adb9-13b1eb4c9e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:17.628649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99272bc4-9073-4ea7-adb9-13b1eb4c9e1e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:17.663663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:17.684021 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2756/5485] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:17.690502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b724-bf92-4701-a51e-d6e458afff1b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:17.704307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:17.705680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.706194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.706713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] PATH_INFO: `/v3/projects/d6a048af6d914061bdeded4be23b971b/users/8abc0cc234274807abbebbd8303bbe16/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:17.722356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:17.738131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a048af6d914061bdeded4be23b971b, user_id=8abc0cc234274807abbebbd8303bbe16, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:17.742093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:17.904478 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2730/5486] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:17 2022] PUT /identity/v3/projects/d6a048af6d914061bdeded4be23b971b/users/8abc0cc234274807abbebbd8303bbe16/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:17.917770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609125e-a749-4998-8aca-35e656e23553 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:17.918306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609125e-a749-4998-8aca-35e656e23553 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:17.918387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609125e-a749-4998-8aca-35e656e23553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:18.017473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6609125e-a749-4998-8aca-35e656e23553 None None] MFA Rules not processed for user `8abc0cc234274807abbebbd8303bbe16`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:18.017473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6609125e-a749-4998-8aca-35e656e23553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:18.142914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2757/5487] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:18.143286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:18.279473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b316b42-80c0-4b4d-abc4-242c19968978 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:18.287350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:18.288645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:18.289894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:18.290365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:18.291251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:18.293647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:18.428140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609125e-a749-4998-8aca-35e656e23553 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:18.428500 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2731/5488] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:18 2022] POST /identity/v3/projects => generated 411 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:18.443904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609125e-a749-4998-8aca-35e656e23553 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:18.557819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:18.558614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:18.559549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:18.564049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:18.564049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:18.564049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:18.729495 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2758/5489] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:18 2022] POST /identity/v3/users => generated 312 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:18.736694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:18.771472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862186f-45f8-4867-8a48-f5621aee226f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:18.811500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:18.812147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:18.812440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:18.812721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:18.818662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:18.843702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:18.912282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:18.917961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2732/5490] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:18.923568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:18.931621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fef4b-b8b2-486b-96c6-40fc07f1c0c0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:18.947644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:18.948606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:18.948902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:18.949183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] PATH_INFO: `/v3/projects/f2dd01c6818e410e94b47df227fc038f/users/9ddb1b230a5a471b8584a511f3eaf978/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:18.988368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2dd01c6818e410e94b47df227fc038f, user_id=9ddb1b230a5a471b8584a511f3eaf978, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:18.996304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:19.101181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2759/5491] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:18 2022] PUT /identity/v3/projects/f2dd01c6818e410e94b47df227fc038f/users/9ddb1b230a5a471b8584a511f3eaf978/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:19.106779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:19.127200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623b547-2c2e-4042-9aac-ad6dbfe34fa6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:19.238571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4523f88-e532-43a6-9ccb-912a5e172b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:19.239502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523f88-e532-43a6-9ccb-912a5e172b8e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:19.240421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523f88-e532-43a6-9ccb-912a5e172b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:19.240421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4523f88-e532-43a6-9ccb-912a5e172b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:19.241153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4523f88-e532-43a6-9ccb-912a5e172b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:19.243912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4523f88-e532-43a6-9ccb-912a5e172b8e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:19.263258 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2733/5492] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:19.264369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:19.278087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb396-a883-4545-ba81-82f456a7ac21 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:19.293134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:19.294184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:19.294886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:19.295378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] PATH_INFO: `/v3/projects/f2dd01c6818e410e94b47df227fc038f/users/9ddb1b230a5a471b8584a511f3eaf978/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:19.299195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2dd01c6818e410e94b47df227fc038f, user_id=9ddb1b230a5a471b8584a511f3eaf978, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:19.307758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:19.331032 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2760/5493] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:19 2022] PUT /identity/v3/projects/f2dd01c6818e410e94b47df227fc038f/users/9ddb1b230a5a471b8584a511f3eaf978/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:08:19.344211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:19.344536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:19.344803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:19.429634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] MFA Rules not processed for user `9ddb1b230a5a471b8584a511f3eaf978`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:19.445554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:19.452894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:19.456432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:19.655948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:19.680349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce951b-6c6d-4fc3-97c8-930a530559e8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:19.689988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:19.693203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:19.694226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:19.696276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:19.698602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:19.719056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2734/5494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:19.824413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:19.826370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:19.854038 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2761/5495] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:20.229260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:20.230934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:20.366147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:20.368269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:20.449531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7c381-20ed-41d6-931a-9d992f2885c3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:20.474458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badf602-12f0-4595-92b9-3a71cccb893f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:20.475535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf602-12f0-4595-92b9-3a71cccb893f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:20.476056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf602-12f0-4595-92b9-3a71cccb893f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:20.476581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf602-12f0-4595-92b9-3a71cccb893f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:20.503331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badf602-12f0-4595-92b9-3a71cccb893f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:20.506024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badf602-12f0-4595-92b9-3a71cccb893f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:20.520480 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2735/5496] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:20.630398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bdb57-1348-40e9-9c43-2ff66e92dc77 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:20.636922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:20.637835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:20.638270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:20.639935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] PATH_INFO: `/v3/users/87109fdea86d40f38dc8dbeb664b9e5c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:20.646037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87109fdea86d40f38dc8dbeb664b9e5c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:20.648519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:20.655538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:20.925233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87109fdea86d40f38dc8dbeb664b9e5c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:20.937329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87109fdea86d40f38dc8dbeb664b9e5c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:20.941745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87109fdea86d40f38dc8dbeb664b9e5c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:20.943621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87109fdea86d40f38dc8dbeb664b9e5c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:20.975073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87109fdea86d40f38dc8dbeb664b9e5c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:21.049261 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2762/5497] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:20 2022] DELETE /identity/v3/users/87109fdea86d40f38dc8dbeb664b9e5c => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:08:21.054475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:21.055916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:21.056511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:21.115997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:21.119833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:21.335539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2736/5498] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:21.358816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:21.360325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:21.585363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb3068-0fd3-428b-a814-e3a2a2986a60 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:21.585363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:21.585363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:21.585363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:21.587852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:21.587852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:21.587852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:21.587852 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2763/5499] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:22.479252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:22.482191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:22.527670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814d4b5-3733-4419-9cfd-58283a82e3f6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:22.536810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:22.537891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:22.538381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:22.539090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] PATH_INFO: `/v3/projects/53043c49bd5c4591bbfc72c443cf66ee` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:22.543189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=53043c49bd5c4591bbfc72c443cf66ee)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:22.546422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:22.737107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53043c49bd5c4591bbfc72c443cf66ee', 'request_id': 'req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:22.783514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53043c49bd5c4591bbfc72c443cf66ee', 'request_id': 'req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:22.821829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53043c49bd5c4591bbfc72c443cf66ee', 'request_id': 'req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:22.926844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] The token cache is being invalidate because project 53043c49bd5c4591bbfc72c443cf66ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:22.926844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:22.926844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:22.926844 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2737/5500] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:22 2022] DELETE /identity/v3/projects/53043c49bd5c4591bbfc72c443cf66ee => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:22.927843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:22.943864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9279-a037-41a8-8197-b7a193de6ae0 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:23.063120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:23.064159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:23.065387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:23.065932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] PATH_INFO: `/v3/users/8e07a83819a04ae2b19ba5c95d236a59` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:23.067847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e07a83819a04ae2b19ba5c95d236a59)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:23.070197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:23.200012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:23.457067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e07a83819a04ae2b19ba5c95d236a59'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:23.474480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e07a83819a04ae2b19ba5c95d236a59'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:23.476999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e07a83819a04ae2b19ba5c95d236a59'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:23.476999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e07a83819a04ae2b19ba5c95d236a59'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:23.495790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e07a83819a04ae2b19ba5c95d236a59'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:23.601467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2764/5501] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:22 2022] DELETE /identity/v3/users/8e07a83819a04ae2b19ba5c95d236a59 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:24.219657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:24.222457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:24.246665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:24.345202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9ca1e-bb85-4ee3-977b-b6c3cbe830ae admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:24.392205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:24.392725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:24.528535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:24.529776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:24.529776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:24.530549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:24.536317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:24.595893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:24.606613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:24.651228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2738/5502] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:24.656344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:24.658777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:24.734006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8972d79-5781-4e0e-a926-677c68764d6f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:24.760290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:24.762022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:24.763896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:24.764311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] PATH_INFO: `/v3/projects/3002f241f3f042af80c23ad5a47a795b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:24.767607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3002f241f3f042af80c23ad5a47a795b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:24.774370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:24.842596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ea61-221d-42a5-9fcc-4596e602904f service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:24.854739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:24.856191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:24.856559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:24.857301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] PATH_INFO: `/v3/users/e94103c4c75b4f2d8b2cb1bd4b6bcf6a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:24.859762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94103c4c75b4f2d8b2cb1bd4b6bcf6a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:24.863396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:25.033922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3002f241f3f042af80c23ad5a47a795b', 'request_id': 'req-974289e5-8a18-4e7b-81c2-1973081508fa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.051862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3002f241f3f042af80c23ad5a47a795b', 'request_id': 'req-974289e5-8a18-4e7b-81c2-1973081508fa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.069915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3002f241f3f042af80c23ad5a47a795b', 'request_id': 'req-974289e5-8a18-4e7b-81c2-1973081508fa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.190982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.199113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:25.209477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] The token cache is being invalidate because project 3002f241f3f042af80c23ad5a47a795b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:25.209952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.211533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-974289e5-8a18-4e7b-81c2-1973081508fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.213066 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2765/5503] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:24 2022] DELETE /identity/v3/projects/3002f241f3f042af80c23ad5a47a795b => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:25.225635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.228228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.231792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:25.231792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:25.231792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:25.262798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.263593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0f41f5a4-d60e-42b1-957f-eed8deb31b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94103c4c75b4f2d8b2cb1bd4b6bcf6a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:25.288347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:25.290355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:25.348241 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2739/5504] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:24 2022] DELETE /identity/v3/users/e94103c4c75b4f2d8b2cb1bd4b6bcf6a => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:25.363227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:25.447632 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2766/5505] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:25.455749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:25.456470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:25.456963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:25.482897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:25.484567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:25.589016 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2740/5506] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:25.593811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:25.608956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b5069-3f1c-4609-aad1-01d6a7167d36 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:25.617576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:25.618546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:25.619643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:25.620386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:25.620725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:25.621044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:25.622908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:25.642378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2767/5507] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:08:25.646741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:25.665293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9e55-3381-41f2-8ead-33883ccb8a7b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:25.673622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:25.674751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:25.675275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:25.675784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:25.676920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:25.688350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:25.855977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2741/5508] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:25 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:25.860893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:25.889167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6facd-e225-452f-bcd0-471e79c40c8f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:25.983733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:25.986658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:26.047586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:26.048999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.048999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.049250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.050012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:26.052180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:26.177829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2768/5509] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:25 2022] POST /identity/v3/users => generated 292 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:26.179217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:26.212888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faefbe-1942-4e15-a5dd-51481e38577b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:26.213299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431158b4-9fd8-46d6-8753-f99202be1b0d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:26.225840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:26.228869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:26.229333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.229438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.229438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.229438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] PATH_INFO: `/v3/projects/3bce0861528a4891b94d174e964456f0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.238193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bce0861528a4891b94d174e964456f0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:26.244286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.244771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.248295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:26.248554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:26.252590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:26.279626 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2769/5510] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:26.287754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:26.309498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025110-16d4-4341-878a-30c843ab70bd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:26.315867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:26.317236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.317236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.317445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.318406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:26.321574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:26.340552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2770/5511] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:26.341108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:26.362522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5057b-aece-4dca-b675-3d628bab68c2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:26.375612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525ecbe-7ae8-4e41-877a-63627dd4abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:26.384232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525ecbe-7ae8-4e41-877a-63627dd4abf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.384649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525ecbe-7ae8-4e41-877a-63627dd4abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.385388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525ecbe-7ae8-4e41-877a-63627dd4abf8 admin admin] PATH_INFO: `/v3/projects/3298773c4bd9452c90a38334e7a0cdc1/users/f160a950e90c445698d7f5ea36944398/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.429151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525ecbe-7ae8-4e41-877a-63627dd4abf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3298773c4bd9452c90a38334e7a0cdc1, user_id=f160a950e90c445698d7f5ea36944398, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:26.429452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:26.437986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525ecbe-7ae8-4e41-877a-63627dd4abf8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:26.439455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bce0861528a4891b94d174e964456f0', 'request_id': 'req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:26.447389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bce0861528a4891b94d174e964456f0', 'request_id': 'req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:26.455920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bce0861528a4891b94d174e964456f0', 'request_id': 'req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:26.573416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2771/5512] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:26 2022] PUT /identity/v3/projects/3298773c4bd9452c90a38334e7a0cdc1/users/f160a950e90c445698d7f5ea36944398/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:26.581206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.581945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.583158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.595314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] The token cache is being invalidate because project 3bce0861528a4891b94d174e964456f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:26.598466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:26.599062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9ec2c1a1-2702-4c62-b1a1-c26a0b7db935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:26.619381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2742/5513] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:25 2022] DELETE /identity/v3/projects/3bce0861528a4891b94d174e964456f0 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:26.620637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757f095-b3b7-4209-b09a-fb39d6ec7607 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.620926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757f095-b3b7-4209-b09a-fb39d6ec7607 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.622252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757f095-b3b7-4209-b09a-fb39d6ec7607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.642256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] MFA Rules not processed for user `f160a950e90c445698d7f5ea36944398`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:26.644191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:26.735410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9757f095-b3b7-4209-b09a-fb39d6ec7607 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:26.736825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9757f095-b3b7-4209-b09a-fb39d6ec7607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:26.739746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:26.754736 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2772/5514] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:26.766780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:26.771183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:26.869007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a21286-5678-4dc5-981e-cfdcf9f50dab None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:26.892426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:26.893767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.894269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.894651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] PATH_INFO: `/v3/users/8abc0cc234274807abbebbd8303bbe16` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:26.913393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abc0cc234274807abbebbd8303bbe16)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:26.917122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:26.982614 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2743/5515] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:26.984585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263cc98-3ab1-4bb6-af42-8a3740b204b3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:26.985095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263cc98-3ab1-4bb6-af42-8a3740b204b3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:26.986347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263cc98-3ab1-4bb6-af42-8a3740b204b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.040837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2263cc98-3ab1-4bb6-af42-8a3740b204b3 None None] MFA Rules not processed for user `f160a950e90c445698d7f5ea36944398`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:27.065319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2263cc98-3ab1-4bb6-af42-8a3740b204b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.094222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2744/5516] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:27.096524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:27.097158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:27.097777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.156702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:27.160308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.175214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2745/5517] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:27.176694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:27.178331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.277504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abc0cc234274807abbebbd8303bbe16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:27.296315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abc0cc234274807abbebbd8303bbe16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:27.299788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abc0cc234274807abbebbd8303bbe16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:27.301501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abc0cc234274807abbebbd8303bbe16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:27.338845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-728517b8-4bca-49f1-912b-f428c9206aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abc0cc234274807abbebbd8303bbe16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:27.361392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb82f-e853-4ebe-bb27-ea9dd36b6d75 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:27.379623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:27.380553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:27.380553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:27.380823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.383154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.395708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:27.399174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:27.415636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2746/5518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:27.416896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:27.419306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.435142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc97cd3-0a72-4121-804c-184c87fe6f75 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:27.440904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:27.441775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:27.442163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:27.442543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.443468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:27.443877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:27.446281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:27.477062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2773/5519] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:26 2022] DELETE /identity/v3/users/8abc0cc234274807abbebbd8303bbe16 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:27.478417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:27.478552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:27.478809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.486861 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2747/5520] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:08:27.488077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:27.491542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.521284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee98358-93c5-4e00-8f8d-b7ddcaa5b1f1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:27.543243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:27.554721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:27.704585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:27.705595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:27.706080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:27.707241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] PATH_INFO: `/v3/users/2b51397c5872403c86210c2dc7f85735` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.708966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b51397c5872403c86210c2dc7f85735)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:27.711789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:27.791293 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2774/5521] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:27.791293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:27.813838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93b7b2-c7a9-4a4c-8e43-270dfb4f6e5e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:27.827708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:27.828444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:27.828801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:27.829156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:27.829934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:27.834783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:28.018165 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2775/5522] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:27 2022] POST /identity/v3/projects => generated 391 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:28.022566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:28.026748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:28.125120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c435de-13ed-4d11-b35f-acff34f06b45 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:28.127995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:28.128637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:28.129078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:28.129419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:28.145156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:28.212007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b51397c5872403c86210c2dc7f85735'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:28.220017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b51397c5872403c86210c2dc7f85735'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:28.221149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b51397c5872403c86210c2dc7f85735'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:28.227186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:28.227186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:28.236322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b51397c5872403c86210c2dc7f85735'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:28.237318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b51397c5872403c86210c2dc7f85735'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:28.242040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2776/5523] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:28.243335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:28.247140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:28.356957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea06c31-111e-4832-aaa9-a575fbf626fb service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:28.363064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:28.363527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:28.363827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:28.364103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:28.366334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:28.386248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:28.388533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:28.409574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2748/5524] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:27 2022] DELETE /identity/v3/users/2b51397c5872403c86210c2dc7f85735 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:28.409574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:28.410221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2777/5525] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:28.420383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:28.452148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:28.608079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbb274-9e75-41f7-ad8c-da9bc902e281 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:28.620180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:28.621048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:28.622426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:28.622924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:28.623767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:28.628365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:28.766148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2749/5526] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:28 2022] POST /identity/v3/users => generated 296 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:28.769421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:28.787718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9546d9-7084-4a16-8229-549a689d7042 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:28.797881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:28.805459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:28.805459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:28.805459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:28.805459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:28.805459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:28.858336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2778/5527] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:28.858766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:28.894165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559ab7-5a23-4984-b0d5-883a101bd3d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:28.923487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff695131-c662-48a6-bc7e-78953b862a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:28.924352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff695131-c662-48a6-bc7e-78953b862a4e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:28.924644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff695131-c662-48a6-bc7e-78953b862a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:28.924934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff695131-c662-48a6-bc7e-78953b862a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:28.925744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff695131-c662-48a6-bc7e-78953b862a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:28.928182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff695131-c662-48a6-bc7e-78953b862a4e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:28.946945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2750/5528] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:28.948843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:28.983906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb49c2-5309-4931-bc05-15b035b5352c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:28.999965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:29.004258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:29.004584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:29.005690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] PATH_INFO: `/v3/projects/887d04ff8eee40e59ec6dd248dd5b548/users/3e45dfaf9fd949548bca37303a117bb1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:29.041496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] RBAC: Authorizing `identity:create_grant(project_id=887d04ff8eee40e59ec6dd248dd5b548, user_id=3e45dfaf9fd949548bca37303a117bb1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:29.045595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:29.160186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5977-1f62-484d-a842-44822e4289dc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:29.160683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5977-1f62-484d-a842-44822e4289dc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:29.160982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5977-1f62-484d-a842-44822e4289dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:29.166281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2779/5529] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:28 2022] PUT /identity/v3/projects/887d04ff8eee40e59ec6dd248dd5b548/users/3e45dfaf9fd949548bca37303a117bb1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:29.239257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-218e5977-1f62-484d-a842-44822e4289dc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:29.240723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-218e5977-1f62-484d-a842-44822e4289dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:29.363217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:29.365155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:29.429992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158dd5-e257-4f64-b82c-13e8d991068d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:29.433643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2751/5530] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:29.436847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5977-1f62-484d-a842-44822e4289dc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:29.445796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:29.447771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-218e5977-1f62-484d-a842-44822e4289dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:29.486395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5977-1f62-484d-a842-44822e4289dc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:29.491217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:29.494956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:29.495846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:29.499626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:29.499773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] PATH_INFO: `/v3/projects/e2f1118744894767a4ab5c9bddc8e5fb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:29.499865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:29.499865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:29.499865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:29.500401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] PATH_INFO: `/v3/projects/d6a048af6d914061bdeded4be23b971b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:29.502648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a048af6d914061bdeded4be23b971b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:29.505081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:29.505869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f1118744894767a4ab5c9bddc8e5fb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:29.515966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:29.709911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f1118744894767a4ab5c9bddc8e5fb', 'request_id': 'req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.720733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a048af6d914061bdeded4be23b971b', 'request_id': 'req-59446f3d-5448-48e0-b43d-026f75686c9e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.725400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f1118744894767a4ab5c9bddc8e5fb', 'request_id': 'req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.736798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f1118744894767a4ab5c9bddc8e5fb', 'request_id': 'req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.739664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a048af6d914061bdeded4be23b971b', 'request_id': 'req-59446f3d-5448-48e0-b43d-026f75686c9e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.756467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a048af6d914061bdeded4be23b971b', 'request_id': 'req-59446f3d-5448-48e0-b43d-026f75686c9e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.848448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] The token cache is being invalidate because project e2f1118744894767a4ab5c9bddc8e5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:29.848827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.849431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.855341 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2780/5531] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:29 2022] DELETE /identity/v3/projects/e2f1118744894767a4ab5c9bddc8e5fb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:08:29.855341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:29.855341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:29.939486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41037e3e-88e7-49d8-8b60-bb9ec5e2749e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:29.945520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:29.946578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:29.947043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:29.947484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:29.949489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:29.967800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] The token cache is being invalidate because project d6a048af6d914061bdeded4be23b971b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:29.968457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.970184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-59446f3d-5448-48e0-b43d-026f75686c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:29.974296 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2752/5532] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:29 2022] DELETE /identity/v3/projects/d6a048af6d914061bdeded4be23b971b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:29.976777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096cf19-83a8-4daf-a55b-00743e740dd0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:29.977259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096cf19-83a8-4daf-a55b-00743e740dd0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:29.977709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096cf19-83a8-4daf-a55b-00743e740dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.021103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0096cf19-83a8-4daf-a55b-00743e740dd0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:30.022271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0096cf19-83a8-4daf-a55b-00743e740dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:30.093865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.095786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:30.123866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2781/5533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:30.125845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:30.130652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:30.151904 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2753/5534] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:30.155080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.155080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.155923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.157913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67a33-fe12-4c89-b82e-90bf219cba59 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:30.165181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:30.170304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.170304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.170304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] PATH_INFO: `/v3/users/9ddb1b230a5a471b8584a511f3eaf978` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.170304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddb1b230a5a471b8584a511f3eaf978)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.171370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:30.186194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:30.187991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:30.211093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2754/5535] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:30.215990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:30.229037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b9e73-2c2b-42a7-a9de-a43b3fec80fc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:30.235044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:30.235664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.235951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.236230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.236898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:30.237749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.243821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:30.261550 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2755/5536] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:08:30.262839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:30.278476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03061d-613b-4e29-9ce3-f01896f6305f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:30.288080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:30.289540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.289964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.290389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.300011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.302536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:30.332076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:30.473815 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2756/5537] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:30 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:30.477964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:30.484740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddb1b230a5a471b8584a511f3eaf978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:30.497292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:30.501107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddb1b230a5a471b8584a511f3eaf978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:30.502910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddb1b230a5a471b8584a511f3eaf978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:30.503683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddb1b230a5a471b8584a511f3eaf978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:30.556075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddb1b230a5a471b8584a511f3eaf978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:30.649012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2248-d570-4bb0-b367-eeaca09b15bb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:30.649012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:30.649012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.649012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.649634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.649634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.649634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:30.717613 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2782/5538] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:30 2022] DELETE /identity/v3/users/9ddb1b230a5a471b8584a511f3eaf978 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:30.806191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2757/5539] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:30 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:08:30.811408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:30.814749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:30.932981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12421ef6-4517-4e9b-bdfb-5078d63bef85 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:30.941594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:30.942228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.943111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.943111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.946045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.946045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:30.969715 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2783/5540] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:30.971169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:30.984918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85af72-c0db-40e6-a4f4-95c5081c74ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:30.992480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca5971-061c-41eb-a386-481268442e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:30.998466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca5971-061c-41eb-a386-481268442e7a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:30.998466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca5971-061c-41eb-a386-481268442e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:30.998466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca5971-061c-41eb-a386-481268442e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:30.998466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca5971-061c-41eb-a386-481268442e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:30.998466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca5971-061c-41eb-a386-481268442e7a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:31.016065 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2758/5541] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:08:31.017361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:31.031425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c4266-43ed-49b3-b994-9956a5a65666 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:31.037195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:31.038069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:31.038354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:31.038691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] PATH_INFO: `/v3/projects/eb1353cb350f4463862e78e75c5b2e50/users/b3257d707d4e47bd9c68496acf8788ad/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:31.090687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1353cb350f4463862e78e75c5b2e50, user_id=b3257d707d4e47bd9c68496acf8788ad, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:31.093516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:31.309876 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2784/5542] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:31 2022] PUT /identity/v3/projects/eb1353cb350f4463862e78e75c5b2e50/users/b3257d707d4e47bd9c68496acf8788ad/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:31.312766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:31.313349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:31.313762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:31.368244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:31.372146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:31.529479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2759/5543] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:08:31.568525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:31.571418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:31.614839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:31.622593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:31.641019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c8321-c537-4fce-8770-722dd8914ef3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:31.662933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:31.664598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:31.667558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:31.667938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] PATH_INFO: `/v3/projects/f2dd01c6818e410e94b47df227fc038f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:31.669845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2dd01c6818e410e94b47df227fc038f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:31.672005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:31.732606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cb087-907c-4a9b-a22a-fc2f6c0a29af admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:31.738652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:31.740388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:31.740860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:31.741306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:31.752618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:31.754696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:31.810331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2785/5544] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:31.856750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2dd01c6818e410e94b47df227fc038f', 'request_id': 'req-2a6a98f9-b771-4501-95c3-9cf70fc0d361'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:31.872073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2dd01c6818e410e94b47df227fc038f', 'request_id': 'req-2a6a98f9-b771-4501-95c3-9cf70fc0d361'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:31.890135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2dd01c6818e410e94b47df227fc038f', 'request_id': 'req-2a6a98f9-b771-4501-95c3-9cf70fc0d361'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:31.968986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:31.970882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:31.994640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7756d80-7516-4649-afee-9cfe6e45c28e service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:32.020272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:32.048134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] The token cache is being invalidate because project f2dd01c6818e410e94b47df227fc038f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:32.049403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:32.054486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a6a98f9-b771-4501-95c3-9cf70fc0d361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:32.054486 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2760/5545] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:31 2022] DELETE /identity/v3/projects/f2dd01c6818e410e94b47df227fc038f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:08:32.059682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.059682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.060040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.073174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:32.075587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.075930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.076150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.080568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:32.095138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:32.097294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:32.108924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:32.189577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:32.191859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435bcc1-635c-4fcf-a83c-d36433aab389 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:32.224039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2786/5546] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:08:32.262519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2761/5547] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:32.272157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.272509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.273507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.299756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:32.302549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:32.316831 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2787/5548] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:32.318028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:32.338307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0c712-7f7f-4c90-9b04-38604ab5618a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:32.376237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:32.381268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.381268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.381268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.381268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:32.381268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:32.384598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:32.417436 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2762/5549] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:08:32.423550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:32.440265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366971-87ec-40bc-9129-c3f2505b5adf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:32.457671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:32.458303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.458589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.458861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.460221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:32.461491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:32.594579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2788/5550] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:32 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:32.599955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:32.618099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e6432-efdb-45e3-8d3b-36012ac73b9f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:32.728569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:32.730067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.730357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.730639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.732574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:32.759172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:32.937651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2763/5551] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:32 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:32.942906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:32.982308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af160c-c78c-4866-9fa5-195cf1eb01f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:32.991887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:32.993039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:32.993481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:32.993920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:32.994986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:32.999215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:33.027549 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2789/5552] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:33.035659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:33.050720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358443a-0695-42cb-b72c-4bd11998a1b5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:33.066262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca667-f597-455d-9aea-c8bc4e2858d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:33.066994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca667-f597-455d-9aea-c8bc4e2858d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:33.067332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca667-f597-455d-9aea-c8bc4e2858d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:33.067610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca667-f597-455d-9aea-c8bc4e2858d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:33.072203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca667-f597-455d-9aea-c8bc4e2858d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:33.073859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca667-f597-455d-9aea-c8bc4e2858d3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:33.105403 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2764/5553] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:33.109038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:33.127395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990596ee-0131-4256-b717-bef86e13e8e3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:33.139532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:33.140879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:33.141629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:33.146301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] PATH_INFO: `/v3/projects/976aafbc0a854a549b1946c066f99032/users/f9762aa31a3748548b58158616d36d3e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:33.188096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976aafbc0a854a549b1946c066f99032, user_id=f9762aa31a3748548b58158616d36d3e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:33.190954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:33.351907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2790/5554] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:33 2022] PUT /identity/v3/projects/976aafbc0a854a549b1946c066f99032/users/f9762aa31a3748548b58158616d36d3e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:33.362867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:33.364035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:33.365454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:33.485391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] MFA Rules not processed for user `f9762aa31a3748548b58158616d36d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:33.489537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:33.606879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2765/5555] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:33.646205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:33.649969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:33.767833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b776-9ac3-4f26-ac85-99c3c73a0dc7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:33.776610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07923d19-da72-4496-8f9d-2f96fdccdc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:33.777734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923d19-da72-4496-8f9d-2f96fdccdc4b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:33.778181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923d19-da72-4496-8f9d-2f96fdccdc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:33.778818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923d19-da72-4496-8f9d-2f96fdccdc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:33.795296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923d19-da72-4496-8f9d-2f96fdccdc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:33.799354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923d19-da72-4496-8f9d-2f96fdccdc4b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:33.814511 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2791/5556] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:33.880152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:33.902805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:33.974348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac242a-977d-48fa-90c2-abefeea39b48 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:33.980830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:33.980830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:33.980830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:33.980830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] PATH_INFO: `/v3/users/f9762aa31a3748548b58158616d36d3e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:33.982303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9762aa31a3748548b58158616d36d3e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:33.983770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:34.352214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9762aa31a3748548b58158616d36d3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:34.372763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9762aa31a3748548b58158616d36d3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:34.376983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9762aa31a3748548b58158616d36d3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:34.477594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9762aa31a3748548b58158616d36d3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:34.477594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9762aa31a3748548b58158616d36d3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:34.636620 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2766/5557] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:33 2022] DELETE /identity/v3/users/f9762aa31a3748548b58158616d36d3e => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:08:34.641321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bee68-624a-4ec6-be80-8acd92005772 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:34.641852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bee68-624a-4ec6-be80-8acd92005772 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:34.641997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bee68-624a-4ec6-be80-8acd92005772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:34.674513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:34.700375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-752bee68-624a-4ec6-be80-8acd92005772 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:34.702759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-752bee68-624a-4ec6-be80-8acd92005772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:34.847188 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2792/5558] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:34.942858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:34.944471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:35.115869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7635f-b4b9-433f-96a5-856b01470c88 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:35.122588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:35.123290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:35.123555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:35.123871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:35.171886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:35.174589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:35.207856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2767/5559] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:37.245086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:37.247986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:37.247986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:37.269113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:37.270625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:37.342892 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2793/5560] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:08:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:08:37.357330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:37.359776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:37.384573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:37.388539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:37.417113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0ca38-e72b-41df-b6b8-6ccdbb17b1d6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:37.425077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:37.430426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:37.431477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:37.431983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:37.432732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] PATH_INFO: `/v3/projects/976aafbc0a854a549b1946c066f99032` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:37.434586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=976aafbc0a854a549b1946c066f99032)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:37.439699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:37.525722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395976f-890e-403a-a4fe-09e8288a0ebd service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:37.532337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf9783-cb08-4378-b3da-70d5c9c0bda1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:37.533672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9783-cb08-4378-b3da-70d5c9c0bda1 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:37.534182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9783-cb08-4378-b3da-70d5c9c0bda1 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:37.534883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9783-cb08-4378-b3da-70d5c9c0bda1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:37.548853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9783-cb08-4378-b3da-70d5c9c0bda1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:37.548853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9783-cb08-4378-b3da-70d5c9c0bda1 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:37.558786 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2768/5561] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:08:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:08:37.621122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976aafbc0a854a549b1946c066f99032', 'request_id': 'req-6b891e39-f84e-4afe-9711-dc337e99f11b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:37.653490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976aafbc0a854a549b1946c066f99032', 'request_id': 'req-6b891e39-f84e-4afe-9711-dc337e99f11b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:37.678258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976aafbc0a854a549b1946c066f99032', 'request_id': 'req-6b891e39-f84e-4afe-9711-dc337e99f11b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:37.782882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] The token cache is being invalidate because project 976aafbc0a854a549b1946c066f99032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:37.783245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:37.787528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b891e39-f84e-4afe-9711-dc337e99f11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:37.794370 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2794/5562] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:37 2022] DELETE /identity/v3/projects/976aafbc0a854a549b1946c066f99032 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:37.796882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:37.797428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:37.797841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:37.844750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:37.846837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:38.025679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.027303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.028016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.035191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2769/5563] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:38.057505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:38.059626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:38.074929 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2795/5564] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:38.075781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:38.093153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cccb0-8999-407d-92a6-7feb2077216d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:38.106773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:38.108246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.108743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.109944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.111826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:38.112651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:38.116033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:38.144063 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2770/5565] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:08:38.144762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:38.162765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57249b0d-10c9-42a7-9956-3e3e12bebff9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:38.178178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:38.178912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.179484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.179774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.180417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:38.182373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:38.320942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:38.342630 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2796/5566] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:38 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:38.350441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:38.391656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e90a-4fff-4081-89c3-663dd08c6f04 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:38.519143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:38.519143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.519143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.519143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.519806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:38.521621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:38.678446 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2771/5567] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:38 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:38.680101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:38.695816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f05267-eb7b-4a27-bce5-f7dd2c189693 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:38.703738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:38.707045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.707045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.707045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.707045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:38.708650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:38.723188 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2797/5568] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:08:38.727798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:38.738223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac86d46-891e-434c-bcd8-b8779ef74e74 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:38.745422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7f79d-fbba-439c-9893-0fb445de41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:38.746388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7f79d-fbba-439c-9893-0fb445de41c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.747047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7f79d-fbba-439c-9893-0fb445de41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.747827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7f79d-fbba-439c-9893-0fb445de41c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.748985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7f79d-fbba-439c-9893-0fb445de41c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:38.751228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7f79d-fbba-439c-9893-0fb445de41c0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:38.763639 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2772/5569] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:38.767578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:38.782714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8dece-bb9b-42ad-b0ae-48c949e21e2d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:38.789095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:38.790905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.791385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.792086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] PATH_INFO: `/v3/projects/d74cebc447df40999bba54b46f724260/users/cd688ef7a0c34ec7be19f850924ea2ee/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:38.815912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74cebc447df40999bba54b46f724260, user_id=cd688ef7a0c34ec7be19f850924ea2ee, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:38.819476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:38.949975 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2798/5570] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:38 2022] PUT /identity/v3/projects/d74cebc447df40999bba54b46f724260/users/cd688ef7a0c34ec7be19f850924ea2ee/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:38.960928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68452e-915c-449a-97be-31555540a41a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:38.961660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68452e-915c-449a-97be-31555540a41a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:38.962102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68452e-915c-449a-97be-31555540a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:39.022335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-de68452e-915c-449a-97be-31555540a41a None None] MFA Rules not processed for user `cd688ef7a0c34ec7be19f850924ea2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:39.024815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de68452e-915c-449a-97be-31555540a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:39.043051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:39.179691 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2773/5571] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:39.217531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:39.219661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:39.394645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e11923-0eda-497a-bb03-2797ab57eaa8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:39.431624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:39.437586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:39.440240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:39.440240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:39.475112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:39.477359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:39.492267 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2799/5572] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:41.901682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68452e-915c-449a-97be-31555540a41a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:41.901682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de68452e-915c-449a-97be-31555540a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:42.218937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68452e-915c-449a-97be-31555540a41a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:42.238846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:42.239555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:42.239842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:42.240118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] PATH_INFO: `/v3/users/f16abbf8a68344b68444ff8fc2795c67` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:42.242311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16abbf8a68344b68444ff8fc2795c67)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:42.244761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:42.501979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16abbf8a68344b68444ff8fc2795c67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:42.523257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16abbf8a68344b68444ff8fc2795c67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:42.524594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16abbf8a68344b68444ff8fc2795c67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:42.559604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16abbf8a68344b68444ff8fc2795c67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:42.560399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fc6302d0-a4c2-43c0-b034-092467d9073c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16abbf8a68344b68444ff8fc2795c67'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:42.655122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2774/5573] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:41 2022] DELETE /identity/v3/users/f16abbf8a68344b68444ff8fc2795c67 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:43.218948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:43.239333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6701c82-9f37-4092-81a9-eae28d8bf8f2 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:43.319443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:43.320245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:43.320643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:43.321200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] PATH_INFO: `/v3/projects/dcd5ffec2c6246fb89ba181542692585` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:43.323350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd5ffec2c6246fb89ba181542692585)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:43.325771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:43.470626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd5ffec2c6246fb89ba181542692585', 'request_id': 'req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:43.495615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd5ffec2c6246fb89ba181542692585', 'request_id': 'req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:43.511604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd5ffec2c6246fb89ba181542692585', 'request_id': 'req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:43.584149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:43.590757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] The token cache is being invalidate because project dcd5ffec2c6246fb89ba181542692585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:43.591463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:43.592497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7b1e4ffb-0fd2-4fc5-92ca-680ee578da6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:43.606862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2800/5574] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:43 2022] DELETE /identity/v3/projects/dcd5ffec2c6246fb89ba181542692585 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:43.613592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:43.614907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:43.615489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:43.644658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:43.646688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:43.743076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:43.841400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2775/5575] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:43.843553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:43.845470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:43.845470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:43.892610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:43.897152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:43.926956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2801/5576] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:43.929723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:43.967698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338eb0f-554c-4e9a-b7a6-f6b34a456298 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:43.983259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:43.985994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:43.986430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:43.986822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:43.989537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:43.992504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:43.998561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:44.047827 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2776/5577] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:08:44.050857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:44.067847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e4d1-e986-48e4-bd5d-fdc1160b9547 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:44.077806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:44.079660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:44.080573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:44.081395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:44.082437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:44.085266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:44.253553 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2802/5578] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:44 2022] POST /identity/v3/projects => generated 399 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:44.258512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:44.275707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca74ee4-cd48-46ec-ab8a-ebc0e8e460f5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:44.437300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:44.437936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:44.439194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:44.439194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:44.439194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:44.441163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:44.557677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2777/5579] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:44 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:44.560768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:44.587338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec8ca8-f74a-4e5d-ae3e-a1cb85f8fa49 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:44.594249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:44.595289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:44.595793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:44.596300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:44.597194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:44.601138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:44.616069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2803/5580] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:44.621121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:44.633240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36201-042a-44ab-9ad8-377dde05f295 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:44.654698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af0a7-44dc-42b6-a64f-01a3c057c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:44.656284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af0a7-44dc-42b6-a64f-01a3c057c881 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:44.659327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af0a7-44dc-42b6-a64f-01a3c057c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:44.659327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af0a7-44dc-42b6-a64f-01a3c057c881 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:44.659327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065af0a7-44dc-42b6-a64f-01a3c057c881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:44.659327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065af0a7-44dc-42b6-a64f-01a3c057c881 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:44.715579 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2778/5581] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:44.719618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:44.747480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da3783-fe2f-4057-8cde-59ff0f302e95 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:44.760242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daef551-bde6-49d2-944e-15420ff06598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:44.760935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daef551-bde6-49d2-944e-15420ff06598 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:44.761301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daef551-bde6-49d2-944e-15420ff06598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:44.761484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daef551-bde6-49d2-944e-15420ff06598 admin admin] PATH_INFO: `/v3/projects/2b481aea2f954dd7a003f847cff2cbeb/users/e8fa57e6acb6405788cdacdf1b318c10/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:44.818930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daef551-bde6-49d2-944e-15420ff06598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b481aea2f954dd7a003f847cff2cbeb, user_id=e8fa57e6acb6405788cdacdf1b318c10, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:44.826563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daef551-bde6-49d2-944e-15420ff06598 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:44.972594 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2804/5582] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:44 2022] PUT /identity/v3/projects/2b481aea2f954dd7a003f847cff2cbeb/users/e8fa57e6acb6405788cdacdf1b318c10/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:44.979375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:44.979672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:44.979954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:45.042397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:45.063074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:45.297150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:45.298611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:45.299153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:45.309589 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2779/5583] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:45.319380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:45.321667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:45.370000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] MFA Rules not processed for user `b3257d707d4e47bd9c68496acf8788ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:45.373239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:45.431978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:45.472270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb337d-0f0d-4a4c-bfa2-8d05321667db None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:45.472270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cce57f-6bd4-4004-8ebc-3464bd5eefde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:45.472270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cce57f-6bd4-4004-8ebc-3464bd5eefde service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:45.472270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cce57f-6bd4-4004-8ebc-3464bd5eefde service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:45.473218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cce57f-6bd4-4004-8ebc-3464bd5eefde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:45.488266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cce57f-6bd4-4004-8ebc-3464bd5eefde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:45.490210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cce57f-6bd4-4004-8ebc-3464bd5eefde service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:45.503228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2780/5584] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:45.582059 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2805/5585] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:45.582799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9103c-1547-4b7f-bd82-013f478bb1be None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:45.583193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9103c-1547-4b7f-bd82-013f478bb1be None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:45.583545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9103c-1547-4b7f-bd82-013f478bb1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:45.628471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-05f9103c-1547-4b7f-bd82-013f478bb1be None None] MFA Rules not processed for user `b3257d707d4e47bd9c68496acf8788ad`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:45.636914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-05f9103c-1547-4b7f-bd82-013f478bb1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:45.640236 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2781/5586] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:45.686231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:45.690513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:45.992947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037152ea-f66f-4d4a-8d3b-79a9c6f79e64 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:46.002152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c28bf-3c2b-43b2-8fd1-74b4cf10db0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:46.003233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c28bf-3c2b-43b2-8fd1-74b4cf10db0b service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:46.003933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c28bf-3c2b-43b2-8fd1-74b4cf10db0b service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:46.005319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c28bf-3c2b-43b2-8fd1-74b4cf10db0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:46.019667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c28bf-3c2b-43b2-8fd1-74b4cf10db0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:46.023215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c28bf-3c2b-43b2-8fd1-74b4cf10db0b service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:46.042467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2806/5587] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:49.534403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:49.535112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:49.535213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:49.655371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] MFA Rules not processed for user `3e45dfaf9fd949548bca37303a117bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:49.658311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:49.840450 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2782/5588] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:08:49.851530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:49.852266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:49.852400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:49.902962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] MFA Rules not processed for user `3e45dfaf9fd949548bca37303a117bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:49.904420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:49.939602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2807/5589] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:49.956519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:49.956519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:49.988429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41c7c8-72f9-4c0c-aa42-5edc2946c24a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:50.001188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:50.001864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:50.002149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:50.002422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:50.032836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:50.034515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:50.046969 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2783/5590] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:50.515728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:50.518016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:50.527755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:50.549836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699969c-dd57-4ba3-b26a-011da1833f42 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:50.567556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:50.568442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:50.568754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:50.569035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:50.593821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:50.619532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:50.621472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37dadf-86d4-4650-aee4-866d237ae999 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:50.643482 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2808/5591] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:50.766143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:50.769228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:50.803994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c2595-7d98-46e7-8ef6-8a3ad3d9e300 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:50.817924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:50.818739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:50.819159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:50.819664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] PATH_INFO: `/v3/users/86e756626ac4446e907deba71a0ebeb2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:50.821558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e756626ac4446e907deba71a0ebeb2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:50.835285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:51.386035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e756626ac4446e907deba71a0ebeb2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:51.397821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e756626ac4446e907deba71a0ebeb2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:51.405788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e756626ac4446e907deba71a0ebeb2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:51.431506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e756626ac4446e907deba71a0ebeb2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:51.432438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e756626ac4446e907deba71a0ebeb2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:51.678350 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2784/5592] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:08:50 2022] DELETE /identity/v3/users/86e756626ac4446e907deba71a0ebeb2 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:51.722344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300c394-c64a-4af8-a33a-f2fb5a2e4984 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:51.722920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300c394-c64a-4af8-a33a-f2fb5a2e4984 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:51.722920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300c394-c64a-4af8-a33a-f2fb5a2e4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:51.747232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2300c394-c64a-4af8-a33a-f2fb5a2e4984 None None] MFA Rules not processed for user `3e45dfaf9fd949548bca37303a117bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:51.749196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2300c394-c64a-4af8-a33a-f2fb5a2e4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:51.904410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2809/5593] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:52.281577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:52.283717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:52.413299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:52.483504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28893487-bbd8-44db-8757-0ecfca80636a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:52.493621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:52.494780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:52.495339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:52.495996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] PATH_INFO: `/v3/projects/534a6b8f7bb04d4e9e3493388bd1d86e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:52.501169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=534a6b8f7bb04d4e9e3493388bd1d86e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:52.501169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:52.684924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534a6b8f7bb04d4e9e3493388bd1d86e', 'request_id': 'req-2f0f1aca-159b-4c2b-9960-c40d6186bbef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:52.704175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534a6b8f7bb04d4e9e3493388bd1d86e', 'request_id': 'req-2f0f1aca-159b-4c2b-9960-c40d6186bbef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:52.712196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534a6b8f7bb04d4e9e3493388bd1d86e', 'request_id': 'req-2f0f1aca-159b-4c2b-9960-c40d6186bbef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:52.835370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] The token cache is being invalidate because project 534a6b8f7bb04d4e9e3493388bd1d86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:08:52.836067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:52.839755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f0f1aca-159b-4c2b-9960-c40d6186bbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:08:52.861073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2785/5594] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:08:52 2022] DELETE /identity/v3/projects/534a6b8f7bb04d4e9e3493388bd1d86e => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:52.875562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:52.877618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:52.878200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:52.924298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:52.925977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:53.066149 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2810/5595] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:53.182877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:53.183208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:53.183559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:53.225456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:53.227538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:53.241384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2786/5596] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:53.242541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:53.258565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d59156-9666-4134-8d09-a24cf78319e0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:53.267752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:53.267752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:53.267752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:53.267752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:53.268609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:08:53.269157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:53.271263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:53.295180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2811/5597] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:08:53.312658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:53.327826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e7288-d6f1-494d-99cb-a354a11b1a3a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:53.338974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:53.339977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:53.340450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:53.340974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:53.342081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:53.345230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:53.561237 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2787/5598] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:08:53 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:53.563043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:53.594287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cce51-0546-419f-ba04-0b290174050c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:53.802665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:53.804277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:53.804725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:53.806757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:53.806757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:53.809152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:53.966909 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2812/5599] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:08:53 2022] POST /identity/v3/users => generated 285 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:08:53.970586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:53.987300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c23ae-d7b4-488e-8944-4da66d4d809f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:54.001213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:54.001998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:54.002347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:54.002687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:54.003588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:54.012418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:54.043811 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2788/5600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:54.048449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:54.064851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e760e9-74e9-4633-8ad7-438eb3bfcbaa admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:54.077662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97da0f2-462f-4176-a366-9df2f3a6e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:54.078632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97da0f2-462f-4176-a366-9df2f3a6e4be admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:54.079809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97da0f2-462f-4176-a366-9df2f3a6e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:54.080251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97da0f2-462f-4176-a366-9df2f3a6e4be admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:54.081450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97da0f2-462f-4176-a366-9df2f3a6e4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:54.083903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97da0f2-462f-4176-a366-9df2f3a6e4be admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:54.097109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:08:54.110114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2813/5601] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:08:54.114819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:54.128102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ffd3-a482-4af8-baae-295f894ea9da admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:54.144186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:54.145257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:54.145456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:54.145900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] PATH_INFO: `/v3/projects/b41a3cc723934533a97db195ae45686c/users/c8b04240d75543a98980d085263358de/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:54.184707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41a3cc723934533a97db195ae45686c, user_id=c8b04240d75543a98980d085263358de, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:54.189808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:54.327122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2789/5602] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:08:54 2022] PUT /identity/v3/projects/b41a3cc723934533a97db195ae45686c/users/c8b04240d75543a98980d085263358de/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:08:54.338395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeafa3-6974-49b4-a4b8-2eb7f28b1762 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:54.338764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeafa3-6974-49b4-a4b8-2eb7f28b1762 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:54.339147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeafa3-6974-49b4-a4b8-2eb7f28b1762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:54.427657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a6aeafa3-6974-49b4-a4b8-2eb7f28b1762 None None] MFA Rules not processed for user `c8b04240d75543a98980d085263358de`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:08:54.431997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a6aeafa3-6974-49b4-a4b8-2eb7f28b1762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:54.650052 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2814/5603] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:08:54.666232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:08:54.668048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:08:54.759756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1e67b-03cf-4a2a-985f-c8057a84f489 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:08:54.765400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:08:54.766353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:08:54.767031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:08:54.767519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:08:54.780280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:08:54.782368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:08:54.795314 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2790/5604] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:08:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:08:56.736917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:03.589740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22d5fd-6b19-4ea6-b74c-1bb94309992d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:03.590872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22d5fd-6b19-4ea6-b74c-1bb94309992d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:03.591382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22d5fd-6b19-4ea6-b74c-1bb94309992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:03.615193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c22d5fd-6b19-4ea6-b74c-1bb94309992d None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:03.617600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c22d5fd-6b19-4ea6-b74c-1bb94309992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:03.692390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2815/5605] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:03.708700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:03.710241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:03.829730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9fe9-c11d-489a-8525-ddc7b7e6dd08 service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:03.837354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c4d01-4a45-494d-91bb-1d17da626a28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:03.838274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4d01-4a45-494d-91bb-1d17da626a28 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:03.838707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4d01-4a45-494d-91bb-1d17da626a28 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:03.839843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4d01-4a45-494d-91bb-1d17da626a28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:03.852485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c4d01-4a45-494d-91bb-1d17da626a28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:03.854819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c4d01-4a45-494d-91bb-1d17da626a28 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:03.871873 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2791/5606] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:09:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:09:04.302521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:04.302949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:04.303159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:04.383605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] MFA Rules not processed for user `e8fa57e6acb6405788cdacdf1b318c10`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:04.387849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:04.709184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2816/5607] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:04.719232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430126-16e5-44ba-b1cc-0f3dacafa9b7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:04.720558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430126-16e5-44ba-b1cc-0f3dacafa9b7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:04.721046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430126-16e5-44ba-b1cc-0f3dacafa9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:04.803305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3a430126-16e5-44ba-b1cc-0f3dacafa9b7 None None] MFA Rules not processed for user `e8fa57e6acb6405788cdacdf1b318c10`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:04.805019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a430126-16e5-44ba-b1cc-0f3dacafa9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:04.827797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2792/5608] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:05.302900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:05.310228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:05.389706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:05.511642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd877d3c-9711-4006-97f5-15a9d2473ff5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:05.522781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:05.523998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:05.525325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:05.525816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:05.544322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:05.546571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:05.564533 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2817/5609] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:09:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:09:14.772092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=38 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:17.479946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=23 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:24.492742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:24.493365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:24.493365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:24.528309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:24.530968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:24.554694 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2793/5610] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:24.561681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:24.581675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421b112-a6dc-4ce9-99f3-1e36b2afccb4 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:24.588726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:24.589858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:24.590852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:24.591417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:24.605128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:24.608088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:24.643110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2818/5611] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:09:27.864919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:27.867355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:27.976766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324f53-2f8a-4b7d-99bf-4d117c989741 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:27.982777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:27.983387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:27.983665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:27.983943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] PATH_INFO: `/v3/users/b3257d707d4e47bd9c68496acf8788ad` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:27.985120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3257d707d4e47bd9c68496acf8788ad)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:27.987090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:28.401116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3257d707d4e47bd9c68496acf8788ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:28.412338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3257d707d4e47bd9c68496acf8788ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:28.413274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3257d707d4e47bd9c68496acf8788ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:28.433763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3257d707d4e47bd9c68496acf8788ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:28.434714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58527cf5-e5d6-4ec6-bda0-3c5626c05826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3257d707d4e47bd9c68496acf8788ad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:28.565854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2794/5612] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:09:27 2022] DELETE /identity/v3/users/b3257d707d4e47bd9c68496acf8788ad => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:29.009578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:29.047117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41af22f-9650-4081-a3e3-f1d59bc6224e service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:29.131898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:29.134042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:29.134042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:29.134042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] PATH_INFO: `/v3/projects/eb1353cb350f4463862e78e75c5b2e50` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:29.134809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1353cb350f4463862e78e75c5b2e50)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:29.137167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:29.287255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1353cb350f4463862e78e75c5b2e50', 'request_id': 'req-f1819897-e59f-4bc0-bd97-36addd0b38ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:29.297836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1353cb350f4463862e78e75c5b2e50', 'request_id': 'req-f1819897-e59f-4bc0-bd97-36addd0b38ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:29.303724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1353cb350f4463862e78e75c5b2e50', 'request_id': 'req-f1819897-e59f-4bc0-bd97-36addd0b38ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:29.423470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] The token cache is being invalidate because project eb1353cb350f4463862e78e75c5b2e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:09:29.423922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:29.425672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1819897-e59f-4bc0-bd97-36addd0b38ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:29.431855 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2819/5613] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:29 2022] DELETE /identity/v3/projects/eb1353cb350f4463862e78e75c5b2e50 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:29.439348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:29.439845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:29.439967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:29.465464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:29.466736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:29.540297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2795/5614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:29.548947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:29.549237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:29.549517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:29.571537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:29.573522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:29.581760 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2820/5615] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:29.586484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:29.598334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8189b-5bda-4241-b35b-ff547ad12ad9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:29.603943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:29.604632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:29.604966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:29.605297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:29.606069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:09:29.606409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:29.608378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:29.619462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:29.625381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2796/5616] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:09:29.628531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:29.639789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba13a0-cc6f-4b9b-926d-ea1e8ac33349 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:29.645058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:29.648311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:29.648311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:29.648311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:29.648311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:29.648872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:29.791735 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2821/5617] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:09:29 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:09:29.796030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:29.818473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00caba2-5a63-4fbe-9bae-879b5840894b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:29.895064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:29.895700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:29.895988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:29.900219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:29.900219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:29.900219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:30.014574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2797/5618] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:09:29 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:09:30.015242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:30.028387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da49c6-ce13-4cdf-bebd-0742fcf5314c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:30.042214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:30.043463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:30.043853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:30.044232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:30.045009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:30.046937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:30.063897 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2822/5619] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:09:30.065541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:30.087270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606ac1-1f70-48bc-80d6-61cbc957ca15 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:30.093404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ae404-0f3c-473a-9ed9-caca8343f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:30.094261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ae404-0f3c-473a-9ed9-caca8343f064 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:30.094706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ae404-0f3c-473a-9ed9-caca8343f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:30.095179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ae404-0f3c-473a-9ed9-caca8343f064 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:30.096001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ae404-0f3c-473a-9ed9-caca8343f064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:30.097619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ae404-0f3c-473a-9ed9-caca8343f064 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:30.113866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2798/5620] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:09:30.115456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:30.128052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474d132-8eee-4d8a-bd03-8c865d8aa936 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:30.134068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:30.135097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:30.135612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:30.136469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] PATH_INFO: `/v3/projects/2ca2ee6cad064b14bd68229c859db365/users/14cbba91d5874eb3992ff869ff32e98a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:30.154261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca2ee6cad064b14bd68229c859db365, user_id=14cbba91d5874eb3992ff869ff32e98a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:30.157459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:30.326773 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2823/5621] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:09:30 2022] PUT /identity/v3/projects/2ca2ee6cad064b14bd68229c859db365/users/14cbba91d5874eb3992ff869ff32e98a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:09:30.332789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babc7b-0f99-46e7-9351-bb2404ef85da None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:30.333121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babc7b-0f99-46e7-9351-bb2404ef85da None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:30.333398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babc7b-0f99-46e7-9351-bb2404ef85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:30.357991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-79babc7b-0f99-46e7-9351-bb2404ef85da None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:30.359583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79babc7b-0f99-46e7-9351-bb2404ef85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:30.460092 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2799/5622] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:30.471529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:30.480754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:30.491448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:30.568746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e90d-eee1-4434-ab0b-64334b1474e8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:30.584366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:30.585017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:30.585306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:30.585588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:30.599051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:30.600236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:30.619371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2824/5623] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:09:33.976267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:33.976829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:33.976829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:33.999187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:34.000765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:34.133664 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2800/5624] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:09:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:34.135110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:34.136870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:34.320271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615239df-f71f-4dea-bdc3-4ec70d78a234 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:34.328632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:34.330143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:34.330438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:34.330778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:34.343332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:34.346129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:34.364001 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2825/5625] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:09:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:09:42.042691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:42.048162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:42.071616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c47db-e93e-4f01-a4f4-c293a321173b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:42.076579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:42.077601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:42.078421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:42.079156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] PATH_INFO: `/v3/users/e8fa57e6acb6405788cdacdf1b318c10` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:42.081387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fa57e6acb6405788cdacdf1b318c10)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:42.084805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:42.130268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:42.428168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fa57e6acb6405788cdacdf1b318c10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:42.441844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fa57e6acb6405788cdacdf1b318c10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:42.442875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fa57e6acb6405788cdacdf1b318c10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:42.482316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fa57e6acb6405788cdacdf1b318c10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:42.483623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241db07f-e4e3-4315-898d-accc13e9c34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fa57e6acb6405788cdacdf1b318c10'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:42.623151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2801/5626] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:09:42 2022] DELETE /identity/v3/users/e8fa57e6acb6405788cdacdf1b318c10 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:43.322189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:43.346321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7179ac-1806-4c95-ae6d-4f0235938719 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:43.480831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:43.481690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:43.481982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:43.482447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] PATH_INFO: `/v3/projects/2b481aea2f954dd7a003f847cff2cbeb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:43.483887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b481aea2f954dd7a003f847cff2cbeb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:43.486602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:43.716877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:43.718440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b481aea2f954dd7a003f847cff2cbeb', 'request_id': 'req-5a79e32e-14c9-425d-bfc9-a9ff9d738924'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:43.738156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b481aea2f954dd7a003f847cff2cbeb', 'request_id': 'req-5a79e32e-14c9-425d-bfc9-a9ff9d738924'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:43.768179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b481aea2f954dd7a003f847cff2cbeb', 'request_id': 'req-5a79e32e-14c9-425d-bfc9-a9ff9d738924'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:43.897185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] The token cache is being invalidate because project 2b481aea2f954dd7a003f847cff2cbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:09:43.897620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:43.898397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a79e32e-14c9-425d-bfc9-a9ff9d738924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:43.901933 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2826/5627] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:43 2022] DELETE /identity/v3/projects/2b481aea2f954dd7a003f847cff2cbeb => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:43.907378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:43.908557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:43.909029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:43.990856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:43.995458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:44.201597 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2802/5628] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:44.211752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:44.212198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:44.212592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:44.244517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:44.245953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:44.261684 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2827/5629] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:44.265337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:44.294501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9fea-bfb9-42c5-84e1-9e34028edce3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:44.311363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:44.315295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:44.316135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:44.316733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:44.319865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:09:44.321166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:44.330403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:44.395415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2803/5630] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:09:44.400458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:44.425554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbed2fb-2f6c-4cdb-862d-b57e0dcda9c9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:44.443859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab3b5-0801-41c7-bfeb-08715d48979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:44.447505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab3b5-0801-41c7-bfeb-08715d48979b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:44.449841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab3b5-0801-41c7-bfeb-08715d48979b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:44.450322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab3b5-0801-41c7-bfeb-08715d48979b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:44.451186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab3b5-0801-41c7-bfeb-08715d48979b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:44.461539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab3b5-0801-41c7-bfeb-08715d48979b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:44.713561 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2828/5631] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:09:44 2022] POST /identity/v3/projects => generated 405 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:09:44.719506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:44.737740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e981ce2-3711-4a41-84ef-c7f304a9b3c2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:44.869268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3979b-14d3-467c-a228-93dd710fe082 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:44.869891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3979b-14d3-467c-a228-93dd710fe082 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:44.880928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3979b-14d3-467c-a228-93dd710fe082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:44.975659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-aad3979b-14d3-467c-a228-93dd710fe082 None None] MFA Rules not processed for user `14cbba91d5874eb3992ff869ff32e98a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:44.976826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aad3979b-14d3-467c-a228-93dd710fe082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:44.984876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:44.985562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:44.986615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:44.986946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:44.993305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:44.996768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:45.115286 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2829/5632] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:09:45.152430 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2804/5633] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:09:44 2022] POST /identity/v3/users => generated 303 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:09:45.153712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.154178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.154670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.156484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:45.200487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb63c18-714b-439f-823f-67fa7d5e0991 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:45.215298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:45.216145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.217905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.218164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.218836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:45.221054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:45.229486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] MFA Rules not processed for user `14cbba91d5874eb3992ff869ff32e98a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:45.233526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:45.252493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2830/5634] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:45.252705 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2805/5635] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:09:45.254117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:45.284554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecdc96-7ced-4294-b713-ba97b66e7336 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:45.286858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:45.288694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:45.293559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:45.294633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:45.296552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.298313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.298848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.299745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:45.302835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:45.323886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2831/5636] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:09:45.327859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:45.340238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3304a-c365-489f-891c-07808fc5b8df admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:45.347248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d9490-306b-40a3-8aff-8b16dbf4eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:45.348005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9490-306b-40a3-8aff-8b16dbf4eb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.348288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9490-306b-40a3-8aff-8b16dbf4eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.349264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9490-306b-40a3-8aff-8b16dbf4eb12 admin admin] PATH_INFO: `/v3/projects/a2edd13a86624b4fbebab5f650bac271/users/3d84a0cde53b4c278fc96b6d7296d5e4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.372160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d9490-306b-40a3-8aff-8b16dbf4eb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2edd13a86624b4fbebab5f650bac271, user_id=3d84a0cde53b4c278fc96b6d7296d5e4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:45.376379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d9490-306b-40a3-8aff-8b16dbf4eb12 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:45.485288 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2832/5637] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:09:45 2022] PUT /identity/v3/projects/a2edd13a86624b4fbebab5f650bac271/users/3d84a0cde53b4c278fc96b6d7296d5e4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:45.492698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.493256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.493770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.541665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba669-fbfc-4d67-885a-b272c491dbeb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:45.543209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:45.544469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:45.646739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:45.688926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:45.689526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.689752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.689886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2833/5638] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:09:45.690038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.702693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:45.704904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:45.820488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:45.822538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:45.853408 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2806/5639] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:09:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:09:45.855060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f1260-e003-4ba1-b235-25cccdea5f0e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:45.868748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac708-dd46-402a-8b9e-bfa72c5a541d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:45.869429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac708-dd46-402a-8b9e-bfa72c5a541d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:45.869714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac708-dd46-402a-8b9e-bfa72c5a541d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:45.869993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac708-dd46-402a-8b9e-bfa72c5a541d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:45.911746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac708-dd46-402a-8b9e-bfa72c5a541d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:45.913224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac708-dd46-402a-8b9e-bfa72c5a541d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:45.935686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2834/5640] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:09:53.219901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:53.222522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:53.261538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596f26-f96a-4ffb-82d2-1569214e40d9 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:53.283488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:53.284887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:53.285491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:53.286060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] PATH_INFO: `/v3/users/c8b04240d75543a98980d085263358de` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:53.287682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b04240d75543a98980d085263358de)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:53.289840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:53.321493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:53.594920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b04240d75543a98980d085263358de'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:53.619580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b04240d75543a98980d085263358de'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:53.620625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b04240d75543a98980d085263358de'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:53.639580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b04240d75543a98980d085263358de'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:53.640534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b04240d75543a98980d085263358de'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:53.801100 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2807/5641] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:09:53 2022] DELETE /identity/v3/users/c8b04240d75543a98980d085263358de => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:53.805992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:53.806536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:53.811233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:53.890257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:53.894994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:54.085846 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2835/5642] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:54.176874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:54.179392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:54.324502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d5ff-4e89-48e1-8d7c-7b931eff818f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:54.336576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc68006-3c32-42cc-8f4b-58f54ba1deb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:54.337500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68006-3c32-42cc-8f4b-58f54ba1deb2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:54.338042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68006-3c32-42cc-8f4b-58f54ba1deb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:54.338474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc68006-3c32-42cc-8f4b-58f54ba1deb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:54.365031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc68006-3c32-42cc-8f4b-58f54ba1deb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:54.372899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc68006-3c32-42cc-8f4b-58f54ba1deb2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:54.398010 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2808/5643] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:09:56.217874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:56.220194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:56.273074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c2de8-b594-4c83-9a15-a241af2859d3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:56.289506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:56.291698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:56.292228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:56.292742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] PATH_INFO: `/v3/projects/b41a3cc723934533a97db195ae45686c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:56.297797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41a3cc723934533a97db195ae45686c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:56.301708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:56.489626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41a3cc723934533a97db195ae45686c', 'request_id': 'req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:56.503141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41a3cc723934533a97db195ae45686c', 'request_id': 'req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:56.524704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41a3cc723934533a97db195ae45686c', 'request_id': 'req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:56.662844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] The token cache is being invalidate because project b41a3cc723934533a97db195ae45686c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:09:56.663342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:56.666149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f7bcfec-a5c2-48b1-80bc-e3c8229e760c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:09:56.667909 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2836/5644] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:09:56 2022] DELETE /identity/v3/projects/b41a3cc723934533a97db195ae45686c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:56.675528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:56.676032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:56.676164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:56.720667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:56.722191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:56.890213 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2809/5645] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:09:56.898413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:56.898781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:56.899021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:56.968767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:56.970642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:56.998116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2837/5646] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:57.003285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:57.021385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9a3f2-1e9d-481f-a831-4961897a53bd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:57.032830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:57.035086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:57.035086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:57.035942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:57.037128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:09:57.037748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:57.050342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:57.104630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2810/5647] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:09:57.109560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:57.131731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf14c-96df-417e-ad5a-688272f31be3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:57.140574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:57.141329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:57.141617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:57.141895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:57.142741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:57.144938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:57.166117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:57.436132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:57.444307 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2838/5648] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:09:57 2022] POST /identity/v3/projects => generated 371 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:09:57.468709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719869d-45e5-45a7-a34e-7c9cae1acc61 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:57.615966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:09:57.750074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:57.751713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:57.752348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:57.752831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:57.753692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:57.755981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:57.876964 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2811/5649] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:09:57 2022] POST /identity/v3/users => generated 286 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:09:57.885620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:57.902979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909d19a-54d1-42e5-aa15-98f4d610c96c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:57.942444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:57.943041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:57.943335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:57.944746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:57.945442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:57.947166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:57.978105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2839/5650] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:09:57.979730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:57.990366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5c8f-8803-4da9-8511-8e1b7e152d27 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:58.013107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa53c-b2d3-41f8-a856-224c9cf1b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:58.014139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa53c-b2d3-41f8-a856-224c9cf1b35d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:58.014645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa53c-b2d3-41f8-a856-224c9cf1b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:58.015167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa53c-b2d3-41f8-a856-224c9cf1b35d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:58.016034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa53c-b2d3-41f8-a856-224c9cf1b35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:58.019538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa53c-b2d3-41f8-a856-224c9cf1b35d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:58.063438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2812/5651] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:09:58.065761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:58.082428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc788f3-136f-4629-ad31-8475a6dd1b55 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:58.095080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:58.095608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:58.095892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:58.096175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] PATH_INFO: `/v3/projects/7a214ee417be47eb9acfd28062a7d2a2/users/2e7ae0c95ed24a808ce2a1d69ded6c3e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:58.139179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a214ee417be47eb9acfd28062a7d2a2, user_id=2e7ae0c95ed24a808ce2a1d69ded6c3e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:58.145034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:58.441901 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2840/5652] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:09:58 2022] PUT /identity/v3/projects/7a214ee417be47eb9acfd28062a7d2a2/users/2e7ae0c95ed24a808ce2a1d69ded6c3e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:09:58.446652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb070d-0a03-40b1-9eab-d15d197860cb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:58.446947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb070d-0a03-40b1-9eab-d15d197860cb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:58.447271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb070d-0a03-40b1-9eab-d15d197860cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:58.488587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f0cb070d-0a03-40b1-9eab-d15d197860cb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:09:58.489782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f0cb070d-0a03-40b1-9eab-d15d197860cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:58.598879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2813/5653] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:09:58.608145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:09:58.610036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:09:58.716929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bcda1-e6d8-47d4-8c69-91e17584372e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:09:58.721277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a18586-93c7-469e-b08b-37336785c2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:09:58.722260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18586-93c7-469e-b08b-37336785c2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:09:58.722648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18586-93c7-469e-b08b-37336785c2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:09:58.734257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18586-93c7-469e-b08b-37336785c2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:09:58.734723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a18586-93c7-469e-b08b-37336785c2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:09:58.736738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a18586-93c7-469e-b08b-37336785c2c0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:09:58.753845 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2841/5654] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:00.573207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:00.573774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:00.573975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:00.647586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:00.652437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:00.765758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:00.766582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:00.766582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:00.840494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2814/5655] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:10:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:00.842923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] MFA Rules not processed for user `3d84a0cde53b4c278fc96b6d7296d5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:00.844493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:00.855377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:00.858114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:00.996796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:01.069462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0f770-050e-4381-9f2e-bbe23dd47cef None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:01.082579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2842/5656] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:01.083791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:01.086111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:01.086308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:01.088650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:01.090378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:01.090378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:01.109582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:01.114910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:01.131765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae286082-eaf4-42eb-a94a-d84b5c62ba18 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:01.138854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2815/5657] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:10:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:01.179076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:01.179867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:01.180159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:01.180440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:01.181094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:01.183079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:01.327972 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2843/5658] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:10:01 2022] POST /identity/v3/projects => generated 403 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:10:01.332083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:01.348627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da917fa4-b74a-4204-860f-7856239835ad service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:01.475272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:01.478544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:01.480218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:01.480893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:01.482237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:01.486431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:01.662110 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2816/5659] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:10:01 2022] POST /identity/v3/users => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:10:01.666980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:01.680010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa420b-f022-47a1-ae50-ac6d6ae0b075 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:01.686728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:01.687678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:01.688329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:01.692091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:01.692091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:01.692091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:01.704432 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2844/5660] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:01.709090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:01.724451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9967-77d6-4ffc-9aef-8d4d131b7a15 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:01.733749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:01.734785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:01.735226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:01.735635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:01.736366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:01.738181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:01.754262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2817/5661] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:01.758322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:01.771042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551b70e-adf1-4f95-a0b3-b24fa3963fa6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:01.776227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f240af3-27c6-4e81-aaed-fa98feb7145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:01.777141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240af3-27c6-4e81-aaed-fa98feb7145f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:01.777570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240af3-27c6-4e81-aaed-fa98feb7145f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:01.777965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240af3-27c6-4e81-aaed-fa98feb7145f admin admin] PATH_INFO: `/v3/projects/6db29c866cb84356b44d74de4b38b859/users/27793466151d4470985c94b43658588c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:01.797059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f240af3-27c6-4e81-aaed-fa98feb7145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db29c866cb84356b44d74de4b38b859, user_id=27793466151d4470985c94b43658588c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:01.800803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f240af3-27c6-4e81-aaed-fa98feb7145f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:01.803517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:01.897678 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2845/5662] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:10:01 2022] PUT /identity/v3/projects/6db29c866cb84356b44d74de4b38b859/users/27793466151d4470985c94b43658588c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:10.547169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:10.551073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:10.574580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61004bf-dcd3-4b2b-8b9d-976873ebc36a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:10.685699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:10.697787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:10.697787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:10.697787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] PATH_INFO: `/v3/users/f160a950e90c445698d7f5ea36944398` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:10.697787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f160a950e90c445698d7f5ea36944398)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:10.697787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:11.004382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f160a950e90c445698d7f5ea36944398'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:11.024440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f160a950e90c445698d7f5ea36944398'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:11.025428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f160a950e90c445698d7f5ea36944398'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:11.032688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:11.042295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f160a950e90c445698d7f5ea36944398'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:11.043686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-781fd2cb-5987-45cf-9150-3811693f76af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f160a950e90c445698d7f5ea36944398'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:11.094452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.094969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.095080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:11.140870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] MFA Rules not processed for user `2e7ae0c95ed24a808ce2a1d69ded6c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:11.142424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:11.199845 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2818/5663] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:10:10 2022] DELETE /identity/v3/users/f160a950e90c445698d7f5ea36944398 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:11.204171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.204530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.204878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:11.250354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:11.252455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:11.285071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2846/5664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:10:11.290145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:11.295938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:11.308437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9c2d4-e84e-43ad-ade1-71e8f83e44c6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:11.370778 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2819/5665] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:10:11.382243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:11.383648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:11.383982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:11.384708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.385095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.385491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:11.386222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:11.388723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:11.458708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8b8a-f903-4abf-8dc7-9248c262f8bb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:11.464151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:11.464151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.464434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.464711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:11.477028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:11.478753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:11.491310 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2820/5666] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:11.555806 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2847/5667] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:10:11 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:10:11.559380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:11.575545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25df64-4e5c-416c-8445-efa0b621ed72 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:11.697958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:11.698770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.699363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.702069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:11.702069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:11.706012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:11.883959 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2821/5668] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:10:11 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:10:11.885246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:11.914720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995aaac-abf9-46f6-9f2e-dea0001fcccd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:11.920680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:11.922663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.923084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.924633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:11.925439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:11.927517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:11.946710 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2848/5669] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:11.947975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:11.965679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7cab0-7f48-4f39-8ccf-bbfd61cb5834 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:11.982007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:11.982860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:11.983596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:11.983937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] PATH_INFO: `/v3/projects/5da257e162aa4109a0bc914b2b4e13ed/users/094361c60a54434fb90e605c040800ac/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:12.016430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da257e162aa4109a0bc914b2b4e13ed, user_id=094361c60a54434fb90e605c040800ac, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:12.022493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:12.200807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2822/5670] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:10:11 2022] PUT /identity/v3/projects/5da257e162aa4109a0bc914b2b4e13ed/users/094361c60a54434fb90e605c040800ac/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:12.205037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:12.219594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9f9a8-c356-412a-8354-e7c6b04ca6f9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:12.367612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:12.381289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:12.382252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:12.382552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:12.382823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:12.383519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:12.385339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:12.431824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2849/5671] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:12.436375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:12.475308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682a052-9501-4fc9-a017-18b181ab9ab9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:12.496096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073068d1-4f48-4c0f-9e60-f5c63a0f99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:12.497633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073068d1-4f48-4c0f-9e60-f5c63a0f99cf admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:12.499484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073068d1-4f48-4c0f-9e60-f5c63a0f99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:12.502159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073068d1-4f48-4c0f-9e60-f5c63a0f99cf admin admin] PATH_INFO: `/v3/projects/5da257e162aa4109a0bc914b2b4e13ed/users/094361c60a54434fb90e605c040800ac/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:12.505616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073068d1-4f48-4c0f-9e60-f5c63a0f99cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da257e162aa4109a0bc914b2b4e13ed, user_id=094361c60a54434fb90e605c040800ac, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:12.515374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073068d1-4f48-4c0f-9e60-f5c63a0f99cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:12.548273 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2823/5672] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:10:12 2022] PUT /identity/v3/projects/5da257e162aa4109a0bc914b2b4e13ed/users/094361c60a54434fb90e605c040800ac/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:12.637724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:12.643440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:12.658813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e950bc-9022-4377-ad85-00169bc766df admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:12.919582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:12.922292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:12.922292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:12.922292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] PATH_INFO: `/v3/projects/3298773c4bd9452c90a38334e7a0cdc1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:12.923500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3298773c4bd9452c90a38334e7a0cdc1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:12.925701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:13.268267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3298773c4bd9452c90a38334e7a0cdc1', 'request_id': 'req-c6e3b450-fe81-474f-9e77-8045493a587e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:13.279656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3298773c4bd9452c90a38334e7a0cdc1', 'request_id': 'req-c6e3b450-fe81-474f-9e77-8045493a587e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:13.296225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3298773c4bd9452c90a38334e7a0cdc1', 'request_id': 'req-c6e3b450-fe81-474f-9e77-8045493a587e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:13.478741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] The token cache is being invalidate because project 3298773c4bd9452c90a38334e7a0cdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:10:13.479059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:13.481437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c6e3b450-fe81-474f-9e77-8045493a587e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:13.484834 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2850/5673] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:12 2022] DELETE /identity/v3/projects/3298773c4bd9452c90a38334e7a0cdc1 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:13.490061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:13.490534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:13.490838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:13.526382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:13.527985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:13.690694 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2824/5674] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:13.738033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:13.785120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:13.785702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:13.786138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:13.829439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:13.831080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:13.841337 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2851/5675] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:10:13.846074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:13.859772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf64890-77d3-480b-a6c4-97d3e66f69df None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:13.871670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:13.872508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:13.872968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:13.873427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:13.875623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:10:13.876433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:13.889344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:13.913415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2825/5676] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:10:13.917705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:13.928617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62327ada-7766-4099-b418-aa27976f9ee0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:13.935575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:13.936450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:13.937428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:13.937851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:13.939233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:13.952446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:14.095582 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2852/5677] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:10:13 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:10:14.100928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:14.120392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49554-d223-4dfc-b767-5a886b5ad3ac admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:14.238672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:14.239444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:14.239833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:14.240560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:14.241401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:14.245837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:14.358263 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2826/5678] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:10:14 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:10:14.361362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:14.383635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130a48-105c-4260-84b3-7f7b88ba475a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:14.398135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:14.399098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:14.400187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:14.400741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:14.401934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:14.406291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:14.433766 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2853/5679] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:14.438422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:14.457627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81710c5-2f24-40b9-af18-c7144195ddca admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:14.470408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435625fa-1e3d-4dfd-9867-dd54b7bdd5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:14.474410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435625fa-1e3d-4dfd-9867-dd54b7bdd5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:14.474410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435625fa-1e3d-4dfd-9867-dd54b7bdd5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:14.474410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435625fa-1e3d-4dfd-9867-dd54b7bdd5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:14.474410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435625fa-1e3d-4dfd-9867-dd54b7bdd5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:14.484269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435625fa-1e3d-4dfd-9867-dd54b7bdd5b3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:14.531677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2827/5680] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:14.534588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:14.549704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9751f50-0dbf-40b8-a23a-de0f53a76448 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:14.555965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:14.556790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:14.557576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:14.557922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] PATH_INFO: `/v3/projects/515ab27962674e99a602451fb8f3da61/users/973422e272f6404f81fcf4702fcfb5c5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:14.581203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515ab27962674e99a602451fb8f3da61, user_id=973422e272f6404f81fcf4702fcfb5c5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:14.585118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:14.708417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2854/5681] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:10:14 2022] PUT /identity/v3/projects/515ab27962674e99a602451fb8f3da61/users/973422e272f6404f81fcf4702fcfb5c5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:14.710292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf80a5-62fa-4358-ae34-68bcebc999a0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:14.710594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf80a5-62fa-4358-ae34-68bcebc999a0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:14.710880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf80a5-62fa-4358-ae34-68bcebc999a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:14.780515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-38cf80a5-62fa-4358-ae34-68bcebc999a0 None None] MFA Rules not processed for user `973422e272f6404f81fcf4702fcfb5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:14.781985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-38cf80a5-62fa-4358-ae34-68bcebc999a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:14.924459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2828/5682] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:10:14.940156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:14.946903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:14.981116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:15.060814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119610f-9feb-4982-b85b-cb3225429547 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:15.072579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9037a18-f7a7-4f42-a3c0-83c68315ea08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:15.073709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037a18-f7a7-4f42-a3c0-83c68315ea08 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:15.074310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037a18-f7a7-4f42-a3c0-83c68315ea08 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:15.074859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037a18-f7a7-4f42-a3c0-83c68315ea08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:15.098308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037a18-f7a7-4f42-a3c0-83c68315ea08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:15.100721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037a18-f7a7-4f42-a3c0-83c68315ea08 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:15.128103 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2855/5683] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:15.136544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:15.136848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:15.137132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:15.201329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] MFA Rules not processed for user `27793466151d4470985c94b43658588c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:15.202599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:15.314348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2829/5684] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:15.326450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5b81-7bb7-455b-9431-2c50548524ca None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:15.326843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5b81-7bb7-455b-9431-2c50548524ca None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:15.327267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5b81-7bb7-455b-9431-2c50548524ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:15.372224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e2ea5b81-7bb7-455b-9431-2c50548524ca None None] MFA Rules not processed for user `3d84a0cde53b4c278fc96b6d7296d5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:15.378860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e2ea5b81-7bb7-455b-9431-2c50548524ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:15.474694 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2856/5685] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:15.487469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:15.489324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:15.661514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2084770-8469-4ae3-ba39-0e29f8427172 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:15.692394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:15.693062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:15.693355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:15.693802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:15.697075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:15.727754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:15.729400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:15.756721 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2830/5686] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:10:16.414750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:16.571853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f60e-27ad-4373-93c2-2cee5e990256 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:16.572388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f60e-27ad-4373-93c2-2cee5e990256 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:16.572388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f60e-27ad-4373-93c2-2cee5e990256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:16.624965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7c55f60e-27ad-4373-93c2-2cee5e990256 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:16.626484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7c55f60e-27ad-4373-93c2-2cee5e990256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:16.769372 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2857/5687] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:16.812014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:16.813599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:17.042425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3b5be-aef0-4e97-a3f4-b3251aa52452 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:17.066668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:17.067751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:17.068099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:17.068490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:17.081495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:17.083551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:17.132417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2831/5688] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:17.894256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:20.007585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:20.008043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:20.008148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:20.049553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:20.052101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:20.068623 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2858/5689] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:20.087504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:20.115527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921ae8f-3c90-4e40-b76b-b43f7ef0073f service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:20.151453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b386b3a-8e40-4fa8-aaac-2ca8c11c9f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:20.152352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b386b3a-8e40-4fa8-aaac-2ca8c11c9f90 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:20.152819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b386b3a-8e40-4fa8-aaac-2ca8c11c9f90 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:20.153265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b386b3a-8e40-4fa8-aaac-2ca8c11c9f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:20.185397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b386b3a-8e40-4fa8-aaac-2ca8c11c9f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:20.187407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b386b3a-8e40-4fa8-aaac-2ca8c11c9f90 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:20.212122 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2832/5690] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:10:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:20.922070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:20.942892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67baa2-6d30-43f1-8d84-64a4ee766a84 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:20.947931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:20.949516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:20.949907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:20.950192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:20.952336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:20.990774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:20.992621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:21.030655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2859/5691] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:22.576238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9f68-e5e8-408e-b96a-e8105d1ce92e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:22.577611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9f68-e5e8-408e-b96a-e8105d1ce92e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:22.578626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9f68-e5e8-408e-b96a-e8105d1ce92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:22.614265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d8aa9f68-e5e8-408e-b96a-e8105d1ce92e None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:22.616087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8aa9f68-e5e8-408e-b96a-e8105d1ce92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:22.636269 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2833/5692] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:22.649063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:22.678139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b6e22-cd27-423d-962f-8314aa83d1cc service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:22.696446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bf1f5-42b7-4d60-bec2-30faa0902c42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:22.698840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bf1f5-42b7-4d60-bec2-30faa0902c42 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:22.699430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bf1f5-42b7-4d60-bec2-30faa0902c42 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:22.700145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bf1f5-42b7-4d60-bec2-30faa0902c42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:22.726540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bf1f5-42b7-4d60-bec2-30faa0902c42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:22.733028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bf1f5-42b7-4d60-bec2-30faa0902c42 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:22.748426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2860/5693] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:10:23.666192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:23.666687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:23.666687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:23.699132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] MFA Rules not processed for user `973422e272f6404f81fcf4702fcfb5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:23.701172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:23.716449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2834/5694] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:25.069745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35e14-f104-4dd7-8934-c7e027b6f5f9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:25.070341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35e14-f104-4dd7-8934-c7e027b6f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:25.070534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35e14-f104-4dd7-8934-c7e027b6f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:25.173276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9cd35e14-f104-4dd7-8934-c7e027b6f5f9 None None] MFA Rules not processed for user `973422e272f6404f81fcf4702fcfb5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:25.178480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9cd35e14-f104-4dd7-8934-c7e027b6f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:25.223809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2861/5695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:25.309810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:25.327889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad8d68-0773-4a81-8ef3-5080f439c021 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:25.346237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:25.347394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:25.347689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:25.352228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:25.358674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:25.429540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:25.430918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:25.497675 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2835/5696] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:27.622499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bd9e2-6495-4083-90bc-498d1f81c98d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:27.622499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bd9e2-6495-4083-90bc-498d1f81c98d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:27.622499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bd9e2-6495-4083-90bc-498d1f81c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:27.665737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-487bd9e2-6495-4083-90bc-498d1f81c98d None None] MFA Rules not processed for user `094361c60a54434fb90e605c040800ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:27.667709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-487bd9e2-6495-4083-90bc-498d1f81c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:27.701336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:27.793038 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2862/5697] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:27.805712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:27.820424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e6935-a9b2-4ad1-b78a-971cbd80b0ad service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:27.834296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:27.835198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:27.835643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:27.836036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:27.865692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:27.870467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:27.936651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2836/5698] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:27.990269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:27.991624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:27.991624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:28.029352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] MFA Rules not processed for user `2e7ae0c95ed24a808ce2a1d69ded6c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:28.031325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:28.137649 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2863/5699] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:33.496424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:33.505096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:33.670401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9e9a7-d725-4de4-b269-3703e286c0fb service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:33.681788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:33.682884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:33.683314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:33.683686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:33.686355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:33.744641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:33.748793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:33.781723 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2837/5700] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:33.837954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:33.840112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:34.076194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ab11-5b9b-479c-90a7-79bce917f4aa None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:34.084257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:34.085087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:34.085383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:34.085731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] PATH_INFO: `/v3/users/14cbba91d5874eb3992ff869ff32e98a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:34.087868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14cbba91d5874eb3992ff869ff32e98a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:34.089819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:34.619114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14cbba91d5874eb3992ff869ff32e98a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:34.641025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14cbba91d5874eb3992ff869ff32e98a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:34.650180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14cbba91d5874eb3992ff869ff32e98a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:34.651221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14cbba91d5874eb3992ff869ff32e98a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:34.663779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:34.694948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1b97e530-473d-436e-9017-3bc4c458be34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14cbba91d5874eb3992ff869ff32e98a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:34.843356 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2864/5701] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:10:33 2022] DELETE /identity/v3/users/14cbba91d5874eb3992ff869ff32e98a => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:35.607720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:35.638753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d97fdf-e300-4fc5-8585-0b09a320111e service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:35.802110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:35.805760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:35.806638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:35.810216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] PATH_INFO: `/v3/projects/2ca2ee6cad064b14bd68229c859db365` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:35.811800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca2ee6cad064b14bd68229c859db365)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:35.816372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:35.859204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:36.010584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca2ee6cad064b14bd68229c859db365', 'request_id': 'req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:36.019658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca2ee6cad064b14bd68229c859db365', 'request_id': 'req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:36.026777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca2ee6cad064b14bd68229c859db365', 'request_id': 'req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:36.124738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] The token cache is being invalidate because project 2ca2ee6cad064b14bd68229c859db365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:10:36.124738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:36.124738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-651a4dea-1ec5-4e84-a0e6-b07d55b1e6fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:10:36.125468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2838/5702] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:10:35 2022] DELETE /identity/v3/projects/2ca2ee6cad064b14bd68229c859db365 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:36.133888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:36.134484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:36.134484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:36.196076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:36.198220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:36.303530 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2865/5703] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:36.323280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:36.323661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:36.323941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:36.387886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:36.393637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:36.422357 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2839/5704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:36.424157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:36.449197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90976-3b06-4abd-8c94-73c9521035f8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:36.461260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:36.462281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:36.464713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:36.465637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:36.480300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:10:36.481069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:36.485510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:36.520210 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2866/5705] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:10:36.525069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:36.538563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95838b5-23b2-48fd-964b-ccb61135fad1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:36.544867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:36.545515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:36.545788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:36.546066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:36.546799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:36.549031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:36.674436 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2840/5706] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:10:36 2022] POST /identity/v3/projects => generated 395 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:10:36.679538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:36.691388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75abb-a0eb-4d91-b2c5-b2a670449154 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:36.928730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:36.928730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:36.928730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:36.928730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:36.929233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:36.929233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:37.120200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2867/5707] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:10:36 2022] POST /identity/v3/users => generated 298 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:10:37.120670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:37.139248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fda05-192d-48af-9567-574d15c9083f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:37.151748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:37.152641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:37.153220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:37.153607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:37.155346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:37.157722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:37.212123 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2841/5708] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:37.214858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:37.240576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96296ca-695c-42f4-8a60-30f7000bde22 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:37.246553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee443b-1a6d-4435-9137-9eb4ff83c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:37.247269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee443b-1a6d-4435-9137-9eb4ff83c13d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:37.248729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee443b-1a6d-4435-9137-9eb4ff83c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:37.249232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee443b-1a6d-4435-9137-9eb4ff83c13d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:37.250067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee443b-1a6d-4435-9137-9eb4ff83c13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:37.253323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee443b-1a6d-4435-9137-9eb4ff83c13d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:37.276039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:37.277950 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2868/5709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:10:37.292939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473975-bc81-446c-b2a0-f1ba44b3fac3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:37.298838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:37.299602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:37.300027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:37.308707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] PATH_INFO: `/v3/projects/0444d17c98fd486faf23794180465b3d/users/7c58a8e8fcff4ca2afc6c54b9bc4e6e6/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:37.320968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0444d17c98fd486faf23794180465b3d, user_id=7c58a8e8fcff4ca2afc6c54b9bc4e6e6, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:37.324203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:37.440292 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2842/5710] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:10:37 2022] PUT /identity/v3/projects/0444d17c98fd486faf23794180465b3d/users/7c58a8e8fcff4ca2afc6c54b9bc4e6e6/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:10:37.446144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b067a-0517-4bae-aa53-6aceac502760 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:37.446431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b067a-0517-4bae-aa53-6aceac502760 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:37.446767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b067a-0517-4bae-aa53-6aceac502760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:37.490827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a82b067a-0517-4bae-aa53-6aceac502760 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:37.492269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a82b067a-0517-4bae-aa53-6aceac502760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:37.555839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:37.578189 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2869/5711] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:37.593132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:37.594944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:37.672036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90595-ee8e-4c08-8960-22e25de3fcd9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:37.676468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:37.677106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:37.677344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:37.677618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:37.692219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:37.692219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:37.701712 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2843/5712] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:38.462061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:38.462542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:38.462646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:38.498737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] MFA Rules not processed for user `3e45dfaf9fd949548bca37303a117bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:38.500015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:38.609567 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2870/5713] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:40.883571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:40.886701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:40.960092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:40.999570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cb908-9554-425f-be8e-73b648f32960 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:41.007384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:41.008315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:41.011770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:41.011770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:41.018573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:41.044177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:41.046311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28700d59-6c20-4b44-9867-28cf58492929 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:41.068155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2844/5714] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:51.030905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=30 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:10:52.270048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:52.271724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:52.377006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:52.377498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:52.377607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:52.462348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ee47e-0963-4233-a9b6-79639c927fd8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:52.494847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] MFA Rules not processed for user `7c58a8e8fcff4ca2afc6c54b9bc4e6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:52.496260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:52.497897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:52.498823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:52.505652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:52.506277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:52.508979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:52.673007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:52.674892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528936-1d2a-4055-ade8-31f8c09d7c4d service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:52.706917 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2871/5715] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:52 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:52.710197 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2845/5716] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:52.730207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9859-1965-47dc-93db-f10478061606 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:52.730207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9859-1965-47dc-93db-f10478061606 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:52.730207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9859-1965-47dc-93db-f10478061606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:52.788825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b00e9859-1965-47dc-93db-f10478061606 None None] MFA Rules not processed for user `7c58a8e8fcff4ca2afc6c54b9bc4e6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:52.788825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b00e9859-1965-47dc-93db-f10478061606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:52.804391 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2872/5717] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:53.016413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:53.018258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:53.053308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7c473-17fb-4179-a117-088576e912c6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:53.068840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:53.070007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:53.070964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:53.072985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:53.088803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:53.092548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:53.120943 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2846/5718] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:10:54.714556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b031-da3b-459d-9517-e235bcf8053e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:54.715790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b031-da3b-459d-9517-e235bcf8053e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:54.716282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3b031-da3b-459d-9517-e235bcf8053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:54.744340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d6a3b031-da3b-459d-9517-e235bcf8053e None None] MFA Rules not processed for user `2e7ae0c95ed24a808ce2a1d69ded6c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:10:54.746008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d6a3b031-da3b-459d-9517-e235bcf8053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:54.878706 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2873/5719] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:10:57.887592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:10:57.929238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed62817-48ce-41d1-8107-125a12d9c33a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:10:57.946587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:10:57.948076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:10:57.949270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:10:57.950149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:10:57.957643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:10:58.012627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:10:58.017335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:10:58.040225 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2847/5720] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:11:02.090340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:02.091447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:02.091881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:02.213654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:02.217321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:02.243612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:02.420553 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2874/5721] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:02.438398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:02.441506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:02.596858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304eea-887e-467b-957c-a11b52cf68e5 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:02.606531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:02.607959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:02.608555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:02.609941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:02.622232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:02.625669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:02.638549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2848/5722] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:11:06.359951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:06.384363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3059a7a-db0c-4db3-9c3c-1d1c89bdcd7d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:06.402528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:06.406340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:06.406340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:06.406340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:06.406340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:06.435552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:06.437731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:06.463487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2875/5723] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:08.850894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:08.864504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ca17-0852-41ac-9089-14e3d5ca2342 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:08.889149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:08.890844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:08.890844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:08.891220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:08.893691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:08.913811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:08.914923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:08.921882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:08.939805 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2849/5724] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:16.453707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=26 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:17.581593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:17.609239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0f6a6-6452-4e0e-b1f4-7a1cc1841162 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:17.614714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:17.615429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:17.615749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:17.616198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:17.621820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:17.662959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:17.664496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:17.695143 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2876/5725] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:23.223002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:23.224962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:23.255980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112717-c06d-4590-af27-1021f64c1194 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:23.261963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:23.263701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:23.266265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:23.266964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] PATH_INFO: `/v3/users/3d84a0cde53b4c278fc96b6d7296d5e4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:23.270066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d84a0cde53b4c278fc96b6d7296d5e4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:23.274529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:23.630552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d84a0cde53b4c278fc96b6d7296d5e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:23.641816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d84a0cde53b4c278fc96b6d7296d5e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:23.642804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d84a0cde53b4c278fc96b6d7296d5e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:23.672346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d84a0cde53b4c278fc96b6d7296d5e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:23.673402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d84a0cde53b4c278fc96b6d7296d5e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:23.807992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2850/5726] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:23 2022] DELETE /identity/v3/users/3d84a0cde53b4c278fc96b6d7296d5e4 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:24.146398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:24.170231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b55ff-173a-4126-91f4-55df9635acd5 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:24.252180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:24.252830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:24.253274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:24.253549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] PATH_INFO: `/v3/projects/a2edd13a86624b4fbebab5f650bac271` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:24.254700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2edd13a86624b4fbebab5f650bac271)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:24.256940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:24.400664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2edd13a86624b4fbebab5f650bac271', 'request_id': 'req-79a5551f-2836-45f3-ba97-589c281e7e1a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.409182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2edd13a86624b4fbebab5f650bac271', 'request_id': 'req-79a5551f-2836-45f3-ba97-589c281e7e1a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.419449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2edd13a86624b4fbebab5f650bac271', 'request_id': 'req-79a5551f-2836-45f3-ba97-589c281e7e1a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.525717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] The token cache is being invalidate because project a2edd13a86624b4fbebab5f650bac271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:24.526022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.526694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.528285 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2877/5727] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:24 2022] DELETE /identity/v3/projects/a2edd13a86624b4fbebab5f650bac271 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:24.533378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:24.535239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:24.554539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ea468-aa97-4157-b855-05ee033b5df2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:24.635834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:24.636513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:24.636934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:24.637282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] PATH_INFO: `/v3/users/27793466151d4470985c94b43658588c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:24.638644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=27793466151d4470985c94b43658588c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:24.641430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:24.938182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27793466151d4470985c94b43658588c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.953889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27793466151d4470985c94b43658588c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.954963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27793466151d4470985c94b43658588c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.975089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27793466151d4470985c94b43658588c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.977457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27793466151d4470985c94b43658588c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:24.980826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:25.129719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2851/5728] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:24 2022] DELETE /identity/v3/users/27793466151d4470985c94b43658588c => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:25.440776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:25.440776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:25.624085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5551f-2836-45f3-ba97-589c281e7e1a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:25.642358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:25.697850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:25.703640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:25.790944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:25.792086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:25.792528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:25.792984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:25.796011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:25.814974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:25.818960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4adb6-1c41-41ca-9634-e4c5a34767f7 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:25.847386 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2878/5729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:25.902427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0d230-1a7b-4910-9544-e0ea144396ab admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:25.926612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:25.927323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:25.927597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:25.928065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] PATH_INFO: `/v3/projects/6db29c866cb84356b44d74de4b38b859` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:25.929389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db29c866cb84356b44d74de4b38b859)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:25.940090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:26.113340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db29c866cb84356b44d74de4b38b859', 'request_id': 'req-7c661ef8-cf82-4e94-81af-6266ea910898'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:26.122296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db29c866cb84356b44d74de4b38b859', 'request_id': 'req-7c661ef8-cf82-4e94-81af-6266ea910898'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:26.132631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db29c866cb84356b44d74de4b38b859', 'request_id': 'req-7c661ef8-cf82-4e94-81af-6266ea910898'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:26.249076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] The token cache is being invalidate because project 6db29c866cb84356b44d74de4b38b859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:26.249512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:26.250295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c661ef8-cf82-4e94-81af-6266ea910898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:26.256251 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2852/5730] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:25 2022] DELETE /identity/v3/projects/6db29c866cb84356b44d74de4b38b859 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:26.263773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:26.264270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:26.264645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:26.296016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:26.297374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:26.394652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2879/5731] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:26.403628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:26.406124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:26.406798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:26.468275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:26.470024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:26.495690 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2853/5732] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:26.507031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:26.528767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f01613-5693-4e42-8fe1-19147903abc5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:26.545771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:26.546527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:26.546817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:26.547149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:26.547820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:26.548345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:26.550106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:26.566127 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2880/5733] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:26.570747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:26.587190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff1c9-17c5-4d23-9776-e2b4b9dc7bb4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:26.596310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:26.597299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:26.597774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:26.598254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:26.599371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:26.602851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:26.762314 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2854/5734] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:26 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:26.767899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:26.780194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088f1e-049b-4e51-89ce-e14db8b37b48 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:26.874682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:26.875824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:26.879536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:26.879536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:26.879536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:26.886674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.046309 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2881/5735] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:26 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:27.050608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.067004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87de14-c4fe-419b-871a-faade64a4eb0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.071710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.072668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.073048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.073940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.074756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.076841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.103506 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2855/5736] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:27.108262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.136001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572aa1-fcb0-4685-bd06-5ef79989d3ce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.152790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.153541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.153832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.154133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.154943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.156894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.192009 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2882/5737] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:27.193620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.239952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb5391-21a8-4645-bd88-a46139307033 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.266204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbab2a-5765-4192-91c0-8e1bd9c0ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.267052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbab2a-5765-4192-91c0-8e1bd9c0ee56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.267354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbab2a-5765-4192-91c0-8e1bd9c0ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.267632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbab2a-5765-4192-91c0-8e1bd9c0ee56 admin admin] PATH_INFO: `/v3/projects/d5d088535ffb4f968ab38c3bf7257a6f/users/9ce20539aae745a48a7761be28c79a02/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.288339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbab2a-5765-4192-91c0-8e1bd9c0ee56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d088535ffb4f968ab38c3bf7257a6f, user_id=9ce20539aae745a48a7761be28c79a02, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.292710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbab2a-5765-4192-91c0-8e1bd9c0ee56 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.368708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.370727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:27.389542 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2856/5738] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:27 2022] PUT /identity/v3/projects/d5d088535ffb4f968ab38c3bf7257a6f/users/9ce20539aae745a48a7761be28c79a02/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:27.393294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b60408-5bfb-49bd-ba9c-85af8bbec3a9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.402669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.403179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.404132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.405590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:27.443750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] MFA Rules not processed for user `9ce20539aae745a48a7761be28c79a02`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:27.447255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:27.451942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:27.488852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.489585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.489867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.490172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] PATH_INFO: `/v3/users/cd688ef7a0c34ec7be19f850924ea2ee` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.491416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd688ef7a0c34ec7be19f850924ea2ee)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.493454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.541014 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2857/5739] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:27.542337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.555886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8543d-5f35-4dcd-8ba9-ea10e1354286 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.561735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.562540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.562831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.563189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.564032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.566679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.733966 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2858/5740] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:27 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:27.738065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.805447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a12231-3465-492e-9db1-985ac95f4bd6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.810176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.810937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.811128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.816776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.816776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.816776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.829591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd688ef7a0c34ec7be19f850924ea2ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:27.837041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd688ef7a0c34ec7be19f850924ea2ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:27.837810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd688ef7a0c34ec7be19f850924ea2ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:27.839706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd688ef7a0c34ec7be19f850924ea2ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:27.855399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e702c292-7908-4d65-948b-09171d6d7e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd688ef7a0c34ec7be19f850924ea2ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:27.922251 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2859/5741] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:27 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:27.926257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.928087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:27.940772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc7888-ccd7-4ad5-8c45-9861628f4b61 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.945887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:27.946574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.946860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.947172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.948001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:27.952981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:27.956230 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2883/5742] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:27 2022] DELETE /identity/v3/users/cd688ef7a0c34ec7be19f850924ea2ee => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:27.960620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:27.960968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:27.961222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:27.964677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2860/5743] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:27.969819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:27.982363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:27.982969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e1ad-2780-490f-9405-d33a176a4049 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:27.983653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:28.064547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.065182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.065467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.065746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] PATH_INFO: `/v3/projects/ec2f9c258a824be1bc2f703947db2a12/users/094682d585ea49caa0e409e24b2cd3a2/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.077932 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2884/5744] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:28.087768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2f9c258a824be1bc2f703947db2a12, user_id=094682d585ea49caa0e409e24b2cd3a2, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.090481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.093914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.096378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:28.135999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:28.170539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46107cd-dfed-40f9-89fe-42930f0686c1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.176401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.177435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.177924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.178423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.190566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.192846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.204288 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2861/5745] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:27 2022] PUT /identity/v3/projects/ec2f9c258a824be1bc2f703947db2a12/users/094682d585ea49caa0e409e24b2cd3a2/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:28.206828 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2885/5746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:11:28.208771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.309393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2a7ca-973d-49b1-8d43-5b50a847be3a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.319491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa3e11-4e17-4dc4-be54-1d2a356e1689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.320468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3e11-4e17-4dc4-be54-1d2a356e1689 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.321007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3e11-4e17-4dc4-be54-1d2a356e1689 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.321501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3e11-4e17-4dc4-be54-1d2a356e1689 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.322827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa3e11-4e17-4dc4-be54-1d2a356e1689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.325604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa3e11-4e17-4dc4-be54-1d2a356e1689 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.353320 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2862/5747] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:28.355038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.397793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:28.400546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4741b-626c-4898-8bc0-fe0a05128ece service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.408016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.409141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.409656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.410074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] PATH_INFO: `/v3/projects/ec2f9c258a824be1bc2f703947db2a12/users/094682d585ea49caa0e409e24b2cd3a2/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.413674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2f9c258a824be1bc2f703947db2a12, user_id=094682d585ea49caa0e409e24b2cd3a2, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.418914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.433451 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2886/5748] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:28 2022] PUT /identity/v3/projects/ec2f9c258a824be1bc2f703947db2a12/users/094682d585ea49caa0e409e24b2cd3a2/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:28.446037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.446490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.450227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.480706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] MFA Rules not processed for user `094682d585ea49caa0e409e24b2cd3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:28.481998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:28.559916 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2863/5749] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:28.566042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.581802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448517c1-7d14-4ca2-bd6e-49227879a2c5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.583386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.584000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.584313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.584592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.585244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.586274 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:28.586274 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:11:28.586274 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:11:28.587193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.686230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.688701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:28.717538 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2887/5750] 10.222.0.20 () {60 vars in 1185 bytes} [Tue Sep 6 11:11:28 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:28.718970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.738891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c451-540d-4c98-ad02-8230bcf6d760 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.745795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.746460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.746777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.747093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5209abce714d420f97dfadc8a98fcf5c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.747693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=5209abce714d420f97dfadc8a98fcf5c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.750812 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:28.750812 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:11:28.750812 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:11:28.751792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.759467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2888/5751] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:11:28 2022] GET /identity/v3/OS-OAUTH1/consumers/5209abce714d420f97dfadc8a98fcf5c => generated 221 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:11:28.764695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:28.776209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7594fa-5441-4369-8db0-28fcd1323f25 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.781330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.782006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.782482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.782760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5209abce714d420f97dfadc8a98fcf5c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.783388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5209abce714d420f97dfadc8a98fcf5c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.784422 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:28.784422 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:11:28.784422 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:11:28.785296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.785572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invalidating token cache because consumer 5209abce714d420f97dfadc8a98fcf5c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:28.785857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:28.786566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:28.819480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdc38e-d7a6-4d84-8b0d-160ee1b3bf65 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:28.831328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:28.832145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:28.832450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:28.832736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] PATH_INFO: `/v3/projects/d74cebc447df40999bba54b46f724260` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:28.833978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74cebc447df40999bba54b46f724260)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:28.835984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:28.908445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5209abce714d420f97dfadc8a98fcf5c', 'request_id': 'req-34c8d510-2150-4916-87b1-83713f14ed6f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:28.985638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74cebc447df40999bba54b46f724260', 'request_id': 'req-ca93cdd3-5c1b-4836-99dc-aac4e2166877'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:28.992924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74cebc447df40999bba54b46f724260', 'request_id': 'req-ca93cdd3-5c1b-4836-99dc-aac4e2166877'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.000142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74cebc447df40999bba54b46f724260', 'request_id': 'req-ca93cdd3-5c1b-4836-99dc-aac4e2166877'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.053866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2889/5752] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:11:28 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5209abce714d420f97dfadc8a98fcf5c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:29.058885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.061638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.077800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d510-2150-4916-87b1-83713f14ed6f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.139369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.139939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.140246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.140521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.141198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.142828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.150380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] The token cache is being invalidate because project d74cebc447df40999bba54b46f724260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:29.150682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.151333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca93cdd3-5c1b-4836-99dc-aac4e2166877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.152866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2864/5753] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:28 2022] DELETE /identity/v3/projects/d74cebc447df40999bba54b46f724260 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:29.159814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fee53-b00f-48a6-917d-7176c76bd120 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.160110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fee53-b00f-48a6-917d-7176c76bd120 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.160380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fee53-b00f-48a6-917d-7176c76bd120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.182449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a83fee53-b00f-48a6-917d-7176c76bd120 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:29.183752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a83fee53-b00f-48a6-917d-7176c76bd120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.251094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2890/5754] 10.222.0.20 () {60 vars in 1185 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:29.251305 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2865/5755] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:29.252957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.256936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.257941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.258349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.258673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.275209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc7cfa-31ad-446e-be97-75c2add219de tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.280279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.281102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.281383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.281530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:29.281658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.282240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=622c6f21a65349ce9709ae71117beb12)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.282638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.283867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.289362 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2891/5756] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:11:29 2022] GET /identity/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12 => generated 220 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:29.292636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2866/5757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:29.293501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.297343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.305437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422b447-c60d-47b0-8035-f497c1054fc9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.308669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c21a-8145-443c-a87f-ea3d57eba7fb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.312405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.312405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.312405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.312930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.312930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=622c6f21a65349ce9709ae71117beb12)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.314471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.314744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invalidating token cache because consumer 622c6f21a65349ce9709ae71117beb12 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:29.314882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.315066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.315528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.315811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.316085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.316581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.316748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:29.317192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.318865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.331403 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2867/5758] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:11:29.336428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.338546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.342577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:29.353629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230556-0bd3-435f-9e41-608b018a6237 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.361633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.362676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.363247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.363747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.364944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.368719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.438517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '622c6f21a65349ce9709ae71117beb12', 'request_id': 'req-13e24eae-03b3-4473-ba06-6d24a9387c36'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.479863 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2868/5759] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:29.480388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.548572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2892/5760] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:11:29 2022] DELETE /identity/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:29.551162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818bda3-47ec-41b2-aac4-47a5a3c61fa8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.555508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.556289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.556919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.557032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.557205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.557485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.558134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.560165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.570934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24eae-03b3-4473-ba06-6d24a9387c36 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.598741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:29.634349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.635029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.635324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.635598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.636177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=622c6f21a65349ce9709ae71117beb12)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.637810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.659682 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2869/5761] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:29.663393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Sep 06 11:11:29.664005 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:11:29.667763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2893/5762] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:11:29 2022] GET /identity/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12 => generated 74 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:11:29.669717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.674438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937bfca-c542-4e82-9f64-3f0712c0ab8e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.679527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.680147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.680445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.680720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.681361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.681847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d12e-113a-42ef-907d-7120aafa3cf7 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.683092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.687190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.687858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.688147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.688425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.689177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=622c6f21a65349ce9709ae71117beb12)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.690707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.691000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invalidating token cache because consumer 622c6f21a65349ce9709ae71117beb12 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:29.691446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.692001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:29.694749 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2870/5763] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:29.699034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.700961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.713968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e749-061f-4e67-b840-7958ceade114 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Sep 06 11:11:29.715563 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Sep 06 11:11:29.717234 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:11:29.718030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2894/5764] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:11:29 2022] DELETE /identity/v3/OS-OAUTH1/consumers/622c6f21a65349ce9709ae71117beb12 => generated 74 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:11:29.722190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.722356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.722795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.723114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.723391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.723566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:29.724200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.726092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.739640 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2871/5765] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:29.745535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191f7e-93dd-440f-9a63-d09af4080a2e tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.745535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.745535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.745883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.746080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.746712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.748659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.748846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.759899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50a4e-c94e-473e-ac9b-8eeb377c2ba0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.765552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a3f76-91a7-43a4-b153-0b72b695c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.766255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3f76-91a7-43a4-b153-0b72b695c447 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.768538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3f76-91a7-43a4-b153-0b72b695c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.768538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3f76-91a7-43a4-b153-0b72b695c447 admin admin] PATH_INFO: `/v3/projects/475b057b774748288aae17ed98a044cc/users/d1082698ef4142b3b803e7f4c67a2d01/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.782570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a3f76-91a7-43a4-b153-0b72b695c447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475b057b774748288aae17ed98a044cc, user_id=d1082698ef4142b3b803e7f4c67a2d01, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.785283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a3f76-91a7-43a4-b153-0b72b695c447 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.848587 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2895/5766] 10.222.0.20 () {60 vars in 1185 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:29.852575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:29.863555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdccb4-5c4a-426c-8a58-28843f30d02a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:29.868417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:29.869001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.873890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.873890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.873890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:29.873890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:29.974668 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2872/5767] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:29 2022] PUT /identity/v3/projects/475b057b774748288aae17ed98a044cc/users/d1082698ef4142b3b803e7f4c67a2d01/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:29.986473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:29.986710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:29.987095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:29.994637 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2896/5768] 10.222.0.20 () {60 vars in 1185 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:29.999280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.012464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dca3d-ee45-4c1f-b8e5-a82c574d64d8 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.021660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] MFA Rules not processed for user `d1082698ef4142b3b803e7f4c67a2d01`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:30.023116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:30.093384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.093384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.093384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.093763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.093763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.093763 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:30.093763 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:11:30.093763 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:11:30.093763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.103424 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2897/5769] 10.222.0.20 () {58 vars in 1164 bytes} [Tue Sep 6 11:11:29 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:30.104495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.104911 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2873/5770] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:30.113164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.117996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55acfe-57d0-487f-b36e-e4191302d1e1 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.130961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.132297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.132977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.133706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1ea75d477b0c45c2ae91ce3556b256a3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.134499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1ea75d477b0c45c2ae91ce3556b256a3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.136556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.137020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invalidating token cache because consumer 1ea75d477b0c45c2ae91ce3556b256a3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:30.143104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:30.143104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:30.185977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:30.190768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acaf31-e12c-4b97-8a7b-089b6b335209 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.204397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.205588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.205874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.206158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.211148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.211148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.234048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1ea75d477b0c45c2ae91ce3556b256a3', 'request_id': 'req-ca0e33a9-e540-49b3-a444-e25d3514032a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:30.311394 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2874/5771] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:30 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:30.315402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.317127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:30.340067 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2898/5772] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:11:30 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1ea75d477b0c45c2ae91ce3556b256a3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:30.346531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.348220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:30.361503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e33a9-e540-49b3-a444-e25d3514032a tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.386909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9de4fc-6d11-4c8d-8b52-b892f258649a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.393174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.393794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.394084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.394362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.394999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.396956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.424241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.424894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.425186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.425467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8445c389677d4db39c239f86edc1e9ca` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.426114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8445c389677d4db39c239f86edc1e9ca)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.427780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.428061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invalidating token cache because consumer 8445c389677d4db39c239f86edc1e9ca has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:30.428379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:30.429030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:30.533724 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2875/5773] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:30 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:30.537552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.539330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:30.550472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8445c389677d4db39c239f86edc1e9ca', 'request_id': 'req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:30.556006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e34771-d4d0-4e22-80b1-a3f61f24abe2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.558948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.559595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.559884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.560165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.561323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.563102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.574827 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2876/5774] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:30.579601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.597420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32533988-cd73-4d50-903d-6eef54e62207 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.597420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.597420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.597420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.598133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] PATH_INFO: `/v3/projects/a110750f82a34f8e8b299a43254b25dc/users/5b582e621d674c83b93c28ccd9d14680/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.613086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a110750f82a34f8e8b299a43254b25dc, user_id=5b582e621d674c83b93c28ccd9d14680, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.615854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.673662 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2899/5775] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:11:30 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8445c389677d4db39c239f86edc1e9ca => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:30.679518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.680912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:30.696788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54198f-32d0-4b0d-99eb-28b4a2aa88a0 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.701961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.702579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.702872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.703190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.703842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.705453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.780000 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2877/5776] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:30 2022] PUT /identity/v3/projects/a110750f82a34f8e8b299a43254b25dc/users/5b582e621d674c83b93c28ccd9d14680/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:30.784257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.849275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873efb2c-7f4e-4c91-8f8c-862480ed1d8d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.854165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.854775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.855234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.855503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.856142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.858555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.869070 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2878/5777] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:30.873689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.884876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76e916-3ab4-4bbd-ae0c-d93c1753275c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.890549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c872b-9a28-4e8b-94b8-8c1e83952100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:30.891380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c872b-9a28-4e8b-94b8-8c1e83952100 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.891673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c872b-9a28-4e8b-94b8-8c1e83952100 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.891944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c872b-9a28-4e8b-94b8-8c1e83952100 admin admin] PATH_INFO: `/v3/projects/a110750f82a34f8e8b299a43254b25dc/users/5b582e621d674c83b93c28ccd9d14680/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.893970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c872b-9a28-4e8b-94b8-8c1e83952100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a110750f82a34f8e8b299a43254b25dc, user_id=5b582e621d674c83b93c28ccd9d14680, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:30.896696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c872b-9a28-4e8b-94b8-8c1e83952100 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:30.908777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2879/5778] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:30 2022] PUT /identity/v3/projects/a110750f82a34f8e8b299a43254b25dc/users/5b582e621d674c83b93c28ccd9d14680/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:30.917453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:30.920632 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2900/5779] 10.222.0.20 () {60 vars in 1185 bytes} [Tue Sep 6 11:11:30 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:30.923592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:30.923945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:30.924228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:30.924560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:30.941920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ef909-9183-4e50-9191-9ef32b6a961c tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:30.960759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] MFA Rules not processed for user `5b582e621d674c83b93c28ccd9d14680`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:30.961992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:31.001365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:31.002017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:31.002312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:31.002632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d7cbf1cb91904901a3877724175d6759` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:31.003345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=d7cbf1cb91904901a3877724175d6759)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:31.004365 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:31.004365 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:11:31.004365 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:11:31.008100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:31.032734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2880/5780] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:31.047619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:31.049102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:31.110837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75118ce-6b58-464e-ba6a-d718863e1fc4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:31.114672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:31.115191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:31.115476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:31.115755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:31.126221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:31.127814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:31.139570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2881/5781] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:11:31.184874 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2901/5782] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Sep 6 11:11:30 2022] PATCH /identity/v3/OS-OAUTH1/consumers/d7cbf1cb91904901a3877724175d6759 => generated 220 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:31.187282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:31.199277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf379-66a1-4656-8616-1f548b1d59c7 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:31.204751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:31.207571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:31.209369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:31.209369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d7cbf1cb91904901a3877724175d6759` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:31.209369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d7cbf1cb91904901a3877724175d6759)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:31.209872 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:31.209872 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:11:31.209872 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:11:31.211262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:31.221730 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2882/5783] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Sep 6 11:11:31 2022] GET /identity/v3/OS-OAUTH1/consumers/d7cbf1cb91904901a3877724175d6759 => generated 220 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:31.226187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:31.244215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5d42d-6ddf-4409-a2ad-7af40d7418c9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:31.251220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094682d585ea49caa0e409e24b2cd3a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec2f9c258a824be1bc2f703947db2a12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:31.252114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:31.252554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:31.253303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d7cbf1cb91904901a3877724175d6759` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:31.254115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d7cbf1cb91904901a3877724175d6759)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:31.258254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:31.258809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invalidating token cache because consumer d7cbf1cb91904901a3877724175d6759 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:31.259129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.259853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.376365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f1e66f55-8a2c-41f0-8340-09bbf35b205f tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd7cbf1cb91904901a3877724175d6759', 'request_id': 'req-f1e66f55-8a2c-41f0-8340-09bbf35b205f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.476864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2902/5784] 10.222.0.20 () {58 vars in 1266 bytes} [Tue Sep 6 11:11:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d7cbf1cb91904901a3877724175d6759 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:31.484798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:31.486550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:31.561495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5526-aa6e-42f4-bc6c-fb05cb8004e9 tempest-OAUTHConsumersV3Test-1821378202 tempest-OAUTHConsumersV3Test-1821378202-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:31.578810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:31.582051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:31.582356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:31.582650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] PATH_INFO: `/v3/users/9ce20539aae745a48a7761be28c79a02` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:31.583971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce20539aae745a48a7761be28c79a02)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:31.586102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:31.934259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce20539aae745a48a7761be28c79a02'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.942848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce20539aae745a48a7761be28c79a02'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.943604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce20539aae745a48a7761be28c79a02'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.957114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce20539aae745a48a7761be28c79a02'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.957850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce20539aae745a48a7761be28c79a02'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:31.980272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:32.073270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2883/5785] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:31 2022] DELETE /identity/v3/users/9ce20539aae745a48a7761be28c79a02 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:32.079359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ed11-8977-4c91-9d08-501f25612be6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:32.080271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ed11-8977-4c91-9d08-501f25612be6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:32.080739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ed11-8977-4c91-9d08-501f25612be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:32.101500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ea09ed11-8977-4c91-9d08-501f25612be6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:32.102719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ea09ed11-8977-4c91-9d08-501f25612be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:32.164904 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2903/5786] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:32.174830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:32.176732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:32.207313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:32.207682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:32.208037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:32.232145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:32.234672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:32.265173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785109e-245f-4e46-85ec-58505be0283a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:32.270762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:32.271499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:32.271788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:32.272118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:32.282756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:32.284379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:32.303411 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2884/5787] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:32.315854 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2904/5788] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:32.328911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:32.331664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:32.411212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e973-a8d5-4163-8fc4-d5ac88b52e31 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:32.427446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:32.428452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:32.428987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:32.429627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:32.449035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:32.452034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:32.475344 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2885/5789] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:11:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:11:32.605910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:32.614965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:32.630300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c722-5ca5-47ca-bc94-ab7ac541eb85 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:32.640960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:32.646633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:32.646633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:32.646633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] PATH_INFO: `/v3/users/d1082698ef4142b3b803e7f4c67a2d01` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:32.646633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1082698ef4142b3b803e7f4c67a2d01)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:32.647108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:32.878986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:32.881447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:32.907811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12000-98e1-4ec3-bfc5-692c32c34782 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:32.920369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:32.926068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:32.927630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:32.928026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:32.928382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] PATH_INFO: `/v3/projects/d5d088535ffb4f968ab38c3bf7257a6f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:32.929669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d088535ffb4f968ab38c3bf7257a6f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:32.932095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:32.945340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1082698ef4142b3b803e7f4c67a2d01'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:32.958750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1082698ef4142b3b803e7f4c67a2d01'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:32.960518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1082698ef4142b3b803e7f4c67a2d01'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:32.961166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1082698ef4142b3b803e7f4c67a2d01'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:32.980376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-db76fe2e-9147-46b5-8e0d-efb41a50b9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1082698ef4142b3b803e7f4c67a2d01'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.085756 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2905/5790] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:32 2022] DELETE /identity/v3/users/d1082698ef4142b3b803e7f4c67a2d01 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:33.090164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:33.090578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:33.091059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:33.114530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d088535ffb4f968ab38c3bf7257a6f', 'request_id': 'req-10986272-b9aa-4b91-b061-31108f4d1fba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.115536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:33.118875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:33.133087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d088535ffb4f968ab38c3bf7257a6f', 'request_id': 'req-10986272-b9aa-4b91-b061-31108f4d1fba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.150703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d088535ffb4f968ab38c3bf7257a6f', 'request_id': 'req-10986272-b9aa-4b91-b061-31108f4d1fba'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.203392 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2906/5791] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:33.213247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:33.214894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:33.289026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d10688-8d77-4c13-8ba6-b2d302e22acd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:33.298164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:33.299099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:33.299390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:33.299668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:33.314386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:33.315203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] The token cache is being invalidate because project d5d088535ffb4f968ab38c3bf7257a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:33.315721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.316195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:33.317870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.323221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2886/5792] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:32 2022] DELETE /identity/v3/projects/d5d088535ffb4f968ab38c3bf7257a6f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:33.325359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:33.329115 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2907/5793] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:11:33.330779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:33.461917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10986272-b9aa-4b91-b061-31108f4d1fba admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:33.473302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:33.475058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:33.475058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:33.475058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] PATH_INFO: `/v3/users/094682d585ea49caa0e409e24b2cd3a2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:33.476370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=094682d585ea49caa0e409e24b2cd3a2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:33.478952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:33.702749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:33.746715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094682d585ea49caa0e409e24b2cd3a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.755749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094682d585ea49caa0e409e24b2cd3a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.757641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094682d585ea49caa0e409e24b2cd3a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.786854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094682d585ea49caa0e409e24b2cd3a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.791061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094682d585ea49caa0e409e24b2cd3a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:33.893203 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2887/5794] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:33 2022] DELETE /identity/v3/users/094682d585ea49caa0e409e24b2cd3a2 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:34.256198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:34.258917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:34.282536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cb1c7-ae9f-44f3-9574-929726374016 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:34.387758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:34.388829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:34.389326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:34.389774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] PATH_INFO: `/v3/projects/475b057b774748288aae17ed98a044cc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:34.391200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475b057b774748288aae17ed98a044cc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:34.403204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:34.608165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475b057b774748288aae17ed98a044cc', 'request_id': 'req-06244120-fd60-42e2-9a70-1c03a359a6b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.617574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:34.620549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:34.621473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475b057b774748288aae17ed98a044cc', 'request_id': 'req-06244120-fd60-42e2-9a70-1c03a359a6b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.641195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5981-a5d4-483f-8dda-8650447e88cf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:34.647327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475b057b774748288aae17ed98a044cc', 'request_id': 'req-06244120-fd60-42e2-9a70-1c03a359a6b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.758344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:34.759331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:34.759679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:34.760021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] PATH_INFO: `/v3/projects/ec2f9c258a824be1bc2f703947db2a12` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:34.761288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2f9c258a824be1bc2f703947db2a12)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:34.766644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:34.797777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] The token cache is being invalidate because project 475b057b774748288aae17ed98a044cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:34.798618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.800129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.803285 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2908/5795] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:34 2022] DELETE /identity/v3/projects/475b057b774748288aae17ed98a044cc => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:34.810701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:34.811297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:34.816170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:34.834500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06244120-fd60-42e2-9a70-1c03a359a6b2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:34.842860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:34.843797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:34.844192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:34.844573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] PATH_INFO: `/v3/users/5b582e621d674c83b93c28ccd9d14680` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:34.845840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b582e621d674c83b93c28ccd9d14680)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:34.848359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:34.933987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2f9c258a824be1bc2f703947db2a12', 'request_id': 'req-c9680c41-8daf-41df-b32b-87bf4edab96b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.943399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2f9c258a824be1bc2f703947db2a12', 'request_id': 'req-c9680c41-8daf-41df-b32b-87bf4edab96b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:34.949901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2f9c258a824be1bc2f703947db2a12', 'request_id': 'req-c9680c41-8daf-41df-b32b-87bf4edab96b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.054063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] The token cache is being invalidate because project ec2f9c258a824be1bc2f703947db2a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:35.054850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.056003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c9680c41-8daf-41df-b32b-87bf4edab96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.058842 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2888/5796] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:34 2022] DELETE /identity/v3/projects/ec2f9c258a824be1bc2f703947db2a12 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:35.065488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761be9-2ef7-4d1c-b8b7-c9a1119236e5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:35.066104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761be9-2ef7-4d1c-b8b7-c9a1119236e5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:35.066539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761be9-2ef7-4d1c-b8b7-c9a1119236e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:35.096121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6d761be9-2ef7-4d1c-b8b7-c9a1119236e5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:35.098669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6d761be9-2ef7-4d1c-b8b7-c9a1119236e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:35.166191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b582e621d674c83b93c28ccd9d14680'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.186376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b582e621d674c83b93c28ccd9d14680'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.186681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b582e621d674c83b93c28ccd9d14680'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.188612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b582e621d674c83b93c28ccd9d14680'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.189218 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2889/5797] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:35.203914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:35.204547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:35.205065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:35.227476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b582e621d674c83b93c28ccd9d14680'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:35.241569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:35.244270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:35.260752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2890/5798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:35.268605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:35.279487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8492-d96d-4e06-b1d7-8671db0dcb11 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:35.285119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:35.285980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:35.286464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:35.286866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:35.287814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:35.288231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:35.290569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:35.305290 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2891/5799] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:35.315569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:35.333913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce622f2-1bd9-4e54-9ca8-1d3a17992851 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:35.354851 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2909/5800] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:34 2022] DELETE /identity/v3/users/5b582e621d674c83b93c28ccd9d14680 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:35.371248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:35.371248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:35.371248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:35.371248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:35.371686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:35.371686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:35.507307 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2892/5801] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:35 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:35.509916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:35.676117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab2752-1112-4d39-95ed-727aeff498b0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:35.771679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:35.785568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:35.786213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:35.786500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:35.786782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:35.787776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:35.790866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:35.943038 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2910/5802] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:35 2022] POST /identity/v3/users => generated 284 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:35.946743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:35.957884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69d6d-3ebe-4eb9-9d7b-0ee05b8c7c2b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:35.964362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:35.965056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:35.965422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:35.965778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:35.967038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:35.968832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:35.986928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2893/5803] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:35.991737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:36.008698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26004994-47fe-4c43-8dfc-303bd14603b4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:36.015960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:36.021973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:36.021973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:36.021973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:36.021973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:36.033961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:36.052321 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2911/5804] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:36.053577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:36.065397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b2878-f2d7-4ceb-8edc-cab67092b688 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:36.072033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aa49c-d363-4b8a-8bca-aee0e1601beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:36.073147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aa49c-d363-4b8a-8bca-aee0e1601beb admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:36.073637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aa49c-d363-4b8a-8bca-aee0e1601beb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:36.077390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aa49c-d363-4b8a-8bca-aee0e1601beb admin admin] PATH_INFO: `/v3/projects/dede3d57326849598186712b87618ef9/users/e5240c742a4e47de92fef93de1ea9ed1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:36.102333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aa49c-d363-4b8a-8bca-aee0e1601beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dede3d57326849598186712b87618ef9, user_id=e5240c742a4e47de92fef93de1ea9ed1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:36.106955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aa49c-d363-4b8a-8bca-aee0e1601beb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:36.217494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2894/5805] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:36 2022] PUT /identity/v3/projects/dede3d57326849598186712b87618ef9/users/e5240c742a4e47de92fef93de1ea9ed1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:36.310553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:36.315676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:36.319126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:36.319532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:36.319945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:36.350308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142eb9c-1798-4d25-9591-fbc6dbf5c3ff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:36.403478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] MFA Rules not processed for user `e5240c742a4e47de92fef93de1ea9ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:36.406109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:36.422594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:36.564927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:36.566000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:36.566427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:36.567534 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2895/5806] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:36.571568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] PATH_INFO: `/v3/projects/a110750f82a34f8e8b299a43254b25dc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:36.754214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:36.755040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a110750f82a34f8e8b299a43254b25dc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:36.755040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:36.755662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c14dfb-9dd2-4927-b44f-d7202ef828b0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:36.755662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:36.755662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:36.755662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:36.756136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:36.756136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:36.756136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:36.964141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2896/5807] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:36 2022] POST /identity/v3/projects => generated 367 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:36.965740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:36.974916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a110750f82a34f8e8b299a43254b25dc', 'request_id': 'req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:36.989145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a110750f82a34f8e8b299a43254b25dc', 'request_id': 'req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:37.007379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a110750f82a34f8e8b299a43254b25dc', 'request_id': 'req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:37.128009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1fc9-0c13-470f-bfc7-8e74116f6b9e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.134679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.136198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.136544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.136759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.137469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.140180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.184504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] The token cache is being invalidate because project a110750f82a34f8e8b299a43254b25dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:37.184729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:37.191791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-69de92bd-4ff3-43fa-befa-47d5ea6eeee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:37.194705 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2912/5808] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:36 2022] DELETE /identity/v3/projects/a110750f82a34f8e8b299a43254b25dc => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:37.200301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51e310-fd65-4cfd-b3e0-bacc5dae7046 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.200705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51e310-fd65-4cfd-b3e0-bacc5dae7046 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.201056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51e310-fd65-4cfd-b3e0-bacc5dae7046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.233167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8b51e310-fd65-4cfd-b3e0-bacc5dae7046 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:37.233167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b51e310-fd65-4cfd-b3e0-bacc5dae7046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:37.241986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2913/5809] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:37.250721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.250985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.251288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.268021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2897/5810] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:36 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:37.272056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.274932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:37.302097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9887-9c78-4be1-ba55-a4e95646a47e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.311600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:37.312944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:37.320377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.320377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.320377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.320377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.321047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.322088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2914/5811] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:37.322980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.326865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.339418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747a326-3841-4a0f-b59e-5548b7868e01 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.347038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2898/5812] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:37.359119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.362553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.363233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.363518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.363799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.365283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:37.365601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.367712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.376127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462caf-a668-4b28-9f88-bd74a63a8b10 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.382677 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2915/5813] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:37.389643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.389643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.389643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.389643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] PATH_INFO: `/v3/projects/176fafe3753b4340913e0d4516c9bc62/users/d6a8b4bab62d4b7899e3acebed6f6d20/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.392990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.405401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a2976-fbc6-4904-a3f8-59aec68978d7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.416550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=176fafe3753b4340913e0d4516c9bc62, user_id=d6a8b4bab62d4b7899e3acebed6f6d20, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.421591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.424164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.429603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.429603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.429603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.429603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.438789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.520418 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2899/5814] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:37 2022] PUT /identity/v3/projects/176fafe3753b4340913e0d4516c9bc62/users/d6a8b4bab62d4b7899e3acebed6f6d20/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:37.523975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.555445 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2916/5815] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:37 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:37.560658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.659858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5329ee-5fb5-4618-a55e-a46c4fbc8e0e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.672340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e616e00-0321-4f90-8715-15ee99fc0474 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.674259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.677264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.677567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.677856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.678668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.681886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.704595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.705291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.708405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.708405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.708405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.713539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2900/5816] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:37.717165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.719384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.739906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48099c0-f415-433a-b1d8-45e932d80914 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:37.763385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e654fd-0932-41e7-93a2-ad45b97f7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:37.764306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e654fd-0932-41e7-93a2-ad45b97f7aae admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.764809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e654fd-0932-41e7-93a2-ad45b97f7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.764925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e654fd-0932-41e7-93a2-ad45b97f7aae admin admin] PATH_INFO: `/v3/projects/176fafe3753b4340913e0d4516c9bc62/users/d6a8b4bab62d4b7899e3acebed6f6d20/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.767278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e654fd-0932-41e7-93a2-ad45b97f7aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=176fafe3753b4340913e0d4516c9bc62, user_id=d6a8b4bab62d4b7899e3acebed6f6d20, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:37.771590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e654fd-0932-41e7-93a2-ad45b97f7aae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:37.804258 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2901/5817] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:37 2022] PUT /identity/v3/projects/176fafe3753b4340913e0d4516c9bc62/users/d6a8b4bab62d4b7899e3acebed6f6d20/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:37.819041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:37.819387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:37.823852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:37.869815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:37.889014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] MFA Rules not processed for user `d6a8b4bab62d4b7899e3acebed6f6d20`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:37.890634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:37.904232 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2917/5818] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:37 2022] POST /identity/v3/users => generated 293 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:37.915675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:37.946811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6037829-10a9-4f2d-bcd5-16f3aec5a79b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.048193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2902/5819] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:38.052941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.068886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e09114-aa2c-4f4a-9eb0-800a94cd7ec8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.086033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.086856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.087507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.088254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.089474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.090609 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:38.090609 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:11:38.090609 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:11:38.092403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.095116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.101097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.101097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.101097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.101097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.101097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.129594 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2918/5820] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:38.130549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.143489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d84cce-5b4b-4602-b787-d22bb9ff784b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.149654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.149773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.150019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.150419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.151212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.155674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.173676 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2919/5821] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:38.175938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.188741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981509c-2c5f-4167-978e-94e4a4cb2b52 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.196590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859db9-135f-4993-ab6a-4d63d56619cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.196590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859db9-135f-4993-ab6a-4d63d56619cd admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.196590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859db9-135f-4993-ab6a-4d63d56619cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.196590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859db9-135f-4993-ab6a-4d63d56619cd admin admin] PATH_INFO: `/v3/projects/6ee212f581a04220990509996f16c959/users/71d717caf2ba4329bad2d0cc6abf59b5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.216028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53859db9-135f-4993-ab6a-4d63d56619cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee212f581a04220990509996f16c959, user_id=71d717caf2ba4329bad2d0cc6abf59b5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.222224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53859db9-135f-4993-ab6a-4d63d56619cd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.243366 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2903/5822] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:11:38 2022] POST /identity/v3/regions => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:38.248186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.288985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407ead-98fd-463d-9f11-0ae250c343c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.299233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.300462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.300996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.301723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.302597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.304498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.346447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2920/5823] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:38 2022] PUT /identity/v3/projects/6ee212f581a04220990509996f16c959/users/71d717caf2ba4329bad2d0cc6abf59b5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:38.359810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:38.361737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.362033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.362476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.455947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] MFA Rules not processed for user `71d717caf2ba4329bad2d0cc6abf59b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:38.464198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:38.507368 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2904/5824] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:11:38 2022] POST /identity/v3/regions => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:38.508376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.548970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae3bb-c3dc-4359-b762-052e85e2b7c9 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.604067 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2921/5825] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:38.607532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.739505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.740402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.743801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.745528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/047331ff-8175-48d8-a578-1f03f8d5c0c5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.745528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:create_region(region_id=047331ff-8175-48d8-a578-1f03f8d5c0c5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.749909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.783479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807201ba-baab-4c25-8d52-b6284abdc56a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:38.797233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:38.797873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:38.798184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:38.798423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:38.799100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:38.803415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:38.908072 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2905/5826] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Sep 6 11:11:38 2022] PUT /identity/v3/regions/047331ff-8175-48d8-a578-1f03f8d5c0c5 => generated 231 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:38.910421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.956079 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2922/5827] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:38 2022] POST /identity/v3/projects => generated 387 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:38.960178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:38.960432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84f254-182f-4f07-a4c3-036bf9fd409b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.076638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.077406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.077808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.078124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/047331ff-8175-48d8-a578-1f03f8d5c0c5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.078938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:delete_region(region_id=047331ff-8175-48d8-a578-1f03f8d5c0c5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.080940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.143169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42b301-d2d9-4741-935c-bc7549282430 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.186032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.187723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.188260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.189737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.203578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.203578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.221828 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2906/5828] 10.222.0.20 () {58 vars in 1242 bytes} [Tue Sep 6 11:11:38 2022] DELETE /identity/v3/regions/047331ff-8175-48d8-a578-1f03f8d5c0c5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:39.226034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.287680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671070a1-f963-4e8d-beac-2d214403d737 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.303209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.304098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.307388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.307388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.307388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.307388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.354253 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2923/5829] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:38 2022] POST /identity/v3/users => generated 300 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:39.357803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.382060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e11f-5a1d-4d32-9469-c2ddbc8ece17 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.388030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:39.402184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.403238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.403748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.404282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.405395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.407625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.422316 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2924/5830] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:39.426152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.462708 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2907/5831] 10.222.0.20 () {60 vars in 1150 bytes} [Tue Sep 6 11:11:39 2022] POST /identity/v3/regions => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:39.467501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.473156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e8dd6-613f-4bc6-81be-04516365cea5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.517600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.517600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.517600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.517600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] PATH_INFO: `/v3/projects/700677155bbf4c88b4b11b37573f5e6d/users/ec2ad13beb5444e4b3b6fd811947868d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.521934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee12c4-d875-48f1-bd53-ed432e9c0450 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.535934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.538729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.539084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.539889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.541449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:update_region(region_id=2f5b648bde1c4d7980ad3bdbcf0ba7a6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.542447 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:39.542447 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:11:39.542447 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:11:39.552532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.557956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700677155bbf4c88b4b11b37573f5e6d, user_id=ec2ad13beb5444e4b3b6fd811947868d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.562890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.575935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:39.670537 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2925/5832] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:39 2022] PUT /identity/v3/projects/700677155bbf4c88b4b11b37573f5e6d/users/ec2ad13beb5444e4b3b6fd811947868d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:39.674641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.706999 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2908/5833] 10.222.0.20 () {60 vars in 1250 bytes} [Tue Sep 6 11:11:39 2022] PATCH /identity/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6 => generated 253 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:39.712424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.764672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b31-4f8c-49d7-92aa-0c4ad76d88a5 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.851721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2723db6-1e25-4fd8-90a5-1eb70152fb17 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.897812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.898825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.899272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.899648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.900435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.901480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.902816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.903163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.903685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.904268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.904715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:get_region(region_id=2f5b648bde1c4d7980ad3bdbcf0ba7a6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.905838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.915210 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2909/5834] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:11:39 2022] GET /identity/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6 => generated 253 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:39.920543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.936392 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2926/5835] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:39.939832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:39.941527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9160a-5da1-4509-8b66-b78599cc1f07 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.948267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.948967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.949318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.949675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.950355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2f5b648bde1c4d7980ad3bdbcf0ba7a6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.952281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:39.968388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c763893-2793-47eb-8a42-60be763200c4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:39.976482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40399c0-4a80-40cf-8b80-2b835bd7c17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:39.977313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40399c0-4a80-40cf-8b80-2b835bd7c17a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:39.977682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40399c0-4a80-40cf-8b80-2b835bd7c17a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:39.978033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40399c0-4a80-40cf-8b80-2b835bd7c17a admin admin] PATH_INFO: `/v3/projects/700677155bbf4c88b4b11b37573f5e6d/users/ec2ad13beb5444e4b3b6fd811947868d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:39.981657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40399c0-4a80-40cf-8b80-2b835bd7c17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=700677155bbf4c88b4b11b37573f5e6d, user_id=ec2ad13beb5444e4b3b6fd811947868d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:39.985204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40399c0-4a80-40cf-8b80-2b835bd7c17a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.019311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2927/5836] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:39 2022] PUT /identity/v3/projects/700677155bbf4c88b4b11b37573f5e6d/users/ec2ad13beb5444e4b3b6fd811947868d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:40.037713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.038636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.039289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.088383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] MFA Rules not processed for user `ec2ad13beb5444e4b3b6fd811947868d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:40.097466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:40.097868 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2910/5837] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:11:39 2022] DELETE /identity/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:40.098926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.204380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86dbb0-e81c-41d3-9c3b-4dfe28d571f4 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.246839 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2928/5838] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:40.256193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.258192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:40.313567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.314258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.314549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.314826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.315523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.316619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.323496 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2911/5839] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 11:11:40 2022] GET /identity/v3/regions => generated 668 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:40.338285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.359096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3c31f-5128-4cb4-b129-4a0acf4735d0 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.371723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.372523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.372899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.373253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.373942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2f5b648bde1c4d7980ad3bdbcf0ba7a6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.375815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.407670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34309b-c9c3-4850-9291-1f6b785c5e85 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Could not find region: 2f5b648bde1c4d7980ad3bdbcf0ba7a6.: keystone.exception.RegionNotFound: Could not find region: 2f5b648bde1c4d7980ad3bdbcf0ba7a6. Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 2f5b648bde1c4d7980ad3bdbcf0ba7a6. Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:11:40.407883 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 2f5b648bde1c4d7980ad3bdbcf0ba7a6. Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:11:40.409141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2912/5840] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:11:40 2022] DELETE /identity/v3/regions/2f5b648bde1c4d7980ad3bdbcf0ba7a6 => generated 112 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:11:40.410993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.413329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.414585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.415112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.415610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.455268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bf2d2-ddae-4a8a-af59-e0d998d1303d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.463337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.466845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.484690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.485648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.486080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.486506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.492925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.497642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.508394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2929/5841] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:40.548704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2913/5842] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 11:11:40 2022] GET /identity/v3/regions => generated 668 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:11:40.549865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.581284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdaf9-d688-4daa-8fb5-8f6eb8bba973 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.604102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.606260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.606773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.608267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.609065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.616339 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:11:40.616339 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:11:40.616339 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:11:40.616339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.761291 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2930/5843] 10.222.0.20 () {60 vars in 1150 bytes} [Tue Sep 6 11:11:40 2022] POST /identity/v3/regions => generated 253 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:40.766587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.785547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:40.802082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7098a-9889-443d-8516-fd34960ec30d tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.869346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.872723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.873880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.875882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.877618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.879718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Adding query filter params (parent_region_id=d87456e2c65742f78d0109f5d3a74ffe) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:40.881190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.887544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.902587 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2914/5844] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:11:40 2022] GET /identity/v3/regions?parent_region_id=d87456e2c65742f78d0109f5d3a74ffe => generated 399 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:40.916427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:40.935431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b739a6c-b5ba-44c0-ba93-977d286e52fc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:40.941236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:40.942108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:40.942598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:40.943102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/7720dd681230461bae76e6f01725a00e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:40.944241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7720dd681230461bae76e6f01725a00e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:40.946359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:40.970542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:41.064137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abc96-cdab-4912-b3f4-ff3abed1fb1b tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:41.072360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:41.073571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:41.074240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:41.074829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] PATH_INFO: `/v3/users/71d717caf2ba4329bad2d0cc6abf59b5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:41.077410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d717caf2ba4329bad2d0cc6abf59b5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:41.081102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:41.248346 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2915/5845] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:11:40 2022] DELETE /identity/v3/regions/7720dd681230461bae76e6f01725a00e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:41.257040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:41.301965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78707f1-9a6d-493d-92fb-14d568fff9cc tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:41.313543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:41.313543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:41.313543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:41.313921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/7e6572291f844188a2c389a26b585708` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:41.313921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7e6572291f844188a2c389a26b585708)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:41.313921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:41.403983 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2916/5846] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:11:41 2022] DELETE /identity/v3/regions/7e6572291f844188a2c389a26b585708 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:41.408169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:41.439659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770177d-b41e-4fdf-8f48-2830beaeb9b7 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:41.452754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a8b4bab62d4b7899e3acebed6f6d20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '176fafe3753b4340913e0d4516c9bc62', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:41.453400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:41.453686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:41.453966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] PATH_INFO: `/v3/regions/d87456e2c65742f78d0109f5d3a74ffe` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:41.454562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d87456e2c65742f78d0109f5d3a74ffe)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:41.456948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:41.546752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d717caf2ba4329bad2d0cc6abf59b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:41.556557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d717caf2ba4329bad2d0cc6abf59b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:41.559174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d717caf2ba4329bad2d0cc6abf59b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:41.559174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d717caf2ba4329bad2d0cc6abf59b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:41.598608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-90861d15-938b-4810-9095-1ab56968eb6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d717caf2ba4329bad2d0cc6abf59b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:41.640594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2917/5847] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:11:41 2022] DELETE /identity/v3/regions/d87456e2c65742f78d0109f5d3a74ffe => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:41.641433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:41.643223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:41.686257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53631-367f-4a24-a986-6414f0cc5e62 tempest-RegionsTestJSON-1946696618 tempest-RegionsTestJSON-1946696618-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:41.697067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:41.705219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:41.705219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:41.705219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] PATH_INFO: `/v3/users/e5240c742a4e47de92fef93de1ea9ed1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:41.705219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5240c742a4e47de92fef93de1ea9ed1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:41.705219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:41.793838 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2931/5848] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:40 2022] DELETE /identity/v3/users/71d717caf2ba4329bad2d0cc6abf59b5 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:41.796720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:41.797159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:41.797537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:41.834219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:41.843571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:41.954397 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2932/5849] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:41.961137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:41.965596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:41.985992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5240c742a4e47de92fef93de1ea9ed1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:42.001619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5240c742a4e47de92fef93de1ea9ed1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:42.002580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5240c742a4e47de92fef93de1ea9ed1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:42.028272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5240c742a4e47de92fef93de1ea9ed1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:42.029883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d421b45d-1267-46d4-918b-fee1a39f666d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5240c742a4e47de92fef93de1ea9ed1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:42.105988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2423e6-5411-4e8c-95b8-c2b82c8fd87d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:42.111562 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2918/5850] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:41 2022] DELETE /identity/v3/users/e5240c742a4e47de92fef93de1ea9ed1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:42.112646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:42.113310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:42.113651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:42.114077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:42.116818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:42.118060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:42.118473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:42.119145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:42.149402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:42.152774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:42.192542 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2933/5851] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:42.196319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:42.197604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:42.244869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:42.363589 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2919/5852] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:42.373510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:42.375360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:42.389742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c8be1-908c-4773-a334-c117fb3b221d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:42.448094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:42.448819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:42.449177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:42.449528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:42.461085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:42.462886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:42.475412 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2934/5853] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:42.818607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:43.113801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:43.337599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:43.339038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:43.352812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba104b8-2ee5-407d-8050-f4e3ad14f4ab None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:43.360738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:43.360738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:43.360738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:43.360738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] PATH_INFO: `/v3/projects/6ee212f581a04220990509996f16c959` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:43.362252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee212f581a04220990509996f16c959)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:43.368996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:43.369505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:43.371933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:43.420543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910dd44-c312-4690-8ea5-e374de63d293 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:43.437230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:43.450614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:43.450614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:43.450614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] PATH_INFO: `/v3/projects/dede3d57326849598186712b87618ef9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:43.450614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dede3d57326849598186712b87618ef9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:43.452567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:43.712796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee212f581a04220990509996f16c959', 'request_id': 'req-e4c697ef-52da-42f2-ab32-e6629133e072'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.720727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee212f581a04220990509996f16c959', 'request_id': 'req-e4c697ef-52da-42f2-ab32-e6629133e072'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.727526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee212f581a04220990509996f16c959', 'request_id': 'req-e4c697ef-52da-42f2-ab32-e6629133e072'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.731342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dede3d57326849598186712b87618ef9', 'request_id': 'req-3f14f66b-2b13-4ea6-828e-a63fc09e056f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.749015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dede3d57326849598186712b87618ef9', 'request_id': 'req-3f14f66b-2b13-4ea6-828e-a63fc09e056f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.757479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dede3d57326849598186712b87618ef9', 'request_id': 'req-3f14f66b-2b13-4ea6-828e-a63fc09e056f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.870713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:43.876053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] The token cache is being invalidate because project 6ee212f581a04220990509996f16c959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:43.877847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.877847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.879343 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2920/5854] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:43 2022] DELETE /identity/v3/projects/6ee212f581a04220990509996f16c959 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:43.887491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:43.892015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:43.976468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] The token cache is being invalidate because project dede3d57326849598186712b87618ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:43.976824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.977539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:43.981501 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2935/5855] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:43 2022] DELETE /identity/v3/projects/dede3d57326849598186712b87618ef9 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:43.986227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:43.995560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:44.025182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c697ef-52da-42f2-ab32-e6629133e072 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:44.104923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:44.105717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:44.106079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:44.106440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] PATH_INFO: `/v3/users/ec2ad13beb5444e4b3b6fd811947868d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:44.108669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2ad13beb5444e4b3b6fd811947868d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:44.112233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:44.134865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14f66b-2b13-4ea6-828e-a63fc09e056f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:44.134865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:44.134865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:44.134865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:44.135570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] PATH_INFO: `/v3/users/d6a8b4bab62d4b7899e3acebed6f6d20` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:44.135570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a8b4bab62d4b7899e3acebed6f6d20)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:44.135570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:44.523532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2ad13beb5444e4b3b6fd811947868d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.543816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2ad13beb5444e4b3b6fd811947868d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.548012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2ad13beb5444e4b3b6fd811947868d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.555514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a8b4bab62d4b7899e3acebed6f6d20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.580587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2ad13beb5444e4b3b6fd811947868d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.581578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2ad13beb5444e4b3b6fd811947868d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.584538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a8b4bab62d4b7899e3acebed6f6d20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.587622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a8b4bab62d4b7899e3acebed6f6d20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.589297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a8b4bab62d4b7899e3acebed6f6d20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.623893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a8b4bab62d4b7899e3acebed6f6d20'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:44.730609 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2921/5856] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:43 2022] DELETE /identity/v3/users/ec2ad13beb5444e4b3b6fd811947868d => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:44.898655 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2936/5857] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:43 2022] DELETE /identity/v3/users/d6a8b4bab62d4b7899e3acebed6f6d20 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:45.074544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:45.828360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:45.831614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:45.878798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:46.016332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13515b-1a33-457d-82e0-45b55d583845 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:46.150225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:46.155770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:46.185702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:46.186474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.187247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.188768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] PATH_INFO: `/v3/projects/700677155bbf4c88b4b11b37573f5e6d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.203723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700677155bbf4c88b4b11b37573f5e6d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:46.206641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:46.314463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d3d60-08c6-4252-918a-ea51f72f63b3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:46.331666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:46.334127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.334127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.334127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] PATH_INFO: `/v3/projects/176fafe3753b4340913e0d4516c9bc62` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.335359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=176fafe3753b4340913e0d4516c9bc62)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:46.341477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:46.397525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700677155bbf4c88b4b11b37573f5e6d', 'request_id': 'req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.410894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700677155bbf4c88b4b11b37573f5e6d', 'request_id': 'req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.422991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700677155bbf4c88b4b11b37573f5e6d', 'request_id': 'req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.584256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176fafe3753b4340913e0d4516c9bc62', 'request_id': 'req-54526a90-3dee-46c0-8c50-b5aaab2ba60f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.594099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176fafe3753b4340913e0d4516c9bc62', 'request_id': 'req-54526a90-3dee-46c0-8c50-b5aaab2ba60f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.605393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176fafe3753b4340913e0d4516c9bc62', 'request_id': 'req-54526a90-3dee-46c0-8c50-b5aaab2ba60f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.642112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] The token cache is being invalidate because project 700677155bbf4c88b4b11b37573f5e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:46.642723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.643435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9457f7-12f1-48cd-9ce2-d2934dd4a9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.645226 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2922/5858] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:45 2022] DELETE /identity/v3/projects/700677155bbf4c88b4b11b37573f5e6d => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:46.650643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8c50a-da37-4b01-8fa3-2807f656e0e4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.650933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8c50a-da37-4b01-8fa3-2807f656e0e4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.651344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8c50a-da37-4b01-8fa3-2807f656e0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.737546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-00d8c50a-da37-4b01-8fa3-2807f656e0e4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:46.737546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00d8c50a-da37-4b01-8fa3-2807f656e0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:46.825929 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2923/5859] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:46.837374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.838030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.838030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.843933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] The token cache is being invalidate because project 176fafe3753b4340913e0d4516c9bc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:46.846673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.847046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54526a90-3dee-46c0-8c50-b5aaab2ba60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:46.858842 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2937/5860] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:46 2022] DELETE /identity/v3/projects/176fafe3753b4340913e0d4516c9bc62 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:46.860741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037786e-ce4c-4d7a-b76d-269c4a0a2fd1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.861144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037786e-ce4c-4d7a-b76d-269c4a0a2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.862240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037786e-ce4c-4d7a-b76d-269c4a0a2fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.887337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:46.889572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:46.927286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6037786e-ce4c-4d7a-b76d-269c4a0a2fd1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:46.927702 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2924/5861] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:46.927810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6037786e-ce4c-4d7a-b76d-269c4a0a2fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:46.930406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:46.937602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2938/5862] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:46.939222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.939517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.939797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.949235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e39b-c9ae-46c4-a735-d5c7465d77c0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:46.961582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:46.962879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:46.967292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:46.976381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2939/5863] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:46.981279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:46.981547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:46.985364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:46.988475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:46.989479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:46.989625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:46.993017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:46.995041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:46.998107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f857ae-514f-4730-95d2-ea0e019fb284 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.019617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.020266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.020700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.020992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.022786 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2925/5864] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:11:47.024911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:47.027121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.033253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:47.034203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.039719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.043657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef77a99-54b9-4501-88ed-602e4ab46ee0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.071953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.074156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.074918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.076155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.077145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.079996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.089014 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2940/5865] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:11:47.090854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.107692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7a7d0-fd27-41ed-8ebd-a9d7c0e2ecb7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.114410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.115163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.115450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.115779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.117655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.120349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.236142 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2926/5866] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:47 2022] POST /identity/v3/projects => generated 391 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:11:47.240721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.254156 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2941/5867] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:47 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:47.261980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.408055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b454b87-aa70-4834-9cc6-c35733305d5b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.421831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4455-45d0-4311-97be-6598db4e61b7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.425796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.427351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.427643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.427919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.428581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.430551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.440969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.441981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.442276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.442728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.443402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.448708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.564844 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2927/5868] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:47 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:47.587991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.595592 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2942/5869] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:47 2022] POST /identity/v3/users => generated 285 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:47.632606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.634514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d0ecc-7bea-4485-a889-9601d7f4093a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.648434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee79c9c-e967-4a97-87a4-921644546bd3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.661861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.662606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.663451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.663937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.664398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.665242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.665500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.666084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.666635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.668692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.676909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.677382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.720429 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2928/5870] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:47.720795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.725404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2943/5871] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:47.734745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.752724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3e67c-315f-4d06-8f73-45a6811977db admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.765997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48c8b-2300-4952-8107-b6185523b313 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.769851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.771768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.772175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.772302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.773263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.774207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.774657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.774786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.775613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.776883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.778021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.788425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.796647 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2944/5872] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:47.797992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.810070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98a02-ecce-4ed0-9d8a-75850940ec07 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.815598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca970fc-6888-4e06-ae5e-b790499b1c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.816354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca970fc-6888-4e06-ae5e-b790499b1c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.817003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca970fc-6888-4e06-ae5e-b790499b1c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.817386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca970fc-6888-4e06-ae5e-b790499b1c81 admin admin] PATH_INFO: `/v3/projects/1ce0fbcd65bc4a2e8e7d51c9118c8790/users/0cd4796526324e0ab91d10e1c0b2cc9d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.823839 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2929/5873] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:47.824822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:47.838292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca970fc-6888-4e06-ae5e-b790499b1c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce0fbcd65bc4a2e8e7d51c9118c8790, user_id=0cd4796526324e0ab91d10e1c0b2cc9d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.841797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca970fc-6888-4e06-ae5e-b790499b1c81 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:47.842513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd347b95-1954-425c-9027-c79e04d730a2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:47.851152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf650-f5b3-4a3d-9f0b-e173ff352d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:47.851923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf650-f5b3-4a3d-9f0b-e173ff352d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:47.852338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf650-f5b3-4a3d-9f0b-e173ff352d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:47.852784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf650-f5b3-4a3d-9f0b-e173ff352d3c admin admin] PATH_INFO: `/v3/projects/86b50364074c41c99e5595f716fa9fc3/users/d38abebf5f3d451f8428b2509dbb9b56/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:47.871514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf650-f5b3-4a3d-9f0b-e173ff352d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b50364074c41c99e5595f716fa9fc3, user_id=d38abebf5f3d451f8428b2509dbb9b56, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:47.874513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf650-f5b3-4a3d-9f0b-e173ff352d3c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:48.178684 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2945/5874] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:47 2022] PUT /identity/v3/projects/1ce0fbcd65bc4a2e8e7d51c9118c8790/users/0cd4796526324e0ab91d10e1c0b2cc9d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:48.190666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:48.190991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:48.191308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:48.205691 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2930/5875] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:47 2022] PUT /identity/v3/projects/86b50364074c41c99e5595f716fa9fc3/users/d38abebf5f3d451f8428b2509dbb9b56/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:48.225378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:48.225378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:48.225378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:48.300017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] MFA Rules not processed for user `0cd4796526324e0ab91d10e1c0b2cc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:48.304153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:48.332691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] MFA Rules not processed for user `d38abebf5f3d451f8428b2509dbb9b56`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:48.333960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:48.417708 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2946/5876] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:11:48.422082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:48.422082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:48.474596 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2931/5877] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:48.475482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:48.587097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca8c7-0a2e-4383-ae7f-3e9b56a9b6e0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:48.594442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:48.595539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:48.596007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:48.596495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] PATH_INFO: `/v3/users/2e7ae0c95ed24a808ce2a1d69ded6c3e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:48.597865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7ae0c95ed24a808ce2a1d69ded6c3e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:48.600642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:48.635165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9857f5-e56a-44d5-8605-1b22bec8ab37 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:48.644647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:48.648948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:48.648948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:48.648948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:48.648948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:48.649356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:48.858699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2932/5878] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:48 2022] POST /identity/v3/projects => generated 391 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:48.862041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:48.956994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3d70-66f7-44e4-8fa8-71d44a3e604e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:48.964683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:48.965516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:48.966488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:48.966778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:48.967580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:48.969674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.009301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7ae0c95ed24a808ce2a1d69ded6c3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.022312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7ae0c95ed24a808ce2a1d69ded6c3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.023102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7ae0c95ed24a808ce2a1d69ded6c3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.023725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7ae0c95ed24a808ce2a1d69ded6c3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.040592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7ae0c95ed24a808ce2a1d69ded6c3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.132808 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2947/5879] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:48 2022] DELETE /identity/v3/users/2e7ae0c95ed24a808ce2a1d69ded6c3e => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:49.136787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.137982 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2933/5880] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:48 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:49.138876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:49.141993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.145107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:49.248508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081adc60-e2b5-45ba-96e7-cef246efc3c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.248769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a62a6-366e-487c-bc4e-f33c3c7dcd7b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.250914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.251891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.252627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.252946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.253930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.258388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.261853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.263480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.263959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.264521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.265614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.269753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.430117 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2934/5881] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:49 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:49.431274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.441989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259e96e-bd39-46ce-b8e4-8f80fd5acd58 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.446771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.447422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.447725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.447984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.448648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.451196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.457779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:49.466617 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2935/5882] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:11:49.466853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2948/5883] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:49 2022] POST /identity/v3/users => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:49.467852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.468000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.479041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff363a9-ae1b-4c6e-8b8b-9a2fefda3ff4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.482489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06df5-114d-4653-85f0-3b3f78d6dde7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.484107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.484941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.485425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.485776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.486497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.488238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.495879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.504763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2936/5884] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:49.507445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.507445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.507445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.507445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.507445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.507919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.517655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7021039-05c2-458a-a890-aa2af8e2343d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.519043 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2949/5885] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:49.522873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.525802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.533363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.533363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.533363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] PATH_INFO: `/v3/projects/5d91a0fa6e644757a693132d4b247540/users/b7dfac1341494348a33bf1e90f055943/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.535183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d455f-e813-4c08-8904-32effe7c579e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.541858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.542634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.542994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.543415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] PATH_INFO: `/v3/projects/508316afcbd84da08a9987ce05812135/users/cead6f4b4fc4447180f39805b011821a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.546739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d91a0fa6e644757a693132d4b247540, user_id=b7dfac1341494348a33bf1e90f055943, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.549739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.567213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508316afcbd84da08a9987ce05812135, user_id=cead6f4b4fc4447180f39805b011821a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.570592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.666089 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2937/5886] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:49 2022] PUT /identity/v3/projects/5d91a0fa6e644757a693132d4b247540/users/b7dfac1341494348a33bf1e90f055943/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:49.667795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.669693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:49.700469 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2950/5887] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:49 2022] PUT /identity/v3/projects/508316afcbd84da08a9987ce05812135/users/cead6f4b4fc4447180f39805b011821a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:11:49.701202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.703988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:49.744605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741143-9e50-43cf-89e1-479e75750df1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.793312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741f86-0f3b-4ea4-b9c1-d5c833ec6d49 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:49.799530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee39d8-ec45-43c5-9801-35951955d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.800255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee39d8-ec45-43c5-9801-35951955d2ed admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.800738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee39d8-ec45-43c5-9801-35951955d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.800974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee39d8-ec45-43c5-9801-35951955d2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.801872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee39d8-ec45-43c5-9801-35951955d2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.803792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee39d8-ec45-43c5-9801-35951955d2ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.815824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2951/5888] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:49.824804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.824804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.824804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.826345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:49.826661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:49.827114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:49.827492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] PATH_INFO: `/v3/projects/7a214ee417be47eb9acfd28062a7d2a2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:49.829629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a214ee417be47eb9acfd28062a7d2a2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:49.833318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:49.864180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] MFA Rules not processed for user `cead6f4b4fc4447180f39805b011821a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:49.865420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:49.959249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a214ee417be47eb9acfd28062a7d2a2', 'request_id': 'req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.962749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2952/5889] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:49.964050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:49.967898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a214ee417be47eb9acfd28062a7d2a2', 'request_id': 'req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.974904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a214ee417be47eb9acfd28062a7d2a2', 'request_id': 'req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:49.985670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4795a-7ef1-4b04-9799-b8aee7f259b3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:50.063744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:50.064514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.064800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.065080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] PATH_INFO: `/v3/projects/5d91a0fa6e644757a693132d4b247540/users/b7dfac1341494348a33bf1e90f055943/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.067159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d91a0fa6e644757a693132d4b247540, user_id=b7dfac1341494348a33bf1e90f055943, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:50.069886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:50.082142 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2953/5890] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:11:49 2022] PUT /identity/v3/projects/5d91a0fa6e644757a693132d4b247540/users/b7dfac1341494348a33bf1e90f055943/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:50.083434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:50.085404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.100001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] The token cache is being invalidate because project 7a214ee417be47eb9acfd28062a7d2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:50.100397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.101234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce5e18e1-c1f9-48f1-95c5-1f59e2fac686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.106444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2938/5891] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:49 2022] DELETE /identity/v3/projects/7a214ee417be47eb9acfd28062a7d2a2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:50.108211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.120561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.120561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.157053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] MFA Rules not processed for user `b7dfac1341494348a33bf1e90f055943`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:50.158784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.214110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392dcf2-6d31-4c54-a9fd-6f360a59ddcb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:50.219630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:50.220315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.220687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.220968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.223315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.251593 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2939/5892] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:50.253552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:50.254573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.313370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:50.315245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:50.326659 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2954/5893] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:50.327468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:50.329868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.343491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235680-c63e-42fa-9fad-7f400e8f1bef None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:50.349441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:50.351054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.351524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.351906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] PATH_INFO: `/v3/users/094361c60a54434fb90e605c040800ac` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.353663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094361c60a54434fb90e605c040800ac)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:50.355562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:50.428246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ca5e9-e103-46d4-9f60-be8572b1ad17 service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:50.433090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:50.433704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.433983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.434281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.444916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:50.446389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:50.457687 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2955/5894] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:50.515371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:50.517223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.536257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029ac51-cf11-4c60-8529-6ea45c87fbc6 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:50.541201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:50.541811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.542096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.542399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.545003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.585063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094361c60a54434fb90e605c040800ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.594554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094361c60a54434fb90e605c040800ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.595423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094361c60a54434fb90e605c040800ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.612172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094361c60a54434fb90e605c040800ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.613257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094361c60a54434fb90e605c040800ac'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:50.621177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:50.623199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:50.633085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2956/5895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:50.751102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:50.756183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:50.758394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.766729 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2940/5896] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:50 2022] DELETE /identity/v3/users/094361c60a54434fb90e605c040800ac => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:50.783406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd667-a75a-476c-b92e-57bef513ad6e service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:50.850032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:50.850745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:50.851289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:50.851640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:50.854764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:50.928860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:50.930343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:50.944579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2957/5897] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:11:51.116858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:51.117348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:51.118355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:51.234586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67cb0-d460-4651-b82a-33f2e2a06907 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:51.239623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:51.240284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:51.240572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:51.240859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] PATH_INFO: `/v3/projects/5da257e162aa4109a0bc914b2b4e13ed` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:51.242055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da257e162aa4109a0bc914b2b4e13ed)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:51.244076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:51.401891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da257e162aa4109a0bc914b2b4e13ed', 'request_id': 'req-35020b44-7fe4-4eac-9a4c-51aab50a88e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:51.410262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da257e162aa4109a0bc914b2b4e13ed', 'request_id': 'req-35020b44-7fe4-4eac-9a4c-51aab50a88e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:51.433325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da257e162aa4109a0bc914b2b4e13ed', 'request_id': 'req-35020b44-7fe4-4eac-9a4c-51aab50a88e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:51.542509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] The token cache is being invalidate because project 5da257e162aa4109a0bc914b2b4e13ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:51.546926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:51.546926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-35020b44-7fe4-4eac-9a4c-51aab50a88e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:51.547743 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2941/5898] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:51 2022] DELETE /identity/v3/projects/5da257e162aa4109a0bc914b2b4e13ed => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:51.872494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:52.093891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:52.658770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:52.873850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:53.917379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:54.324614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:54.736522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:54.739608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:54.775464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725a99d-70db-431a-bb73-ed2f18c537c0 service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:54.895623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:54.896410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:54.896704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:54.896982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] PATH_INFO: `/v3/users/d38abebf5f3d451f8428b2509dbb9b56` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:54.900526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38abebf5f3d451f8428b2509dbb9b56)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:54.902533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:55.167341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38abebf5f3d451f8428b2509dbb9b56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:55.187084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38abebf5f3d451f8428b2509dbb9b56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:55.188254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38abebf5f3d451f8428b2509dbb9b56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:55.189870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38abebf5f3d451f8428b2509dbb9b56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:55.212148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38abebf5f3d451f8428b2509dbb9b56'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:55.402160 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2958/5899] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:54 2022] DELETE /identity/v3/users/d38abebf5f3d451f8428b2509dbb9b56 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:55.407653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:55.408123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:55.409441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:55.444333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:55.445720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:55.537199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2942/5900] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:55.547566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:55.549708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:55.647898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5738d2-57ac-46d8-8562-9937a7be598a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:55.660147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f7078-b7f4-4de6-98ca-7af695ca71fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:55.660814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f7078-b7f4-4de6-98ca-7af695ca71fe service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:55.662541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f7078-b7f4-4de6-98ca-7af695ca71fe service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:55.662541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f7078-b7f4-4de6-98ca-7af695ca71fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:55.675103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f7078-b7f4-4de6-98ca-7af695ca71fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:55.676779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f7078-b7f4-4de6-98ca-7af695ca71fe service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:55.690571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2959/5901] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:11:55.753733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:56.388558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:56.390767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:56.408815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37fa6-298c-49aa-ba26-d61c62caea32 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:56.419255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:56.420078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:56.420371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:56.420655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] PATH_INFO: `/v3/projects/86b50364074c41c99e5595f716fa9fc3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:56.421944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b50364074c41c99e5595f716fa9fc3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:56.425534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:56.611826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b50364074c41c99e5595f716fa9fc3', 'request_id': 'req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:56.621390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b50364074c41c99e5595f716fa9fc3', 'request_id': 'req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:56.628142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b50364074c41c99e5595f716fa9fc3', 'request_id': 'req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:56.695535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:56.723750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:56.724328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:56.724960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:56.753308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:56.754668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:56.765039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] The token cache is being invalidate because project 86b50364074c41c99e5595f716fa9fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:56.767181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:56.769059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:56.775472 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2943/5902] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:56 2022] DELETE /identity/v3/projects/86b50364074c41c99e5595f716fa9fc3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:56.777090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:56.779166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:56.849175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:56.861598 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2960/5903] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:11:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:56.876281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:56.884047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:56.895257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24ad5-83c3-43b4-849e-c83a0e7904b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:56.901937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:56.902606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:56.903290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:56.903572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] PATH_INFO: `/v3/users/cead6f4b4fc4447180f39805b011821a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:56.905296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cead6f4b4fc4447180f39805b011821a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:56.907866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:56.998445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62582-0f07-40ff-b31d-413302d882cc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:57.009433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:57.011164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:57.011457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:57.011760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:57.023172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:57.024852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:57.035794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2961/5904] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:11:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:11:57.242063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cead6f4b4fc4447180f39805b011821a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:57.268095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cead6f4b4fc4447180f39805b011821a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:57.271370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cead6f4b4fc4447180f39805b011821a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:57.335177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cead6f4b4fc4447180f39805b011821a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:57.343538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ce2a2061-05d8-4308-9ca4-2591dbf93c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cead6f4b4fc4447180f39805b011821a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:57.462520 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2944/5905] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:11:56 2022] DELETE /identity/v3/users/cead6f4b4fc4447180f39805b011821a => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:58.299998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:58.316211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84798a-7d99-472f-a371-ca9c572f84db service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:58.486835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:58.489040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:58.490286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:58.490708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] PATH_INFO: `/v3/projects/508316afcbd84da08a9987ce05812135` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:58.492855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508316afcbd84da08a9987ce05812135)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:58.498176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:58.564930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:58.745207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508316afcbd84da08a9987ce05812135', 'request_id': 'req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:58.767795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508316afcbd84da08a9987ce05812135', 'request_id': 'req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:58.783801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508316afcbd84da08a9987ce05812135', 'request_id': 'req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:58.878108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] The token cache is being invalidate because project 508316afcbd84da08a9987ce05812135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:11:58.878108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:58.878901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f0b42a-2721-45e3-a366-bb6cf6e00d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:11:58.886915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2962/5906] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:11:58 2022] DELETE /identity/v3/projects/508316afcbd84da08a9987ce05812135 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:11:58.889123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:58.889977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:58.890496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:58.921895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:58.923918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:59.046338 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2945/5907] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:59.059302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:59.059892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:59.060326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:59.103948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:11:59.106560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:11:59.113306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:11:59.121048 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2963/5908] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:11:59.125033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:59.147461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be1c62-ea3d-4cb8-879c-28c1f560edfe None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:59.156106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:59.157213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:59.157655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:59.158178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:59.159033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:11:59.159497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:59.161772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:59.208673 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2946/5909] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:11:59.210032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:59.250081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8b6ff-7e8a-4ae1-a79e-6a8b9abac831 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:59.260831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:59.261522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:59.261801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:59.262177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:59.262829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:59.279108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:59.488527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:59.490520 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2964/5910] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:11:59 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:59.504218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fd31c-a869-4de4-b201-8f8caf199134 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:59.670662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:59.671270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:59.671569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:59.672040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:59.672717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:59.675623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:59.785854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2947/5911] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:11:59 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:11:59.790005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:59.820332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f5b24-885b-41c1-b9d2-28f07273167a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:59.836750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:59.843054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:59.843858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:59.844198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:59.844910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:59.848110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:11:59.886487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2965/5912] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:11:59.895486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:11:59.939841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d055d-db6a-46df-9c15-1ec87b11b915 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:11:59.974587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287c5dc-d58e-4912-8aa2-71e327b89064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:11:59.977943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c5dc-d58e-4912-8aa2-71e327b89064 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:11:59.979769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c5dc-d58e-4912-8aa2-71e327b89064 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:11:59.980152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287c5dc-d58e-4912-8aa2-71e327b89064 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:11:59.984529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287c5dc-d58e-4912-8aa2-71e327b89064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:11:59.984529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287c5dc-d58e-4912-8aa2-71e327b89064 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:00.024859 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2948/5913] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:00.029463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:00.064645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec385e7-03fa-40da-9c11-67dbf80128f4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:00.094125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:00.095063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:00.099450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:00.099450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] PATH_INFO: `/v3/projects/64b17f9502114d8280d94a6cdcc7d23d/users/faa232a6c7cf43f39c080de773d71d44/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:00.120911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b17f9502114d8280d94a6cdcc7d23d, user_id=faa232a6c7cf43f39c080de773d71d44, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:00.125546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:00.222522 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2966/5914] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:00 2022] PUT /identity/v3/projects/64b17f9502114d8280d94a6cdcc7d23d/users/faa232a6c7cf43f39c080de773d71d44/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:00.225979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:00.227608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:00.227608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:00.268624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] MFA Rules not processed for user `faa232a6c7cf43f39c080de773d71d44`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:00.272789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:00.382604 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2949/5915] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:00.387051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:00.421002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:00.455828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:00.529095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f250-7b1e-4baf-bb28-115a14bacf44 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:00.542657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:00.545529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:00.546394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:00.547260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:00.548724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:00.553406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:00.737301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2967/5916] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:00 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:00.741367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:00.755758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07b68-7cdc-40b9-b00b-6bd16dc62ef8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:00.860311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:00.861528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:00.862064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:00.862571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:00.863541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:00.866625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.004212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2950/5917] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:00 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:01.005743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:01.020233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88769946-ea8c-4731-b839-c02acb1e9b64 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:01.029840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:01.030576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.030866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.031257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.031919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:01.033632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.052061 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2968/5918] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:01.053536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:01.068566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9fd74-3458-42cf-84fb-b9604c268a58 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:01.075706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:01.076622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.077770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.078008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.078702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:01.082806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.099227 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2951/5919] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:01.103610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:01.119853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b323c8-a97b-476e-8bf7-63f159b89dc4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:01.138291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1dde9-85aa-4955-93d5-4f5b5bdf08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:01.141634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dde9-85aa-4955-93d5-4f5b5bdf08a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.141634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dde9-85aa-4955-93d5-4f5b5bdf08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.141634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dde9-85aa-4955-93d5-4f5b5bdf08a2 admin admin] PATH_INFO: `/v3/projects/e2154f6ee1064a0389b1367aa550f6c5/users/48c324c9de2142769f87d9e7e8e877e4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.170980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1dde9-85aa-4955-93d5-4f5b5bdf08a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2154f6ee1064a0389b1367aa550f6c5, user_id=48c324c9de2142769f87d9e7e8e877e4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:01.173993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1dde9-85aa-4955-93d5-4f5b5bdf08a2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.200564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:01.203847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:01.221312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8dd9-7f22-40b5-84c5-40f66abbd862 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:01.228595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:01.229380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.243590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.243590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] PATH_INFO: `/v3/users/0cd4796526324e0ab91d10e1c0b2cc9d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.243590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd4796526324e0ab91d10e1c0b2cc9d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:01.243590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.294855 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2969/5920] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:01 2022] PUT /identity/v3/projects/e2154f6ee1064a0389b1367aa550f6c5/users/48c324c9de2142769f87d9e7e8e877e4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:01.303749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.303749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.303749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.340892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] MFA Rules not processed for user `48c324c9de2142769f87d9e7e8e877e4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:01.342305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:01.439605 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2970/5921] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:01.447765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:01.465343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:01.476704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd4796526324e0ab91d10e1c0b2cc9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:01.489533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd4796526324e0ab91d10e1c0b2cc9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:01.491048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd4796526324e0ab91d10e1c0b2cc9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:01.522208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd4796526324e0ab91d10e1c0b2cc9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:01.524475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5c7cc089-c87d-446d-bdd9-af26eaa663ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd4796526324e0ab91d10e1c0b2cc9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:01.570081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ec434-9174-4d53-9e00-315554f8f361 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:01.574689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:01.575650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.576487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.576987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.579490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:01.620809 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2952/5922] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:01 2022] DELETE /identity/v3/users/0cd4796526324e0ab91d10e1c0b2cc9d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:01.627452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:01.632321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.632321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.632321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.657592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:01.659414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:01.717421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:01.761220 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2953/5923] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:01.774657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:01.776580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:01.788175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:01.791814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.811710 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2971/5924] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:01.867942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:01.894959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e95a6-d377-4989-aa53-5bfc024c5af4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:01.899855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:01.900598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:01.900894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:01.901175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:01.939457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:01.943533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:01.992567 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2954/5925] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:02.931869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:02.934917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:02.956065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f54d6-bd96-4a4e-9d1e-1d8be492ded5 service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:03.143989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:03.145784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:03.146073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:03.147220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:03.150596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:03.315697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:03.317896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:03.353152 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2972/5926] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:03.609277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:03.611278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:03.656102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381b9b-b6fb-4c91-8158-7a9d30bd391b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:03.681512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:03.685820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:03.686448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:03.688601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] PATH_INFO: `/v3/projects/1ce0fbcd65bc4a2e8e7d51c9118c8790` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:03.690550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce0fbcd65bc4a2e8e7d51c9118c8790)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:03.695891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:03.930956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce0fbcd65bc4a2e8e7d51c9118c8790', 'request_id': 'req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:03.939180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce0fbcd65bc4a2e8e7d51c9118c8790', 'request_id': 'req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:03.948324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce0fbcd65bc4a2e8e7d51c9118c8790', 'request_id': 'req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.089444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] The token cache is being invalidate because project 1ce0fbcd65bc4a2e8e7d51c9118c8790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:04.089739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.091377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.095130 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2955/5927] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:03 2022] DELETE /identity/v3/projects/1ce0fbcd65bc4a2e8e7d51c9118c8790 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:04.097454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:04.115785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bb3c4-3e96-435b-b32e-72bf958249d6 service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:04.299292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:04.300146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:04.300426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:04.301886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] PATH_INFO: `/v3/users/b7dfac1341494348a33bf1e90f055943` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:04.302347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7dfac1341494348a33bf1e90f055943)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:04.304498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:04.494424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:04.587396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7dfac1341494348a33bf1e90f055943'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.599722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7dfac1341494348a33bf1e90f055943'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.600485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7dfac1341494348a33bf1e90f055943'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.602604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7dfac1341494348a33bf1e90f055943'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.621750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7dfac1341494348a33bf1e90f055943'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:04.734400 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2973/5928] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:04 2022] DELETE /identity/v3/users/b7dfac1341494348a33bf1e90f055943 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:04.860858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:04.862668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:04.915702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628e88-f9cb-4ee1-93b3-a8adbb30c2f7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:05.089580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:05.090766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:05.091276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:05.091741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] PATH_INFO: `/v3/users/faa232a6c7cf43f39c080de773d71d44` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:05.094137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa232a6c7cf43f39c080de773d71d44)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:05.097024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:05.488829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa232a6c7cf43f39c080de773d71d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.491575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:05.498456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa232a6c7cf43f39c080de773d71d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.499287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa232a6c7cf43f39c080de773d71d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.521152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:05.521152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:05.521756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa232a6c7cf43f39c080de773d71d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.530060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dd0582b3-fb9a-4750-9048-f1bedadea1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa232a6c7cf43f39c080de773d71d44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.545209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a328-b5a7-40a1-b29a-ebe75236cb06 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:05.553807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:05.555062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:05.555536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:05.555973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] PATH_INFO: `/v3/projects/5d91a0fa6e644757a693132d4b247540` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:05.557371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d91a0fa6e644757a693132d4b247540)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:05.559619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:05.639670 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2956/5929] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:04 2022] DELETE /identity/v3/users/faa232a6c7cf43f39c080de773d71d44 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:05.650463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:05.651213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:05.651687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:05.695450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:05.706919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:05.792334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d91a0fa6e644757a693132d4b247540', 'request_id': 'req-5a57fc83-0900-475b-90f9-1e0f8caefa6d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.815905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d91a0fa6e644757a693132d4b247540', 'request_id': 'req-5a57fc83-0900-475b-90f9-1e0f8caefa6d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.830432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d91a0fa6e644757a693132d4b247540', 'request_id': 'req-5a57fc83-0900-475b-90f9-1e0f8caefa6d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.873603 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2957/5930] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:05.884527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:05.889774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:05.975570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] The token cache is being invalidate because project 5d91a0fa6e644757a693132d4b247540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:05.976036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.977615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5a57fc83-0900-475b-90f9-1e0f8caefa6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:05.979457 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2974/5931] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:05 2022] DELETE /identity/v3/projects/5d91a0fa6e644757a693132d4b247540 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:05.985175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23707-877d-4e7a-894f-fb5c7e7abde1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:05.985484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23707-877d-4e7a-894f-fb5c7e7abde1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:05.985770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b23707-877d-4e7a-894f-fb5c7e7abde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.038494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ade2-1920-48d2-83e2-be0e7543f5ca None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:06.039954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-40b23707-877d-4e7a-894f-fb5c7e7abde1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:06.042678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-40b23707-877d-4e7a-894f-fb5c7e7abde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:06.188685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:06.189320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:06.190535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:06.190884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.196362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:06.234411 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2975/5932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:06.240325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:06.240614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:06.240871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.317555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:06.320631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:06.340584 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2976/5933] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:06.345988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:06.367622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf46eb-cff5-484f-89de-2572e248979b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:06.379449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:06.383089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:06.384828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:06.386811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.388233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:06.388840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:06.393969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:06.404873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:06.406733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:06.426543 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2977/5934] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:12:06.431067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:06.439280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2958/5935] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:12:06.449152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13056c8a-b8e8-4b82-b4d4-4d20d68a451e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:06.454690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:06.460789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:06.461852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:06.462314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:06.462956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.463818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:06.466763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:06.472600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:06.570554 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2978/5936] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:06 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:06.571969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:06.586221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e58e7-2ed5-48e2-959d-5266c89f7cf9 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:06.755832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:06.756886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:06.757242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:06.763113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.763113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:06.763113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:06.895568 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2959/5937] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:06 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:06.897525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:06.920679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c51ff-342d-40d0-955e-7ce9d9ca93d7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:06.941951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:06.942724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:06.943148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:06.943536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:06.944839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:06.951231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:07.000991 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2979/5938] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:07.005057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:07.033391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef767b-4f7a-4d32-a5b6-bb204557879b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:07.049103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:07.051388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:07.052329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:07.054597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:07.055549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:07.058747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:07.102603 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2960/5939] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:07.104079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:07.125486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51633-4900-44c9-b02d-0b04f988318a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:07.153394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661f56-2bdd-4dae-92bb-3c03818a6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:07.158213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661f56-2bdd-4dae-92bb-3c03818a6820 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:07.158691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661f56-2bdd-4dae-92bb-3c03818a6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:07.158993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661f56-2bdd-4dae-92bb-3c03818a6820 admin admin] PATH_INFO: `/v3/projects/be4a0bc6b4e143ec9a26de6324d54872/users/98e2f6bf7e414a57ae444a76ac5de059/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:07.212274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661f56-2bdd-4dae-92bb-3c03818a6820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4a0bc6b4e143ec9a26de6324d54872, user_id=98e2f6bf7e414a57ae444a76ac5de059, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:07.216220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661f56-2bdd-4dae-92bb-3c03818a6820 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:07.364302 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2980/5940] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:07 2022] PUT /identity/v3/projects/be4a0bc6b4e143ec9a26de6324d54872/users/98e2f6bf7e414a57ae444a76ac5de059/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:07.383402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:07.385667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:07.385955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:07.386240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:07.391276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:07.431533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b902-4f3c-4534-a259-bb2ce3124ac8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:07.494488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] MFA Rules not processed for user `98e2f6bf7e414a57ae444a76ac5de059`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:07.496582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:07.577500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:07.577500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:07.577500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:07.577500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] PATH_INFO: `/v3/projects/64b17f9502114d8280d94a6cdcc7d23d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:07.582685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b17f9502114d8280d94a6cdcc7d23d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:07.592177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:07.712360 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2981/5941] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:07.718452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:07.746561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14923b7a-e3dd-40dd-bc83-9de5ef193a3c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:07.757638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:07.758713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:07.759271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:07.759773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:07.760663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:07.763201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:07.807971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b17f9502114d8280d94a6cdcc7d23d', 'request_id': 'req-c96e0c82-14e2-4f3f-a647-014d5b141254'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:07.822507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b17f9502114d8280d94a6cdcc7d23d', 'request_id': 'req-c96e0c82-14e2-4f3f-a647-014d5b141254'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:07.825369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:07.837595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b17f9502114d8280d94a6cdcc7d23d', 'request_id': 'req-c96e0c82-14e2-4f3f-a647-014d5b141254'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:07.948659 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2982/5942] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:07 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:07.954429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:07.980750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] The token cache is being invalidate because project 64b17f9502114d8280d94a6cdcc7d23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:07.981351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:07.985270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:07.985270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2961/5943] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:07 2022] DELETE /identity/v3/projects/64b17f9502114d8280d94a6cdcc7d23d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:07.991966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:07.995667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:08.164088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e0c82-14e2-4f3f-a647-014d5b141254 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:08.171148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:08.172015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:08.172385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:08.172871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] PATH_INFO: `/v3/users/48c324c9de2142769f87d9e7e8e877e4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:08.174244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c324c9de2142769f87d9e7e8e877e4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:08.179250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:08.197008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59302cef-56a9-49bc-8485-9230bae98fd7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:08.204154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:08.204966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:08.205405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:08.205794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:08.206645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:08.208962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:08.351998 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2983/5944] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:07 2022] POST /identity/v3/users => generated 290 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:08.352905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:08.354864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:08.390020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec97c5-28ff-4529-94e2-25665007bb49 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:08.403283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:08.403928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:08.404214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:08.404577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:08.405559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:08.408401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:08.410065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:08.430387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2984/5945] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:08.431378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:08.452623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d3a77-5ef6-4334-a4d4-20e007026503 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:08.458891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:08.459628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:08.459918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:08.460205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] PATH_INFO: `/v3/projects/c00695bbaa06469c8ecaec390a053f08/users/5035f144137a42b590a0e7e4f06aa720/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:08.479352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00695bbaa06469c8ecaec390a053f08, user_id=5035f144137a42b590a0e7e4f06aa720, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:08.482668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:08.555430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c324c9de2142769f87d9e7e8e877e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:08.565771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c324c9de2142769f87d9e7e8e877e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:08.566728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c324c9de2142769f87d9e7e8e877e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:08.582918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c324c9de2142769f87d9e7e8e877e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:08.583752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c2624da6-0f13-4046-bbd5-6fa9e7fb09c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c324c9de2142769f87d9e7e8e877e4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:09.005281 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2962/5946] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:07 2022] DELETE /identity/v3/users/48c324c9de2142769f87d9e7e8e877e4 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:09.007048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:09.007331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:09.008999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:09.016236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2985/5947] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:08 2022] PUT /identity/v3/projects/c00695bbaa06469c8ecaec390a053f08/users/5035f144137a42b590a0e7e4f06aa720/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:09.028811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:09.035116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:09.079898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] MFA Rules not processed for user `3e45dfaf9fd949548bca37303a117bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:09.090875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:09.194691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86082399-94ce-46f2-9ed0-9c17279ee26b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:09.305376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:09.313625 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2963/5948] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:09.346011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0741421-81b4-4c75-9d2f-4847cd136c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:09.346819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741421-81b4-4c75-9d2f-4847cd136c7b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:09.347250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741421-81b4-4c75-9d2f-4847cd136c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:09.351552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741421-81b4-4c75-9d2f-4847cd136c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:09.352269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0741421-81b4-4c75-9d2f-4847cd136c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:09.354012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0741421-81b4-4c75-9d2f-4847cd136c7b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:09.377143 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2986/5949] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:09.380994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:09.403751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9ba73-8f4a-46f4-b2f6-68b7e5e33d25 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:09.410301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:09.411800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:09.412096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:09.412379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] PATH_INFO: `/v3/projects/c00695bbaa06469c8ecaec390a053f08/users/5035f144137a42b590a0e7e4f06aa720/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:09.415240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00695bbaa06469c8ecaec390a053f08, user_id=5035f144137a42b590a0e7e4f06aa720, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:09.419758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:09.444043 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2964/5950] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:09 2022] PUT /identity/v3/projects/c00695bbaa06469c8ecaec390a053f08/users/5035f144137a42b590a0e7e4f06aa720/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:09.446251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:09.446766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:09.447285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:09.522175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] MFA Rules not processed for user `5035f144137a42b590a0e7e4f06aa720`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:09.523288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:09.676101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:09.682277 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2987/5951] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:09.705225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:09.708346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:09.821038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729029-80e8-4b11-aabb-062fede5ed25 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:09.826488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:09.827711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:09.828241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:09.828729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:09.842608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:09.844523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:09.870014 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2965/5952] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:10.235099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:10.259260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ba9d3-5b62-4c13-8d12-3536cadc41aa None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:10.274355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:10.274987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:10.275295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:10.275573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:10.278032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:10.473864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:10.476078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079450e6-3a40-4abd-801e-ead9efcbb1e8 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:10.498195 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2988/5953] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:10.911845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:10.916476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:11.071830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0aa3-1bb0-47aa-a4e4-0d135690cafa service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:11.083175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:11.083987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:11.084274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:11.084558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] PATH_INFO: `/v3/projects/e2154f6ee1064a0389b1367aa550f6c5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:11.086185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2154f6ee1064a0389b1367aa550f6c5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:11.088186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:11.356382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2154f6ee1064a0389b1367aa550f6c5', 'request_id': 'req-3d260bda-f53a-4367-90f5-784357d94b6b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:11.413976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2154f6ee1064a0389b1367aa550f6c5', 'request_id': 'req-3d260bda-f53a-4367-90f5-784357d94b6b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:11.441415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2154f6ee1064a0389b1367aa550f6c5', 'request_id': 'req-3d260bda-f53a-4367-90f5-784357d94b6b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:11.605937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] The token cache is being invalidate because project e2154f6ee1064a0389b1367aa550f6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:11.608402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:11.610369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d260bda-f53a-4367-90f5-784357d94b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:11.613666 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2966/5954] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:10 2022] DELETE /identity/v3/projects/e2154f6ee1064a0389b1367aa550f6c5 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:11.620205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:11.620760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:11.620760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:11.656755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:11.661730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:11.810003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2989/5955] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:11.820461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:11.820847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:11.821112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:11.870866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:11.872219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:11.915109 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2967/5956] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:11.920411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:11.934873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dc116-cd65-4778-a9fe-cf5df64bd27c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:11.948133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:11.948994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:11.949459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:11.949883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:11.950682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:11.951179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:11.952945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:12.005531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2990/5957] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:12:12.008333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:12.029995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0091e51-ad1e-4c8e-95bd-d0dd02cb7572 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:12.058303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:12.059437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:12.059994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:12.060498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:12.061743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:12.064432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:12.152862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:12.332772 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2968/5958] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:12 2022] POST /identity/v3/projects => generated 381 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:12.335157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:12.347128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d727c44-19bc-4a5c-9d48-5cc4f8d586bd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:12.415809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:12.416769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:12.417128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:12.417469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:12.418234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:12.422043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:12.531665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:12.532985 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2991/5959] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:12 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:12.547355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2334b7-37a8-4460-84ea-3982575a4eea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:12.555169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:12.555805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:12.556139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:12.556425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:12.557243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:12.560673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:12.602721 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2969/5960] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:12.605599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:12.619738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984606f3-ce3e-48ea-897a-dbb2b30cc5db admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:12.627779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43804226-ac76-4b69-a699-a5495024399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:12.628493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804226-ac76-4b69-a699-a5495024399b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:12.628986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804226-ac76-4b69-a699-a5495024399b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:12.629429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804226-ac76-4b69-a699-a5495024399b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:12.630978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43804226-ac76-4b69-a699-a5495024399b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:12.632938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43804226-ac76-4b69-a699-a5495024399b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:12.674396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:12.679462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2992/5961] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:12:12.689543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19790b-e301-49a6-975c-5cf3a37db474 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:12.707272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:12.710029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:12.710029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:12.710029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] PATH_INFO: `/v3/projects/fea82a6e57b64ff38233fda7986c6ee9/users/c74bb9dc03b34ec1bf57df607337d1af/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:12.753872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea82a6e57b64ff38233fda7986c6ee9, user_id=c74bb9dc03b34ec1bf57df607337d1af, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:12.765732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:12.892719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2970/5962] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:12 2022] PUT /identity/v3/projects/fea82a6e57b64ff38233fda7986c6ee9/users/c74bb9dc03b34ec1bf57df607337d1af/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:12.906981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:12.907475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:12.907942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:12.931724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:12.969577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] MFA Rules not processed for user `c74bb9dc03b34ec1bf57df607337d1af`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:12.970826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:13.088188 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2993/5963] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:13.118762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:13.118762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:13.217885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ec469-6a4b-49c2-b2e9-a0685b7ff36c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:13.234787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18db2e-c75d-4f45-84d3-3915148c3c4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:13.234787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db2e-c75d-4f45-84d3-3915148c3c4e service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:13.234787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db2e-c75d-4f45-84d3-3915148c3c4e service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:13.234787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18db2e-c75d-4f45-84d3-3915148c3c4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:13.266203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db2e-c75d-4f45-84d3-3915148c3c4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:13.269730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18db2e-c75d-4f45-84d3-3915148c3c4e service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:13.285521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2971/5964] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:14.033878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:14.160495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161091e-8993-4fad-8d7c-d54e92fcd1d6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:14.166004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:14.170633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:14.170633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:14.170633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] PATH_INFO: `/v3/users/c74bb9dc03b34ec1bf57df607337d1af` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:14.170633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74bb9dc03b34ec1bf57df607337d1af)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:14.170633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:14.566518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74bb9dc03b34ec1bf57df607337d1af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:14.583927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74bb9dc03b34ec1bf57df607337d1af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:14.583927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74bb9dc03b34ec1bf57df607337d1af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:14.583927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74bb9dc03b34ec1bf57df607337d1af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:14.588849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74bb9dc03b34ec1bf57df607337d1af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:15.029494 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2994/5965] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:14 2022] DELETE /identity/v3/users/c74bb9dc03b34ec1bf57df607337d1af => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:15.034616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:15.034616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:15.035253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:15.069137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:15.070400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:15.199238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2972/5966] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:15.199426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:15.199426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:15.216357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:15.359391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ff65-5c1f-40f8-a46b-11a898d87904 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:15.366920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce05ff-73c4-46de-912b-3b34449ae343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:15.369896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce05ff-73c4-46de-912b-3b34449ae343 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:15.373287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce05ff-73c4-46de-912b-3b34449ae343 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:15.373937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce05ff-73c4-46de-912b-3b34449ae343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:15.404402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce05ff-73c4-46de-912b-3b34449ae343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:15.404402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce05ff-73c4-46de-912b-3b34449ae343 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:15.417928 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2995/5967] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:12:16.225677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:16.226798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:16.252210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7010da-47fc-4c9b-9df0-7ac98d6baa3c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:16.257704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:16.258356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:16.258646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:16.258988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] PATH_INFO: `/v3/projects/fea82a6e57b64ff38233fda7986c6ee9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:16.260258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea82a6e57b64ff38233fda7986c6ee9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:16.262232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:16.441105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea82a6e57b64ff38233fda7986c6ee9', 'request_id': 'req-ec9a3179-4321-4f9c-8f54-b17c3283d21d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:16.443794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:16.451692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea82a6e57b64ff38233fda7986c6ee9', 'request_id': 'req-ec9a3179-4321-4f9c-8f54-b17c3283d21d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:16.474302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea82a6e57b64ff38233fda7986c6ee9', 'request_id': 'req-ec9a3179-4321-4f9c-8f54-b17c3283d21d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:16.607189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] The token cache is being invalidate because project fea82a6e57b64ff38233fda7986c6ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:16.609346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:16.609346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec9a3179-4321-4f9c-8f54-b17c3283d21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:16.610028 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2973/5968] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:16 2022] DELETE /identity/v3/projects/fea82a6e57b64ff38233fda7986c6ee9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:16.615289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:16.616068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:16.616068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:16.641113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:16.641598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:16.733184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2996/5969] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:16.734917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:16.735340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:16.735703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:16.759980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:16.761965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:16.771252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2974/5970] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:16.776014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:16.789516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e32960-e782-483f-a3af-2489b9656ad9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:16.804672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:16.804672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:16.804672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:16.804672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:16.805133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:16.805133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:16.805133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:16.822260 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2997/5971] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:12:16.835291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:16.847882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750f8d0-bf89-46a1-9c56-aa90643b3e9c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:16.854315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:16.854993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:16.855532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:16.856016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:16.856641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:16.858598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:17.002820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:17.009138 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2975/5972] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:16 2022] POST /identity/v3/projects => generated 359 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:12:17.016632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbcd38-9533-40fd-8adb-2ddce3022896 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:17.111253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:17.111963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:17.112313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:17.112594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:17.113285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:17.115286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:17.320911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2998/5973] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:17 2022] POST /identity/v3/users => generated 280 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:17.325875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:17.337421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc18c1-5412-42cf-bd53-51b4a502a51b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:17.342960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:17.346745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:17.346745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:17.346745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:17.346745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:17.346745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:17.362335 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2976/5974] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:17.366738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:17.382058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5018d-5de9-4895-915a-d460ca0076dd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:17.389628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37e3e-8eaa-484b-b4a5-37839a9a27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:17.391156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37e3e-8eaa-484b-b4a5-37839a9a27da admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:17.391495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37e3e-8eaa-484b-b4a5-37839a9a27da admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:17.391784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37e3e-8eaa-484b-b4a5-37839a9a27da admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:17.392457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37e3e-8eaa-484b-b4a5-37839a9a27da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:17.397215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37e3e-8eaa-484b-b4a5-37839a9a27da admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:17.410404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 2999/5975] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:17.419361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:17.430663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f346cba-d833-4cc8-8e47-946fc3f007b5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:17.436981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:17.438470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:17.438470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:17.438920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] PATH_INFO: `/v3/projects/e78f6af133a5425e8f1815be52a61705/users/eaa048072b92422e87182898e18e93cd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:17.465032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78f6af133a5425e8f1815be52a61705, user_id=eaa048072b92422e87182898e18e93cd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:17.468091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:17.555869 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2977/5976] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:17 2022] PUT /identity/v3/projects/e78f6af133a5425e8f1815be52a61705/users/eaa048072b92422e87182898e18e93cd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:17.556052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a953a4-70db-4c73-8033-cd6a8ced648d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:17.556331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a953a4-70db-4c73-8033-cd6a8ced648d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:17.556614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a953a4-70db-4c73-8033-cd6a8ced648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:17.600358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d5a953a4-70db-4c73-8033-cd6a8ced648d None None] MFA Rules not processed for user `eaa048072b92422e87182898e18e93cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:17.602490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d5a953a4-70db-4c73-8033-cd6a8ced648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:17.620241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:17.706947 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3000/5977] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:17.727750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:17.806931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4c119-aafe-4d0f-b60a-090410df117d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:17.811925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:17.812559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:17.812837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:17.813110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] PATH_INFO: `/v3/users/eaa048072b92422e87182898e18e93cd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:17.814312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa048072b92422e87182898e18e93cd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:17.816459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:18.099817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa048072b92422e87182898e18e93cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:18.110628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa048072b92422e87182898e18e93cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:18.111512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa048072b92422e87182898e18e93cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:18.126793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa048072b92422e87182898e18e93cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:18.127574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa048072b92422e87182898e18e93cd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:18.213305 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2978/5978] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:17 2022] DELETE /identity/v3/users/eaa048072b92422e87182898e18e93cd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:18.218682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:18.219410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:18.219842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:18.245402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:18.246862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:18.374125 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3001/5979] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:18.432465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:18.467259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:18.468990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:18.611352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f605827-7cc3-4779-865c-9f4daa96bdc6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:18.635540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a289b-64c9-42a9-b37c-bf56d2f1fa58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:18.641895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a289b-64c9-42a9-b37c-bf56d2f1fa58 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:18.642186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a289b-64c9-42a9-b37c-bf56d2f1fa58 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:18.644955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a289b-64c9-42a9-b37c-bf56d2f1fa58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:18.674558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a289b-64c9-42a9-b37c-bf56d2f1fa58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:18.678720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a289b-64c9-42a9-b37c-bf56d2f1fa58 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:18.700648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2979/5980] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:19.604226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:19.605573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:19.629860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa5413-c827-49b6-b4fd-88574cfeb380 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:19.666825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:19.669106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:19.670089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:19.670590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] PATH_INFO: `/v3/projects/e78f6af133a5425e8f1815be52a61705` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:19.675203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78f6af133a5425e8f1815be52a61705)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:19.679387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:19.898039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78f6af133a5425e8f1815be52a61705', 'request_id': 'req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:19.913889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78f6af133a5425e8f1815be52a61705', 'request_id': 'req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:19.926790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78f6af133a5425e8f1815be52a61705', 'request_id': 'req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:19.939704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:19.940250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:19.940250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:19.962558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:19.964596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:20.074967 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2980/5981] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:20.113368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.116735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:20.128444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] The token cache is being invalidate because project e78f6af133a5425e8f1815be52a61705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:20.129124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:20.131321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-36df8ab3-eb31-4ba9-b20d-9ce229dd8332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:20.135537 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3002/5982] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:19 2022] DELETE /identity/v3/projects/e78f6af133a5425e8f1815be52a61705 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:20.141797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.142508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.143234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.196921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:20.198330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:20.239904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48409a-3a42-4a7a-a0e2-93f55026d1e6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.261128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.262167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.262678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.263208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.265096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:20.266616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:20.285349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.288557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfb9e-b586-43a9-8f71-3e8c219cc22d service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:20.308372 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2981/5983] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:12:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:20.317965 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3003/5984] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:20.326233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.326522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.326808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.349650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:20.350882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:20.359389 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2982/5985] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:20.363479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.373468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d43e57-d206-4d32-a7c8-f84e5eef88ef None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.378602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.382250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.382250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.382250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.382250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:20.382250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.382836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:20.397405 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3004/5986] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:12:20.402632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.412597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60c70a-8f8a-446d-9ac6-bf4ba22f22f0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.417874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.418526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.418810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.419134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.419786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.423213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:20.567907 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2983/5987] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:20 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:20.569131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.580392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268977-86d4-4e5a-8ae7-e6ba65503943 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.641156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.643776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.644071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.646875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.646875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.648113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:20.848378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3005/5988] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:20 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:20.850272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.858472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:20.862417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467c54c-b36a-47c2-9d1b-3e6edad2a090 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.867831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.868468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.868785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.869070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.869755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.873338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:20.898745 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2984/5989] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:20.900021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.912164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9cd25-debe-4f56-ad8a-00eeaaa8edce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.917785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2287e4-27b4-4ec3-a880-e40870e37821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.925426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2287e4-27b4-4ec3-a880-e40870e37821 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.925426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2287e4-27b4-4ec3-a880-e40870e37821 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.925426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2287e4-27b4-4ec3-a880-e40870e37821 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.925426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2287e4-27b4-4ec3-a880-e40870e37821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.925426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2287e4-27b4-4ec3-a880-e40870e37821 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:20.935890 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3006/5990] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:12:20.937606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:20.949467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aa8ad-02b3-474b-a5fd-24cc37643c58 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:20.957489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:20.958254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:20.958614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:20.959122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] PATH_INFO: `/v3/projects/32290ba3bd654af18bea9601bac3b5e8/users/e3c5af69641c4af382fa124e2e298865/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:20.984413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32290ba3bd654af18bea9601bac3b5e8, user_id=e3c5af69641c4af382fa124e2e298865, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:20.987207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:21.158733 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2985/5991] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:20 2022] PUT /identity/v3/projects/32290ba3bd654af18bea9601bac3b5e8/users/e3c5af69641c4af382fa124e2e298865/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:21.170739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.173911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.173911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.206756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] MFA Rules not processed for user `e3c5af69641c4af382fa124e2e298865`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:21.208145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:21.321205 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3007/5992] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:21.329202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:21.411616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82239260-567a-4f08-a655-031c2a6d040b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:21.416411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdcc9b-4402-497a-90e6-ca24143b87d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:21.417138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdcc9b-4402-497a-90e6-ca24143b87d7 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.417532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdcc9b-4402-497a-90e6-ca24143b87d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.417816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdcc9b-4402-497a-90e6-ca24143b87d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.418462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdcc9b-4402-497a-90e6-ca24143b87d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:21.420471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdcc9b-4402-497a-90e6-ca24143b87d7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:21.574381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2986/5993] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:21 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:21.578050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:21.601856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ffb2-126d-4545-9e40-501139a47149 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:21.653440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.653922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.654405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.677912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:21.679705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:21.704186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:21.705978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.706466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.706911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.708322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:21.711061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:21.752724 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2987/5994] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:21.782221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:21.784111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:21.830650 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3008/5995] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:21 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:21.836846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:21.848897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3f680-9419-44f7-8b60-0fb9572b603c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:21.853955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:21.855691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.856184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.856617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.857422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:21.860265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:21.876388 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3009/5996] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:12:21.879000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:21.893990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:21.896063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a385-9c44-4d1b-b9cc-1fbf62201e88 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:21.899161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682efbaa-b04a-4ac6-afc9-73722d853922 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:21.901419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123797d-c547-4528-9341-431e42222535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:21.902733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123797d-c547-4528-9341-431e42222535 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.903788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123797d-c547-4528-9341-431e42222535 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.904239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123797d-c547-4528-9341-431e42222535 admin admin] PATH_INFO: `/v3/projects/d2fcf75a325e46ecb13cc3d2f5cb5f94/users/532b3713490e4d71b9f0effe99b004bc/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.909188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:21.909716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:21.910004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:21.910281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:21.920564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:21.922528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:21.931713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123797d-c547-4528-9341-431e42222535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fcf75a325e46ecb13cc3d2f5cb5f94, user_id=532b3713490e4d71b9f0effe99b004bc, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:21.937359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123797d-c547-4528-9341-431e42222535 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:21.943851 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2988/5997] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:22.027538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:22.055701 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3010/5998] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:21 2022] PUT /identity/v3/projects/d2fcf75a325e46ecb13cc3d2f5cb5f94/users/532b3713490e4d71b9f0effe99b004bc/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:22.065351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:22.076441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203c917-7fbd-4395-bf25-934026b7277c service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:22.147161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fe2ad-cb58-4b0f-b3ce-0e9034fafa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:22.148105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fe2ad-cb58-4b0f-b3ce-0e9034fafa1a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:22.148463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fe2ad-cb58-4b0f-b3ce-0e9034fafa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:22.148808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fe2ad-cb58-4b0f-b3ce-0e9034fafa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:22.149826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fe2ad-cb58-4b0f-b3ce-0e9034fafa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:22.152005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fe2ad-cb58-4b0f-b3ce-0e9034fafa1a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:22.167865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2989/5999] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:22.169065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123797d-c547-4528-9341-431e42222535 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:22.182241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123797d-c547-4528-9341-431e42222535 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:22.188529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:22.189220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:22.189505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:22.189785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] PATH_INFO: `/v3/projects/d2fcf75a325e46ecb13cc3d2f5cb5f94/users/532b3713490e4d71b9f0effe99b004bc/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:22.191983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fcf75a325e46ecb13cc3d2f5cb5f94, user_id=532b3713490e4d71b9f0effe99b004bc, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:22.196508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:22.213382 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3011/6000] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:22 2022] PUT /identity/v3/projects/d2fcf75a325e46ecb13cc3d2f5cb5f94/users/532b3713490e4d71b9f0effe99b004bc/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:22.225977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:22.226278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:22.226560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:22.265656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] MFA Rules not processed for user `532b3713490e4d71b9f0effe99b004bc`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:22.267889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:22.371600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2990/6001] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:22.382098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:22.383899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:22.447890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfa069-daea-48b7-b197-45b1bbbe8326 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:22.451607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:22.452225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:22.452509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:22.452784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:22.514299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:22.515804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:22.525821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3012/6002] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:23.296740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:23.298286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:23.398446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869c45c-a37a-4232-ab52-b6028ddcf4a9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:23.405538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:23.406182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:23.406467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:23.407497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] PATH_INFO: `/v3/users/7c58a8e8fcff4ca2afc6c54b9bc4e6e6` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:23.407964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c58a8e8fcff4ca2afc6c54b9bc4e6e6)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:23.409915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:23.424867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:23.444120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:23.457887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43012b36-6ba1-4eba-925c-12ff344a86d0 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:23.464715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30242-2855-4097-9adf-1b51c5129d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:23.465785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30242-2855-4097-9adf-1b51c5129d98 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:23.466239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30242-2855-4097-9adf-1b51c5129d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:23.466523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30242-2855-4097-9adf-1b51c5129d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:23.480770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b30242-2855-4097-9adf-1b51c5129d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:23.482619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b30242-2855-4097-9adf-1b51c5129d98 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:23.501169 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3013/6003] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:23.632774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:23.633370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:23.633867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:23.677727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:23.677727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:23.677930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:23.741620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:23.764608 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3014/6004] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:12:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:23.770159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:23.771539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:23.771957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:23.815663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:23.816750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9b2da102-7c2a-44d0-af5e-78b9f28651b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c58a8e8fcff4ca2afc6c54b9bc4e6e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:23.898849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2bb5-f25b-48ef-96ee-09e7c2c13487 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:23.905716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:23.906351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:23.906632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:23.906912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:23.908857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:23.922060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:23.923801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:23.934305 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3015/6005] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:24.008270 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2991/6006] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:23 2022] DELETE /identity/v3/users/7c58a8e8fcff4ca2afc6c54b9bc4e6e6 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:24.382612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:24.384101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:24.400011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f18a4b-c0c9-4eda-9c54-59498606fcc4 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:24.482228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:24.483380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:24.483814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:24.484282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] PATH_INFO: `/v3/projects/0444d17c98fd486faf23794180465b3d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:24.485759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0444d17c98fd486faf23794180465b3d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:24.487920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:24.622735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0444d17c98fd486faf23794180465b3d', 'request_id': 'req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:24.626817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:24.634273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0444d17c98fd486faf23794180465b3d', 'request_id': 'req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:24.641306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0444d17c98fd486faf23794180465b3d', 'request_id': 'req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:24.773194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] The token cache is being invalidate because project 0444d17c98fd486faf23794180465b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:24.773194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:24.787382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d34bc527-5e7b-49a4-bdea-3802f1f83ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:24.789436 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3016/6007] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:24 2022] DELETE /identity/v3/projects/0444d17c98fd486faf23794180465b3d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:24.796922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:24.797487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:24.797487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:24.824652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:24.825815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:24.927590 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2992/6008] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:24.936299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:24.936595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:24.936880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:24.967704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:24.970708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:24.988547 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3017/6009] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:24.993658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:25.017507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e97fb-1b0b-4076-86cf-32f6a12c4f4e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:25.023230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:25.024091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.024369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.024837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.025520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:25.025822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:25.027512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:25.044347 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2993/6010] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:12:25.048866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:25.059661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9d1e4-0e21-440c-b221-cdcfacaa399e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:25.065680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:25.066466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.067078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.067561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.075585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:25.075585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:25.281347 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3018/6011] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:25 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:25.281678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:25.296534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc02d1-96e9-4b53-8aac-69a39e0cd44b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:25.378972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:25.379664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.379958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.380226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.381009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:25.383251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:25.512450 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2994/6012] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:25 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:25.516544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:25.528900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5665-16c5-4e2f-9a64-cb888173e4fb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:25.535583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:25.537957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.538705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.539511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.540572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:25.543907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:25.560583 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3019/6013] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:25.561786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:25.577925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801df4-1e4e-444b-823d-6f9741d8dbff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:25.585008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd76a8-61f5-473f-863f-2ebd70c2311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:25.587213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd76a8-61f5-473f-863f-2ebd70c2311f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.587213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd76a8-61f5-473f-863f-2ebd70c2311f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.587213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd76a8-61f5-473f-863f-2ebd70c2311f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.587911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd76a8-61f5-473f-863f-2ebd70c2311f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:25.591059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd76a8-61f5-473f-863f-2ebd70c2311f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:25.592813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:25.609463 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2995/6014] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:25.611826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:25.625223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec759-07b2-4b9d-9c5e-11e8e0576e25 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:25.632290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866886dd-bd60-48ae-bdba-c50d92fde70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:25.650856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866886dd-bd60-48ae-bdba-c50d92fde70a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.650856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866886dd-bd60-48ae-bdba-c50d92fde70a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.650856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866886dd-bd60-48ae-bdba-c50d92fde70a admin admin] PATH_INFO: `/v3/projects/472edbb3f752428c8a88aeef89c83b8b/users/037c64b66ce04347aee1f3e434952dfa/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.652071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866886dd-bd60-48ae-bdba-c50d92fde70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=472edbb3f752428c8a88aeef89c83b8b, user_id=037c64b66ce04347aee1f3e434952dfa, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:25.654944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866886dd-bd60-48ae-bdba-c50d92fde70a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:25.801228 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3020/6015] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:25 2022] PUT /identity/v3/projects/472edbb3f752428c8a88aeef89c83b8b/users/037c64b66ce04347aee1f3e434952dfa/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:25.811956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.812548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.816141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:25.849318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] MFA Rules not processed for user `037c64b66ce04347aee1f3e434952dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:25.850593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:25.979958 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2996/6016] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:25.992635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05236073-f145-4466-9e4d-b04448b37320 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:25.993690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05236073-f145-4466-9e4d-b04448b37320 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:25.994080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05236073-f145-4466-9e4d-b04448b37320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:26.018575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-05236073-f145-4466-9e4d-b04448b37320 None None] MFA Rules not processed for user `037c64b66ce04347aee1f3e434952dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:26.020219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-05236073-f145-4466-9e4d-b04448b37320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:26.029311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3021/6017] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:26.045806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:26.047359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:26.153824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7207905-d94b-4a61-89e2-954a24a0193d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:26.162329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa2f54-14d5-4884-a41d-35b8ed5fdf5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:26.172862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2f54-14d5-4884-a41d-35b8ed5fdf5a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:26.172862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2f54-14d5-4884-a41d-35b8ed5fdf5a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:26.172862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa2f54-14d5-4884-a41d-35b8ed5fdf5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:26.180820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa2f54-14d5-4884-a41d-35b8ed5fdf5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:26.183583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa2f54-14d5-4884-a41d-35b8ed5fdf5a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:26.197178 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2997/6018] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:26.960513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05236073-f145-4466-9e4d-b04448b37320 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:26.962761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-05236073-f145-4466-9e4d-b04448b37320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:27.084864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05236073-f145-4466-9e4d-b04448b37320 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:27.090326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:27.091163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:27.091510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:27.091858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] PATH_INFO: `/v3/users/98e2f6bf7e414a57ae444a76ac5de059` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:27.093260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e2f6bf7e414a57ae444a76ac5de059)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:27.095548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:27.543512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e2f6bf7e414a57ae444a76ac5de059'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:27.551088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e2f6bf7e414a57ae444a76ac5de059'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:27.551785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e2f6bf7e414a57ae444a76ac5de059'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:27.552464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e2f6bf7e414a57ae444a76ac5de059'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:27.564736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:27.572492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e2f6bf7e414a57ae444a76ac5de059'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:27.651941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3022/6019] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:26 2022] DELETE /identity/v3/users/98e2f6bf7e414a57ae444a76ac5de059 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:27.657422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:27.657938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:27.658066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:27.685773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:27.690616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:27.781102 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2998/6020] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:27.798151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:27.799881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:27.867954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ddb8c-e1e2-46f4-a61c-4a27f49ab60e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:27.871912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:27.872662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:27.873011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:27.873355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:27.887801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:27.890105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:27.902103 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3023/6021] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:28.650939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:28.658035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:28.671770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:28.681826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efb0c7-0f46-44a9-8e70-d25f30c8cd96 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:28.694377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:28.695299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:28.695676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:28.695964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] PATH_INFO: `/v3/projects/be4a0bc6b4e143ec9a26de6324d54872` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:28.698720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4a0bc6b4e143ec9a26de6324d54872)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:28.700979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:28.888099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4a0bc6b4e143ec9a26de6324d54872', 'request_id': 'req-31049d41-3c1e-45cf-b4e7-91953bbd905b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:28.896159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4a0bc6b4e143ec9a26de6324d54872', 'request_id': 'req-31049d41-3c1e-45cf-b4e7-91953bbd905b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:28.910900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4a0bc6b4e143ec9a26de6324d54872', 'request_id': 'req-31049d41-3c1e-45cf-b4e7-91953bbd905b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.011756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] The token cache is being invalidate because project be4a0bc6b4e143ec9a26de6324d54872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:29.012413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.013473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.016794 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 2999/6022] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:28 2022] DELETE /identity/v3/projects/be4a0bc6b4e143ec9a26de6324d54872 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:29.020561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:29.036209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8719fa-c54c-4f0d-9159-803f2b6ebc7b service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:29.106993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:29.108004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:29.108369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:29.108803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] PATH_INFO: `/v3/users/5035f144137a42b590a0e7e4f06aa720` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:29.110350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5035f144137a42b590a0e7e4f06aa720)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:29.112274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:29.457767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5035f144137a42b590a0e7e4f06aa720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.465686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5035f144137a42b590a0e7e4f06aa720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.466381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5035f144137a42b590a0e7e4f06aa720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.466994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5035f144137a42b590a0e7e4f06aa720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.478794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-556c4b14-ae1b-4d57-ae62-9c49dff019a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5035f144137a42b590a0e7e4f06aa720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:29.605911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3024/6023] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:29 2022] DELETE /identity/v3/users/5035f144137a42b590a0e7e4f06aa720 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:30.584318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:30.585800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:30.603917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31049d41-3c1e-45cf-b4e7-91953bbd905b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:30.684120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:30.687373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:30.687373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:30.687373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] PATH_INFO: `/v3/projects/c00695bbaa06469c8ecaec390a053f08` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:30.687373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00695bbaa06469c8ecaec390a053f08)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:30.689947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:30.839756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00695bbaa06469c8ecaec390a053f08', 'request_id': 'req-27ce4be7-a49e-40bf-8ee4-9cef8765132b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:30.851235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00695bbaa06469c8ecaec390a053f08', 'request_id': 'req-27ce4be7-a49e-40bf-8ee4-9cef8765132b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:30.858356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00695bbaa06469c8ecaec390a053f08', 'request_id': 'req-27ce4be7-a49e-40bf-8ee4-9cef8765132b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:30.993490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] The token cache is being invalidate because project c00695bbaa06469c8ecaec390a053f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:30.993789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:30.994467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-27ce4be7-a49e-40bf-8ee4-9cef8765132b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:30.996095 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3000/6024] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:30 2022] DELETE /identity/v3/projects/c00695bbaa06469c8ecaec390a053f08 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:31.000955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.001438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.001566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.025670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:31.027563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:31.032142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:31.100700 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3025/6025] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:31.108881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.109201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.109485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.133427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:31.134950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:31.144141 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3001/6026] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:31.148990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:31.160230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56d89-abc9-40b3-8bd6-bc9eccfe8151 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:31.165228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:31.165857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.166267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.166548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.167392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:31.167698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:31.169443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:31.181955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3026/6027] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:12:31.187419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:31.197120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14067b8-d952-49ef-b339-1a39257408ea None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:31.203411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:31.204131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.204469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.204658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.205245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:31.207180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:31.213273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:31.368928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3002/6028] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:31 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:31.373466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:31.392059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1868e-8469-4385-be5f-8ab633cfa5ea admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:31.475289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:31.475951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.476239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.476520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.479301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:31.479301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:31.600198 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3027/6029] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:31 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:31.606818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:31.618413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762a9b-e278-4ea0-ad14-4218613665a5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:31.625542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:31.626102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.626389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.626673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.627370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:31.629006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:31.641003 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3003/6030] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:31.645330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:31.662690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f6558-252e-4100-86ea-1ad7060a2c10 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:31.671806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649eb30-8f8d-42fc-9aee-d2b1f6c5769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:31.672865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649eb30-8f8d-42fc-9aee-d2b1f6c5769f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.678851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649eb30-8f8d-42fc-9aee-d2b1f6c5769f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.678851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649eb30-8f8d-42fc-9aee-d2b1f6c5769f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.678851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649eb30-8f8d-42fc-9aee-d2b1f6c5769f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:31.678851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649eb30-8f8d-42fc-9aee-d2b1f6c5769f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:31.689688 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3028/6031] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:31.695267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:31.707266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e0b83-eefa-43b9-8e88-6085b10e323a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:31.713596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:31.714224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.714615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.715040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] PATH_INFO: `/v3/projects/a0f98bbe95504e7287b09b7b7e3e5bfa/users/5ba0c59a66654f1481b4660c4d1bff11/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.733850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f98bbe95504e7287b09b7b7e3e5bfa, user_id=5ba0c59a66654f1481b4660c4d1bff11, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:31.737100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:31.903004 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3004/6032] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:31 2022] PUT /identity/v3/projects/a0f98bbe95504e7287b09b7b7e3e5bfa/users/5ba0c59a66654f1481b4660c4d1bff11/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:31.913769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:31.914118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:31.914449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:31.950719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] MFA Rules not processed for user `5ba0c59a66654f1481b4660c4d1bff11`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:31.953836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:32.038726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3029/6033] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:32.039934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:32.120014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da743b5d-8df5-41a8-bd14-c6c7c69aab78 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:32.129065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:32.134924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.134924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.134924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.134924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:32.134924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:32.266093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3005/6034] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:32 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:12:32.267693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:32.281967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e36f7-6f37-42e3-b529-46faf6a41bcb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:32.343630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:32.357267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:32.357895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.358185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.358458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.359132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:32.361285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:32.488539 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3030/6035] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:32 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:12:32.498986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:32.511733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22024e-3b55-49b0-a772-a625da8419e1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:32.516937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:32.519323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.519809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.521536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.522268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:32.524055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:32.542699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3006/6036] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:32.547282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:32.559082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a5966-b8be-4e5a-ad9d-ac4947daf961 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:32.564192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:32.564875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.565162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.565442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] PATH_INFO: `/v3/projects/79b52cfcd46f4fa082e3345f9fbcdc16/users/395f1953379c4e85a72c7c3082e09dfd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.583128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b52cfcd46f4fa082e3345f9fbcdc16, user_id=395f1953379c4e85a72c7c3082e09dfd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:32.585813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:32.743925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3031/6037] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:32 2022] PUT /identity/v3/projects/79b52cfcd46f4fa082e3345f9fbcdc16/users/395f1953379c4e85a72c7c3082e09dfd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:32.748660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:32.767845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a9fe1-a299-4deb-8443-eda680b7a83e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:32.838505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf832681-5ca6-4e7d-af56-8c17afe04151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:32.839162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf832681-5ca6-4e7d-af56-8c17afe04151 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.839446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf832681-5ca6-4e7d-af56-8c17afe04151 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.839717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf832681-5ca6-4e7d-af56-8c17afe04151 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.840369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf832681-5ca6-4e7d-af56-8c17afe04151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:32.844302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf832681-5ca6-4e7d-af56-8c17afe04151 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:32.856280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3007/6038] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:32.860235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:32.872750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbffb7-f21f-43ba-b86f-a7ed91671834 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:32.879114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:32.879663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.880047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.880426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] PATH_INFO: `/v3/projects/79b52cfcd46f4fa082e3345f9fbcdc16/users/395f1953379c4e85a72c7c3082e09dfd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.884348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b52cfcd46f4fa082e3345f9fbcdc16, user_id=395f1953379c4e85a72c7c3082e09dfd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:32.887946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:32.901744 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3032/6039] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:32 2022] PUT /identity/v3/projects/79b52cfcd46f4fa082e3345f9fbcdc16/users/395f1953379c4e85a72c7c3082e09dfd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:32.918618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:32.918618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:32.918618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:32.949427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] MFA Rules not processed for user `395f1953379c4e85a72c7c3082e09dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:32.950974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:32.964761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:33.031588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3008/6040] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:33.043345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:33.046934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:33.136160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072dce-02fe-488a-a359-a578fcaf2a34 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:33.141394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639a5c2-916f-49bc-a4b9-3b006449cd17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:33.142551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639a5c2-916f-49bc-a4b9-3b006449cd17 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:33.143062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639a5c2-916f-49bc-a4b9-3b006449cd17 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:33.143572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639a5c2-916f-49bc-a4b9-3b006449cd17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:33.217939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639a5c2-916f-49bc-a4b9-3b006449cd17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:33.219600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639a5c2-916f-49bc-a4b9-3b006449cd17 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:33.235224 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3033/6041] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:35.591802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:35.594060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:35.604762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:35.604762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:35.604762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:35.633068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:35.634418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:35.640537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:35.695372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a257f1-81c0-4b6e-b8b3-36776b22c620 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:35.699961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:35.700590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:35.701584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:35.701584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:35.703091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:35.712842 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3034/6042] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:35.714455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:35.716067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:35.780414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:35.782124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:35.795867 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3009/6043] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:35.796609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598c5d2-8fc3-41a5-a5f6-360ccb88352f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:35.796745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:35.798063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:35.808244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:35.808954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:35.809235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:35.809712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] PATH_INFO: `/v3/users/e3c5af69641c4af382fa124e2e298865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:35.812571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c5af69641c4af382fa124e2e298865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:35.815349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:35.863270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:35.882849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156134a8-ecd4-4c34-a090-11c07058644f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:35.888130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e7e99-b8c9-47ad-b514-91c8191bb7f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:35.888767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e7e99-b8c9-47ad-b514-91c8191bb7f9 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:35.889050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e7e99-b8c9-47ad-b514-91c8191bb7f9 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:35.889325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e7e99-b8c9-47ad-b514-91c8191bb7f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:35.898453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e7e99-b8c9-47ad-b514-91c8191bb7f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:35.900096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e7e99-b8c9-47ad-b514-91c8191bb7f9 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:35.910005 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3010/6044] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:12:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:36.191245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c5af69641c4af382fa124e2e298865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:36.198918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c5af69641c4af382fa124e2e298865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:36.199664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c5af69641c4af382fa124e2e298865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:36.200278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c5af69641c4af382fa124e2e298865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:36.212458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c5af69641c4af382fa124e2e298865'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:36.326796 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3035/6045] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:35 2022] DELETE /identity/v3/users/e3c5af69641c4af382fa124e2e298865 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:36.331639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4925-4c09-413c-8b58-4b96afba7b3d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:36.331937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4925-4c09-413c-8b58-4b96afba7b3d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:36.332214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4925-4c09-413c-8b58-4b96afba7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:36.354825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ce7d4925-4c09-413c-8b58-4b96afba7b3d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:36.356154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ce7d4925-4c09-413c-8b58-4b96afba7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:36.425461 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3011/6046] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:36.438429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:36.440801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:36.512185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444f849-25f7-445e-8b8b-669988821557 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:36.516280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:36.516897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:36.517298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:36.517645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:36.527946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:36.529597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:36.539987 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3036/6047] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:36.616306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:36.616771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:36.616920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:36.650754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:36.653997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:36.743344 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3012/6048] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:12:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:36.760948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:36.763822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:36.883657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:36.887715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56416-d0ed-4d37-ae23-d4e657737679 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:36.890247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:36.898097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:36.899676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:36.900356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:36.901179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:36.931455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0103-434a-4c79-af6e-8c766933841d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:36.936434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:36.942639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:36.950097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:36.951965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:36.952736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:36.953481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] PATH_INFO: `/v3/projects/32290ba3bd654af18bea9601bac3b5e8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:36.955914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32290ba3bd654af18bea9601bac3b5e8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:36.961086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:36.966108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3037/6049] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:12:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:12:37.174289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32290ba3bd654af18bea9601bac3b5e8', 'request_id': 'req-9f5da832-4f31-435f-9dae-250741149328'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.183671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32290ba3bd654af18bea9601bac3b5e8', 'request_id': 'req-9f5da832-4f31-435f-9dae-250741149328'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.191184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32290ba3bd654af18bea9601bac3b5e8', 'request_id': 'req-9f5da832-4f31-435f-9dae-250741149328'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.372911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] The token cache is being invalidate because project 32290ba3bd654af18bea9601bac3b5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:37.373432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.374198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f5da832-4f31-435f-9dae-250741149328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.376043 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3013/6050] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:36 2022] DELETE /identity/v3/projects/32290ba3bd654af18bea9601bac3b5e8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:37.380290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:37.392946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b777e8-4568-4ddb-a0e4-2b720d61a486 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:37.494203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:37.495269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:37.495507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:37.495772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] PATH_INFO: `/v3/users/532b3713490e4d71b9f0effe99b004bc` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:37.497502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532b3713490e4d71b9f0effe99b004bc)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:37.499308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:37.731916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:37.732452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:37.732543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:37.753574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:37.754815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:37.766153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:37.816664 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3014/6051] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:37.830012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:37.831630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:37.863906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532b3713490e4d71b9f0effe99b004bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.872381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532b3713490e4d71b9f0effe99b004bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.873355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532b3713490e4d71b9f0effe99b004bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.874342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532b3713490e4d71b9f0effe99b004bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.889642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532b3713490e4d71b9f0effe99b004bc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:37.950918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac2a8-a0ac-4f79-9cfe-4141ce7d91e8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:37.960096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:37.960982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:37.962264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:37.962691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:37.965375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:37.978502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:37.980455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:37.993675 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3015/6052] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:12:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:12:38.048773 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3038/6053] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:37 2022] DELETE /identity/v3/users/532b3713490e4d71b9f0effe99b004bc => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:38.071483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:38.537488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:38.540116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:38.567225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77afc-2847-400c-957a-bcca416324ed service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:38.695563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:38.696676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:38.697176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:38.699108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] PATH_INFO: `/v3/projects/d2fcf75a325e46ecb13cc3d2f5cb5f94` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:38.700866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fcf75a325e46ecb13cc3d2f5cb5f94)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:38.702935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:38.748602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:38.748602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:38.762843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fb8a3-d78e-4992-9e7f-96bfb0b09365 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:38.770114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:38.770712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:38.771218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:38.771750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] PATH_INFO: `/v3/users/973422e272f6404f81fcf4702fcfb5c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:38.773145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973422e272f6404f81fcf4702fcfb5c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:38.778199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:38.848553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fcf75a325e46ecb13cc3d2f5cb5f94', 'request_id': 'req-ef51c266-dd9f-4394-9361-ea1eddc6870e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:38.856903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fcf75a325e46ecb13cc3d2f5cb5f94', 'request_id': 'req-ef51c266-dd9f-4394-9361-ea1eddc6870e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:38.869623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fcf75a325e46ecb13cc3d2f5cb5f94', 'request_id': 'req-ef51c266-dd9f-4394-9361-ea1eddc6870e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:38.958931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] The token cache is being invalidate because project d2fcf75a325e46ecb13cc3d2f5cb5f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:38.960347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:38.961252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ef51c266-dd9f-4394-9361-ea1eddc6870e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:38.964449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3016/6054] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:38 2022] DELETE /identity/v3/projects/d2fcf75a325e46ecb13cc3d2f5cb5f94 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:38.969530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe258-5f88-4eba-b003-0eb89cdb8264 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:38.969829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe258-5f88-4eba-b003-0eb89cdb8264 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:38.970156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe258-5f88-4eba-b003-0eb89cdb8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:38.999612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9ebfe258-5f88-4eba-b003-0eb89cdb8264 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:39.001061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ebfe258-5f88-4eba-b003-0eb89cdb8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:39.076138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973422e272f6404f81fcf4702fcfb5c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:39.084151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3017/6055] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:39.091848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973422e272f6404f81fcf4702fcfb5c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:39.091848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973422e272f6404f81fcf4702fcfb5c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:39.091848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973422e272f6404f81fcf4702fcfb5c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:39.094449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.094940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.095437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.109289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e81590db-b827-48c9-b3c0-1d56b8489ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973422e272f6404f81fcf4702fcfb5c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:39.123668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:39.124956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:39.133752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3018/6056] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:39.144982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.154527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fdf74-e136-4d07-b9ee-8efe8d5fe7fd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.160327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.161148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.161633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.162292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.163163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:39.164354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.166392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:39.181187 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3019/6057] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:12:39.186067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.202850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bccd6a-89b7-4026-993b-f40990043337 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.214366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.214366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.214366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.214366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.214767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.221861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:39.258681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3039/6058] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:38 2022] DELETE /identity/v3/users/973422e272f6404f81fcf4702fcfb5c5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:39.265141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.265929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.266724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.302322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:39.304288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:39.379200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3040/6059] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:39.391242 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3020/6060] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:39 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:39.392044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.393611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:39.403548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.482698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548678c-5b74-4e41-b813-9782d20795f0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.538534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e8894-e2f8-494c-8657-92be226161be admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.555091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.555910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.556196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.556476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.559704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.560337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.560630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.561049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.561702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.563767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:39.566953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.568571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:39.585123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3041/6061] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:39.742735 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3021/6062] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:39 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:39.745891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.764154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757704fe-dc33-4ac8-aba5-8ff47fc47ff1 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.774573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.776958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.778042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.778676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.779927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.782248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:39.799208 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3042/6063] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:39.799905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.816069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd8b8-677e-4c9c-9955-e93c7562459a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.825863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.826605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.827196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.827698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.828602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.830991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:39.860425 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3022/6064] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:12:39.866488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:39.897465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218419b-7816-4b36-b75b-6edad7cdb0cc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:39.906661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778734f9-0664-4c61-a7b0-b494521f7cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:39.907588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778734f9-0664-4c61-a7b0-b494521f7cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:39.908074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778734f9-0664-4c61-a7b0-b494521f7cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:39.908515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778734f9-0664-4c61-a7b0-b494521f7cb7 admin admin] PATH_INFO: `/v3/projects/8f6d30aea7c94d03ab53b17781ed7dfe/users/3ad79169ca4543e79399cd2b7f1ae985/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:39.932585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778734f9-0664-4c61-a7b0-b494521f7cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6d30aea7c94d03ab53b17781ed7dfe, user_id=3ad79169ca4543e79399cd2b7f1ae985, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:39.935784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778734f9-0664-4c61-a7b0-b494521f7cb7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.017774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.020068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:40.023447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3043/6065] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:39 2022] PUT /identity/v3/projects/8f6d30aea7c94d03ab53b17781ed7dfe/users/3ad79169ca4543e79399cd2b7f1ae985/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:40.043533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.044038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.044718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.051196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659811-6b07-448d-839c-8c6812453a39 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.087649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] MFA Rules not processed for user `3ad79169ca4543e79399cd2b7f1ae985`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:40.089786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:40.158814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.159748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.160358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.160813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] PATH_INFO: `/v3/projects/515ab27962674e99a602451fb8f3da61` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.162110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=515ab27962674e99a602451fb8f3da61)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.164519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.201971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3044/6066] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:40.206027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.219527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9df3f-51cf-4aa0-872f-bc109eed44bc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.232309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.240897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.240897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.240897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.240897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.240897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.375949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515ab27962674e99a602451fb8f3da61', 'request_id': 'req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:40.383580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515ab27962674e99a602451fb8f3da61', 'request_id': 'req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:40.390052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515ab27962674e99a602451fb8f3da61', 'request_id': 'req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:40.433973 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3045/6067] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:12:40.435339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.507463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e06e77-a445-4c30-a752-4b39180caf80 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.515719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.516355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.516647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.516931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.517563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.519554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.564479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] The token cache is being invalidate because project 515ab27962674e99a602451fb8f3da61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:40.564479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:40.564479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f4e6cdc3-c323-4dcb-ae36-1be1c25ecd8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:40.564479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3023/6068] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:40 2022] DELETE /identity/v3/projects/515ab27962674e99a602451fb8f3da61 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:40.564479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad05c71-58e1-42f6-b076-5bccf5295f2c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.565582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad05c71-58e1-42f6-b076-5bccf5295f2c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.565582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad05c71-58e1-42f6-b076-5bccf5295f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.583663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7ad05c71-58e1-42f6-b076-5bccf5295f2c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:40.584638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ad05c71-58e1-42f6-b076-5bccf5295f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:40.593706 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3024/6069] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:40.601502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.601787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.602074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.625814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:40.627194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:40.635823 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3025/6070] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:40.640161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.650476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf1c6-3ea3-444e-b5cb-a908a24b9fb8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.655380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.656003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.656289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.656571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.657234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:40.657799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.659523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.690094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3046/6071] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:40.695556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.713865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:40.725165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad435cf-b0de-4b1a-9e31-569f2c0d5185 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.731119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3026/6072] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:12:40.731658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.732341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.732510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.732812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.733091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.743725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.747352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.749467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547658b2-23df-4554-ba35-ea338c32c2b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.758341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.759664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.761427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.762056 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3047/6073] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:40.762487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.764218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.766510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.767359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.780405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117f92-5a48-463c-a001-d9c2c173511a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:40.786754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:40.788172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:40.789325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:40.790874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] PATH_INFO: `/v3/projects/ce834769486e41d084f7de8d1eb578b1/users/8a3a17199a3a459e8bf9d6aa382d73c8/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:40.809954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce834769486e41d084f7de8d1eb578b1, user_id=8a3a17199a3a459e8bf9d6aa382d73c8, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:40.812797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:40.983356 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3027/6074] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:40.987604 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3048/6075] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:40 2022] PUT /identity/v3/projects/ce834769486e41d084f7de8d1eb578b1/users/8a3a17199a3a459e8bf9d6aa382d73c8/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:40.988766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:40.992160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.093287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee910-eb3f-40d4-a729-9c9fca0100df admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.102248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b0f7-2d47-4325-8a58-8ead889c112f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.102810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.103654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.104017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.104458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.105195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.107296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.111680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.112930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.113450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.114029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.115292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.120319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.143050 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3028/6076] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:41.146226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.162975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed1954-03a1-4163-ace8-feb8e4ef3b96 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.168661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadb82c-4301-4119-83da-3ad321ebff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.169378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadb82c-4301-4119-83da-3ad321ebff30 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.169745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadb82c-4301-4119-83da-3ad321ebff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.170022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadb82c-4301-4119-83da-3ad321ebff30 admin admin] PATH_INFO: `/v3/projects/ce834769486e41d084f7de8d1eb578b1/users/8a3a17199a3a459e8bf9d6aa382d73c8/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.172063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadb82c-4301-4119-83da-3ad321ebff30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce834769486e41d084f7de8d1eb578b1, user_id=8a3a17199a3a459e8bf9d6aa382d73c8, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.174848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadb82c-4301-4119-83da-3ad321ebff30 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.196974 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3029/6077] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:41 2022] PUT /identity/v3/projects/ce834769486e41d084f7de8d1eb578b1/users/8a3a17199a3a459e8bf9d6aa382d73c8/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:41.198563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.198889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.199376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.228924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] MFA Rules not processed for user `8a3a17199a3a459e8bf9d6aa382d73c8`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:41.234333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:41.242194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3049/6078] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:40 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:41.245493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.261687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536f6a0-5a2c-4916-84ed-c7586a87fed6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.337920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.339792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.340079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.340363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.341038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.342659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.357594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3030/6079] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:41.357807 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3050/6080] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:41.358636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.367104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.370074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:41.371194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96a8c4-1c06-41bf-85e4-1006b28741b0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.376269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.377963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.377963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.377963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.378270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.379789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.392743 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3031/6081] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:41.397464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.408423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1585f8-2607-492a-af39-b6d9a4c083cf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.415036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.419111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.419532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.420026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] PATH_INFO: `/v3/projects/e0413c72e86542c3a7df65d5830ffc27/users/387ee93c80cb40398df6fec3c902bed0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.441773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002404-0248-42dc-8366-976f325213b2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.442043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0413c72e86542c3a7df65d5830ffc27, user_id=387ee93c80cb40398df6fec3c902bed0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.446327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.448862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d470c2-a9b5-4061-9448-f3a62144dadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.449584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d470c2-a9b5-4061-9448-f3a62144dadd service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.449867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d470c2-a9b5-4061-9448-f3a62144dadd service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.450142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d470c2-a9b5-4061-9448-f3a62144dadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.460209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d470c2-a9b5-4061-9448-f3a62144dadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.461659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d470c2-a9b5-4061-9448-f3a62144dadd service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.472168 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3051/6082] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:41.526477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3032/6083] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:41 2022] PUT /identity/v3/projects/e0413c72e86542c3a7df65d5830ffc27/users/387ee93c80cb40398df6fec3c902bed0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:41.528142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.528579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.528707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.551408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:41.552816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:41.599802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:41.632358 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3052/6084] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:41.643570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:41.738777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3ef5-8233-422d-8f3a-47a7b4479e29 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:41.743546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:41.744630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:41.745993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:41.746445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:41.764097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:41.766518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:41.779644 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3033/6085] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:41.946404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:43.120291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:43.120291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:43.160748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae86533-e746-4658-be43-64af82d0b9f2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:43.166760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:43.167422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:43.167700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:43.170131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:43.170131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:43.276262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:43.277875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddb3ee-0199-40a2-9473-f7ea9e05ed85 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:43.291800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3053/6086] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:43.774639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:44.059844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:44.874683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:44.889504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47729b-53e7-48ce-9b20-75dba94159d9 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:44.914041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:44.916342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:44.916926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:44.917543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] PATH_INFO: `/v3/users/3ad79169ca4543e79399cd2b7f1ae985` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:44.919067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad79169ca4543e79399cd2b7f1ae985)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:44.921350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:45.261826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad79169ca4543e79399cd2b7f1ae985'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:45.280143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad79169ca4543e79399cd2b7f1ae985'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:45.281381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad79169ca4543e79399cd2b7f1ae985'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:45.306825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad79169ca4543e79399cd2b7f1ae985'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:45.309460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad79169ca4543e79399cd2b7f1ae985'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:45.464316 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3034/6087] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:44 2022] DELETE /identity/v3/users/3ad79169ca4543e79399cd2b7f1ae985 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:45.466449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:45.466994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:45.467149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:45.539640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:45.543532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:45.831380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3054/6088] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:45.843617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:45.846538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:45.992049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc451c-e5eb-45f9-b9d5-3defa0d31030 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:46.014774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:46.015503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:46.015916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:46.016626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:46.060906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:46.062664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:46.101274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3035/6089] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:46.486641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:46.633010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:46.638868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:46.672497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea468a3-7238-469b-a5d3-9513ad686353 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:46.686129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:46.687204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:46.687712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:46.688334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] PATH_INFO: `/v3/users/176b78609fe64a958eb12cddae83c0b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:46.723477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=176b78609fe64a958eb12cddae83c0b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:46.723477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:46.917993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:47.038339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176b78609fe64a958eb12cddae83c0b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:47.054049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176b78609fe64a958eb12cddae83c0b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:47.055808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176b78609fe64a958eb12cddae83c0b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:47.057968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176b78609fe64a958eb12cddae83c0b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:47.079459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176b78609fe64a958eb12cddae83c0b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:47.212347 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3055/6090] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:46 2022] DELETE /identity/v3/users/176b78609fe64a958eb12cddae83c0b9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:47.570244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:47.572147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:47.592309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:47.594157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:47.637374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343d86-6091-4462-a339-8718d737b5e3 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:47.752640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58438-ed07-4ddf-8ebb-2e2355a34345 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:47.760978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:47.762430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:47.762985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:47.771376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] PATH_INFO: `/v3/projects/f753981cf9264d27b16090d7499bf372` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:47.780557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:47.781090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f753981cf9264d27b16090d7499bf372)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:47.781265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:47.781493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:47.781767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] PATH_INFO: `/v3/projects/8f6d30aea7c94d03ab53b17781ed7dfe` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:47.783212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6d30aea7c94d03ab53b17781ed7dfe)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:47.783331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:47.785467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:47.988080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f753981cf9264d27b16090d7499bf372', 'request_id': 'req-82fd8527-db68-44ad-8ad7-7f8595b9f561'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:47.999001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f753981cf9264d27b16090d7499bf372', 'request_id': 'req-82fd8527-db68-44ad-8ad7-7f8595b9f561'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.011813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f753981cf9264d27b16090d7499bf372', 'request_id': 'req-82fd8527-db68-44ad-8ad7-7f8595b9f561'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.028740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6d30aea7c94d03ab53b17781ed7dfe', 'request_id': 'req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.043034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6d30aea7c94d03ab53b17781ed7dfe', 'request_id': 'req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.060872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6d30aea7c94d03ab53b17781ed7dfe', 'request_id': 'req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.130037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] The token cache is being invalidate because project f753981cf9264d27b16090d7499bf372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:48.130556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.132226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.135163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3056/6091] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:47 2022] DELETE /identity/v3/projects/f753981cf9264d27b16090d7499bf372 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:48.139501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:48.142345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:48.239633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd8527-db68-44ad-8ad7-7f8595b9f561 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:48.308938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:48.310102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:48.310768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:48.311365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] PATH_INFO: `/v3/users/9657b4e5915d4efaadc6c6e563f2e5b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:48.312925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9657b4e5915d4efaadc6c6e563f2e5b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:48.315366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:48.315573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] The token cache is being invalidate because project 8f6d30aea7c94d03ab53b17781ed7dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:48.316056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.317315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.320528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3036/6092] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:47 2022] DELETE /identity/v3/projects/8f6d30aea7c94d03ab53b17781ed7dfe => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:48.327939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:48.331334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:48.353170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8c3ac-f31c-489e-a0fb-39e5f03f5ec8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:48.364021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:48.365000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:48.365473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:48.365956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] PATH_INFO: `/v3/users/8a3a17199a3a459e8bf9d6aa382d73c8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:48.367527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3a17199a3a459e8bf9d6aa382d73c8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:48.369794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:48.608068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9657b4e5915d4efaadc6c6e563f2e5b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.621562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9657b4e5915d4efaadc6c6e563f2e5b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.627028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9657b4e5915d4efaadc6c6e563f2e5b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.627028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9657b4e5915d4efaadc6c6e563f2e5b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.638869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9657b4e5915d4efaadc6c6e563f2e5b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.658794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:48.672869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3a17199a3a459e8bf9d6aa382d73c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.681120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3a17199a3a459e8bf9d6aa382d73c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.682451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3a17199a3a459e8bf9d6aa382d73c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.698311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3a17199a3a459e8bf9d6aa382d73c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.701568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e3fba2f-c3d7-4a3c-ae9c-4dd5967d6210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3a17199a3a459e8bf9d6aa382d73c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:48.726908 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3057/6093] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:48 2022] DELETE /identity/v3/users/9657b4e5915d4efaadc6c6e563f2e5b9 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:48.862266 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3037/6094] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:12:48 2022] DELETE /identity/v3/users/8a3a17199a3a459e8bf9d6aa382d73c8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:48.896974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:49.024117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:49.026275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:49.227694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffb501-e317-42f6-b054-afaf66ee9573 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:49.350355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:49.351406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:49.351866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:49.352300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] PATH_INFO: `/v3/projects/403d1c06f29f4076ab6e9a2156a3ccff` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:49.354352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403d1c06f29f4076ab6e9a2156a3ccff)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:49.356640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:49.590500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403d1c06f29f4076ab6e9a2156a3ccff', 'request_id': 'req-acf7e020-db3a-470c-bf1f-2c50a90df029'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:49.613164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403d1c06f29f4076ab6e9a2156a3ccff', 'request_id': 'req-acf7e020-db3a-470c-bf1f-2c50a90df029'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:49.626688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403d1c06f29f4076ab6e9a2156a3ccff', 'request_id': 'req-acf7e020-db3a-470c-bf1f-2c50a90df029'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:49.741049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] The token cache is being invalidate because project 403d1c06f29f4076ab6e9a2156a3ccff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:49.742524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:49.743650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-acf7e020-db3a-470c-bf1f-2c50a90df029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:49.746018 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3058/6095] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:49 2022] DELETE /identity/v3/projects/403d1c06f29f4076ab6e9a2156a3ccff => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:49.751564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:49.752881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:49.753560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:49.806294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:49.807995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:49.961263 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3038/6096] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:49.970823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:49.971157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:49.971508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.008386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:50.011132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:50.022158 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3059/6097] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:50.026460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.043601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca8b5a-279c-4419-8d18-4805939a55fd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.049099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.049864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.050234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.050601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.051457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:50.051978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.054167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.068422 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3039/6098] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:12:50.073737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.084272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3186f71-43df-4516-832b-db521d1bf37a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.089459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.090081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.090369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.094526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.094526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.094526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.123331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.125769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:50.144167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450624c7-67d4-4f0b-b309-d08188c1d0a8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.150933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.151948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.152396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.152848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] PATH_INFO: `/v3/projects/ce834769486e41d084f7de8d1eb578b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.154403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce834769486e41d084f7de8d1eb578b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.162499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.247933 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3060/6099] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:50 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:50.251978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.330254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce834769486e41d084f7de8d1eb578b1', 'request_id': 'req-2c15dd7f-ff0e-4705-8d71-4711b104567d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:50.350174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce834769486e41d084f7de8d1eb578b1', 'request_id': 'req-2c15dd7f-ff0e-4705-8d71-4711b104567d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:50.351849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce834769486e41d084f7de8d1eb578b1', 'request_id': 'req-2c15dd7f-ff0e-4705-8d71-4711b104567d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:50.391310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772f10-4107-4781-88ba-5c3a91ed8935 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.510939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] The token cache is being invalidate because project ce834769486e41d084f7de8d1eb578b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:12:50.511615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:50.514074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c15dd7f-ff0e-4705-8d71-4711b104567d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:12:50.522917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:50.526995 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3040/6100] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:12:50 2022] DELETE /identity/v3/projects/ce834769486e41d084f7de8d1eb578b1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:50.533682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593f6b-3d0d-4be8-8a88-f2b84330210b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.533682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593f6b-3d0d-4be8-8a88-f2b84330210b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.533682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88593f6b-3d0d-4be8-8a88-f2b84330210b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.537713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.538545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.538835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.539232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.539872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.542489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.576839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-88593f6b-3d0d-4be8-8a88-f2b84330210b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:50.580427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-88593f6b-3d0d-4be8-8a88-f2b84330210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:50.621473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3041/6101] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:50.640307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.640787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.641276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.688173 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3061/6102] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:50 2022] POST /identity/v3/users => generated 294 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:50.701599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.705436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:50.705660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:50.707855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:50.724391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3042/6103] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:50.732606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.738374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7e01d-0edf-47e1-a1a5-dfe3d883448b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.747494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.748460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.748886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.751427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.751427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.752052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.769462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3062/6104] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:50.779132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.796914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572240-fc9a-4152-9b84-4b32b84e9dfe None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.810716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.812826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.813188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.816884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.817598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:12:50.817986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.821038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60576e1-c3a1-4616-bd2f-ca7a4caffec8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.824537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.827187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.827880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.828227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.829347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.830093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.832086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.846825 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3043/6105] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:12:50.850281 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3063/6106] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:50.853750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.854758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:50.876701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d04ab6-4ec9-4d6c-83e5-f7e23f0bb940 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.884357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22129f6-ee02-41b7-a5a7-a0e2f42ce9cf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:50.892072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.892631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.892751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9339-32b5-4660-8ff6-52d56dced61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:50.892941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.893279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.893849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9339-32b5-4660-8ff6-52d56dced61f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:50.894072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.894348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9339-32b5-4660-8ff6-52d56dced61f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:50.894837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9339-32b5-4660-8ff6-52d56dced61f admin admin] PATH_INFO: `/v3/projects/30cea8e2c3b9438ea6a50fb852468a7b/users/36f490bcb6d643fa99b73ffa55d37c5e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:50.896713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:50.935635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb9339-32b5-4660-8ff6-52d56dced61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cea8e2c3b9438ea6a50fb852468a7b, user_id=36f490bcb6d643fa99b73ffa55d37c5e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:50.940129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb9339-32b5-4660-8ff6-52d56dced61f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.011338 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3044/6107] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:50 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:51.017187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:51.037830 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3064/6108] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:50 2022] PUT /identity/v3/projects/30cea8e2c3b9438ea6a50fb852468a7b/users/36f490bcb6d643fa99b73ffa55d37c5e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:51.045528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574f0e-ff20-42cd-a4d1-861bc613b56e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.046043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574f0e-ff20-42cd-a4d1-861bc613b56e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.046404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574f0e-ff20-42cd-a4d1-861bc613b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.070669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-59574f0e-ff20-42cd-a4d1-861bc613b56e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:51.075812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-59574f0e-ff20-42cd-a4d1-861bc613b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:51.111733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:51.129796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0409d1-49ca-4274-806c-ee514ad369a2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:51.158533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:51.175952 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3065/6109] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:51.177407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.178053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.178053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.219117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:51.220079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.220364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.220567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] MFA Rules not processed for user `387ee93c80cb40398df6fec3c902bed0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:51.220690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.221370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:51.221790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:51.223673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.312100 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3045/6110] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:51 2022] POST /identity/v3/users => generated 285 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:51.312100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:51.312636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:51.314888 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3066/6111] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:51.315966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:51.335175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea779e15-f490-44a0-a48e-433efd10cbea None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:51.341654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:51.346574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.346574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.346574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.346574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:51.346574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.369769 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3067/6112] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:51.371223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:51.373693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:51.396473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577ae3-b131-431a-ac6f-2e767f714637 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:51.401132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:51.401858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.402217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.402566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.414010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:51.415757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.426784 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3046/6113] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:51.427527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:51.440418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d78b5d-3966-4336-9b08-3a0f0e3d770f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:51.446509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:51.447992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.448271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.448554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.449384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:51.450908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.465067 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3047/6114] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:51.467079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:51.476744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3135-533c-4bac-a9a1-6f24da98fb30 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:51.481811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:51.482630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.482926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.483237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7841f3-2c3d-4876-b824-fe67d65acc4c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:51.483348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] PATH_INFO: `/v3/projects/bc5fd6f35048487aa2d3f22415a288a1/users/cc99c9955f8a4a99a135fb0297256458/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.489100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d906d-1d75-4416-9bc9-5ab50b4f61ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:51.489727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d906d-1d75-4416-9bc9-5ab50b4f61ac service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.490030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d906d-1d75-4416-9bc9-5ab50b4f61ac service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.490306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d906d-1d75-4416-9bc9-5ab50b4f61ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.499773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d906d-1d75-4416-9bc9-5ab50b4f61ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:51.500944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5fd6f35048487aa2d3f22415a288a1, user_id=cc99c9955f8a4a99a135fb0297256458, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:51.503724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d906d-1d75-4416-9bc9-5ab50b4f61ac service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.504134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:51.512218 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3068/6115] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:51.711348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3048/6116] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:51 2022] PUT /identity/v3/projects/bc5fd6f35048487aa2d3f22415a288a1/users/cc99c9955f8a4a99a135fb0297256458/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:12:51.720543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:51.721172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:51.721657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:51.785504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] MFA Rules not processed for user `cc99c9955f8a4a99a135fb0297256458`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:51.787581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:51.960993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3069/6117] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:12:51.968529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:52.093414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8a0aa-b2e0-4d4e-ba4c-b1e89bea6fcd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:52.099178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:52.099879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.100226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.100509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.101512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:52.103738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:52.252059 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3049/6118] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:12:51 2022] POST /identity/v3/projects => generated 369 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:12:52.255959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:52.270318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6288fbd-4824-4f76-8f38-ebc6317ddc32 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:52.338175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:52.338796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.339113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.339392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.344300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:52.344300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:52.440094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3070/6119] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:12:52 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:12:52.444308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:52.456079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dfa4f-218b-4581-bc18-e9bec492facc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:52.460957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:52.461578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.461866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.462169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.462872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:52.464541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:52.477156 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3050/6120] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:52.492188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:52.505016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4122-9dc3-48f6-a762-52693f35db44 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:52.510838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:52.511615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.517137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.517137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] PATH_INFO: `/v3/projects/507f3004a3894af0bc0ea27d8d6bdfbb/users/f00de9f06a9b4558a6ecf30dfff17831/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.530671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507f3004a3894af0bc0ea27d8d6bdfbb, user_id=f00de9f06a9b4558a6ecf30dfff17831, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:52.533493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:52.636309 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3071/6121] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:52 2022] PUT /identity/v3/projects/507f3004a3894af0bc0ea27d8d6bdfbb/users/f00de9f06a9b4558a6ecf30dfff17831/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:52.641139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:52.652683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0c9a1-4cf0-4267-a5ac-b8d40b6ee0b2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:52.733098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa7c9-0bb2-4eed-b154-4a88c9baf7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:52.735967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa7c9-0bb2-4eed-b154-4a88c9baf7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.737115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa7c9-0bb2-4eed-b154-4a88c9baf7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.737115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa7c9-0bb2-4eed-b154-4a88c9baf7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.745263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fa7c9-0bb2-4eed-b154-4a88c9baf7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:52.745263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fa7c9-0bb2-4eed-b154-4a88c9baf7d5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:52.772954 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3051/6122] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:12:52.775278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:52.800173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fca5e9-4e4e-4474-9ebe-f52fd3f74207 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:52.808566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:52.812073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.812592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.812992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] PATH_INFO: `/v3/projects/507f3004a3894af0bc0ea27d8d6bdfbb/users/f00de9f06a9b4558a6ecf30dfff17831/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.816023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] RBAC: Authorizing `identity:create_grant(project_id=507f3004a3894af0bc0ea27d8d6bdfbb, user_id=f00de9f06a9b4558a6ecf30dfff17831, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:52.819660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:52.833742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3072/6123] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:12:52 2022] PUT /identity/v3/projects/507f3004a3894af0bc0ea27d8d6bdfbb/users/f00de9f06a9b4558a6ecf30dfff17831/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:12:52.844999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d38bc-9eda-496b-90ed-47b41089d3f1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:52.845360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d38bc-9eda-496b-90ed-47b41089d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:52.845839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d38bc-9eda-496b-90ed-47b41089d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:52.891075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ac3d38bc-9eda-496b-90ed-47b41089d3f1 None None] MFA Rules not processed for user `f00de9f06a9b4558a6ecf30dfff17831`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:52.892991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac3d38bc-9eda-496b-90ed-47b41089d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:52.926342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:52.995783 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3052/6124] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:12:53.010058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:12:53.020667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:53.031046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:53.099421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385604f-18b9-43e7-8049-659dd6a6151b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:12:53.105463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:12:53.106442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:53.106858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:53.107246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:53.119457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:12:53.123101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:12:53.136964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3073/6125] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:12:55.358988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:55.628518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:58.367001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:58.639846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:12:58.672268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399539-7194-4821-930f-e4b7208d08cd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:12:58.672705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399539-7194-4821-930f-e4b7208d08cd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:12:58.673245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399539-7194-4821-930f-e4b7208d08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:12:58.716540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-04399539-7194-4821-930f-e4b7208d08cd None None] MFA Rules not processed for user `387ee93c80cb40398df6fec3c902bed0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:12:58.721166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-04399539-7194-4821-930f-e4b7208d08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:12:58.867647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3053/6126] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:12:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:00.231746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:03.991722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:03.995837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:04.064672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:04.065855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:04.067220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:04.109832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:04.150223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] MFA Rules not processed for user `36f490bcb6d643fa99b73ffa55d37c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:04.153941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:04.217071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4c02-c83d-4bc5-8c3c-bce4de8f5515 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:04.230615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:04.233817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:04.233817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:04.233817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] PATH_INFO: `/v3/users/5ba0c59a66654f1481b4660c4d1bff11` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:04.236535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba0c59a66654f1481b4660c4d1bff11)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:04.245893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:04.292361 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3054/6127] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:04.294754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:04.313854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b01cb-deea-467f-95fa-59eca2ff6fc6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:04.324273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:04.325215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:04.325855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:04.326276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:04.327133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:04.329450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:04.337488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:04.504888 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3055/6128] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:04 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:04.509310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:04.589010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba0c59a66654f1481b4660c4d1bff11'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:04.606227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba0c59a66654f1481b4660c4d1bff11'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:04.607612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba0c59a66654f1481b4660c4d1bff11'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:04.608828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba0c59a66654f1481b4660c4d1bff11'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:04.614987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c674-ffdd-4621-9567-f3090340d59f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:04.622145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:04.622804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:04.623227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:04.623730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:04.624465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:04.626764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:04.634899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bb946e4-6e65-4cd1-93da-c0e281fdd3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba0c59a66654f1481b4660c4d1bff11'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:04.776450 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3074/6129] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:13:03 2022] DELETE /identity/v3/users/5ba0c59a66654f1481b4660c4d1bff11 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:04.778038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3056/6130] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:04 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:13:04.783593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:04.784032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:04.784261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:04.790340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:04.790500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:04.802414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6073a-8788-48f2-997c-d98f7d2be752 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:04.807004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:04.808250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:04.909336 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3075/6131] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:13:04.910988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:04.911631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:04.913565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:04.913767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:04.913767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:04.913767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:04.914263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:04.915802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:04.931406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3057/6132] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:04.931406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:04.937610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:05.074957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb86b7-6109-4d59-9fe9-74d874ce3afd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.081408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.082853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.085626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.085626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.102491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.104604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660983aa-7cf3-4b46-955d-6d30213602dc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.112736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.123450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f00de9f06a9b4558a6ecf30dfff17831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507f3004a3894af0bc0ea27d8d6bdfbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.124505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.125014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.125488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.126368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:13:05.126922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.130302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.142020 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3058/6133] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:05.143098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:05.149954 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3076/6134] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:13:05.154897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:05.163177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bfc5a-12d0-479a-8824-be307df8cfda service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.168174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861cac-feda-4fff-912d-b9389e1d915b tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.174101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f00de9f06a9b4558a6ecf30dfff17831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507f3004a3894af0bc0ea27d8d6bdfbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.175287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.175595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.176028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.176309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.176703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.177061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] PATH_INFO: `/v3/projects/7d18243ce3f34e568e50af39ddd3ff15/users/8edd949d1caa49428039942ef7e61114/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.177364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.178356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.181373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.212496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:05.221340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d18243ce3f34e568e50af39ddd3ff15, user_id=8edd949d1caa49428039942ef7e61114, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.228883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.385236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3077/6135] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:05 2022] POST /identity/v3/projects => generated 347 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:05.389658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:05.443714 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3059/6136] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:05 2022] PUT /identity/v3/projects/7d18243ce3f34e568e50af39ddd3ff15/users/8edd949d1caa49428039942ef7e61114/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:05.450339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:05.578507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2657478-6745-403c-ab2e-c093698cce4c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.584659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:05.600121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.601093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.601992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.603969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.609974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.610464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.638785 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3060/6137] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:05.647636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:05.681552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17f693-61df-4609-ad94-acfb76da514b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.713910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d2c07-1c6b-4b95-bada-ea95acea75e4 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:05.716346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.724548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.728196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.729068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] PATH_INFO: `/v3/projects/7d18243ce3f34e568e50af39ddd3ff15/users/8edd949d1caa49428039942ef7e61114/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.735446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d18243ce3f34e568e50af39ddd3ff15, user_id=8edd949d1caa49428039942ef7e61114, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.748125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.789932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3061/6138] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:05 2022] PUT /identity/v3/projects/7d18243ce3f34e568e50af39ddd3ff15/users/8edd949d1caa49428039942ef7e61114/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:05.925112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f00de9f06a9b4558a6ecf30dfff17831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507f3004a3894af0bc0ea27d8d6bdfbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:05.929379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:05.929379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:05.929379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:05.929379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:13:05.929379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:05.929941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:05.969196 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3078/6139] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:13:06.141870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:06.144028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:06.312933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385125b-b7fa-44aa-ad37-3f6dc027c55d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:06.322455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:06.323262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:06.323559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:06.323841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] PATH_INFO: `/v3/projects/a0f98bbe95504e7287b09b7b7e3e5bfa` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:06.325199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f98bbe95504e7287b09b7b7e3e5bfa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:06.327850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:06.492010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f98bbe95504e7287b09b7b7e3e5bfa', 'request_id': 'req-2635affd-5a69-498c-a9bf-e619258d1773'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:06.521567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f98bbe95504e7287b09b7b7e3e5bfa', 'request_id': 'req-2635affd-5a69-498c-a9bf-e619258d1773'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:06.536621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f98bbe95504e7287b09b7b7e3e5bfa', 'request_id': 'req-2635affd-5a69-498c-a9bf-e619258d1773'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:06.663102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] The token cache is being invalidate because project a0f98bbe95504e7287b09b7b7e3e5bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:13:06.663449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:06.666131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:06.675474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3062/6140] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:13:06 2022] DELETE /identity/v3/projects/a0f98bbe95504e7287b09b7b7e3e5bfa => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:06.677773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:06.681220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:06.734742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeae9d-1a18-4792-8712-03e281dc10a7 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:06.887944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:06.888619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:06.889531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:06.889531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] PATH_INFO: `/v3/users/395f1953379c4e85a72c7c3082e09dfd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:06.890419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395f1953379c4e85a72c7c3082e09dfd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:06.892424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:07.214418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395f1953379c4e85a72c7c3082e09dfd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:07.225636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395f1953379c4e85a72c7c3082e09dfd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:07.226748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395f1953379c4e85a72c7c3082e09dfd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:07.227710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395f1953379c4e85a72c7c3082e09dfd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:07.275162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395f1953379c4e85a72c7c3082e09dfd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:07.451078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3079/6141] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:13:06 2022] DELETE /identity/v3/users/395f1953379c4e85a72c7c3082e09dfd => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:07.728321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:07.861980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:07.863559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:07.871374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:07.965960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635affd-5a69-498c-a9bf-e619258d1773 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:08.080380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f00de9f06a9b4558a6ecf30dfff17831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '507f3004a3894af0bc0ea27d8d6bdfbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:08.081708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:08.083882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:08.084178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] PATH_INFO: `/v3/projects/18f410ee58ae43d5be9c83946b631daf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:08.086832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18f410ee58ae43d5be9c83946b631daf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:08.090169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:08.174096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:08.175722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:08.283292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f410ee58ae43d5be9c83946b631daf', 'request_id': 'req-33706cb7-5e81-4f5e-808c-eae9cb651d40'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.293217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f410ee58ae43d5be9c83946b631daf', 'request_id': 'req-33706cb7-5e81-4f5e-808c-eae9cb651d40'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.309964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f410ee58ae43d5be9c83946b631daf', 'request_id': 'req-33706cb7-5e81-4f5e-808c-eae9cb651d40'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.344965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94671-c849-4c12-b43c-6855f0e8d9f2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:08.469274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] The token cache is being invalidate because project 18f410ee58ae43d5be9c83946b631daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:13:08.469631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.474948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.483595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3063/6142] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:13:07 2022] DELETE /identity/v3/projects/18f410ee58ae43d5be9c83946b631daf => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:08.497776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:08.499221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:08.503825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:08.506979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:08.507811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:08.510022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] PATH_INFO: `/v3/projects/79b52cfcd46f4fa082e3345f9fbcdc16` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:08.515803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b52cfcd46f4fa082e3345f9fbcdc16)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:08.518187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:08.646688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33706cb7-5e81-4f5e-808c-eae9cb651d40 tempest-RoutersAdminTest-1932847703 tempest-RoutersAdminTest-1932847703-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:08.659105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:08.659538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:08.659833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:08.660163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:08.664228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:08.791674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b52cfcd46f4fa082e3345f9fbcdc16', 'request_id': 'req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.817750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b52cfcd46f4fa082e3345f9fbcdc16', 'request_id': 'req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.826209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b52cfcd46f4fa082e3345f9fbcdc16', 'request_id': 'req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.832469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:08.839352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85aa71-a6d9-4e41-95a0-d3b8c86ce4f1 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:08.855177 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3064/6143] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:13:08.929450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] The token cache is being invalidate because project 79b52cfcd46f4fa082e3345f9fbcdc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:13:08.930610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.931526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f2c45c5b-9dbb-4bd6-89c6-2337d3ef6ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:08.935365 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3080/6144] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:13:08 2022] DELETE /identity/v3/projects/79b52cfcd46f4fa082e3345f9fbcdc16 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:08.941905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:08.942608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:08.942608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:08.997919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:08.999397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:09.108293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:09.157116 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3065/6145] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:09.157402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:09.157719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:09.158096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:09.187483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:09.189619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:09.200013 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3081/6146] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:13:09.204263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:09.216878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7187316-7b0b-4476-bdd7-78df0d2e38d4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:09.222360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:09.223172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:09.235699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:09.236082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:09.236826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:13:09.237145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:09.239990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:09.260691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:09.292021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3066/6147] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:13:09.294708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05757b0-0f2c-454b-b827-f7626af35ad9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:09.313532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:09.318832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:09.318832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:09.318832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:09.318832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:09.324568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:09.552891 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3082/6148] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:13:09.559658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:09.571872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68336f7b-6869-4602-84db-2dacbb461d55 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:09.757216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:09.757840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:09.758151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:09.758963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:09.759654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:09.761687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:09.882647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3067/6149] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:09 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:09.883054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:09.907274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8c8ea-1486-46d0-aaad-6602ddfafbc6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:09.917955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:09.918610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:09.918865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:09.919178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:09.919854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:09.921483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:09.953002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3083/6150] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:09.956908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:09.980294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d98a-23e5-4023-8fe0-d115fa1c4f08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:09.999722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75825e66-4490-4ae9-a027-4f9a81ecfd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:10.000715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825e66-4490-4ae9-a027-4f9a81ecfd92 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:10.001075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825e66-4490-4ae9-a027-4f9a81ecfd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:10.001573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825e66-4490-4ae9-a027-4f9a81ecfd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:10.002831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75825e66-4490-4ae9-a027-4f9a81ecfd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:10.004788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75825e66-4490-4ae9-a027-4f9a81ecfd92 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:10.010803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:10.038611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3068/6151] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:10.042661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:10.069078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054164f4-f314-4054-a876-3d7f980ab6d3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:10.081205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:10.082698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:10.083242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:10.083756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] PATH_INFO: `/v3/projects/0cedbba80847457996a79d241d7fe3d9/users/22e413c1b3384b839e7003280bab07e7/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:10.125456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cedbba80847457996a79d241d7fe3d9, user_id=22e413c1b3384b839e7003280bab07e7, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:10.131113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:10.276149 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3084/6152] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:10 2022] PUT /identity/v3/projects/0cedbba80847457996a79d241d7fe3d9/users/22e413c1b3384b839e7003280bab07e7/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:10.279909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:10.280350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:10.281148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:10.332928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] MFA Rules not processed for user `22e413c1b3384b839e7003280bab07e7`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:10.334208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:10.418438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3069/6153] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:10.427574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:10.438235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:10.520751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24725fce-0c84-4914-af82-88266e3f70ed admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:10.527574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:10.528660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:10.529197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:10.529650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:10.545177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:10.546658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:10.565874 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3085/6154] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:10.596521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:10.607751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:10.609315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:10.753881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599776be-3152-4b02-95f2-e3099839017a service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:10.759606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:10.760355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:10.763341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:10.763341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] PATH_INFO: `/v3/users/037c64b66ce04347aee1f3e434952dfa` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:10.763341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=037c64b66ce04347aee1f3e434952dfa)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:10.767676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:10.781092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d4289-1a6a-4461-b3cb-b5c1e7c4d956 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:10.791795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:10.791795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:10.791795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:10.791795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] PATH_INFO: `/v3/users/22e413c1b3384b839e7003280bab07e7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:10.792465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e413c1b3384b839e7003280bab07e7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:10.794527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:11.045136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e413c1b3384b839e7003280bab07e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.052894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e413c1b3384b839e7003280bab07e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.053642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e413c1b3384b839e7003280bab07e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.077467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e413c1b3384b839e7003280bab07e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.078864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-425f9074-a1fe-465b-8677-8b086c39af0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e413c1b3384b839e7003280bab07e7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.088566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037c64b66ce04347aee1f3e434952dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.103371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037c64b66ce04347aee1f3e434952dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.109857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037c64b66ce04347aee1f3e434952dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.109857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037c64b66ce04347aee1f3e434952dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.120878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-39387f35-390f-4503-9563-7ab42476be15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037c64b66ce04347aee1f3e434952dfa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:11.194867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:11.246348 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3070/6155] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:13:10 2022] DELETE /identity/v3/users/22e413c1b3384b839e7003280bab07e7 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:11.251400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:11.252534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:11.253008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:11.283632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:11.285168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:11.372523 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3071/6156] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:11.389226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:11.391948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:11.394449 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3086/6157] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:13:10 2022] DELETE /identity/v3/users/037c64b66ce04347aee1f3e434952dfa => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:11.396300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:11.396770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:11.397200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:11.429204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:11.431637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:11.485654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7fc4-0028-46a6-bb3c-5afb69dc16fb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:11.528468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3087/6158] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:11.550818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:11.563861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:11.565144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:11.565836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:11.566515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:11.583631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:11.584240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26994a93-fe46-4bff-8a38-38e8fcd60562 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:11.585944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:11.592395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:11.593623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:11.595546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:11.595546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:11.604327 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3072/6159] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:11.611733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:11.614102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:11.629048 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3088/6160] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:12.365327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:12.408815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:12.411145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:12.442681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:12.444806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:12.450687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd8d6-b3f9-4fec-be12-7488ab3a6ac0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:12.469863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08192705-271b-43cd-80d2-1a457290acf5 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:12.481093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:12.481763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:12.482052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:12.482338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] PATH_INFO: `/v3/projects/472edbb3f752428c8a88aeef89c83b8b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:12.484816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] RBAC: Authorizing `identity:delete_project(project_id=472edbb3f752428c8a88aeef89c83b8b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:12.488019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:12.493085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:12.493085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:12.493085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:12.495312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] PATH_INFO: `/v3/projects/0cedbba80847457996a79d241d7fe3d9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:12.501037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cedbba80847457996a79d241d7fe3d9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:12.503364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:12.757516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472edbb3f752428c8a88aeef89c83b8b', 'request_id': 'req-98c8e80a-f995-42a1-8453-455c575a495f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.775325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472edbb3f752428c8a88aeef89c83b8b', 'request_id': 'req-98c8e80a-f995-42a1-8453-455c575a495f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.777728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cedbba80847457996a79d241d7fe3d9', 'request_id': 'req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.786332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472edbb3f752428c8a88aeef89c83b8b', 'request_id': 'req-98c8e80a-f995-42a1-8453-455c575a495f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.791407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cedbba80847457996a79d241d7fe3d9', 'request_id': 'req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.805525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cedbba80847457996a79d241d7fe3d9', 'request_id': 'req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.878077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] The token cache is being invalidate because project 472edbb3f752428c8a88aeef89c83b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:13:12.878536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.879447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98c8e80a-f995-42a1-8453-455c575a495f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.883627 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3073/6161] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:13:12 2022] DELETE /identity/v3/projects/472edbb3f752428c8a88aeef89c83b8b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:13:12.888842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65c2c-5dc1-4a3c-ba41-e226c8fc44e4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:12.889648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65c2c-5dc1-4a3c-ba41-e226c8fc44e4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:12.890151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65c2c-5dc1-4a3c-ba41-e226c8fc44e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:12.918145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f1a65c2c-5dc1-4a3c-ba41-e226c8fc44e4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:12.919551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f1a65c2c-5dc1-4a3c-ba41-e226c8fc44e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:12.987146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] The token cache is being invalidate because project 0cedbba80847457996a79d241d7fe3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:13:12.987404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.994775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0802d8d1-f041-4baa-a51a-15d50cfbd3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:12.994982 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3074/6162] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:12.996359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3089/6163] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:13:12 2022] DELETE /identity/v3/projects/0cedbba80847457996a79d241d7fe3d9 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:13.001483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.001483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.001483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.003377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f635b2-949d-4fd6-826a-70ce729e5fb6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.003808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f635b2-949d-4fd6-826a-70ce729e5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.004228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f635b2-949d-4fd6-826a-70ce729e5fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.024880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:13.026330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:13.026683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e5f635b2-949d-4fd6-826a-70ce729e5fb6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:13.028030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e5f635b2-949d-4fd6-826a-70ce729e5fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:13.037466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3075/6164] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:13.038885 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3090/6165] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:13.048228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.049712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.050407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.050947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.058577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88efe3f-6828-4f8f-b711-6df6d465b2a5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.065150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.065780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.066065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.066879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.067258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:13:13.067578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.070080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.074388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:13.075789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:13.085115 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3076/6166] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:13:13.090111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.092845 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3091/6167] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:13.097489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.102142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a947-b400-41da-84b9-7b478f339fb0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.107911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873494b0-c941-4ddb-9915-d4e0046f3283 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.108116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.108619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.108910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.109599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.109833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.111919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.117872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.118741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.119329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.119799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.120649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:13:13.121135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.123200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.138516 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3092/6168] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:13:13.143211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.155293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e0896-c74a-4c77-b5ed-330de042a148 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.160281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.160956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.161317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.161665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.162422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.164629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.260350 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3077/6169] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:13.264792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.297889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3093/6170] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:13.302267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.341607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ac5a5-2c72-4707-808d-b5fbfc91915c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.377640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f6a3-0a46-4b86-9e5e-e3783210713e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.383967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.384674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.384959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.385247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.386012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.387898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.413892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.414472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.414707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.414989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.415671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.417736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.488116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3094/6171] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:13:13.489375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.501200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574ac4b-b750-435a-914c-3e0faeef2881 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.507413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.508174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.508464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.509257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.509908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.511672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.528385 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3095/6172] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:13:13.529602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.531999 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3078/6173] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:13:13.538355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.544194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ccf6-e168-4037-a31a-fe7436d35689 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.551355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.551490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3457e0-fd42-428d-a796-442e3284deac admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.552010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.552307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.558028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.558742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.559123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.559402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.559729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.560642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.561325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.562754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.563246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.580151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3096/6174] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:13:13.580416 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3079/6175] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:13:13.583654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.585076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.597266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7e79b-9089-43f0-a64d-c7aec89e909e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.600861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65faca-6d15-413d-b7af-dcf0da9763e7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.606165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5961b-c414-41aa-aa16-0c3002313981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.606872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5961b-c414-41aa-aa16-0c3002313981 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.607096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.607281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5961b-c414-41aa-aa16-0c3002313981 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.607542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5961b-c414-41aa-aa16-0c3002313981 admin admin] PATH_INFO: `/v3/projects/deb7f753413a467fb1c86f7463b12563/users/9d49264c495645f38d17ceb03a43195f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.607719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.608215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.608698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.609651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.612135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.630384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3080/6176] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:13:13.632823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5961b-c414-41aa-aa16-0c3002313981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb7f753413a467fb1c86f7463b12563, user_id=9d49264c495645f38d17ceb03a43195f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.638945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:13.639692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5961b-c414-41aa-aa16-0c3002313981 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.647361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93270c9c-4dff-4dc4-853d-9334328c40c3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:13.653757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262714e-6aa2-473d-b89a-35fc5657888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:13.654445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262714e-6aa2-473d-b89a-35fc5657888a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.654733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262714e-6aa2-473d-b89a-35fc5657888a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.655099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262714e-6aa2-473d-b89a-35fc5657888a admin admin] PATH_INFO: `/v3/projects/64ad0aa0c40a40d18f33ec559adac83f/users/c73d9683f7f04bdeafa6d06ab565c800/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.679160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262714e-6aa2-473d-b89a-35fc5657888a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ad0aa0c40a40d18f33ec559adac83f, user_id=c73d9683f7f04bdeafa6d06ab565c800, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:13.684187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262714e-6aa2-473d-b89a-35fc5657888a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:13.731709 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3097/6177] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:13 2022] PUT /identity/v3/projects/deb7f753413a467fb1c86f7463b12563/users/9d49264c495645f38d17ceb03a43195f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:13.801704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3081/6178] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:13 2022] PUT /identity/v3/projects/64ad0aa0c40a40d18f33ec559adac83f/users/c73d9683f7f04bdeafa6d06ab565c800/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:13:13.813306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.814565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.814936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.847636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927148c-dbd0-4c0d-b132-00153172f3b5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:13.848266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927148c-dbd0-4c0d-b132-00153172f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:13.848739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927148c-dbd0-4c0d-b132-00153172f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:13.898471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3927148c-dbd0-4c0d-b132-00153172f3b5 None None] MFA Rules not processed for user `9d49264c495645f38d17ceb03a43195f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:13.903854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3927148c-dbd0-4c0d-b132-00153172f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:13.913821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] MFA Rules not processed for user `c73d9683f7f04bdeafa6d06ab565c800`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:13.917542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:13.919047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:14.075996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3098/6179] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:14.111688 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3082/6180] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:13:14.128800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:14.168992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:14.169778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:14.170298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:14.222135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] MFA Rules not processed for user `c73d9683f7f04bdeafa6d06ab565c800`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:14.223806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:14.255866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3083/6181] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:14.351523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bca1b-ec61-4001-aa32-4ef917e1fbea None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:14.356969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:14.358063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:14.358384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:14.358688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:14.360286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:14.362421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:14.531517 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3099/6182] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:14 2022] POST /identity/v3/projects => generated 387 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:14.537546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:14.572910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128d730-5242-402f-9a29-8c2123c2bd59 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:14.619182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:14.619431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:14.655737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:14.726174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:14.727216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:14.727942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:14.728824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:14.731237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:14.739975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:14.858243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dbc66-2650-499a-9449-192dff4162a9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:14.871514 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3084/6183] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:14 2022] POST /identity/v3/users => generated 294 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:14.877779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:14.889127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1421-6372-4add-bf87-205590574dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:14.889783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1421-6372-4add-bf87-205590574dba service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:14.890065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1421-6372-4add-bf87-205590574dba service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:14.890338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1421-6372-4add-bf87-205590574dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:14.900470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec70ee-312e-4cbb-8237-cc3573eddbf4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:14.926207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:14.928475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:14.929004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:14.930750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:14.931698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:14.937052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:14.957545 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3085/6184] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:14.962094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:14.984061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629bb37-8243-4d9b-a424-7e9e6283cfb5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:14.991958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:14.993997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:14.994693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:14.995605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:14.996881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:14.999522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:15.014222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d1421-6372-4add-bf87-205590574dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:15.015919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d1421-6372-4add-bf87-205590574dba service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:15.021466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3086/6185] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:15.021466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:15.035866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9408-63c3-4680-aab8-c8a45b31f25c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:15.044127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:15.045344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:15.045859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:15.046345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] PATH_INFO: `/v3/projects/494fa2e5483044c092e8becf06d9df0f/users/b48ac63276aa406c82db08e3d68937d1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:15.073270 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3100/6186] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:13:15.078167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=494fa2e5483044c092e8becf06d9df0f, user_id=b48ac63276aa406c82db08e3d68937d1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:15.082885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:15.179151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3087/6187] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:15 2022] PUT /identity/v3/projects/494fa2e5483044c092e8becf06d9df0f/users/b48ac63276aa406c82db08e3d68937d1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:13:15.190035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:15.190558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:15.190942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:15.245692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] MFA Rules not processed for user `b48ac63276aa406c82db08e3d68937d1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:15.248433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:15.408268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3101/6188] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:15.409942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:15.494426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44fb83-3cf8-480e-9092-85b9dca210fa admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:15.500305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:15.500931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:15.501221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:15.501530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:15.502201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:15.504640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:15.643079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3088/6189] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:15 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:13:15.650268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:15.672778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bef74-4030-407b-b8b5-f1448713c27b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:15.787076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:15.787076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:15.787076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:15.787076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:15.787941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:15.788883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:15.889997 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3102/6190] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:15 2022] POST /identity/v3/users => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:15.894990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:15.963875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5127c3-176f-41eb-a52c-6ce13962f950 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:15.990405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:15.991145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:16.010780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:16.010780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:16.010780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:16.010780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:16.029571 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3089/6191] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:16.034647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:16.051343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9baaf3-8501-478f-a619-4e7e208c7d5a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:16.088053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:16.088762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:16.089054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:16.089344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] PATH_INFO: `/v3/projects/dd2662c986324ee1a51c45374ae8bf83/users/10629371687c4bceb7ea078fa49e4484/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:16.140437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2662c986324ee1a51c45374ae8bf83, user_id=10629371687c4bceb7ea078fa49e4484, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:16.161030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:16.370701 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3103/6192] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:16 2022] PUT /identity/v3/projects/dd2662c986324ee1a51c45374ae8bf83/users/10629371687c4bceb7ea078fa49e4484/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:16.375727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:16.410904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcd1f1-8a1d-41b3-bc54-9b1c61945bea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:16.619607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:16.622460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:16.624607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:16.624607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:16.625635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:16.627839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:16.639084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:16.646355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:16.668630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3090/6193] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:16.670727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:16.683646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ea7e6-584a-40ef-97d2-894671b855d0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:16.703793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c1313-2d54-4671-9d59-5edcbcdf5b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:16.717094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c1313-2d54-4671-9d59-5edcbcdf5b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:16.717388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c1313-2d54-4671-9d59-5edcbcdf5b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:16.717676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c1313-2d54-4671-9d59-5edcbcdf5b50 admin admin] PATH_INFO: `/v3/projects/dd2662c986324ee1a51c45374ae8bf83/users/10629371687c4bceb7ea078fa49e4484/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:16.721822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c1313-2d54-4671-9d59-5edcbcdf5b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2662c986324ee1a51c45374ae8bf83, user_id=10629371687c4bceb7ea078fa49e4484, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:16.729823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c1313-2d54-4671-9d59-5edcbcdf5b50 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:16.744704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3091/6194] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:16 2022] PUT /identity/v3/projects/dd2662c986324ee1a51c45374ae8bf83/users/10629371687c4bceb7ea078fa49e4484/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:16.760434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:16.760793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:16.761145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:16.822281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] MFA Rules not processed for user `10629371687c4bceb7ea078fa49e4484`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:16.826575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:16.849038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3a1d-3417-4a78-b710-ebeb971c26c8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:17.036522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3092/6195] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:17.047606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:17.055337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:17.056198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:17.056643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:17.057090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:17.059553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:17.077469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:17.080377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fdacd-ec52-4617-92c4-92d4c67d367d service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:17.105981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3104/6196] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:13:17.168930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59ff9-3a54-41a6-94ff-629e10e585ba None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:17.175567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:17.175933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:17.176114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:17.176287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:17.323225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:17.325116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:17.344525 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3093/6197] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:17.530008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:17.856386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:18.804189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:18.805670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:18.806185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:18.860126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] MFA Rules not processed for user `8edd949d1caa49428039942ef7e61114`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:18.861908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:18.994652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3105/6198] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:19.006123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:19.010662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:19.130434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4309-fd99-4dc9-91c3-2b4940fad53b service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:19.136217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:19.137206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:19.137674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:19.138128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:19.140293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:19.274009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:19.276767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:19.307982 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3094/6199] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:20.228962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:20.702295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:22.385014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:22.550544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:22.553866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:22.662267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e504b-358a-4959-9aff-d19ffd24fcd0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:22.671401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4cbf-8aef-418c-91eb-1568f0996546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:22.672621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4cbf-8aef-418c-91eb-1568f0996546 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:22.673291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4cbf-8aef-418c-91eb-1568f0996546 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:22.673842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4cbf-8aef-418c-91eb-1568f0996546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:22.692896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4cbf-8aef-418c-91eb-1568f0996546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:22.695662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4cbf-8aef-418c-91eb-1568f0996546 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:22.713274 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3106/6200] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:23.501039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:23.589600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:25.121620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:27.504338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:28.449940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:28.452134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:28.498411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c069ff-52ec-49be-b2c7-4d84ae5751a9 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:28.526681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:28.527368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:28.527653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:28.527940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:28.530323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:28.561405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:28.563267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:28.593234 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3095/6201] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:32.349667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:32.350234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:32.350234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:32.372486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] MFA Rules not processed for user `9d49264c495645f38d17ceb03a43195f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:32.374775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:32.385073 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3107/6202] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:32.494680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:32.497320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:32.535255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797917cb-fcdb-4196-8a13-3607777abdd5 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:32.542475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:32.543227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:32.543899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:32.543899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:32.545904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:32.661433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:32.661433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:32.681204 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3096/6203] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:36.549052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:36.588020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518caff-3721-45f6-a4be-4ea151e1ce87 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:36.598944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:36.599996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:36.601949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:36.602540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:36.604955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:36.632228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:36.635350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:36.671640 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3108/6204] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:36.829496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:36.836492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:36.883428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437856c8-235c-43a2-8a72-2a6975f39938 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:36.919805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:36.919805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:36.920132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:36.920427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] PATH_INFO: `/v3/users/3e45dfaf9fd949548bca37303a117bb1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:36.921950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e45dfaf9fd949548bca37303a117bb1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:36.925052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:37.176716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e45dfaf9fd949548bca37303a117bb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:37.186817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e45dfaf9fd949548bca37303a117bb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:37.187666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e45dfaf9fd949548bca37303a117bb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:37.204155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e45dfaf9fd949548bca37303a117bb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:37.205056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-34a5657f-40f8-4986-b52e-05dc692517e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e45dfaf9fd949548bca37303a117bb1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:37.212536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:37.344990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3097/6205] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:13:36 2022] DELETE /identity/v3/users/3e45dfaf9fd949548bca37303a117bb1 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:37.780120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:37.799935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64dfe-88ea-4f24-adbe-55a41077ea32 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:37.956307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:37.957791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:37.958488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:37.959444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] PATH_INFO: `/v3/projects/887d04ff8eee40e59ec6dd248dd5b548` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:37.965710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=887d04ff8eee40e59ec6dd248dd5b548)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:37.994707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:38.442873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887d04ff8eee40e59ec6dd248dd5b548', 'request_id': 'req-a31a9657-7c6a-4d70-8773-3d1dd8691211'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:38.485940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887d04ff8eee40e59ec6dd248dd5b548', 'request_id': 'req-a31a9657-7c6a-4d70-8773-3d1dd8691211'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:38.515238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887d04ff8eee40e59ec6dd248dd5b548', 'request_id': 'req-a31a9657-7c6a-4d70-8773-3d1dd8691211'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:38.620287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] The token cache is being invalidate because project 887d04ff8eee40e59ec6dd248dd5b548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:13:38.620287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:38.621150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a31a9657-7c6a-4d70-8773-3d1dd8691211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:13:38.624287 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3109/6206] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:13:37 2022] DELETE /identity/v3/projects/887d04ff8eee40e59ec6dd248dd5b548 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:38.629250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:38.629793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:38.629793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:38.669503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:38.672345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:38.835114 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3098/6207] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:38.848251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:38.850306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:38.851504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:38.922444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:38.930984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:38.960430 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3110/6208] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:38.964382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:38.982728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6082d-d93a-4e13-b0cf-831838bff912 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:38.990308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:38.991862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:38.993384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:38.993384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:38.993384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:13:38.994552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:38.996763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:39.024570 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3099/6209] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:13:39.033353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:39.053488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4e5b-4440-45ee-918a-5cdb3f2fe09a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:39.060732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:39.061763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:39.062249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:39.062652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:39.063443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:39.066128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:39.254200 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3111/6210] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:13:39 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:39.259539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:39.274848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25f0c1-7b19-48dd-8dd1-8b122a0ddfc7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:39.429734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:39.431049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:39.431615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:39.432832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:39.434171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:39.440069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:39.646902 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3100/6211] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:13:39 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:13:39.651170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:39.669732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aa56f-46a1-4945-83f4-bd283fa3f848 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:39.687151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:39.687779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:39.688066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:39.688343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:39.689001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:39.695815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:39.723212 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3112/6212] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:39.727474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:39.768333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c9b8-0913-4800-97d0-2aca6052ff2d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:39.787655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6236a71-7fc5-4024-8b10-217e8fc0bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:39.789333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236a71-7fc5-4024-8b10-217e8fc0bddc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:39.789810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236a71-7fc5-4024-8b10-217e8fc0bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:39.790267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6236a71-7fc5-4024-8b10-217e8fc0bddc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:39.790953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6236a71-7fc5-4024-8b10-217e8fc0bddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:39.793642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6236a71-7fc5-4024-8b10-217e8fc0bddc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:39.812480 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3101/6213] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:13:39.816347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:39.829181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7ba56-364f-4b88-92c3-840a131a6337 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:39.839677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:39.840891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:39.841612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:39.843892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] PATH_INFO: `/v3/projects/aad114c7a41a47e785fd117e1103f168/users/3e904f27c02248389ae9ca86cb95c54a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:39.873219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad114c7a41a47e785fd117e1103f168, user_id=3e904f27c02248389ae9ca86cb95c54a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:39.879358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:39.999571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:40.012333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df48ab-1dd9-4c45-b228-3ea387da7698 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:40.013104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df48ab-1dd9-4c45-b228-3ea387da7698 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:40.013229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df48ab-1dd9-4c45-b228-3ea387da7698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:40.016375 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3113/6214] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:13:39 2022] PUT /identity/v3/projects/aad114c7a41a47e785fd117e1103f168/users/3e904f27c02248389ae9ca86cb95c54a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:13:40.080266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e1df48ab-1dd9-4c45-b228-3ea387da7698 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:40.088034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e1df48ab-1dd9-4c45-b228-3ea387da7698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:40.229868 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3102/6215] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:40.257582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:40.260447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:40.448829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107f2dd-8382-41fd-921f-4dbb15b26861 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:40.464187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f87fb4-f528-408c-b7ca-2c8271769aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:40.465101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f87fb4-f528-408c-b7ca-2c8271769aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:40.465742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f87fb4-f528-408c-b7ca-2c8271769aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:40.466277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f87fb4-f528-408c-b7ca-2c8271769aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:40.482832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f87fb4-f528-408c-b7ca-2c8271769aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:40.485216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f87fb4-f528-408c-b7ca-2c8271769aa6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:40.502936 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3114/6216] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:46.029306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:46.030415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:46.030907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:46.039065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:13:46.054600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] MFA Rules not processed for user `36f490bcb6d643fa99b73ffa55d37c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:46.056300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:46.159942 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3103/6217] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:13:46.170185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:46.170809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:46.170809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:46.205064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] MFA Rules not processed for user `36f490bcb6d643fa99b73ffa55d37c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:46.206435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:46.224378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3115/6218] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:47.659999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:47.675090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a08d7-716b-423d-9afd-091d19090e00 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:47.680007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:47.680872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:47.681113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:47.681622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:47.683488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:47.703611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:47.705577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774128c7-e2da-477e-8c4d-215e87ac14f0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:47.722444 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3104/6219] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:52.121996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:52.123719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:52.156258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:52.156895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:52.157629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:52.166738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fc930-06be-4aa7-b2fe-9982f59925ae None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:52.181468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:52.184691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:52.185003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:52.185283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:52.199339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:52.269481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:52.270774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:52.375247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:52.376715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8a8e7-98df-43ee-ac29-bb5d28f6a48c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:52.393452 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3116/6220] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:52.446424 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3105/6221] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:52.459763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:52.460075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:52.460345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:52.491830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:13:52.491830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:52.507420 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3117/6222] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:13:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:13:52.520921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:52.522712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:52.548048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7b03c-3ee2-44f6-bee1-7a6a2f79ac40 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:52.556719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:52.556719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:52.556719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:52.556719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:52.568722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:52.571191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:52.596665 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3106/6223] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:13:52.939566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:13:52.952571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef07a8a-542b-4dea-839f-46c9308cd4c1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:13:52.957619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:13:52.958426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:13:52.958723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:13:52.959624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:13:52.961629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:13:52.979391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:13:52.980838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdcbc8-cae4-4ddc-b111-a61c7fa0d3c0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:13:52.992113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3118/6224] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:13:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:02.580430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=68 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:02.989039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=72 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:05.462391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:05.465310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:05.514491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf127-2b08-4b06-833a-ff17443fb438 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:05.526849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:05.528317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:05.528965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:05.529821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] PATH_INFO: `/v3/users/c73d9683f7f04bdeafa6d06ab565c800` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:05.532131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73d9683f7f04bdeafa6d06ab565c800)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:05.540268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:05.797178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73d9683f7f04bdeafa6d06ab565c800'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:05.807553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73d9683f7f04bdeafa6d06ab565c800'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:05.808354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73d9683f7f04bdeafa6d06ab565c800'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:05.831399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73d9683f7f04bdeafa6d06ab565c800'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:05.835629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73d9683f7f04bdeafa6d06ab565c800'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:05.991093 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3107/6225] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:05 2022] DELETE /identity/v3/users/c73d9683f7f04bdeafa6d06ab565c800 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:05.996967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:05.997510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:05.998208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:06.042238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:06.044844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:06.163911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3119/6226] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:06.178560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:06.180310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:06.309549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c7fba-a774-44dd-9015-2978eb7e9df7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:06.321329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aae29-d511-47c7-864e-d99333a0845c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:06.321329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aae29-d511-47c7-864e-d99333a0845c service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:06.321329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aae29-d511-47c7-864e-d99333a0845c service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:06.321329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aae29-d511-47c7-864e-d99333a0845c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:06.348354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aae29-d511-47c7-864e-d99333a0845c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:06.352894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aae29-d511-47c7-864e-d99333a0845c service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:06.377746 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3108/6227] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:07.307236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:07.307236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:07.317858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ae49f-64bd-474c-9b08-7626368e312a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:07.330306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:07.330886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:07.331271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:07.331703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] PATH_INFO: `/v3/projects/64ad0aa0c40a40d18f33ec559adac83f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:07.333035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ad0aa0c40a40d18f33ec559adac83f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:07.336264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:07.625252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ad0aa0c40a40d18f33ec559adac83f', 'request_id': 'req-10d21c9e-e287-42cd-92d7-9de11a677d86'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:07.639060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ad0aa0c40a40d18f33ec559adac83f', 'request_id': 'req-10d21c9e-e287-42cd-92d7-9de11a677d86'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:07.660062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ad0aa0c40a40d18f33ec559adac83f', 'request_id': 'req-10d21c9e-e287-42cd-92d7-9de11a677d86'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:07.791670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] The token cache is being invalidate because project 64ad0aa0c40a40d18f33ec559adac83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:07.792448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:07.793727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10d21c9e-e287-42cd-92d7-9de11a677d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:07.796641 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3120/6228] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:07 2022] DELETE /identity/v3/projects/64ad0aa0c40a40d18f33ec559adac83f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:07.803427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:07.804219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:07.804219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:07.843122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:07.847335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:08.004923 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3109/6229] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:08.013685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.014459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.014951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.050746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:08.052585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:08.071052 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3121/6230] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:08.075530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:08.087214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183987-653a-41f7-b278-00dfaf915970 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:08.092730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:08.093573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.094075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.094718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.095601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:08.096071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:08.098207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:08.122875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:08.137761 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3110/6231] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:08.139472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960008-d529-4fed-9d9a-41e3bef5689f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:08.149137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:08.161643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.161939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.162281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.162984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:08.165293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:08.315441 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3122/6232] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:08 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:08.316701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:08.325781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:08.333513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85491c22-b73a-4b0b-8b7e-313b38f08556 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:08.415775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:08.416710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.417329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.418716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.419589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:08.421816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:08.640736 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3111/6233] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:08 2022] POST /identity/v3/users => generated 282 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:08.645790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:08.655511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87762e50-fe82-44bd-ad47-f8de64656453 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:08.666705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:08.668964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.669526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.671424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.672903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:08.678791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:08.718190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:08.726043 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3123/6234] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:08.736541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554ac6-b265-42c8-8fba-19f8f0f3a84f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:08.742748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fa412-0877-47b7-8c6e-d5fd25c9333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:08.745804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fa412-0877-47b7-8c6e-d5fd25c9333d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.755346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fa412-0877-47b7-8c6e-d5fd25c9333d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.755346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fa412-0877-47b7-8c6e-d5fd25c9333d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.755346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fa412-0877-47b7-8c6e-d5fd25c9333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:08.755346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fa412-0877-47b7-8c6e-d5fd25c9333d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:08.786881 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3112/6235] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:08.790951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:08.804203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681c836-6d5f-4dd8-9935-f38e1fd0e265 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:08.812903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:08.813847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.814422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.814899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3/users/2d25771bdd164eb6bdd83557dbf884ec/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:08.861503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72339a3e36b948f7b3fb35d097cdc7b3, user_id=2d25771bdd164eb6bdd83557dbf884ec, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:08.865754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:08.963359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3124/6236] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:08 2022] PUT /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3/users/2d25771bdd164eb6bdd83557dbf884ec/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:08.975792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:08.976396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:08.976396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.022670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] MFA Rules not processed for user `2d25771bdd164eb6bdd83557dbf884ec`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:09.025348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:09.106315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:09.111402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:09.129896 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3113/6237] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:09.146862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:09.149053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:09.165521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:09.267072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eed3b-cb99-48dc-a836-76336598a607 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:09.285161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:09.286057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.286519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.287031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] PATH_INFO: `/v3/users/387ee93c80cb40398df6fec3c902bed0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.288908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc9ac9-429a-4f99-8a9d-093191226ce9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:09.290129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387ee93c80cb40398df6fec3c902bed0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:09.293124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:09.298926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae7761-d1ae-499c-8f56-f55ddc2d75df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:09.299870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae7761-d1ae-499c-8f56-f55ddc2d75df service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.300319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae7761-d1ae-499c-8f56-f55ddc2d75df service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.301906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae7761-d1ae-499c-8f56-f55ddc2d75df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.328436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae7761-d1ae-499c-8f56-f55ddc2d75df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:09.335195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae7761-d1ae-499c-8f56-f55ddc2d75df service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:09.359048 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3114/6238] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:09.382813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a73b5-30cd-4305-9350-bbc8cbbeb52b None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.383143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a73b5-30cd-4305-9350-bbc8cbbeb52b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.383428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a73b5-30cd-4305-9350-bbc8cbbeb52b None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.386427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3115/6239] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:14:09.390759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a73b5-30cd-4305-9350-bbc8cbbeb52b None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:14:09.419314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a73b5-30cd-4305-9350-bbc8cbbeb52b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:09.432868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a73b5-30cd-4305-9350-bbc8cbbeb52b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:09.439310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c079a0-e183-4361-8939-e88a9239bcc9 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d25771bdd164eb6bdd83557dbf884ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72339a3e36b948f7b3fb35d097cdc7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:09.447428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c079a0-e183-4361-8939-e88a9239bcc9 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.448764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c079a0-e183-4361-8939-e88a9239bcc9 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.449070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c079a0-e183-4361-8939-e88a9239bcc9 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.452439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c079a0-e183-4361-8939-e88a9239bcc9 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorizing `identity:get_project(project_id=72339a3e36b948f7b3fb35d097cdc7b3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:09.455345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c079a0-e183-4361-8939-e88a9239bcc9 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:09.457824 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3116/6240] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:14:09 2022] GET /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3 => generated 363 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:14:09.499434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4693fb-7d7c-439b-ab9d-464d471665c3 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.499770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4693fb-7d7c-439b-ab9d-464d471665c3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.500144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4693fb-7d7c-439b-ab9d-464d471665c3 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.504855 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3117/6241] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:14:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:14:09.518880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4693fb-7d7c-439b-ab9d-464d471665c3 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:14:09.557778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4693fb-7d7c-439b-ab9d-464d471665c3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:09.569099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4693fb-7d7c-439b-ab9d-464d471665c3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:09.574460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6229b-4e2c-46f9-81a5-a489e3f125d1 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d25771bdd164eb6bdd83557dbf884ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72339a3e36b948f7b3fb35d097cdc7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:09.575509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6229b-4e2c-46f9-81a5-a489e3f125d1 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.576123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6229b-4e2c-46f9-81a5-a489e3f125d1 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.576741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6229b-4e2c-46f9-81a5-a489e3f125d1 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.577008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387ee93c80cb40398df6fec3c902bed0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:09.578434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6229b-4e2c-46f9-81a5-a489e3f125d1 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorizing `identity:get_project(project_id=72339a3e36b948f7b3fb35d097cdc7b3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:09.580720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6229b-4e2c-46f9-81a5-a489e3f125d1 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:09.583599 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3118/6242] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:14:09 2022] GET /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3 => generated 363 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:09.587207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387ee93c80cb40398df6fec3c902bed0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:09.588134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387ee93c80cb40398df6fec3c902bed0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:09.588766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387ee93c80cb40398df6fec3c902bed0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:09.613864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387ee93c80cb40398df6fec3c902bed0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:09.653827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.653827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.653827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.653827 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3119/6243] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 11:14:09.654192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:14:09.655927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:09.678728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:09.680160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:09.701509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cda59f-9dd0-405f-9914-ec88eae3d1e1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:09.707569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a8d1-4604-437d-a35c-bd02e407377e tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d25771bdd164eb6bdd83557dbf884ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72339a3e36b948f7b3fb35d097cdc7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:09.708261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a8d1-4604-437d-a35c-bd02e407377e tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.708546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a8d1-4604-437d-a35c-bd02e407377e tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.708832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a8d1-4604-437d-a35c-bd02e407377e tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.710146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a8d1-4604-437d-a35c-bd02e407377e tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorizing `identity:get_project(project_id=72339a3e36b948f7b3fb35d097cdc7b3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:09.712305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a8d1-4604-437d-a35c-bd02e407377e tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:09.714906 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3120/6244] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:14:09 2022] GET /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3 => generated 363 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:09.719502 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3125/6245] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:09 2022] DELETE /identity/v3/users/387ee93c80cb40398df6fec3c902bed0 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:09.757151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49e9db-6cc5-4be1-a68f-acd9c4110ca6 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:09.759619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49e9db-6cc5-4be1-a68f-acd9c4110ca6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:09.759619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49e9db-6cc5-4be1-a68f-acd9c4110ca6 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:09.759619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3121/6246] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:14:09.766727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:14:09.769045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:09.922073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.004643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02e8fd-20a8-429c-a90e-7e47715fffe4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.011067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d25771bdd164eb6bdd83557dbf884ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72339a3e36b948f7b3fb35d097cdc7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.011067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.011067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.011431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.012308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorizing `identity:get_project(project_id=72339a3e36b948f7b3fb35d097cdc7b3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.014713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.016392 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3126/6247] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:14:09 2022] GET /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3 => generated 363 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:10.067044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52093b34-031d-477a-b33d-497e1caf9d7e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.068226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52093b34-031d-477a-b33d-497e1caf9d7e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.068620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52093b34-031d-477a-b33d-497e1caf9d7e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.070070 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3122/6248] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:14:10.075585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:14:10.100824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.114462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52093b34-031d-477a-b33d-497e1caf9d7e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.117247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-52093b34-031d-477a-b33d-497e1caf9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:10.136981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0dfea-81a1-463e-b1d7-d11d69139890 tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.147895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d25771bdd164eb6bdd83557dbf884ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72339a3e36b948f7b3fb35d097cdc7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.150296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.150664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.151043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.153368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorizing `identity:get_project(project_id=72339a3e36b948f7b3fb35d097cdc7b3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.161311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.164992 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3127/6249] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:14:10 2022] GET /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3 => generated 363 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:10.213392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.216655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:10.228845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52093b34-031d-477a-b33d-497e1caf9d7e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.235435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.236491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.237000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.237501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] PATH_INFO: `/v3/projects/e0413c72e86542c3a7df65d5830ffc27` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.239788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0413c72e86542c3a7df65d5830ffc27)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.241330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c4dac-7b14-40c5-b9bc-822a1995d00a tempest-QuotasTestJSON-826064441 tempest-QuotasTestJSON-826064441-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.242557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.247584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.247833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:10.248302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.248862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.249293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] PATH_INFO: `/v3/users/2d25771bdd164eb6bdd83557dbf884ec` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.250773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d25771bdd164eb6bdd83557dbf884ec)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.253495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.456725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d25771bdd164eb6bdd83557dbf884ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.464431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0413c72e86542c3a7df65d5830ffc27', 'request_id': 'req-cec9fd50-a54a-485a-9c23-aee02943e133'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.473261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0413c72e86542c3a7df65d5830ffc27', 'request_id': 'req-cec9fd50-a54a-485a-9c23-aee02943e133'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.486127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0413c72e86542c3a7df65d5830ffc27', 'request_id': 'req-cec9fd50-a54a-485a-9c23-aee02943e133'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.504359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d25771bdd164eb6bdd83557dbf884ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.507580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d25771bdd164eb6bdd83557dbf884ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.511843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d25771bdd164eb6bdd83557dbf884ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.541197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81b38a1b-77df-4600-8a24-3d9f34162c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d25771bdd164eb6bdd83557dbf884ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.597539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] The token cache is being invalidate because project e0413c72e86542c3a7df65d5830ffc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:10.597835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.599910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cec9fd50-a54a-485a-9c23-aee02943e133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:10.607990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3123/6250] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:10 2022] DELETE /identity/v3/projects/e0413c72e86542c3a7df65d5830ffc27 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:10.610771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8327b77-f360-4e5f-8549-5fa844d76241 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.611325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8327b77-f360-4e5f-8549-5fa844d76241 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.611826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8327b77-f360-4e5f-8549-5fa844d76241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.644149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d8327b77-f360-4e5f-8549-5fa844d76241 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:10.645379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8327b77-f360-4e5f-8549-5fa844d76241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:10.653998 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3128/6251] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:10 2022] DELETE /identity/v3/users/2d25771bdd164eb6bdd83557dbf884ec => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:14:10.660577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.661639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.662210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.690046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:10.691777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:10.771386 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3124/6252] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:10.775450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.776289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.776760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.814777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:10.816288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:10.818640 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3129/6253] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:10.830646 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3125/6254] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:10.839986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.840119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.841795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:10.858418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:10.860527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5c940-bee9-4919-b774-9df7e15ae422 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.868081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.873291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.873291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.873291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.873291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:10.873291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.873291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.891517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3126/6255] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:10.893992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:10.916868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c8147-35f5-448c-b391-ac04853dcb08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.926074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.926572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.928180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.928477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.929636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.932535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.951254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9aacf-2d91-4269-a41e-f226fa91174c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:10.955575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:10.956284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:10.963157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:10.963157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:10.968559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:10.970168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:10.982148 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3130/6256] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:11.075667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3127/6257] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:10 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:14:11.076220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:11.089167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1982b-129a-429c-8833-ed04adaf2ca0 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:11.157166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:11.157792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.158072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.158342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:11.158974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:11.160946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:11.317147 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3131/6258] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:11 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:14:11.318823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:11.337848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a443457-0685-4fd6-b993-63221015b30a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:11.345406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:11.346762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.347536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.347953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:11.349032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:11.352031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:11.372439 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3128/6259] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:14:11.377967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:11.396435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bfa98-7536-4d8f-93d6-572fd64aae5b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:11.404930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:11.406096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.406386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.406635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:11.407621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:11.409737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:11.421429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3132/6260] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:11.425710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:11.436250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e590b2-099a-4095-b40b-46b319b3790a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:11.441635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7d719-374a-4dfc-bf5f-21afedecc395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:11.443146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d719-374a-4dfc-bf5f-21afedecc395 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.443340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d719-374a-4dfc-bf5f-21afedecc395 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.444115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d719-374a-4dfc-bf5f-21afedecc395 admin admin] PATH_INFO: `/v3/projects/484053c22101496a920ce98bbc707f3d/users/a27aefd012a34168bf5e9e1b6d68195b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:11.462192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7d719-374a-4dfc-bf5f-21afedecc395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484053c22101496a920ce98bbc707f3d, user_id=a27aefd012a34168bf5e9e1b6d68195b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:11.464950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7d719-374a-4dfc-bf5f-21afedecc395 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:11.468951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:11.565855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:11.565855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:11.579793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107719d5-37fb-4f0e-9485-86631b8181fd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:11.599033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:11.599758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.600044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.600327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] PATH_INFO: `/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:11.601406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3129/6261] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:11 2022] PUT /identity/v3/projects/484053c22101496a920ce98bbc707f3d/users/a27aefd012a34168bf5e9e1b6d68195b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:14:11.602110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72339a3e36b948f7b3fb35d097cdc7b3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:11.606262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:11.606937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.607556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.607833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:11.649690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:11.655783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:11.779384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72339a3e36b948f7b3fb35d097cdc7b3', 'request_id': 'req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:11.800901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72339a3e36b948f7b3fb35d097cdc7b3', 'request_id': 'req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:11.808425 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3130/6262] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:11.820380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72339a3e36b948f7b3fb35d097cdc7b3', 'request_id': 'req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:11.825650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:11.828327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:11.921541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd03cc9-eb91-4809-b343-09a355acedf9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:11.947830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] The token cache is being invalidate because project 72339a3e36b948f7b3fb35d097cdc7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:11.948269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:11.960853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d5fd7665-16c8-4fd4-8a71-8493cc8fe987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:11.960853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3133/6263] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:11 2022] DELETE /identity/v3/projects/72339a3e36b948f7b3fb35d097cdc7b3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:14:11.962830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069829bb-50df-499f-9641-91f94d24be32 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:11.963306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069829bb-50df-499f-9641-91f94d24be32 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:11.963859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069829bb-50df-499f-9641-91f94d24be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.018419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-069829bb-50df-499f-9641-91f94d24be32 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:12.020114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-069829bb-50df-499f-9641-91f94d24be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.081489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.083242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.083671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.084087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.091217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.115920 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3134/6264] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:12.139866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.140224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.140455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.202524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:12.205183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.208084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.210175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.224426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3135/6265] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:12.231097 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3131/6266] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:14:12.231313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.242589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ce8e5-fba5-4102-a6c4-29302062c3c3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.249046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.249622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.249957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.250237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.251799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:12.252158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.254003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.288823 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3136/6267] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:12.293530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.323357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0925-6473-434d-b968-7ab033e36529 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.328635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.329262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.329542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.329817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.330449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.332681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.402329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.404130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.419069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d823bb-65d2-45d2-a277-50706c507ab5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.424242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.424869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.425147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.425430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] PATH_INFO: `/v3/users/cc99c9955f8a4a99a135fb0297256458` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.426604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc99c9955f8a4a99a135fb0297256458)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.429255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.498169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3132/6268] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:12 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:12.499422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.571324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0519c1-471a-412f-bd03-bb7fa3173352 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.576510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.577149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.577428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.577702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.578384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.580454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.753506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc99c9955f8a4a99a135fb0297256458'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:12.761002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc99c9955f8a4a99a135fb0297256458'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:12.761772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc99c9955f8a4a99a135fb0297256458'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:12.762390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc99c9955f8a4a99a135fb0297256458'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:12.778189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f36a31af-54c3-4226-a288-8f6d9335434b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc99c9955f8a4a99a135fb0297256458'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:12.792574 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3133/6269] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:12 2022] POST /identity/v3/users => generated 286 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:12.798023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.799908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.812599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd79b2-6a8d-4619-be75-a9d00b2a88e9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.818132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.818654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.818951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.819290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.819938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.821622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.833752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3134/6270] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:14:12.838237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.844162 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3137/6271] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:12 2022] DELETE /identity/v3/users/cc99c9955f8a4a99a135fb0297256458 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:14:12.849497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf0931-f658-4057-bfa7-b72aa76d2572 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.849657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.850068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.850578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.879043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:12.880521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.919733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.921035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.921382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.921730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.922744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.924494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:12.939194 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3135/6272] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:14:12.940916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.953239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795130-8fa5-4fdf-81d6-6464ad4281d1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:12.955774 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3138/6273] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:12.960859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfac4a-d036-4850-9e36-cf230a38f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:12.961954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfac4a-d036-4850-9e36-cf230a38f392 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:12.961954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfac4a-d036-4850-9e36-cf230a38f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:12.962279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfac4a-d036-4850-9e36-cf230a38f392 admin admin] PATH_INFO: `/v3/projects/041b07c4e3dd4a88b18646126981b420/users/8c33476cb26f4a2fb575cdcd03e97269/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:12.963397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:12.972133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:12.973707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:12.986618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfac4a-d036-4850-9e36-cf230a38f392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041b07c4e3dd4a88b18646126981b420, user_id=8c33476cb26f4a2fb575cdcd03e97269, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:12.988550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfac4a-d036-4850-9e36-cf230a38f392 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:13.043500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68c861-50ac-4df5-a14d-611c29ac4b82 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:13.048199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3136/6274] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:12 2022] PUT /identity/v3/projects/041b07c4e3dd4a88b18646126981b420/users/8c33476cb26f4a2fb575cdcd03e97269/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:13.063772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:13.067037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:13.067037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:13.103635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] MFA Rules not processed for user `8c33476cb26f4a2fb575cdcd03e97269`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:13.105295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:13.122761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a576c5-bb37-442a-8bca-42cbdec29832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:13.123524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a576c5-bb37-442a-8bca-42cbdec29832 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:13.123843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a576c5-bb37-442a-8bca-42cbdec29832 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:13.124120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a576c5-bb37-442a-8bca-42cbdec29832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:13.129260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:13.201979 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3137/6275] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:13.215849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:13.218279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:13.238590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a576c5-bb37-442a-8bca-42cbdec29832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:13.244097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a576c5-bb37-442a-8bca-42cbdec29832 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:13.274657 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3139/6276] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:14:13.373256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bdb1-2da3-4b33-8e18-21189b229a1f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:13.381652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:13.384221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:13.384221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:13.384221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:13.395196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:13.397103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:13.409853 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3138/6277] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:14:13.689124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:13.689124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:13.689124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:13.718700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:13.725468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:13.795532 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3140/6278] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:14.395434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:14.398105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:14.413898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906cd5-05e5-425a-890a-67d9570ce229 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:14.419273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:14.420135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:14.420236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:14.420512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] PATH_INFO: `/v3/projects/bc5fd6f35048487aa2d3f22415a288a1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:14.421670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5fd6f35048487aa2d3f22415a288a1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:14.424381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:14.551530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:14.597799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5fd6f35048487aa2d3f22415a288a1', 'request_id': 'req-773cdd20-9af3-496d-b7df-30a76002f202'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:14.608998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5fd6f35048487aa2d3f22415a288a1', 'request_id': 'req-773cdd20-9af3-496d-b7df-30a76002f202'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:14.619699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5fd6f35048487aa2d3f22415a288a1', 'request_id': 'req-773cdd20-9af3-496d-b7df-30a76002f202'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:14.650966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:14.726101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] The token cache is being invalidate because project bc5fd6f35048487aa2d3f22415a288a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:14.726486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:14.728539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:14.733129 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3139/6279] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:14 2022] DELETE /identity/v3/projects/bc5fd6f35048487aa2d3f22415a288a1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:14.734692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:14.766028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830f60-17e3-40fb-8e74-2914dd853a15 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:14.907899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:14.907899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:14.907899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:14.907899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] PATH_INFO: `/v3/users/f00de9f06a9b4558a6ecf30dfff17831` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:14.908691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00de9f06a9b4558a6ecf30dfff17831)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:14.920615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:15.227577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00de9f06a9b4558a6ecf30dfff17831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:15.247384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00de9f06a9b4558a6ecf30dfff17831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:15.248239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00de9f06a9b4558a6ecf30dfff17831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:15.248907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00de9f06a9b4558a6ecf30dfff17831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:15.268818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a2f12ead-9178-4cd2-99e7-081f1009ca46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00de9f06a9b4558a6ecf30dfff17831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:15.492461 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3141/6280] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:14 2022] DELETE /identity/v3/users/f00de9f06a9b4558a6ecf30dfff17831 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:15.855170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:15.856816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:15.880315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cdd20-9af3-496d-b7df-30a76002f202 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:16.050881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:16.050881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:16.050881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:16.050881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] PATH_INFO: `/v3/projects/507f3004a3894af0bc0ea27d8d6bdfbb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:16.053853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507f3004a3894af0bc0ea27d8d6bdfbb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:16.053853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:16.346313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507f3004a3894af0bc0ea27d8d6bdfbb', 'request_id': 'req-37704795-0226-47ed-ac01-e25a22644753'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:16.353772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507f3004a3894af0bc0ea27d8d6bdfbb', 'request_id': 'req-37704795-0226-47ed-ac01-e25a22644753'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:16.360828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507f3004a3894af0bc0ea27d8d6bdfbb', 'request_id': 'req-37704795-0226-47ed-ac01-e25a22644753'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:16.568060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] The token cache is being invalidate because project 507f3004a3894af0bc0ea27d8d6bdfbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:16.568597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:16.569622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-37704795-0226-47ed-ac01-e25a22644753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:16.571238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3140/6281] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:15 2022] DELETE /identity/v3/projects/507f3004a3894af0bc0ea27d8d6bdfbb => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:16.580523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:16.580523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:16.580523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:16.598084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:16.600172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:16.668732 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3142/6282] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:16.678587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:16.679121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:16.679402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:16.685205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:16.702983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:16.704487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:16.713467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3141/6283] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:16.724082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:16.733237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79859249-f012-4e2a-84b2-45981ea0f8f5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:16.740304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:16.740924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:16.741211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:16.741487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:16.742141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:16.742448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:16.744159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:16.756964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3143/6284] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:16.766456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:16.776495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7c3a9-16c9-45ca-b25a-4f206275159f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:16.781666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:16.782274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:16.782557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:16.782835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:16.783512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:16.785457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:16.908240 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3142/6285] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:16 2022] POST /identity/v3/projects => generated 397 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:16.913020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:16.925671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039b86-f123-471a-bb10-b705fbb660f2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:17.027889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:17.027889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:17.027889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:17.027889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:17.028452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:17.030962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:17.127726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3144/6286] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:16 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:14:17.128683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:17.148802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77a68-7848-41d7-aa56-f5f784082d1f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:17.154933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:17.159971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:17.159971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:17.159971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:17.159971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:17.159971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:17.192834 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3143/6287] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:17.199405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:17.225649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4af8a-9cee-45a7-ba8e-2e28b7ea1729 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:17.232736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091db01d-5112-4130-9063-2fee44b7f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:17.233567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091db01d-5112-4130-9063-2fee44b7f018 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:17.234140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091db01d-5112-4130-9063-2fee44b7f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:17.234634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091db01d-5112-4130-9063-2fee44b7f018 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:17.235571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091db01d-5112-4130-9063-2fee44b7f018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:17.237756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091db01d-5112-4130-9063-2fee44b7f018 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:17.267889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3145/6288] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:17.275045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:17.291056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df904-c8aa-46b7-8299-9b684d847e76 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:17.300208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:17.302488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:17.304031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:17.317097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] PATH_INFO: `/v3/projects/2e1f1441ef334a89aac3ae19326d528c/users/448f4ea270994374ace848e8dd4f6a3e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:17.338223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1f1441ef334a89aac3ae19326d528c, user_id=448f4ea270994374ace848e8dd4f6a3e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:17.344937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:17.511537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3144/6289] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:17 2022] PUT /identity/v3/projects/2e1f1441ef334a89aac3ae19326d528c/users/448f4ea270994374ace848e8dd4f6a3e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:17.532954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:17.532954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:17.532954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:17.574383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] MFA Rules not processed for user `448f4ea270994374ace848e8dd4f6a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:17.578419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:17.642367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:17.703995 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3146/6290] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:17.764717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:17.766678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:17.882926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158010cb-643e-464e-9104-8789057fea6a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:17.887079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84de74-41b2-4925-996f-cc1dfe2f3284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:17.887889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84de74-41b2-4925-996f-cc1dfe2f3284 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:17.888766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84de74-41b2-4925-996f-cc1dfe2f3284 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:17.889121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84de74-41b2-4925-996f-cc1dfe2f3284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:17.903236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84de74-41b2-4925-996f-cc1dfe2f3284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:17.905006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84de74-41b2-4925-996f-cc1dfe2f3284 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:17.934902 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3145/6291] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:19.356864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:20.048802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:21.033401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:22.052327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:22.055304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:22.226565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa922f-0141-4d56-a797-51252e6b23e0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:22.230534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:22.232287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:22.238567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:22.239374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] PATH_INFO: `/v3/users/8c33476cb26f4a2fb575cdcd03e97269` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:22.241264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c33476cb26f4a2fb575cdcd03e97269)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:22.243634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:22.508915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c33476cb26f4a2fb575cdcd03e97269'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:22.534549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c33476cb26f4a2fb575cdcd03e97269'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:22.536812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c33476cb26f4a2fb575cdcd03e97269'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:22.537686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c33476cb26f4a2fb575cdcd03e97269'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:22.581085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c33476cb26f4a2fb575cdcd03e97269'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:22.649486 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3147/6292] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:22 2022] DELETE /identity/v3/users/8c33476cb26f4a2fb575cdcd03e97269 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:22.654255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398e675-3a45-4537-963f-f2731799a06a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:22.654758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398e675-3a45-4537-963f-f2731799a06a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:22.654856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398e675-3a45-4537-963f-f2731799a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:22.676236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5398e675-3a45-4537-963f-f2731799a06a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:22.677704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5398e675-3a45-4537-963f-f2731799a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:22.751883 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3146/6293] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:22.767439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:22.773004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:22.973563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc76dc-0b5f-40f5-8add-ca88220ebf9f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:22.980946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c65201-8366-4979-89ed-431225881b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:22.981867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65201-8366-4979-89ed-431225881b27 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:22.981867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65201-8366-4979-89ed-431225881b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:22.982152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65201-8366-4979-89ed-431225881b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:23.002741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c65201-8366-4979-89ed-431225881b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:23.003902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c65201-8366-4979-89ed-431225881b27 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:23.027133 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3148/6294] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:23.397755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:24.192760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398e675-3a45-4537-963f-f2731799a06a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:24.194471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5398e675-3a45-4537-963f-f2731799a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:24.220141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398e675-3a45-4537-963f-f2731799a06a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:24.226631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:24.231488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:24.231488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:24.231488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] PATH_INFO: `/v3/projects/041b07c4e3dd4a88b18646126981b420` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:24.231488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=041b07c4e3dd4a88b18646126981b420)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:24.239856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:24.427563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041b07c4e3dd4a88b18646126981b420', 'request_id': 'req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:24.434180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041b07c4e3dd4a88b18646126981b420', 'request_id': 'req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:24.440689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041b07c4e3dd4a88b18646126981b420', 'request_id': 'req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:24.555410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] The token cache is being invalidate because project 041b07c4e3dd4a88b18646126981b420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:24.555410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:24.555410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4ab0fb7a-1a04-4a20-8e2d-a5861043e87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:24.557135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3147/6295] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:24 2022] DELETE /identity/v3/projects/041b07c4e3dd4a88b18646126981b420 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:24.562530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:24.563973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:24.567757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:24.622266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:24.624355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:24.715686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3149/6296] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:24.724083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:24.724431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:24.724754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:24.747826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:24.750177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:24.761728 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3148/6297] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:24.767947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:24.783943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813e3c1-d320-4249-876b-97ef06ea78b3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:24.790772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:24.791471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:24.791755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:24.792028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:24.792684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:24.792984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:24.795484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:24.810504 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3150/6298] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:24.814886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:24.820216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:24.825904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218b809-f796-4055-8ba8-4bbe81ff5dcf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:24.834740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:24.835403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:24.835687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:24.836818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:24.837658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:24.840398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:24.960610 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3149/6299] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:24 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:24.965239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:24.985135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7924-9ec9-4f89-817c-fb7137b161bd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:25.082159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:25.082989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:25.083501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:25.083857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:25.084729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:25.086983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:25.178942 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3151/6300] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:24 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:25.180331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:25.206033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb63e3-6688-4d07-b39d-ccadb55cd5ea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:25.219605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:25.220557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:25.221016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:25.221475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:25.222296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:25.225539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:25.243424 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3150/6301] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:14:25.246491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:25.260906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aaea8-0db7-4135-b876-3e6b7aa0b1a0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:25.268263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff51174-f82c-4941-9ce1-7875ddb820f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:25.269270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff51174-f82c-4941-9ce1-7875ddb820f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:25.269638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff51174-f82c-4941-9ce1-7875ddb820f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:25.270539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff51174-f82c-4941-9ce1-7875ddb820f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:25.279607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff51174-f82c-4941-9ce1-7875ddb820f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:25.281571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff51174-f82c-4941-9ce1-7875ddb820f7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:25.304953 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3152/6302] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:25.307033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:25.319515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d715449-8901-43e1-aa4e-f2db075854af admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:25.336665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:25.336665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:25.336987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:25.337799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] PATH_INFO: `/v3/projects/f629267070cc4308b78648f7e77115ce/users/2df22ffde8d441e89515b1af1856bac3/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:25.386608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f629267070cc4308b78648f7e77115ce, user_id=2df22ffde8d441e89515b1af1856bac3, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:25.391460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:25.534902 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3151/6303] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:25 2022] PUT /identity/v3/projects/f629267070cc4308b78648f7e77115ce/users/2df22ffde8d441e89515b1af1856bac3/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:25.538374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ddd12-7004-44db-ab7d-ea9b5bbd737f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:25.538890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ddd12-7004-44db-ab7d-ea9b5bbd737f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:25.539360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ddd12-7004-44db-ab7d-ea9b5bbd737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:25.578945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c98ddd12-7004-44db-ab7d-ea9b5bbd737f None None] MFA Rules not processed for user `2df22ffde8d441e89515b1af1856bac3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:25.580354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c98ddd12-7004-44db-ab7d-ea9b5bbd737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:25.623718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:25.735058 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3153/6304] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:25.748894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:25.750657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:25.873508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d665d-e35a-4629-b1d7-78724e534671 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:25.881467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:25.882240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:25.882633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:25.883093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:25.915658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:25.917300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:25.946701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3152/6305] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:27.418626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ab909-06a8-4387-bc18-0a6192ed4932 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:27.419574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ab909-06a8-4387-bc18-0a6192ed4932 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:27.421685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ab909-06a8-4387-bc18-0a6192ed4932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:27.460559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c98ab909-06a8-4387-bc18-0a6192ed4932 None None] MFA Rules not processed for user `a27aefd012a34168bf5e9e1b6d68195b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:27.462200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c98ab909-06a8-4387-bc18-0a6192ed4932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:27.604034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3154/6306] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:27.624810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:27.627279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:27.841694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085389-62eb-4a2c-872f-48b03d958f4f service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:27.853457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15facd9d-d09f-49d8-8690-e3531cef51fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:27.855396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15facd9d-d09f-49d8-8690-e3531cef51fd service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:27.855720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15facd9d-d09f-49d8-8690-e3531cef51fd service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:27.855962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15facd9d-d09f-49d8-8690-e3531cef51fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:27.875554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15facd9d-d09f-49d8-8690-e3531cef51fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:27.877736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15facd9d-d09f-49d8-8690-e3531cef51fd service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:27.893998 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3153/6307] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:34.355374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8036-1203-4227-9aeb-9b4aed431bd9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:34.356376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8036-1203-4227-9aeb-9b4aed431bd9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:34.357087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8036-1203-4227-9aeb-9b4aed431bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:34.383199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4a1b8036-1203-4227-9aeb-9b4aed431bd9 None None] MFA Rules not processed for user `a27aefd012a34168bf5e9e1b6d68195b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:34.384107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4a1b8036-1203-4227-9aeb-9b4aed431bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:34.392749 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3155/6308] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:37.886971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:42.618049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:42.618686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:42.618940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:42.684559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] MFA Rules not processed for user `9d49264c495645f38d17ceb03a43195f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:42.688340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:42.852269 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3154/6309] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:43.760338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50e7a-1586-41ad-a44e-2fa8b6a88e1c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:43.760338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50e7a-1586-41ad-a44e-2fa8b6a88e1c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:43.760338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50e7a-1586-41ad-a44e-2fa8b6a88e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:43.809020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a1f50e7a-1586-41ad-a44e-2fa8b6a88e1c None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:43.810723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a1f50e7a-1586-41ad-a44e-2fa8b6a88e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:43.966447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3156/6310] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:47.619500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:47.621128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:47.815314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce829e-9a37-45ba-bf87-c18bf37e2dfd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:47.821093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:47.822563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:47.822850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:47.823401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] PATH_INFO: `/v3/users/448f4ea270994374ace848e8dd4f6a3e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:47.826679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] RBAC: Authorizing `identity:delete_user(user_id=448f4ea270994374ace848e8dd4f6a3e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:47.829180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:48.172843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448f4ea270994374ace848e8dd4f6a3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:48.178406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:48.180332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448f4ea270994374ace848e8dd4f6a3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:48.181148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448f4ea270994374ace848e8dd4f6a3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:48.194283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448f4ea270994374ace848e8dd4f6a3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:48.195114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448f4ea270994374ace848e8dd4f6a3e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:48.352343 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3155/6311] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:47 2022] DELETE /identity/v3/users/448f4ea270994374ace848e8dd4f6a3e => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:48.357173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590f6a-0263-44f1-9efc-56ab70031e59 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:48.357730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590f6a-0263-44f1-9efc-56ab70031e59 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:48.357730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590f6a-0263-44f1-9efc-56ab70031e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:48.389430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:48.394467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e9590f6a-0263-44f1-9efc-56ab70031e59 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:48.396532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e9590f6a-0263-44f1-9efc-56ab70031e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:48.471240 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3157/6312] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:48.480148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:48.481649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:48.599788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5459e9-5fbd-48fe-b0ea-e8b8d991246e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:48.607973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:48.608711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:48.609001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:48.609432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:48.623747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:48.624455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:48.647252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3156/6313] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:49.322930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac5cc-86d9-4847-a6e5-83a1d303fefe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:49.327400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac5cc-86d9-4847-a6e5-83a1d303fefe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:49.327400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac5cc-86d9-4847-a6e5-83a1d303fefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:49.347640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-28fac5cc-86d9-4847-a6e5-83a1d303fefe None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:49.349326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28fac5cc-86d9-4847-a6e5-83a1d303fefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:49.438235 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3158/6314] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:49.478809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:49.480342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:49.515317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba6e3a-ac1c-44e9-8c23-a6b225272949 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:49.520037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:49.520525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:49.522188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:49.522188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] PATH_INFO: `/v3/projects/2e1f1441ef334a89aac3ae19326d528c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:49.523113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1f1441ef334a89aac3ae19326d528c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:49.528095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:49.725370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1f1441ef334a89aac3ae19326d528c', 'request_id': 'req-c525a26d-4678-4183-8c22-7efb1b5ae962'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:49.748352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1f1441ef334a89aac3ae19326d528c', 'request_id': 'req-c525a26d-4678-4183-8c22-7efb1b5ae962'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:49.758235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1f1441ef334a89aac3ae19326d528c', 'request_id': 'req-c525a26d-4678-4183-8c22-7efb1b5ae962'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:49.928913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] The token cache is being invalidate because project 2e1f1441ef334a89aac3ae19326d528c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:49.931480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:49.932538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c525a26d-4678-4183-8c22-7efb1b5ae962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:49.938491 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3157/6315] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:49 2022] DELETE /identity/v3/projects/2e1f1441ef334a89aac3ae19326d528c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:49.943545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:49.943830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:49.944955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.052511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:50.054116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:50.204291 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3159/6316] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:50.211183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:50.211485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:50.211771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.257903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:50.257903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:50.264948 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3158/6317] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:50.269387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:50.279840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9e1b4-8a7d-45ad-b223-97d1e908115e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:50.286656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:50.291818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:50.291818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:50.291818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.291818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:50.291818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:50.291818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:50.305534 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3160/6318] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:50.310606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:50.321999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b764-fa97-4309-b96d-e6bf0018bb8f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:50.329096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:50.329580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:50.329872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:50.330159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.330811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:50.333796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:50.367968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:50.532455 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3159/6319] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:50 2022] POST /identity/v3/projects => generated 361 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:50.538642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:50.564847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2bfb6-efde-464c-82bb-ccf571686b9e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:50.586307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:50.672450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:50.672450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:50.672450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:50.672450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.673110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:50.673110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:50.854110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3161/6320] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:50 2022] POST /identity/v3/users => generated 281 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:50.857545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:50.874028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c945c-769a-4041-9a97-4eacdbd04bec admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:50.887828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:50.888838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:50.889625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:50.890288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.891649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:50.894266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:50.917671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3160/6321] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:50.926536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:50.939692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8cf0-955d-48c4-885e-ccc52db9cedd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:50.948452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57ace-f183-41c3-922e-fc2cc4268c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:50.949181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57ace-f183-41c3-922e-fc2cc4268c46 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:50.949467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57ace-f183-41c3-922e-fc2cc4268c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:50.949744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57ace-f183-41c3-922e-fc2cc4268c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:50.966374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57ace-f183-41c3-922e-fc2cc4268c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:50.968213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57ace-f183-41c3-922e-fc2cc4268c46 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:50.998533 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3162/6322] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:51.001679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:51.033633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6701a-4690-4154-be4f-a2912d1a5f3c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:51.047844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:51.048814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:51.049081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:51.049429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] PATH_INFO: `/v3/projects/36423ada893145ba9751e28c63ac2942/users/b69f87914d26428a9c4895f47a3cb4b0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:51.071863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36423ada893145ba9751e28c63ac2942, user_id=b69f87914d26428a9c4895f47a3cb4b0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:51.074784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:51.245165 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3161/6323] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:51 2022] PUT /identity/v3/projects/36423ada893145ba9751e28c63ac2942/users/b69f87914d26428a9c4895f47a3cb4b0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:51.255762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecdb18-62ac-48fb-9ff7-48dfd5e6e436 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:51.256642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecdb18-62ac-48fb-9ff7-48dfd5e6e436 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:51.257423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecdb18-62ac-48fb-9ff7-48dfd5e6e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:51.302266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-04ecdb18-62ac-48fb-9ff7-48dfd5e6e436 None None] MFA Rules not processed for user `b69f87914d26428a9c4895f47a3cb4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:51.303820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-04ecdb18-62ac-48fb-9ff7-48dfd5e6e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:51.388061 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3163/6324] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:51.398195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:51.399982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:51.488779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f7d5-02d3-4d80-8d29-8c96b42d761e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:51.493072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd389a9-a0cf-463f-8df9-88c840452c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:51.493823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd389a9-a0cf-463f-8df9-88c840452c78 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:51.494119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd389a9-a0cf-463f-8df9-88c840452c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:51.494494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd389a9-a0cf-463f-8df9-88c840452c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:51.505229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd389a9-a0cf-463f-8df9-88c840452c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:51.506955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd389a9-a0cf-463f-8df9-88c840452c78 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:51.517937 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3162/6325] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:53.325497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074bd6a-3721-4c82-90df-4afbb457a6ac None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:53.326056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074bd6a-3721-4c82-90df-4afbb457a6ac None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:53.326056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074bd6a-3721-4c82-90df-4afbb457a6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:53.348720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5074bd6a-3721-4c82-90df-4afbb457a6ac None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:53.349958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5074bd6a-3721-4c82-90df-4afbb457a6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:53.421239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3164/6326] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:53.877016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:53.877943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:53.878413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:53.901034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:53.902537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:53.913992 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3163/6327] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:14:54.641032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e8cda-e7ab-4cb5-8df1-797a2bc47dcd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:54.642157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e8cda-e7ab-4cb5-8df1-797a2bc47dcd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:54.642714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e8cda-e7ab-4cb5-8df1-797a2bc47dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:54.710085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f87e8cda-e7ab-4cb5-8df1-797a2bc47dcd None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:54.717383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f87e8cda-e7ab-4cb5-8df1-797a2bc47dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:54.728560 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3165/6328] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:55.386907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:55.391312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:55.537790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19545-6fa1-41e1-939b-826f13e43973 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:55.548849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:55.549865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:55.550957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:55.551286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] PATH_INFO: `/v3/users/2df22ffde8d441e89515b1af1856bac3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:55.554085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df22ffde8d441e89515b1af1856bac3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:55.557532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:55.860122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df22ffde8d441e89515b1af1856bac3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:55.884177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee2ed-a8ee-479b-9f50-ef67e0e8eeda None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:55.885135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee2ed-a8ee-479b-9f50-ef67e0e8eeda None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:55.885577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee2ed-a8ee-479b-9f50-ef67e0e8eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:55.891921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df22ffde8d441e89515b1af1856bac3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:55.896631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df22ffde8d441e89515b1af1856bac3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:55.899040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:55.913773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b50ee2ed-a8ee-479b-9f50-ef67e0e8eeda None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:55.915759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b50ee2ed-a8ee-479b-9f50-ef67e0e8eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:55.934111 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3166/6329] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:55.936586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df22ffde8d441e89515b1af1856bac3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:55.956558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df22ffde8d441e89515b1af1856bac3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:56.116031 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3164/6330] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:14:55 2022] DELETE /identity/v3/users/2df22ffde8d441e89515b1af1856bac3 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:56.123542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a6d3-d64f-4159-a849-109e05e6fea2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:56.124348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a6d3-d64f-4159-a849-109e05e6fea2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:56.124876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5a6d3-d64f-4159-a849-109e05e6fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:56.156253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-28e5a6d3-d64f-4159-a849-109e05e6fea2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:56.157909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-28e5a6d3-d64f-4159-a849-109e05e6fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:56.172488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:56.267825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3167/6331] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:56.326644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:56.331215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:56.478364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d33219-cd94-4b58-a60e-5fa56c63a829 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:56.490595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:56.491258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:56.491593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:56.491942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:56.508390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:56.518471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:56.522397 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3165/6332] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:14:56.863380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccb0a1-2155-44fe-bde1-e5b580b7764a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:56.872977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccb0a1-2155-44fe-bde1-e5b580b7764a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:56.872977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccb0a1-2155-44fe-bde1-e5b580b7764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:56.889763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-94ccb0a1-2155-44fe-bde1-e5b580b7764a None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:56.891949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-94ccb0a1-2155-44fe-bde1-e5b580b7764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:57.001147 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3168/6333] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:57.731807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:57.734849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:57.769958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52131-8434-47d8-a121-4d436b34de7c service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:57.777412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:57.778657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:57.779267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:57.779645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] PATH_INFO: `/v3/projects/f629267070cc4308b78648f7e77115ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:57.780945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f629267070cc4308b78648f7e77115ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:57.783382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:57.955932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f629267070cc4308b78648f7e77115ce', 'request_id': 'req-9c1302ac-ca69-4ad9-af95-ea2495561922'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:57.970170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f629267070cc4308b78648f7e77115ce', 'request_id': 'req-9c1302ac-ca69-4ad9-af95-ea2495561922'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:57.982322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f629267070cc4308b78648f7e77115ce', 'request_id': 'req-9c1302ac-ca69-4ad9-af95-ea2495561922'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:58.078261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] The token cache is being invalidate because project f629267070cc4308b78648f7e77115ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:14:58.079315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:58.080228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9c1302ac-ca69-4ad9-af95-ea2495561922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:14:58.085994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3166/6334] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:14:57 2022] DELETE /identity/v3/projects/f629267070cc4308b78648f7e77115ce => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:58.087660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd603b3-4f67-4161-b241-2e7ef612be47 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.088156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd603b3-4f67-4161-b241-2e7ef612be47 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.088156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd603b3-4f67-4161-b241-2e7ef612be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.127577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7dd603b3-4f67-4161-b241-2e7ef612be47 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:58.131233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7dd603b3-4f67-4161-b241-2e7ef612be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:58.247598 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3169/6335] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:58.263178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.263696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.264136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.289665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:58.291254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:58.300304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.300965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.303469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.304636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3167/6336] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:58.305862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:58.317031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e7be9-860d-41b0-9bd3-5032be14282b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:58.325131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:58.325131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.325131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.325522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.327071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:14:58.327569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:58.329402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:58.355428 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3168/6337] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:14:58.356554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:58.359386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:58.364106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:58.379673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a213aa-d125-441c-9672-a387797fd88e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:58.395567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:58.396527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.397412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.398055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.398892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:58.401067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:58.497538 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3170/6338] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:58.570380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:58.572262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3169/6339] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:58 2022] POST /identity/v3/projects => generated 401 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:58.592081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc466-b988-463c-ae6d-c457ba4119a9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:58.602658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:58.738155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:58.740341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.740875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.741346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.742008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:58.744908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:58.918118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3171/6340] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:58 2022] POST /identity/v3/users => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:14:58.921710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:58.942662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93adaf-0ef7-4c8d-86ee-7012f205d172 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:58.951544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:58.952748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:58.953269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:58.954009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:58.955650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:58.960575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:58.980312 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3170/6341] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:58.984306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:58.997334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ece1b-65cd-4857-84bb-fff71193ec13 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:59.004039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6c966-85aa-46db-947b-2434417bf3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:59.004873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6c966-85aa-46db-947b-2434417bf3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.005166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6c966-85aa-46db-947b-2434417bf3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.005448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6c966-85aa-46db-947b-2434417bf3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.006383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6c966-85aa-46db-947b-2434417bf3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:59.010182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6c966-85aa-46db-947b-2434417bf3f3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:59.035879 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3172/6342] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:14:59.038124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:59.068036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fdd1-9317-459a-8634-447b6feb5137 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.068628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fdd1-9317-459a-8634-447b6feb5137 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.069242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fdd1-9317-459a-8634-447b6feb5137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.070279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea6df6-aaf1-4446-9d1e-a1fec2d5585e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:59.078854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:59.079598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.079934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.080216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] PATH_INFO: `/v3/projects/d2e3404fe7ac4a889c2b9f30f887000d/users/44974d6b18604ea3b9445e8ef2cef587/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.084315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:59.104152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-21a6fdd1-9317-459a-8634-447b6feb5137 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:59.105442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e3404fe7ac4a889c2b9f30f887000d, user_id=44974d6b18604ea3b9445e8ef2cef587, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:59.106529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21a6fdd1-9317-459a-8634-447b6feb5137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:59.113300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:59.187431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3173/6343] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:59.215536 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3171/6344] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:14:59 2022] PUT /identity/v3/projects/d2e3404fe7ac4a889c2b9f30f887000d/users/44974d6b18604ea3b9445e8ef2cef587/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:14:59.232272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.232563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.232843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.276728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] MFA Rules not processed for user `44974d6b18604ea3b9445e8ef2cef587`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:14:59.278339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:14:59.417256 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3174/6345] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:14:59.424560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:59.543586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41794611-bdab-4d75-b213-3fcf38d4b6a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:59.548769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:59.549534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.550576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.550576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.551832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:59.554078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:59.644059 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3172/6346] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:14:59 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:14:59.647844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:59.662670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650991c-0e08-45db-a08b-e06b22b67340 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:59.685069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:14:59.745835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:59.746634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.747076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.747467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.748235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:59.750499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:14:59.936174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3175/6347] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:14:59 2022] POST /identity/v3/users => generated 308 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:14:59.941928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:14:59.959846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849a75-9a94-4f13-8082-5daadee8d54e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:14:59.978715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:14:59.979443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:14:59.979729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:14:59.980021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:14:59.980860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:14:59.982918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:00.014605 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3173/6348] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:00.018747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:00.052587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a81d3-18c7-44a8-aa1a-cf99f92f1c3e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:00.052587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d44789-9fb7-4090-9e34-eaba5e1f4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:00.052587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44789-9fb7-4090-9e34-eaba5e1f4858 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.052587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44789-9fb7-4090-9e34-eaba5e1f4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.053076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44789-9fb7-4090-9e34-eaba5e1f4858 admin admin] PATH_INFO: `/v3/projects/9373fba025d54bcfbf83d23027c2af9c/users/76e3016b1f394a648f34f2e9390b5069/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.083453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d44789-9fb7-4090-9e34-eaba5e1f4858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9373fba025d54bcfbf83d23027c2af9c, user_id=76e3016b1f394a648f34f2e9390b5069, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:00.089114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d44789-9fb7-4090-9e34-eaba5e1f4858 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:00.245325 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3176/6349] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:00 2022] PUT /identity/v3/projects/9373fba025d54bcfbf83d23027c2af9c/users/76e3016b1f394a648f34f2e9390b5069/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:00.250514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:00.262379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26507e6c-388c-4163-9875-2d3165c0f8fc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:00.318800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.319838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.320290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.355438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:00.357877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:00.391992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:00.392626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.392949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.393218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.393887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:00.404981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:00.417917 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3174/6350] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:00.422760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:00.436258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6096-00fe-4b89-a55b-9c0ba2075a16 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:00.443208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97f590-7564-40e1-a492-b9669cda889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:00.445520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f590-7564-40e1-a492-b9669cda889a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.445822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f590-7564-40e1-a492-b9669cda889a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.446103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97f590-7564-40e1-a492-b9669cda889a admin admin] PATH_INFO: `/v3/projects/9373fba025d54bcfbf83d23027c2af9c/users/76e3016b1f394a648f34f2e9390b5069/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.454644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97f590-7564-40e1-a492-b9669cda889a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9373fba025d54bcfbf83d23027c2af9c, user_id=76e3016b1f394a648f34f2e9390b5069, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:00.459684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97f590-7564-40e1-a492-b9669cda889a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:00.489083 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3175/6351] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:00 2022] PUT /identity/v3/projects/9373fba025d54bcfbf83d23027c2af9c/users/76e3016b1f394a648f34f2e9390b5069/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:00.496998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.496998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.496998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.534652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3177/6352] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:00.540821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] MFA Rules not processed for user `76e3016b1f394a648f34f2e9390b5069`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:00.542742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:00.694774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3176/6353] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:00.701421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:00.828936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af1a-c0a3-47c7-8e7a-1d180a83dc67 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:00.837153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76e3016b1f394a648f34f2e9390b5069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9373fba025d54bcfbf83d23027c2af9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:00.837153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.837153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.837756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.838786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:00.841796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:00.961853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3178/6354] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:15:00 2022] POST /identity/v3/roles => generated 240 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:00.966968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:00.978584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9695-f327-4d99-8dd1-847dca71a916 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:00.983816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b506861-9cd1-4798-9b74-75ad17ae5157 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76e3016b1f394a648f34f2e9390b5069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9373fba025d54bcfbf83d23027c2af9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:00.984570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506861-9cd1-4798-9b74-75ad17ae5157 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:00.984858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506861-9cd1-4798-9b74-75ad17ae5157 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:00.985161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506861-9cd1-4798-9b74-75ad17ae5157 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] PATH_INFO: `/v3/projects/d2e3404fe7ac4a889c2b9f30f887000d/users/44974d6b18604ea3b9445e8ef2cef587/roles/c9663208c1ba4446b637c2e3b085437d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:00.987652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b506861-9cd1-4798-9b74-75ad17ae5157 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d2e3404fe7ac4a889c2b9f30f887000d, user_id=44974d6b18604ea3b9445e8ef2cef587, role_id=c9663208c1ba4446b637c2e3b085437d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:00.990776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b506861-9cd1-4798-9b74-75ad17ae5157 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:01.075314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:01.075763 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3177/6355] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:00 2022] PUT /identity/v3/projects/d2e3404fe7ac4a889c2b9f30f887000d/users/44974d6b18604ea3b9445e8ef2cef587/roles/c9663208c1ba4446b637c2e3b085437d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:01.171043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:01.215862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57bcf-73d0-42dd-8b22-fef4bf2dad0e tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:01.288538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:01.327344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44974d6b18604ea3b9445e8ef2cef587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e3404fe7ac4a889c2b9f30f887000d', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1252401296', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:01.328662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:01.329301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:01.329928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] PATH_INFO: `/v3/users/44974d6b18604ea3b9445e8ef2cef587/application_credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:01.330940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] RBAC: Authorizing `identity:create_application_credential(user_id=44974d6b18604ea3b9445e8ef2cef587)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:01.332535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:01.509503 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3179/6356] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Sep 6 11:15:01 2022] POST /identity/v3/users/44974d6b18604ea3b9445e8ef2cef587/application_credentials => generated 660 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:01.515668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:01.516099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:01.516607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:01.548047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] MFA Rules not processed for user `44974d6b18604ea3b9445e8ef2cef587`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:01.550123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:01.715171 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3178/6357] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:01 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Sep 06 11:15:01.719240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:01.736334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cda90-9f4c-480f-8615-a05176a7c515 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:01.757783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44974d6b18604ea3b9445e8ef2cef587', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2e3404fe7ac4a889c2b9f30f887000d', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1252401296', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:01.759779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:01.760149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:01.761073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] PATH_INFO: `/v3/users/44974d6b18604ea3b9445e8ef2cef587/application_credentials/8742006519604380b002e69be9737dff` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:01.762755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=44974d6b18604ea3b9445e8ef2cef587, application_credential_id=8742006519604380b002e69be9737dff)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:01.765539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:01.894101 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3180/6358] 10.222.0.20 () {58 vars in 1395 bytes} [Tue Sep 6 11:15:01 2022] DELETE /identity/v3/users/44974d6b18604ea3b9445e8ef2cef587/application_credentials/8742006519604380b002e69be9737dff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:01.899656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:01.988488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1380bc6-18eb-4f27-907d-b379f6790a04 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:01.994317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76e3016b1f394a648f34f2e9390b5069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9373fba025d54bcfbf83d23027c2af9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:01.994995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:01.995316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:01.995602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] PATH_INFO: `/v3/roles/c9663208c1ba4446b637c2e3b085437d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:01.997131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c9663208c1ba4446b637c2e3b085437d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:01.998804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:02.208657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] Invalidating the token cache because role c9663208c1ba4446b637c2e3b085437d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:02.209010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.210193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3325f2c3-a8e4-4fd7-b6e3-9004fc2ebe84 tempest-ApplicationCredentialsV3AdminTest-1232250610 tempest-ApplicationCredentialsV3AdminTest-1232250610-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.212466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3179/6359] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:01 2022] DELETE /identity/v3/roles/c9663208c1ba4446b637c2e3b085437d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:02.217887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:02.220087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:02.375961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d3aa0-86a6-4e81-b0e2-7f823a770993 tempest-ApplicationCredentialsV3AdminTest-783851604 tempest-ApplicationCredentialsV3AdminTest-783851604-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:02.467495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:02.503256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:02.503931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:02.504287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:02.504568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] PATH_INFO: `/v3/users/44974d6b18604ea3b9445e8ef2cef587` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:02.506274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44974d6b18604ea3b9445e8ef2cef587)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:02.508759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:02.519435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:02.789078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44974d6b18604ea3b9445e8ef2cef587'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.812954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44974d6b18604ea3b9445e8ef2cef587'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.815558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44974d6b18604ea3b9445e8ef2cef587'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.816901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44974d6b18604ea3b9445e8ef2cef587'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.837446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44974d6b18604ea3b9445e8ef2cef587'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:02.954527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3181/6360] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:02 2022] DELETE /identity/v3/users/44974d6b18604ea3b9445e8ef2cef587 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:02.962669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:02.962669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:02.962669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:02.992377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:02.994808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:03.084039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3180/6361] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:03.107063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:03.108755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:03.209465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777be67-0945-433c-a3a5-2898c2b508e4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:03.214045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:03.214858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:03.215296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:03.215680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:03.227934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:03.229833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:03.242386 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3182/6362] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:03.782544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:03.782544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:03.822577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aee42-9763-4c2a-9749-fafd7ef693ab None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:03.841086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:03.841086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:03.841086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:03.841086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] PATH_INFO: `/v3/projects/d2e3404fe7ac4a889c2b9f30f887000d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:03.841503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e3404fe7ac4a889c2b9f30f887000d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:03.841503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:04.004862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e3404fe7ac4a889c2b9f30f887000d', 'request_id': 'req-e2b3af28-111e-4b3d-8e42-5874b98a4237'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.022502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e3404fe7ac4a889c2b9f30f887000d', 'request_id': 'req-e2b3af28-111e-4b3d-8e42-5874b98a4237'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.028779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e3404fe7ac4a889c2b9f30f887000d', 'request_id': 'req-e2b3af28-111e-4b3d-8e42-5874b98a4237'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.142202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] The token cache is being invalidate because project d2e3404fe7ac4a889c2b9f30f887000d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:04.144614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.147630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.151256 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3181/6363] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:03 2022] DELETE /identity/v3/projects/d2e3404fe7ac4a889c2b9f30f887000d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:04.158823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:04.189129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46748332-2e4b-410f-8f4c-720b04a603fd service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:04.255408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:04.332168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:04.332168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:04.332168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:04.332168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] PATH_INFO: `/v3/users/76e3016b1f394a648f34f2e9390b5069` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:04.333941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e3016b1f394a648f34f2e9390b5069)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:04.340257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:04.601796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e3016b1f394a648f34f2e9390b5069'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.612691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e3016b1f394a648f34f2e9390b5069'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.613451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e3016b1f394a648f34f2e9390b5069'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.614273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e3016b1f394a648f34f2e9390b5069'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.644119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3898dfb8-5d84-423d-ba89-155649ed8e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e3016b1f394a648f34f2e9390b5069'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:04.753441 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3183/6364] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:04 2022] DELETE /identity/v3/users/76e3016b1f394a648f34f2e9390b5069 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:05.510105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:05.514805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:05.534984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3af28-111e-4b3d-8e42-5874b98a4237 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:05.589427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:05.630705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:05.630705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:05.630705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:05.630705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] PATH_INFO: `/v3/projects/9373fba025d54bcfbf83d23027c2af9c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:05.631487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9373fba025d54bcfbf83d23027c2af9c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:05.632935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:05.812736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9373fba025d54bcfbf83d23027c2af9c', 'request_id': 'req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:05.818361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9373fba025d54bcfbf83d23027c2af9c', 'request_id': 'req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:05.824948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9373fba025d54bcfbf83d23027c2af9c', 'request_id': 'req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:05.927571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] The token cache is being invalidate because project 9373fba025d54bcfbf83d23027c2af9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:05.928392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:05.931468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ec5dcb48-e0a8-4dcf-b733-1bcb7c4d417d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:05.934322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3182/6365] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:05 2022] DELETE /identity/v3/projects/9373fba025d54bcfbf83d23027c2af9c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:05.939386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:05.942324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:05.944428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:05.983875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:05.985192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:06.074208 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3184/6366] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:06.076613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.076924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.077199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.106041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:06.107376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:06.116895 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3183/6367] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:06.121759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:06.133918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49800f-d6a6-4dea-9267-22ba5fe1e62a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:06.139737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:06.140381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.140834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.141317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.142454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:06.143394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:06.145822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:06.163590 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3185/6368] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:06.168685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:06.181515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc98c5a-dcb9-4cd2-8f78-514272e751d8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:06.189964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f1039-4326-417d-b05b-9014f69f227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:06.189964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1039-4326-417d-b05b-9014f69f227f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.192697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1039-4326-417d-b05b-9014f69f227f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.192697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f1039-4326-417d-b05b-9014f69f227f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.192697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f1039-4326-417d-b05b-9014f69f227f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:06.193421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f1039-4326-417d-b05b-9014f69f227f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:06.336196 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3184/6369] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:06 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:06.340664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:06.359513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247a026-9da6-409c-a40c-7511413b4087 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:06.388263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:06.426008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.426317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.429507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.456323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:06.457778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:06.465642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:06.466675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.467099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.467384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.468465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:06.472240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:06.558185 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3185/6370] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:06.612549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:06.613681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3186/6371] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:06 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:06.626804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4424db7-a1e5-46b4-ad58-c05bd30f94ca None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:06.638129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:06.639341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.639989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.642302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.644597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:06.646755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:06.662207 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3186/6372] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:06.666254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:06.690814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0fd33-c279-4c73-949d-fa532bc419ba admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:06.698865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b33460-18d0-490e-bb27-74fd458098a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:06.700401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b33460-18d0-490e-bb27-74fd458098a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.700797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b33460-18d0-490e-bb27-74fd458098a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.701182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b33460-18d0-490e-bb27-74fd458098a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.701978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b33460-18d0-490e-bb27-74fd458098a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:06.703848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b33460-18d0-490e-bb27-74fd458098a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:06.721918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3187/6373] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:06.723465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:06.738903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0491-0db8-4f38-a50a-47ac1e80b5bb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:06.745622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:06.746710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.749548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.749548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] PATH_INFO: `/v3/projects/5011d6694b414527be6993f76c5d5255/users/f223913527b9438180094858bda4e84a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.777245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5011d6694b414527be6993f76c5d5255, user_id=f223913527b9438180094858bda4e84a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:06.785356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:06.918438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3187/6374] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:06 2022] PUT /identity/v3/projects/5011d6694b414527be6993f76c5d5255/users/f223913527b9438180094858bda4e84a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:06.934334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef125ca-609d-409e-8fd0-d4608e45ca95 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:06.934890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef125ca-609d-409e-8fd0-d4608e45ca95 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:06.936095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef125ca-609d-409e-8fd0-d4608e45ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:06.978798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fef125ca-609d-409e-8fd0-d4608e45ca95 None None] MFA Rules not processed for user `f223913527b9438180094858bda4e84a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:06.981230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fef125ca-609d-409e-8fd0-d4608e45ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:07.089184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3188/6375] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:07.093734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:07.159408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc428a-3112-4546-8292-73feef1c104d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:07.159702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc428a-3112-4546-8292-73feef1c104d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:07.159982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc428a-3112-4546-8292-73feef1c104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:07.210114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-85fc428a-3112-4546-8292-73feef1c104d None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:07.212468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-85fc428a-3112-4546-8292-73feef1c104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:07.241381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6654f0-65aa-41aa-92f7-4b66a285cd14 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:07.248938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:07.250231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:07.250752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:07.251308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:07.252822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:07.255121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:07.317440 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3189/6376] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:07.454407 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3188/6377] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:07 2022] POST /identity/v3/projects => generated 383 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:07.455751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc428a-3112-4546-8292-73feef1c104d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:07.470444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc428a-3112-4546-8292-73feef1c104d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:07.569492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:07.570120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:07.570452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:07.570781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:07.571851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:07.574490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:07.677965 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3190/6378] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:07 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:15:07.682003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:07.696029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5f071-41f1-4a16-a1da-2738615e8452 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:07.701229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:07.701861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:07.702152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:07.702432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:07.703125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:07.704756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:07.720101 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3189/6379] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:07.725158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:07.737327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ad3f1-cb0c-442e-9d5c-7319e0676d7a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:07.745418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:07.746101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:07.746387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:07.746665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] PATH_INFO: `/v3/projects/8740e890a05849ac870b7f7ee7386acb/users/777d53be241b4a32a6504a569568a2fd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:07.764124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8740e890a05849ac870b7f7ee7386acb, user_id=777d53be241b4a32a6504a569568a2fd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:07.766874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:07.821207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:07.919854 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3191/6380] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:07 2022] PUT /identity/v3/projects/8740e890a05849ac870b7f7ee7386acb/users/777d53be241b4a32a6504a569568a2fd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:07.932996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:07.944940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebad4d8-4634-4882-9fa4-4c620e7876fe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.053167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662f39d-6701-4a1e-a10d-a2d9ca7ab209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.053932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f39d-6701-4a1e-a10d-a2d9ca7ab209 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.054374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f39d-6701-4a1e-a10d-a2d9ca7ab209 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.054689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f39d-6701-4a1e-a10d-a2d9ca7ab209 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.055464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f39d-6701-4a1e-a10d-a2d9ca7ab209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.057758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f39d-6701-4a1e-a10d-a2d9ca7ab209 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.073974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.074549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3190/6381] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:08.086721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3308f3-1034-464d-84ad-23fad044b6ec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.094495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.095377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.096400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.096774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] PATH_INFO: `/v3/projects/8740e890a05849ac870b7f7ee7386acb/users/777d53be241b4a32a6504a569568a2fd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.099035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8740e890a05849ac870b7f7ee7386acb, user_id=777d53be241b4a32a6504a569568a2fd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.102003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.113714 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3192/6382] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:08 2022] PUT /identity/v3/projects/8740e890a05849ac870b7f7ee7386acb/users/777d53be241b4a32a6504a569568a2fd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:08.127612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.130130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.130130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.181451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] MFA Rules not processed for user `777d53be241b4a32a6504a569568a2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:08.183002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:08.273701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3191/6383] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:08.280399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.296725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4a5c1-601e-4864-9a16-780f69c74d02 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.303603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.309764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.309764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.309764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.309764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.309764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invalid input for field 'name': '' is too short Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: On instance['name']: Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: On instance['name']: Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: '' Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise error Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application '' Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.317570 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 11:15:08.319361 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application '' Sep 06 11:15:08.320573 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:08.328109 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3193/6384] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:15:08 2022] POST /identity/v3/domains => generated 283 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 11:15:08.339233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.341073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98402b96-5890-4cf3-baa9-2728159dc051 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.347392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.348122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.348759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.349091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.350014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.351855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: On instance['name']: Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: On instance['name']: Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise error Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.358913 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Sep 06 11:15:08.360847 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application On instance['name']: Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.363569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3192/6385] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:15:08 2022] POST /identity/v3/domains => generated 412 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 11:15:08.366361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.377609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617745c-2754-4042-b402-11a0cd749175 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.382895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.383565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.383849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.384363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.385248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.387080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.457588 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3194/6386] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:15:08 2022] POST /identity/v3/domains => generated 276 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:08.461899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.473426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73867-cc1a-455a-81a8-9fefe0a3ad25 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.545518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.546308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.546604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.546888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/14741279da164634a551db908c62850e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.558962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=14741279da164634a551db908c62850e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.560599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Sep 06 11:15:08.595741 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Sep 06 11:15:08.596967 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:08.600729 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3193/6387] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:08 2022] DELETE /identity/v3/domains/14741279da164634a551db908c62850e => generated 120 bytes in 138 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:15:08.601526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.615845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc5e09-33d9-4a3c-8a60-99d4439b21a6 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.621705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.622765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.623121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.623411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/14741279da164634a551db908c62850e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.626026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=14741279da164634a551db908c62850e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.629706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:08.650404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:08.677139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '14741279da164634a551db908c62850e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:08.678462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '14741279da164634a551db908c62850e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:08.782556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '14741279da164634a551db908c62850e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:08.783262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '14741279da164634a551db908c62850e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:08.786565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3195/6388] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:15:08 2022] PATCH /identity/v3/domains/14741279da164634a551db908c62850e => generated 277 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:15:08.792615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:08.794532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:08.824671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42704419-f173-4bf1-be05-94cd6ca61d6d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:08.935214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:08.935576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:08.935874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:08.941927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/14741279da164634a551db908c62850e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:08.978791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=14741279da164634a551db908c62850e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:08.982950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:09.019205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '14741279da164634a551db908c62850e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.035185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '14741279da164634a551db908c62850e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.186923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14741279da164634a551db908c62850e', 'request_id': 'req-d0e433e8-d276-443a-a258-ca5ecb753720'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.196720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14741279da164634a551db908c62850e', 'request_id': 'req-d0e433e8-d276-443a-a258-ca5ecb753720'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.211925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14741279da164634a551db908c62850e', 'request_id': 'req-d0e433e8-d276-443a-a258-ca5ecb753720'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.411927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] The token cache is being invalidate because project 14741279da164634a551db908c62850e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:09.412578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.413426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.425108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '14741279da164634a551db908c62850e', 'request_id': 'req-d0e433e8-d276-443a-a258-ca5ecb753720'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.429279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '14741279da164634a551db908c62850e', 'request_id': 'req-d0e433e8-d276-443a-a258-ca5ecb753720'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.435242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '14741279da164634a551db908c62850e', 'request_id': 'req-d0e433e8-d276-443a-a258-ca5ecb753720'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:09.447044 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3194/6389] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:08 2022] DELETE /identity/v3/domains/14741279da164634a551db908c62850e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:09.452284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:09.467291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba744250-0ca0-4ad0-8347-25e737bded53 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:09.574563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:09.574563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:09.574563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:09.574853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/5267a9fce78c42659a403bcb89233a3f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:09.601896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Could not find domain: 5267a9fce78c42659a403bcb89233a3f.: keystone.exception.DomainNotFound: Could not find domain: 5267a9fce78c42659a403bcb89233a3f. Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5267a9fce78c42659a403bcb89233a3f. Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:15:09.608439 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:15:09.609593 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:15:09.610698 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5267a9fce78c42659a403bcb89233a3f. Sep 06 11:15:09.613586 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:09.613586 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3196/6390] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:09 2022] DELETE /identity/v3/domains/5267a9fce78c42659a403bcb89233a3f => generated 112 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:15:09.616171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:09.618598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:09.654958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e433e8-d276-443a-a258-ca5ecb753720 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:09.665424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:09.666693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:09.667265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:09.668094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:09.670170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:09.674346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:09.765670 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3195/6391] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:15:09 2022] POST /identity/v3/domains => generated 253 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:15:09.770323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:09.782279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:09.806189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a281d1-296d-4c1b-874d-4b9250f7a086 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:09.865485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:09.951445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:09.952666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:09.953133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:09.954478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:09.956613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:09.959814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:10.013158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.sql.core [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1586710517' for key 'project.ixu_project_name_domain_id'") Sep 06 11:15:10.013158 ncdv-master-1 devstack@keystone.service[92878]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 11:15:10.013158 ncdv-master-1 devstack@keystone.service[92878]: [parameters: {'id': '727d7a4202fc4050bacaabe22e77178a', 'name': 'tempest-domain-dup-1586710517', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 06 11:15:10.013158 ncdv-master-1 devstack@keystone.service[92878]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92878) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1586710517.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1586710517. Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:15:10.040092 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result.read() Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1586710517' for key 'project.ixu_project_name_domain_id'") Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 11:15:10.041239 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application yield resource Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application next(self.gen) Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise self.value Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application session.commit() Sep 06 11:15:10.042603 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.session.flush() Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application compat.raise_( Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 11:15:10.043875 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 11:15:10.045166 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application conn.query(q) Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application result.read() Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 11:15:10.046364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1586710517' for key 'project.ixu_project_name_domain_id'") Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [parameters: {'id': '727d7a4202fc4050bacaabe22e77178a', 'name': 'tempest-domain-dup-1586710517', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.052784 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1586710517. Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:15:10.054364 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1586710517. Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:15:10.055591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3197/6392] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:15:09 2022] POST /identity/v3/domains => generated 212 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:15:10.056710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:10.065245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea973-e3d2-475b-8202-4ab46aeba654 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:10.072227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:10.073245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:10.073535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:10.073814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/a94e00ddb0674b38a12d30ba64059918` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:10.109015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a94e00ddb0674b38a12d30ba64059918)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:10.117517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:10.167790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.168565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.320060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.320625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.326759 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3196/6393] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:15:10 2022] PATCH /identity/v3/domains/a94e00ddb0674b38a12d30ba64059918 => generated 254 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:15:10.330958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:10.330958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:10.346634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5715f-08c9-4521-a747-a134fa99c45d tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:10.454019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:10.454974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:10.454974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:10.455420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/a94e00ddb0674b38a12d30ba64059918` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:10.482017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a94e00ddb0674b38a12d30ba64059918)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:10.483731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:10.532554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.539484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.823639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918', 'request_id': 'req-219a91d0-7483-473c-ac89-32489d1b50e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.846147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918', 'request_id': 'req-219a91d0-7483-473c-ac89-32489d1b50e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.863116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918', 'request_id': 'req-219a91d0-7483-473c-ac89-32489d1b50e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.945115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] The token cache is being invalidate because project a94e00ddb0674b38a12d30ba64059918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:10.945796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.946781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.977917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918', 'request_id': 'req-219a91d0-7483-473c-ac89-32489d1b50e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.979342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918', 'request_id': 'req-219a91d0-7483-473c-ac89-32489d1b50e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:10.988220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a94e00ddb0674b38a12d30ba64059918', 'request_id': 'req-219a91d0-7483-473c-ac89-32489d1b50e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:11.008131 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3198/6394] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:10 2022] DELETE /identity/v3/domains/a94e00ddb0674b38a12d30ba64059918 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:11.008658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:11.020668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b565-38e9-4ac8-9573-c713d3214afe tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:11.026512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:11.094505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14421e06-256d-467b-8890-df4ee0f172f1 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '777d53be241b4a32a6504a569568a2fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8740e890a05849ac870b7f7ee7386acb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:11.095195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421e06-256d-467b-8890-df4ee0f172f1 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:11.095419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421e06-256d-467b-8890-df4ee0f172f1 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:11.096311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421e06-256d-467b-8890-df4ee0f172f1 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] PATH_INFO: `/v3/domains/14741279da164634a551db908c62850e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:11.103881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14421e06-256d-467b-8890-df4ee0f172f1 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-14421e06-256d-467b-8890-df4ee0f172f1 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Could not find domain: 14741279da164634a551db908c62850e.: keystone.exception.DomainNotFound: Could not find domain: 14741279da164634a551db908c62850e. Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 14741279da164634a551db908c62850e. Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:15:11.109485 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:15:11.110864 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:15:11.114952 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 14741279da164634a551db908c62850e. Sep 06 11:15:11.116384 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:15:11.116384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3197/6395] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:15:11 2022] PATCH /identity/v3/domains/14741279da164634a551db908c62850e => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:15:11.116572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:11.116953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:11.188770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a91d0-7483-473c-ac89-32489d1b50e7 tempest-DomainsNegativeTestJSON-1752478021 tempest-DomainsNegativeTestJSON-1752478021-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:11.198548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:11.199565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:11.200100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:11.200457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] PATH_INFO: `/v3/users/f223913527b9438180094858bda4e84a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:11.202118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f223913527b9438180094858bda4e84a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:11.204381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:11.450666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f223913527b9438180094858bda4e84a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:11.462721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f223913527b9438180094858bda4e84a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:11.464128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f223913527b9438180094858bda4e84a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:11.467909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f223913527b9438180094858bda4e84a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:11.483961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f223913527b9438180094858bda4e84a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:11.579704 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3199/6396] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:11 2022] DELETE /identity/v3/users/f223913527b9438180094858bda4e84a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:11.584743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:11.585108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:11.585403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:11.605078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:11.606211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:11.674157 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3198/6397] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:11.684407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:11.686051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:11.771402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cf191-dfae-4902-9591-c8c856e6f031 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:11.775286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:11.776010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:11.776290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:11.776563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:11.787202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:11.788664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:11.801997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:11.802225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3200/6398] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:12.488986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:12.529809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:12.531308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:12.562049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b1458-bacf-4762-b830-fe9f68422e44 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:12.572679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:12.573703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:12.574054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:12.574438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] PATH_INFO: `/v3/projects/5011d6694b414527be6993f76c5d5255` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:12.578503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5011d6694b414527be6993f76c5d5255)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:12.581625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:12.749516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5011d6694b414527be6993f76c5d5255', 'request_id': 'req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:12.761895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5011d6694b414527be6993f76c5d5255', 'request_id': 'req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:12.773938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5011d6694b414527be6993f76c5d5255', 'request_id': 'req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:12.924923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] The token cache is being invalidate because project 5011d6694b414527be6993f76c5d5255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:12.925232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:12.931554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:12.934119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3199/6399] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:12 2022] DELETE /identity/v3/projects/5011d6694b414527be6993f76c5d5255 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:12.938432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:12.963551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bd2d-a976-481a-ab85-fd05c1472973 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:13.063336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:13.064440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:13.065151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:13.065560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] PATH_INFO: `/v3/users/777d53be241b4a32a6504a569568a2fd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:13.067385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777d53be241b4a32a6504a569568a2fd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:13.069624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:13.437689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777d53be241b4a32a6504a569568a2fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:13.450055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777d53be241b4a32a6504a569568a2fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:13.460611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777d53be241b4a32a6504a569568a2fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:13.461674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777d53be241b4a32a6504a569568a2fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:13.480179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a820e02f-7017-4195-aa1e-a8fdd400fc67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777d53be241b4a32a6504a569568a2fd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:13.556925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3201/6400] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:12 2022] DELETE /identity/v3/users/777d53be241b4a32a6504a569568a2fd => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:13.625935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:14.336032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:14.337852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:14.375101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f609b0e-9334-4f3a-8941-2b57ccc7c04d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:14.493298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:14.494287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:14.494955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:14.496196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] PATH_INFO: `/v3/projects/8740e890a05849ac870b7f7ee7386acb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:14.497823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8740e890a05849ac870b7f7ee7386acb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:14.500542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:14.693112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8740e890a05849ac870b7f7ee7386acb', 'request_id': 'req-9f49fa17-9a47-4e52-bb71-e89131d2e17f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:14.705947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8740e890a05849ac870b7f7ee7386acb', 'request_id': 'req-9f49fa17-9a47-4e52-bb71-e89131d2e17f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:14.716257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8740e890a05849ac870b7f7ee7386acb', 'request_id': 'req-9f49fa17-9a47-4e52-bb71-e89131d2e17f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:14.814434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] The token cache is being invalidate because project 8740e890a05849ac870b7f7ee7386acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:14.814842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:14.824835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9f49fa17-9a47-4e52-bb71-e89131d2e17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:14.831775 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3200/6401] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:14 2022] DELETE /identity/v3/projects/8740e890a05849ac870b7f7ee7386acb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:14.833740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:14.834260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:14.834480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:14.903251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:14.904931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:15.063238 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3202/6402] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:15.072378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.072954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.073475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.099582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:15.100835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:15.113238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3201/6403] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:15.117234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:15.132389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38418d1-1394-4761-806d-d0d3f03c5d97 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:15.145680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:15.146771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.147556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.148023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.149120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:15.149837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:15.153240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:15.176909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:15.180352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3203/6404] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:15.184332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:15.190502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977e307-24c5-49e5-a7b3-01c333df7867 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:15.203930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:15.203930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.203930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.203930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.205176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:15.205176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:15.348934 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3202/6405] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:15 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:15.350835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:15.364696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399a65-7f40-4495-b1fe-50e320f0e34b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:15.422619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:15.468924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:15.471553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.471553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.471553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.471553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:15.475232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:15.598993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3204/6406] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:15 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:15.603426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:15.630355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d331-479b-4904-9b85-1444c4aee48a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:15.647974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:15.651368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.652101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.652438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.653318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:15.657364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:15.686198 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3203/6407] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:15.688406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:15.713785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f08a9-e334-45cf-9f3e-7f60f46e2fdb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:15.724960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd7574-9da3-4051-937f-9c17f29f1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:15.725676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd7574-9da3-4051-937f-9c17f29f1a0e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.725676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd7574-9da3-4051-937f-9c17f29f1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.726841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd7574-9da3-4051-937f-9c17f29f1a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.726841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd7574-9da3-4051-937f-9c17f29f1a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:15.728632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd7574-9da3-4051-937f-9c17f29f1a0e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:15.744605 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3205/6408] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:15.749222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:15.766416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1a0de-5294-460d-8657-ae06973675c9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:15.772251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:15.780540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.780540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.780540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] PATH_INFO: `/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3/users/1604428bf78f41f48eff0106e8a1a94c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:15.805885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ee96b729894a2ab1e0219cd76b0ca3, user_id=1604428bf78f41f48eff0106e8a1a94c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:15.809452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:15.914345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3204/6409] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:15 2022] PUT /identity/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3/users/1604428bf78f41f48eff0106e8a1a94c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:15.931650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:15.933272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:15.933680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:16.002190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] MFA Rules not processed for user `1604428bf78f41f48eff0106e8a1a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:16.006366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:16.161667 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3206/6410] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:16.162229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:16.269695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8af4-8eeb-44ed-adc4-35fea944845c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:16.275983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:16.277077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:16.277544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:16.278176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:16.279351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:16.282417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:16.429682 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3205/6411] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:16 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:15:16.433326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:16.459204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668384a-a9b8-412b-8064-82ab6fa258db None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:16.588432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:16.589641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:16.590203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:16.591249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:16.592887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:16.597397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:16.695376 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3207/6412] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:16 2022] POST /identity/v3/users => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:16.699680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:16.714348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bce849-ba83-4641-92fb-54ba97ea4da2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:16.731894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:16.733347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:16.733893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:16.734391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:16.742761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:16.744056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:16.765035 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3206/6413] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:16.769120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:16.795284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bcce-659f-44fa-81ad-353305bc5a77 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:16.803364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:16.804353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:16.805468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:16.805769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] PATH_INFO: `/v3/projects/216c1d1e9b4040efbcb046e54cbb8299/users/52397f6a21624955b35ad016293ec864/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:16.837545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216c1d1e9b4040efbcb046e54cbb8299, user_id=52397f6a21624955b35ad016293ec864, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:16.843849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:16.991836 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3208/6414] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:16 2022] PUT /identity/v3/projects/216c1d1e9b4040efbcb046e54cbb8299/users/52397f6a21624955b35ad016293ec864/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:16.993265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.006919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7830ae-59bf-445a-8198-25f47006f478 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.101126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1907dfa-6bd8-4d4c-a992-e5d99e8c90ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.101772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1907dfa-6bd8-4d4c-a992-e5d99e8c90ec admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.102156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1907dfa-6bd8-4d4c-a992-e5d99e8c90ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.102441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1907dfa-6bd8-4d4c-a992-e5d99e8c90ec admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.103135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1907dfa-6bd8-4d4c-a992-e5d99e8c90ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.104778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1907dfa-6bd8-4d4c-a992-e5d99e8c90ec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.117540 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3207/6415] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:17.124193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.150462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3af55-8ee0-4f7a-afdf-41fd23a570d8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.163615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.164668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.165017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.165365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] PATH_INFO: `/v3/projects/216c1d1e9b4040efbcb046e54cbb8299/users/52397f6a21624955b35ad016293ec864/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.167622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216c1d1e9b4040efbcb046e54cbb8299, user_id=52397f6a21624955b35ad016293ec864, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.170448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.185018 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3209/6416] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:17 2022] PUT /identity/v3/projects/216c1d1e9b4040efbcb046e54cbb8299/users/52397f6a21624955b35ad016293ec864/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:17.203131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.205624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.212465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.231279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:17.251113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] MFA Rules not processed for user `52397f6a21624955b35ad016293ec864`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:17.252396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:17.264047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:17.363341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3208/6417] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:17.368321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.382681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40b2b5-e3c5-4eaa-b868-eb9e11a0c2f3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.397856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.398901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.399719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.400019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.401979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:get_project(project_id=57ee96b729894a2ab1e0219cd76b0ca3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.405330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.411069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3210/6418] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:17 2022] GET /identity/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3 => generated 387 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:17.412366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.428781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2d034-dde0-4c9e-82a2-a86871d39ac5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.435891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.436946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.436946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.437620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.438337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.441809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.615403 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3209/6419] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:15:17 2022] POST /identity/v3/projects => generated 339 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:17.616920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.655172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6aa4e-b912-4780-82c9-23b9e4982407 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.770383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.770914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.771595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.772086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.773116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.776464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.821585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.834988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3211/6420] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:15:17 2022] GET /identity/v3/projects => generated 6596 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:17.842296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b835c9-9213-4a75-8340-43e8ef97d246 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.854142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.855568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.856098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.856757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.859225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:get_project(project_id=57ee96b729894a2ab1e0219cd76b0ca3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.862415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.869576 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3210/6421] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:17 2022] GET /identity/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3 => generated 387 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:17.870960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.920294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42497a1-1799-4bc5-b200-10fbd70b406e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.935262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af45fd-dde8-4bb1-9a94-6290720f6d56 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.936009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af45fd-dde8-4bb1-9a94-6290720f6d56 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.936283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af45fd-dde8-4bb1-9a94-6290720f6d56 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.936578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af45fd-dde8-4bb1-9a94-6290720f6d56 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects/9f6cc3eb0d0945a6b0561864d702290a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.940452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af45fd-dde8-4bb1-9a94-6290720f6d56 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:get_project(project_id=9f6cc3eb0d0945a6b0561864d702290a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.944290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af45fd-dde8-4bb1-9a94-6290720f6d56 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:17.947358 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3212/6422] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:17 2022] GET /identity/v3/projects/9f6cc3eb0d0945a6b0561864d702290a => generated 339 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:17.952943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:17.969996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3e24-a4c0-40de-a248-b239aadb2e69 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:17.990142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:17.990791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:17.991094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:17.991589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:17.992537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:17.994751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.064465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.065909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.066709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.097364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3211/6423] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:15:17 2022] GET /identity/v3/projects => generated 6596 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:15:18.098925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.110839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] MFA Rules not processed for user `3e904f27c02248389ae9ca86cb95c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:18.113268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:18.125336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89026228-d955-41e5-8934-92bb36e38717 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:18.141157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:18.141157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.141157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.141741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.141741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:18.141741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:18.141741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.187211 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3212/6424] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Sep 6 11:15:18 2022] GET /identity/v3/projects?domain_id=default => generated 6265 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:18.193109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.208178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c660-56ae-43c6-8ab9-985369962f20 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:18.217507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:18.218654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.219259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.226908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.226908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:18.226908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.250611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3213/6425] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:15:18 2022] GET /identity/v3/projects => generated 6596 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:18.260864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.270307 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3213/6426] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:18.275265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a71d0-6bed-4dfa-9da9-a6fb485951b1 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:18.286897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:18.286897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.286897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.288133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.288133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:18.288133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:18.288133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.328153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3214/6427] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Sep 6 11:15:18 2022] GET /identity/v3/projects?domain_id=default => generated 6265 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:18.328349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.364074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878584-b9fc-4b45-8c13-7f1884910836 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:18.364074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:18.364074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.364503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.364503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.364503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:18.366567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.391217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3214/6428] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:15:18 2022] GET /identity/v3/projects => generated 6596 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:18.401135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.420181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b53db-88c4-43b7-b7c0-5de796467789 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:18.426855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:18.427855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.428340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.428623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.429378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-592303200) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:18.429902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:18.431866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.446705 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3215/6429] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:15:18 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-592303200 => generated 534 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:18.473322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.503939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4ffbe-327a-4a95-8eeb-acc3c6a28387 tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:18.525438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52397f6a21624955b35ad016293ec864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '216c1d1e9b4040efbcb046e54cbb8299', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:18.526715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:18.527227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:18.532541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] PATH_INFO: `/v3/projects/9f6cc3eb0d0945a6b0561864d702290a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:18.532541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f6cc3eb0d0945a6b0561864d702290a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:18.534225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:18.794333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6cc3eb0d0945a6b0561864d702290a', 'request_id': 'req-4be7371f-d9a7-422e-8c2b-8fb478847d3b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:18.815178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6cc3eb0d0945a6b0561864d702290a', 'request_id': 'req-4be7371f-d9a7-422e-8c2b-8fb478847d3b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:18.837252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6cc3eb0d0945a6b0561864d702290a', 'request_id': 'req-4be7371f-d9a7-422e-8c2b-8fb478847d3b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:18.847844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:18.984664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] The token cache is being invalidate because project 9f6cc3eb0d0945a6b0561864d702290a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:18.984979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:18.989918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4be7371f-d9a7-422e-8c2b-8fb478847d3b tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:18.989918 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3215/6430] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:18 2022] DELETE /identity/v3/projects/9f6cc3eb0d0945a6b0561864d702290a => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:18.992969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:18.997370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:19.128200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27be1f7-75fe-452d-b7e2-cac3dbf64e5e tempest-ListProjectsStaticTestJSON-2100902553 tempest-ListProjectsStaticTestJSON-2100902553-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:19.153180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:19.247872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:19.249033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:19.249649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:19.250218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] PATH_INFO: `/v3/users/1604428bf78f41f48eff0106e8a1a94c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:19.253345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1604428bf78f41f48eff0106e8a1a94c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:19.257365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:19.613664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1604428bf78f41f48eff0106e8a1a94c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:19.632240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1604428bf78f41f48eff0106e8a1a94c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:19.637492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1604428bf78f41f48eff0106e8a1a94c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:19.673307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1604428bf78f41f48eff0106e8a1a94c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:19.673307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1604428bf78f41f48eff0106e8a1a94c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:19.780014 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3216/6431] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:18 2022] DELETE /identity/v3/users/1604428bf78f41f48eff0106e8a1a94c => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:19.786272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:19.786809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:19.787038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:19.812136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:19.813389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:19.913400 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3216/6432] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:19.922331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:19.925726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:20.043665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d76f8-c2fe-4f6f-a707-0913b80f376d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:20.049441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:20.050574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:20.051079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:20.051529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:20.069275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:20.071228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:20.110257 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3217/6433] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:20.966905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:20.967456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:20.997985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf410-605e-4ddc-aa00-662d77bb8fb6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:21.004064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:21.005226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:21.009020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:21.009020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] PATH_INFO: `/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:21.018006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ee96b729894a2ab1e0219cd76b0ca3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:21.020119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:21.205177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ee96b729894a2ab1e0219cd76b0ca3', 'request_id': 'req-7808f7a3-7016-43f7-b799-8ed7879b163b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.212096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ee96b729894a2ab1e0219cd76b0ca3', 'request_id': 'req-7808f7a3-7016-43f7-b799-8ed7879b163b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.220954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ee96b729894a2ab1e0219cd76b0ca3', 'request_id': 'req-7808f7a3-7016-43f7-b799-8ed7879b163b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.416496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] The token cache is being invalidate because project 57ee96b729894a2ab1e0219cd76b0ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:21.417033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.418771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.420606 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3217/6434] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:20 2022] DELETE /identity/v3/projects/57ee96b729894a2ab1e0219cd76b0ca3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:21.424671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:21.436518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45fbc-efa1-49d0-8e06-bce28a7cd93f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:21.487535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:21.512246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:21.513542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:21.513907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:21.514196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] PATH_INFO: `/v3/users/52397f6a21624955b35ad016293ec864` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:21.515548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52397f6a21624955b35ad016293ec864)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:21.518539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:21.758764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52397f6a21624955b35ad016293ec864'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.766274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52397f6a21624955b35ad016293ec864'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.767142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52397f6a21624955b35ad016293ec864'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.804179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52397f6a21624955b35ad016293ec864'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.805027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52397f6a21624955b35ad016293ec864'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:21.883233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3218/6435] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:21 2022] DELETE /identity/v3/users/52397f6a21624955b35ad016293ec864 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:22.058950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:22.060946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:22.185451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f7a3-7016-43f7-b799-8ed7879b163b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:22.244956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:22.274481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:22.277098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:22.277771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:22.278434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:22.282308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:22.416965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:22.418657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937beab9-1a32-41d2-891d-6894614f3b62 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:22.436470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3218/6436] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:22.810307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:22.814793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:22.913798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8904049-0382-4ef7-af0d-ec5277e2b02d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:22.921204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:22.921204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:22.921204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:22.921204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] PATH_INFO: `/v3/projects/216c1d1e9b4040efbcb046e54cbb8299` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:22.923506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216c1d1e9b4040efbcb046e54cbb8299)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:22.924652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:23.110270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216c1d1e9b4040efbcb046e54cbb8299', 'request_id': 'req-82ee4851-6109-42cc-9cef-12890fe89307'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:23.122443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216c1d1e9b4040efbcb046e54cbb8299', 'request_id': 'req-82ee4851-6109-42cc-9cef-12890fe89307'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:23.130142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:23.133444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216c1d1e9b4040efbcb046e54cbb8299', 'request_id': 'req-82ee4851-6109-42cc-9cef-12890fe89307'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:23.270208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] The token cache is being invalidate because project 216c1d1e9b4040efbcb046e54cbb8299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:23.271613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:23.275542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-82ee4851-6109-42cc-9cef-12890fe89307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:23.282792 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3219/6437] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:22 2022] DELETE /identity/v3/projects/216c1d1e9b4040efbcb046e54cbb8299 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:23.287154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:23.287695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:23.287695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:23.316334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:23.318719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:23.418182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3219/6438] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:23.427228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:23.427948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:23.428505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:23.452047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:23.453273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:23.462591 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3220/6439] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:23.467584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:23.483377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1d30a-89d3-4f72-bee7-701ef7dcf6da None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:23.490992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:23.491651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:23.500778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:23.500778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:23.500778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:23.500778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:23.500778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:23.509165 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3220/6440] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:23.516554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:23.536936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b114a7c-7fdb-407e-ac09-ed7694fd4c9b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:23.552036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:23.553168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:23.553751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:23.554232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:23.555150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:23.559348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:23.693638 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3221/6441] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:23 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:23.699265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:23.729827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b474a-cb7a-4cd9-acbd-da5675b37f98 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:23.826560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:23.833564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:23.834262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:23.838478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:23.838478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:23.841475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:23.870727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:23.980906 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3221/6442] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:23 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:23.985866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:24.004254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf6cb-a88f-48f5-a3a6-05b8d57bfdaf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:24.010490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:24.011167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.011453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.011740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:24.012610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:24.014289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:24.036345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3222/6443] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:24.043784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:24.062092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4e895-f284-417f-9d82-1b5e1f3af812 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:24.088601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa10005-b593-4d12-8066-badba191eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:24.089469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10005-b593-4d12-8066-badba191eb6f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.089606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10005-b593-4d12-8066-badba191eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.089826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10005-b593-4d12-8066-badba191eb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:24.090576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa10005-b593-4d12-8066-badba191eb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:24.102882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa10005-b593-4d12-8066-badba191eb6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:24.104777 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3222/6444] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:24.109139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:24.120865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5657a-5500-44ce-9a02-4ac78c79e757 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:24.128066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:24.128756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.129042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.129323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] PATH_INFO: `/v3/projects/ffb088ee6b6b4fadae0406deed389179/users/edbb9040cb484e90827cd9dfb3b7d811/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:24.147374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb088ee6b6b4fadae0406deed389179, user_id=edbb9040cb484e90827cd9dfb3b7d811, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:24.150088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:24.275442 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3223/6445] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:24 2022] PUT /identity/v3/projects/ffb088ee6b6b4fadae0406deed389179/users/edbb9040cb484e90827cd9dfb3b7d811/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:24.287038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.287430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.288009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:24.323594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] MFA Rules not processed for user `edbb9040cb484e90827cd9dfb3b7d811`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:24.325317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:24.406311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3223/6446] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:24.407795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:24.420880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe97a-0b1b-457a-81c3-64fc9059d96c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:24.426910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e0f54-45e1-4064-aa43-684948355f2f tempest-DefaultDomainTestJSON-581105730 tempest-DefaultDomainTestJSON-581105730-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbb9040cb484e90827cd9dfb3b7d811', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffb088ee6b6b4fadae0406deed389179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:24.427638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e0f54-45e1-4064-aa43-684948355f2f tempest-DefaultDomainTestJSON-581105730 tempest-DefaultDomainTestJSON-581105730-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.427924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e0f54-45e1-4064-aa43-684948355f2f tempest-DefaultDomainTestJSON-581105730 tempest-DefaultDomainTestJSON-581105730-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.428420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e0f54-45e1-4064-aa43-684948355f2f tempest-DefaultDomainTestJSON-581105730 tempest-DefaultDomainTestJSON-581105730-project] PATH_INFO: `/v3/domains/default` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:24.433072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e0f54-45e1-4064-aa43-684948355f2f tempest-DefaultDomainTestJSON-581105730 tempest-DefaultDomainTestJSON-581105730-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:24.433072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e0f54-45e1-4064-aa43-684948355f2f tempest-DefaultDomainTestJSON-581105730 tempest-DefaultDomainTestJSON-581105730-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:24.433313 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3224/6447] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Sep 6 11:15:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:15:24.440496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:24.534932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eb25a-b6dc-4cdf-a2a9-573d58915b8e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:24.542249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:24.542913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.543219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.543581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] PATH_INFO: `/v3/users/edbb9040cb484e90827cd9dfb3b7d811` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:24.544734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbb9040cb484e90827cd9dfb3b7d811)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:24.546971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:24.842004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbb9040cb484e90827cd9dfb3b7d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:24.869133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbb9040cb484e90827cd9dfb3b7d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:24.870351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbb9040cb484e90827cd9dfb3b7d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:24.871724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbb9040cb484e90827cd9dfb3b7d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:24.888129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbb9040cb484e90827cd9dfb3b7d811'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:24.975389 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3224/6448] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:24 2022] DELETE /identity/v3/users/edbb9040cb484e90827cd9dfb3b7d811 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:24.981506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:24.983639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:24.984271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:24.984606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:25.008784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:25.010042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:25.106990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3225/6449] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:25.117392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:25.119280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:25.193112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014f64-afde-4219-8aa2-8c8b7de7776e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:25.197854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:25.203861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:25.203861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:25.203861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:25.204932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:25.204932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:25.217978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:25.219665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:25.233070 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3225/6450] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:25.259317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5daba2-98d4-4439-92a3-4db677154e78 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:25.267419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:25.268449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:25.268933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:25.269612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:25.274547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:25.439337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:25.441848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e533b8c-e3b4-42f6-af95-b13bdff4815f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:25.477610 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3226/6451] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:15:25.897153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:25.902247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:25.924801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c005db-901d-47c4-8e0f-5440fc536386 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:25.936085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:25.937628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:25.938097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:25.939477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] PATH_INFO: `/v3/projects/ffb088ee6b6b4fadae0406deed389179` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:25.942743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb088ee6b6b4fadae0406deed389179)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:25.946938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:26.092603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb088ee6b6b4fadae0406deed389179', 'request_id': 'req-dfad11d7-a57e-489c-8253-d3a8b9806d71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:26.100614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb088ee6b6b4fadae0406deed389179', 'request_id': 'req-dfad11d7-a57e-489c-8253-d3a8b9806d71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:26.113960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb088ee6b6b4fadae0406deed389179', 'request_id': 'req-dfad11d7-a57e-489c-8253-d3a8b9806d71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:26.217497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] The token cache is being invalidate because project ffb088ee6b6b4fadae0406deed389179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:26.217856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:26.218721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dfad11d7-a57e-489c-8253-d3a8b9806d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:26.225579 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3226/6452] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:25 2022] DELETE /identity/v3/projects/ffb088ee6b6b4fadae0406deed389179 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:26.227249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.227737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.227860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.244082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:26.251180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:26.252563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:26.334115 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3227/6453] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:26.345880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.352896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.352896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.370851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:26.372471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:26.382211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3227/6454] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:26.387543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:26.399527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ef81d-e9b8-4fdb-9a3a-9b54adf9b47c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:26.408398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:26.408398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.408398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.408398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.408841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:26.408841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:26.408841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:26.425523 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3228/6455] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:26.427176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:26.438877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61e2b7-7a3e-43b0-930f-f247d8070b68 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:26.448679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:26.448679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.450385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.450771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.451528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:26.453950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:26.649695 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3228/6456] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:26 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:26.654278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:26.665141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a6632-71c2-49e0-9c61-6a055c324c96 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:26.755902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:26.756714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.757258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.757815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.758727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:26.761234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:26.896931 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3229/6457] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:26 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:26.901490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:26.913831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767fdd-1933-4e43-ab3d-3903ffb3ace6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:26.921702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:26.922333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.922643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.922926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.923641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:26.925299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:26.939060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3229/6458] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:26.941994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:26.960851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782308e3-196e-424c-9542-37fb8a8e51bb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:26.964026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:26.964724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:26.965016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:26.965303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] PATH_INFO: `/v3/projects/8477b398e1494b5ab348bd7dc30d3ad5/users/4cf9f3a86177455fa310a7c58f75652f/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:26.982965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8477b398e1494b5ab348bd7dc30d3ad5, user_id=4cf9f3a86177455fa310a7c58f75652f, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:26.986226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:27.106038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3230/6459] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:26 2022] PUT /identity/v3/projects/8477b398e1494b5ab348bd7dc30d3ad5/users/4cf9f3a86177455fa310a7c58f75652f/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:27.110269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:27.123234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a90c6-fb35-4ac2-8ea5-71ab3bdab6c6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:27.167296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:27.202056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f3a83-3ef2-4af5-b644-d81a747df215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:27.202865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f3a83-3ef2-4af5-b644-d81a747df215 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:27.203188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f3a83-3ef2-4af5-b644-d81a747df215 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:27.203464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f3a83-3ef2-4af5-b644-d81a747df215 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:27.204715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f3a83-3ef2-4af5-b644-d81a747df215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:27.206421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f3a83-3ef2-4af5-b644-d81a747df215 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:27.223214 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3230/6460] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:27.224380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:27.236638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16513-ad61-4b7b-8dfe-582352ab37ee admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:27.242414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:27.243349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:27.243915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:27.244323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] PATH_INFO: `/v3/projects/8477b398e1494b5ab348bd7dc30d3ad5/users/4cf9f3a86177455fa310a7c58f75652f/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:27.246644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8477b398e1494b5ab348bd7dc30d3ad5, user_id=4cf9f3a86177455fa310a7c58f75652f, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:27.249671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:27.264365 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3231/6461] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:27 2022] PUT /identity/v3/projects/8477b398e1494b5ab348bd7dc30d3ad5/users/4cf9f3a86177455fa310a7c58f75652f/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:27.274664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:27.275063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:27.275415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:27.318333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] MFA Rules not processed for user `4cf9f3a86177455fa310a7c58f75652f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:27.321926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:27.456688 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3231/6462] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:27.461822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:27.524233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:27.542463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ce4e-6185-40ae-b7e9-dd3ac06887a7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:27.548978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:27.549626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:27.549927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:27.550209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:27.551075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:27.553266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:27.708781 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3232/6463] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:27 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:27.713322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:27.728254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecc47-c337-4a63-9e26-dcc300b48c5e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:27.858928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:27.859243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:27.859387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:27.860804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:27.861478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:27.863533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:28.044535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3232/6464] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:27 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:28.050275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:28.062994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5129e8-e85f-4556-9333-ec1cd2e5aeae admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:28.076984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:28.077632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:28.077920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:28.078198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:28.079323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:28.080706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:28.092017 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3233/6465] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:28.097143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:28.109858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e140dc1-6100-40d5-9e89-456987e25c64 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:28.116176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fdc52-9f76-4ee6-be33-3513c2dab7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:28.117229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fdc52-9f76-4ee6-be33-3513c2dab7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:28.117703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fdc52-9f76-4ee6-be33-3513c2dab7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:28.117974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fdc52-9f76-4ee6-be33-3513c2dab7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:28.119407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fdc52-9f76-4ee6-be33-3513c2dab7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:28.121497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fdc52-9f76-4ee6-be33-3513c2dab7b7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:28.134748 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3233/6466] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:28.139185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:28.150514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d9576-2d37-420e-9094-ef76155930e8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:28.157808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:28.158500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:28.158789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:28.159291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] PATH_INFO: `/v3/projects/2e41267adce345f89d010059857ab73b/users/806e72bb09ca449b80612189120faced/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:28.178333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e41267adce345f89d010059857ab73b, user_id=806e72bb09ca449b80612189120faced, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:28.181721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:28.309157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:28.309519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3234/6467] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:28 2022] PUT /identity/v3/projects/2e41267adce345f89d010059857ab73b/users/806e72bb09ca449b80612189120faced/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:28.310001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:28.310001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:28.354808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] MFA Rules not processed for user `806e72bb09ca449b80612189120faced`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:28.356179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:28.435447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3234/6468] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:28.449245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:28.451703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:28.548321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05416f2-d683-4ee9-8e79-dce191a427dc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:28.555144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:28.556042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:28.556457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:28.556844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:28.631824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:28.655669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:28.657826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:28.673648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3235/6469] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:30.915973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:31.007479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041d60-d1dc-4684-b1af-089fcd3739bd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:31.012607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:31.013410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:31.013844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:31.014341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] PATH_INFO: `/v3/users/4cf9f3a86177455fa310a7c58f75652f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:31.015861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf9f3a86177455fa310a7c58f75652f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:31.018072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:31.338240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf9f3a86177455fa310a7c58f75652f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.352665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf9f3a86177455fa310a7c58f75652f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.353668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf9f3a86177455fa310a7c58f75652f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.354483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf9f3a86177455fa310a7c58f75652f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.369849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b3993b3a-d84a-4c0c-bb8d-d6f20e81caf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf9f3a86177455fa310a7c58f75652f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.541682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:31.543642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:31.565703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5e5d-92ea-4016-a0e0-b3a62e5c286e service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:31.573095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:31.574065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3235/6470] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:30 2022] DELETE /identity/v3/users/4cf9f3a86177455fa310a7c58f75652f => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:31.574364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:31.574660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:31.574941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] PATH_INFO: `/v3/users/9d49264c495645f38d17ceb03a43195f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:31.578215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d49264c495645f38d17ceb03a43195f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:31.581257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:31.601310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:31.601735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:31.614222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:31.642108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:31.644094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:31.700038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:31.742698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3236/6471] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:31.760798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:31.762516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:31.835893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ec65e-faa8-42c6-8cf6-6d2eeedb963c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:31.842157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749234f-abbe-454f-8a46-09d442966e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:31.842804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749234f-abbe-454f-8a46-09d442966e81 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:31.843097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749234f-abbe-454f-8a46-09d442966e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:31.843372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749234f-abbe-454f-8a46-09d442966e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:31.870339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749234f-abbe-454f-8a46-09d442966e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:31.872488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749234f-abbe-454f-8a46-09d442966e81 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:31.878484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:31.895379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3237/6472] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:31.897627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d49264c495645f38d17ceb03a43195f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.916500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d49264c495645f38d17ceb03a43195f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.918639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d49264c495645f38d17ceb03a43195f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.953967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d49264c495645f38d17ceb03a43195f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:31.954807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d49264c495645f38d17ceb03a43195f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:32.093612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3236/6473] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:31 2022] DELETE /identity/v3/users/9d49264c495645f38d17ceb03a43195f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:32.098411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:32.098986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:32.098986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:32.121119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:32.122371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:32.227062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3238/6474] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:32.239450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:32.243240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:32.326338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ccc34-f2f2-4880-a8ad-b057a7841ea9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:32.330328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:32.330950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:32.331259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:32.331543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:32.347245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:32.349309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:32.364024 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3237/6475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:32.681400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:32.683108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:32.697257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0deae8-591a-47b7-a366-1b32c59d939a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:32.712691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:32.714307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:32.716335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:32.717116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:32.717497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:32.717869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] PATH_INFO: `/v3/projects/8477b398e1494b5ab348bd7dc30d3ad5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:32.719823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8477b398e1494b5ab348bd7dc30d3ad5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:32.722805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:32.749156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bb676-e93b-4585-83df-a2559d4e1eaa service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:32.763565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:32.765021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:32.765311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:32.765589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] PATH_INFO: `/v3/projects/deb7f753413a467fb1c86f7463b12563` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:32.767538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb7f753413a467fb1c86f7463b12563)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:32.771180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:32.886165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8477b398e1494b5ab348bd7dc30d3ad5', 'request_id': 'req-a6a688dd-271b-484f-8a5e-d6352effd641'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:32.895571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8477b398e1494b5ab348bd7dc30d3ad5', 'request_id': 'req-a6a688dd-271b-484f-8a5e-d6352effd641'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:32.911252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8477b398e1494b5ab348bd7dc30d3ad5', 'request_id': 'req-a6a688dd-271b-484f-8a5e-d6352effd641'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:32.915638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb7f753413a467fb1c86f7463b12563', 'request_id': 'req-3b6724d6-c601-4f9f-942d-0ac28ef9b539'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:32.923326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb7f753413a467fb1c86f7463b12563', 'request_id': 'req-3b6724d6-c601-4f9f-942d-0ac28ef9b539'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:32.929359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb7f753413a467fb1c86f7463b12563', 'request_id': 'req-3b6724d6-c601-4f9f-942d-0ac28ef9b539'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.038425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] The token cache is being invalidate because project 8477b398e1494b5ab348bd7dc30d3ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:33.038731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.039422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.041016 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3239/6476] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:32 2022] DELETE /identity/v3/projects/8477b398e1494b5ab348bd7dc30d3ad5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:33.045022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:33.047405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:33.121154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] The token cache is being invalidate because project deb7f753413a467fb1c86f7463b12563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:33.122562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.124415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.127395 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3238/6477] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:32 2022] DELETE /identity/v3/projects/deb7f753413a467fb1c86f7463b12563 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:33.134129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:33.136530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:33.163688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a688dd-271b-484f-8a5e-d6352effd641 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:33.279128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:33.280095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:33.280444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:33.280725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] PATH_INFO: `/v3/users/806e72bb09ca449b80612189120faced` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:33.283497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6724d6-c601-4f9f-942d-0ac28ef9b539 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:33.285704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806e72bb09ca449b80612189120faced)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:33.286517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:33.289536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:33.290193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:33.290479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:33.290776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] PATH_INFO: `/v3/users/b48ac63276aa406c82db08e3d68937d1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:33.292125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48ac63276aa406c82db08e3d68937d1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:33.294073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:33.450143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:33.526787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806e72bb09ca449b80612189120faced'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.534648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806e72bb09ca449b80612189120faced'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.535556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806e72bb09ca449b80612189120faced'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.540796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806e72bb09ca449b80612189120faced'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.564695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806e72bb09ca449b80612189120faced'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.662332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48ac63276aa406c82db08e3d68937d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.671927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48ac63276aa406c82db08e3d68937d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.672164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48ac63276aa406c82db08e3d68937d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.683519 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3240/6478] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:33 2022] DELETE /identity/v3/users/806e72bb09ca449b80612189120faced => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:33.696642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48ac63276aa406c82db08e3d68937d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.696642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48ac63276aa406c82db08e3d68937d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:33.791595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3239/6479] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:33 2022] DELETE /identity/v3/users/b48ac63276aa406c82db08e3d68937d1 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:33.876938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:34.426479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:34.428344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:34.527433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167619e-632d-49af-bab8-fc32c9a069f9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:34.548393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:34.549923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:34.638533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:34.639498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:34.639793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:34.640073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] PATH_INFO: `/v3/projects/2e41267adce345f89d010059857ab73b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:34.640195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7367fce-e793-419a-80ce-8afb877541cf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:34.647184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e41267adce345f89d010059857ab73b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:34.647184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:34.647516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:34.647516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:34.647516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:34.647516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] PATH_INFO: `/v3/projects/494fa2e5483044c092e8becf06d9df0f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:34.649303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494fa2e5483044c092e8becf06d9df0f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:34.651616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:34.818535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494fa2e5483044c092e8becf06d9df0f', 'request_id': 'req-1c16b568-6acf-4b3e-ac1b-a6f096c11541'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.825083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e41267adce345f89d010059857ab73b', 'request_id': 'req-45d7166d-082a-4df6-bb8c-b2a47fba0978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.834578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494fa2e5483044c092e8becf06d9df0f', 'request_id': 'req-1c16b568-6acf-4b3e-ac1b-a6f096c11541'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.838509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e41267adce345f89d010059857ab73b', 'request_id': 'req-45d7166d-082a-4df6-bb8c-b2a47fba0978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.846619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494fa2e5483044c092e8becf06d9df0f', 'request_id': 'req-1c16b568-6acf-4b3e-ac1b-a6f096c11541'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.852413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e41267adce345f89d010059857ab73b', 'request_id': 'req-45d7166d-082a-4df6-bb8c-b2a47fba0978'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.929135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] The token cache is being invalidate because project 494fa2e5483044c092e8becf06d9df0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:34.929965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.931913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:34.934875 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3240/6480] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:34 2022] DELETE /identity/v3/projects/494fa2e5483044c092e8becf06d9df0f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:34.942906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:34.945934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:35.048298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] The token cache is being invalidate because project 2e41267adce345f89d010059857ab73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:35.048543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.049160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16b568-6acf-4b3e-ac1b-a6f096c11541 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:35.049349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-45d7166d-082a-4df6-bb8c-b2a47fba0978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.054543 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3241/6481] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:34 2022] DELETE /identity/v3/projects/2e41267adce345f89d010059857ab73b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:35.055993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720ba7-3e5c-4e82-a189-0f3ef3332bad None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.056348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720ba7-3e5c-4e82-a189-0f3ef3332bad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.056650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720ba7-3e5c-4e82-a189-0f3ef3332bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.077553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d8720ba7-3e5c-4e82-a189-0f3ef3332bad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:35.080290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8720ba7-3e5c-4e82-a189-0f3ef3332bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:35.116365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:35.117163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.117449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.117721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] PATH_INFO: `/v3/users/10629371687c4bceb7ea078fa49e4484` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.118963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10629371687c4bceb7ea078fa49e4484)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:35.121233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:35.153305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:35.194181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3242/6482] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:35.202008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.202370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.202557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.223779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:35.225132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:35.237034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3243/6483] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:35.242388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:35.255071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43657fb2-c724-418f-af74-84d9d49b2a65 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:35.262199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:35.262889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.263220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.263497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.264715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:35.265258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:35.267737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:35.280866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3244/6484] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:35.285875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:35.296758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d4569-0608-4a2a-8b2e-62459d236941 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:35.302580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:35.303169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.303507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.303779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.304414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:35.307591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:35.366148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10629371687c4bceb7ea078fa49e4484'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.418286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10629371687c4bceb7ea078fa49e4484'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.420655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10629371687c4bceb7ea078fa49e4484'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.441709 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3245/6485] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:35.442723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:35.444644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:35.454139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10629371687c4bceb7ea078fa49e4484'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.455184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10629371687c4bceb7ea078fa49e4484'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:35.557546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:35.583895 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3241/6486] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:34 2022] DELETE /identity/v3/users/10629371687c4bceb7ea078fa49e4484 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:35.601316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a3652-faf2-4a23-9eb0-4b01bf5963e3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:35.701676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:35.702517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.703092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.704156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.718930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:35.722484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:35.887641 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3246/6487] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:35 2022] POST /identity/v3/users => generated 287 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:35.888668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:35.926359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ba77-4979-4a21-8aaf-dbdaeb51edc3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:35.956502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:35.972482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:35.973941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:35.974516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:35.976709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:35.978888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:36.018569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3242/6488] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:15:36.023585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.052737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588afae-aeef-45dc-b67d-6eae05cf87c0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.060206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.061560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.061911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.062106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.063331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:36.065051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:36.085431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3247/6489] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:36.086193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.100537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb337b4-18a2-4e05-ac8b-08c3b0101101 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.107661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c609-bf69-4857-adaa-8fe0b50b84ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.108875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c609-bf69-4857-adaa-8fe0b50b84ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.109358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c609-bf69-4857-adaa-8fe0b50b84ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.109836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c609-bf69-4857-adaa-8fe0b50b84ef admin admin] PATH_INFO: `/v3/projects/52e170dc53d04d26a4e60da4983d1b34/users/b39018af55be486dbaebc559084bd106/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.155701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1c609-bf69-4857-adaa-8fe0b50b84ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e170dc53d04d26a4e60da4983d1b34, user_id=b39018af55be486dbaebc559084bd106, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:36.159003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1c609-bf69-4857-adaa-8fe0b50b84ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:36.181416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.186753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.226333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075a76-906a-4b66-a344-892faac4a3e7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.249149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.249788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.251106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.251106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] PATH_INFO: `/v3/projects/dd2662c986324ee1a51c45374ae8bf83` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.255899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2662c986324ee1a51c45374ae8bf83)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:36.257836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:36.335716 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3243/6490] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:36 2022] PUT /identity/v3/projects/52e170dc53d04d26a4e60da4983d1b34/users/b39018af55be486dbaebc559084bd106/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:36.339627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.345987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.345987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.382001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] MFA Rules not processed for user `b39018af55be486dbaebc559084bd106`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:36.383762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.475822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3244/6491] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:36.489485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2662c986324ee1a51c45374ae8bf83', 'request_id': 'req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:36.492179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.495984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.504948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2662c986324ee1a51c45374ae8bf83', 'request_id': 'req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:36.517851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2662c986324ee1a51c45374ae8bf83', 'request_id': 'req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:36.586056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea1c94-eddd-4383-bd31-bc1a917ed745 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.647880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] The token cache is being invalidate because project dd2662c986324ee1a51c45374ae8bf83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:36.648607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:36.649793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4aeefbbe-0b87-4bbf-b5c5-62aff6d956eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:36.652399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3248/6492] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:36 2022] DELETE /identity/v3/projects/dd2662c986324ee1a51c45374ae8bf83 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:36.654676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.655505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.655969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.656375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.658165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db363e5-16f7-4a0b-8661-06fc3b75044f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.658854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db363e5-16f7-4a0b-8661-06fc3b75044f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.659157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.664358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db363e5-16f7-4a0b-8661-06fc3b75044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.691255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9db363e5-16f7-4a0b-8661-06fc3b75044f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:36.693038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9db363e5-16f7-4a0b-8661-06fc3b75044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.752255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:36.754026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:36.770492 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3245/6493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:15:36.772401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.778833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.785784 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3249/6494] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:36.796238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.796559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.796813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.821543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:36.824620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.840673 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3250/6495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:36.842035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.854632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dfa23-1a2c-4f7e-b034-de2d8ab71871 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.870389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.870389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.870389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.870389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.870973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:36.870973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:36.870973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:36.919122 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3251/6496] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:36.928276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:36.953687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d253abd-a5b7-41d4-b9bc-4da2bd224984 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.967679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c962-aa02-4155-bf02-fb17731afd0c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:36.969830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.970627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.974054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.974315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.982934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:36.987335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:36.988081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:36.988378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:36.988670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:36.992799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:36.996996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:37.026190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:37.030965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:37.073907 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3246/6497] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:37.196111 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3252/6498] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:36 2022] POST /identity/v3/projects => generated 379 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:37.197107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:37.218700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07670d6c-0d2e-4e78-8395-450a98cc04d6 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:37.252368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:37.429468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:37.430801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:37.431275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:37.431637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:37.432380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:37.434727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:37.569594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3247/6499] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:37 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:15:37.574055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:37.597508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7975-8282-456a-ab0a-586765896e62 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:37.606727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:37.609799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:37.609799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:37.609799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:37.609799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:37.612397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:37.626995 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3253/6500] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:37.637209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:37.654163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:37.658277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ed924-6d82-4793-9670-dd0d603aadeb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:37.667356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344bca2-be06-4d00-a17f-f30ab8b7e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:37.667997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bca2-be06-4d00-a17f-f30ab8b7e553 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:37.671151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bca2-be06-4d00-a17f-f30ab8b7e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:37.671483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bca2-be06-4d00-a17f-f30ab8b7e553 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:37.672209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344bca2-be06-4d00-a17f-f30ab8b7e553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:37.676498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344bca2-be06-4d00-a17f-f30ab8b7e553 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:37.697547 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3248/6501] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:15:37.699303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:37.714173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619116cc-8cc7-414b-829a-e72f77432484 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:37.719863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:37.722230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:37.722748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:37.723285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] PATH_INFO: `/v3/projects/208a457b167e497ab5fc0b63cee8b85c/users/7dec6a381d98493c9cef244f20002949/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:37.756069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208a457b167e497ab5fc0b63cee8b85c, user_id=7dec6a381d98493c9cef244f20002949, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:37.760627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:37.938883 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3254/6502] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:37 2022] PUT /identity/v3/projects/208a457b167e497ab5fc0b63cee8b85c/users/7dec6a381d98493c9cef244f20002949/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:37.944412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:37.944976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:37.945489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:37.970289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:37.971877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:37.982103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:37.985100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:38.099227 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3249/6503] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:38.106597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973cf4-cace-4f2f-91ce-1489afd84598 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:38.123851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:38.124961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:38.126266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:38.126558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:38.126833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] PATH_INFO: `/v3/users/b39018af55be486dbaebc559084bd106` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:38.128415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39018af55be486dbaebc559084bd106)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:38.130414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:38.132106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:38.289022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193289-e26a-4d77-b5a4-66a2b0b7dbd3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:38.292915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7a45-4891-4e24-8c1a-4ee0a5a7c642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:38.293750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7a45-4891-4e24-8c1a-4ee0a5a7c642 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:38.294038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7a45-4891-4e24-8c1a-4ee0a5a7c642 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:38.294323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7a45-4891-4e24-8c1a-4ee0a5a7c642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:38.305800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d7a45-4891-4e24-8c1a-4ee0a5a7c642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:38.307500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d7a45-4891-4e24-8c1a-4ee0a5a7c642 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:38.318745 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3250/6504] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:38.519527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39018af55be486dbaebc559084bd106'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:38.528495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39018af55be486dbaebc559084bd106'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:38.529248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39018af55be486dbaebc559084bd106'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:38.529932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39018af55be486dbaebc559084bd106'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:38.554058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39018af55be486dbaebc559084bd106'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:38.745081 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3255/6505] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:37 2022] DELETE /identity/v3/users/b39018af55be486dbaebc559084bd106 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:38.749746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2253d5-a844-44f0-a5ec-d647406b24fa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:38.750146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2253d5-a844-44f0-a5ec-d647406b24fa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:38.750492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2253d5-a844-44f0-a5ec-d647406b24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:38.773430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3e2253d5-a844-44f0-a5ec-d647406b24fa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:38.775277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e2253d5-a844-44f0-a5ec-d647406b24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:38.897920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3251/6506] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:38.920555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:38.922821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:38.932328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:39.012252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05be22c-2e78-4443-97b6-067a1ea1b1cf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:39.021272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:39.022933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:39.022933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:39.023267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:39.036170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:39.037726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:39.057180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3256/6507] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:39.279464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:39.845214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:39.846175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:39.846581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:39.874291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:39.894442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:39.939132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:39.941317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:39.965017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0da55-888f-4a42-b141-046cb2919dc2 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:39.973892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:39.974823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:39.975411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:39.975913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] PATH_INFO: `/v3/projects/52e170dc53d04d26a4e60da4983d1b34` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:39.978045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e170dc53d04d26a4e60da4983d1b34)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:39.981320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:40.049686 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3252/6508] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:15:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:40.164443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e170dc53d04d26a4e60da4983d1b34', 'request_id': 'req-e3403f2c-79f0-49e3-b826-6acd667f8cea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:40.173474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e170dc53d04d26a4e60da4983d1b34', 'request_id': 'req-e3403f2c-79f0-49e3-b826-6acd667f8cea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:40.184024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e170dc53d04d26a4e60da4983d1b34', 'request_id': 'req-e3403f2c-79f0-49e3-b826-6acd667f8cea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:40.248219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:40.249847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:40.299132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] The token cache is being invalidate because project 52e170dc53d04d26a4e60da4983d1b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:40.299769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:40.301499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e3403f2c-79f0-49e3-b826-6acd667f8cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:40.305820 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3257/6509] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:39 2022] DELETE /identity/v3/projects/52e170dc53d04d26a4e60da4983d1b34 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:40.314455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01647-508c-4e7a-af2e-57eff7945672 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.315090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01647-508c-4e7a-af2e-57eff7945672 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.315590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01647-508c-4e7a-af2e-57eff7945672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.365273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-44f01647-508c-4e7a-af2e-57eff7945672 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:40.366829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44f01647-508c-4e7a-af2e-57eff7945672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:40.376495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f43bb-e84f-42e0-af50-72f3aa82bfc7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:40.503042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:40.508686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.508686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.508686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.508686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:40.522424 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3258/6510] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:40.534065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.534359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.534646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.590290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] MFA Rules not processed for user `7dec6a381d98493c9cef244f20002949`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:40.593309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:40.598925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:40.600589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500f87c-1e69-479d-a976-0432d0358379 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:40.612994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3253/6511] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:15:40.614419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.614713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.615085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.621220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:40.670101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:40.702872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:40.705590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:40.754409 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3254/6512] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:40.758604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:40.818284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba4ec-9924-4f21-b6e8-2b4678b03122 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:40.838283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3259/6513] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:40.849302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:40.855664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:40.861046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:40.865187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.867386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.868918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.870475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:40.870971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:40.873178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:40.891588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3255/6514] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:40.902054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:40.902341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e9d1-a7d4-4214-a05e-d0b0adb749c8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:40.909162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:40.909856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.910174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.914223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.914625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:40.918634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:40.927147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25053a5a-f02f-46c8-ace7-b7b31e45e24c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:40.938967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:40.939630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:40.939902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:40.940372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:40.941205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:40.952503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:41.066208 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3260/6515] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:40 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:41.067862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:41.120254 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3256/6516] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:40 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:41.121783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:41.293824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3414e6-9d49-4bcc-afe9-58636cb34b45 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:41.410191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8103-69fd-44b1-b61c-fc93bebfbeb1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:41.433276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:41.436043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:41.439400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:41.439990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:41.441752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:41.454022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:41.540128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:41.542512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:41.543149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:41.546291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:41.546291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:41.564875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:41.664192 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3257/6517] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:41 2022] POST /identity/v3/users => generated 286 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:15:41.666276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:41.711061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e23e6-6e5b-4ee3-b591-103f0867b8be admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:41.729970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:41.734061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:41.735550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:41.736131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:41.739213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:41.763809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:41.775688 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3261/6518] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:41 2022] POST /identity/v3/users => generated 295 bytes in 701 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:41.778905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:41.819741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4aa80-1acb-4e34-afc8-4448c8cf2d78 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:41.828068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:41.829476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:41.829844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:41.831083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:41.835202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:41.835479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3258/6519] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:41.835636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:41.837235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:41.854822 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3262/6520] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:41.858674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:41.891588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def613fe-c666-4113-a7b1-07f687750c5d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:41.896664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cbfbc-b6a6-457f-95db-e581d273cc22 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:41.923036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:41.928126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:41.929909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:41.930608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:41.933326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:41.935352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:41.935867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] PATH_INFO: `/v3/projects/9afcd63bc0bb4c0d8bfc9d28cce454d6/users/3ae91cd00a554808ad5d1d56af80266d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:41.936319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:41.938645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:41.952632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:41.992943 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3259/6521] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:41.996623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:42.041220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ebd0c-3935-464f-9279-257b30c2562f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:42.044092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afcd63bc0bb4c0d8bfc9d28cce454d6, user_id=3ae91cd00a554808ad5d1d56af80266d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:42.046736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:42.047380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50c994-577b-4a76-9c46-61172fc9cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:42.051459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c994-577b-4a76-9c46-61172fc9cf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:42.052196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c994-577b-4a76-9c46-61172fc9cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:42.052990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c994-577b-4a76-9c46-61172fc9cf6e admin admin] PATH_INFO: `/v3/projects/910e6fb181f4408680db643c0d1c4613/users/87a09826a4c149b19645ba0cd5ab37e0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:42.099780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50c994-577b-4a76-9c46-61172fc9cf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=910e6fb181f4408680db643c0d1c4613, user_id=87a09826a4c149b19645ba0cd5ab37e0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:42.102362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50c994-577b-4a76-9c46-61172fc9cf6e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:42.141213 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3263/6522] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:41 2022] PUT /identity/v3/projects/9afcd63bc0bb4c0d8bfc9d28cce454d6/users/3ae91cd00a554808ad5d1d56af80266d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:15:42.142594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:42.227099 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3260/6523] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:41 2022] PUT /identity/v3/projects/910e6fb181f4408680db643c0d1c4613/users/87a09826a4c149b19645ba0cd5ab37e0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:42.232928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:42.233229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:42.233521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:42.266920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaf7ea-b7a7-41c9-a039-36333209c038 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:42.310123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] MFA Rules not processed for user `87a09826a4c149b19645ba0cd5ab37e0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:42.311509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:42.359816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:42.418491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:42.420428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:42.420824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:42.422588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:42.423428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:42.427210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:42.453007 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3264/6524] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:42.456583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:42.489852 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3261/6525] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:42.500794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21039e-bcdc-46e6-af35-335e0ece28d0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:42.508377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18a76-b802-44c5-98cb-73de74af765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:42.509669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18a76-b802-44c5-98cb-73de74af765b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:42.510247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18a76-b802-44c5-98cb-73de74af765b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:42.510389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:42.510855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18a76-b802-44c5-98cb-73de74af765b admin admin] PATH_INFO: `/v3/projects/9afcd63bc0bb4c0d8bfc9d28cce454d6/users/3ae91cd00a554808ad5d1d56af80266d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:42.511799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:42.513864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18a76-b802-44c5-98cb-73de74af765b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afcd63bc0bb4c0d8bfc9d28cce454d6, user_id=3ae91cd00a554808ad5d1d56af80266d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:42.522786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18a76-b802-44c5-98cb-73de74af765b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:42.541677 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3265/6526] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:42 2022] PUT /identity/v3/projects/9afcd63bc0bb4c0d8bfc9d28cce454d6/users/3ae91cd00a554808ad5d1d56af80266d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:42.668305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa93b56-cb8b-4fa0-be08-8ccd64f75c08 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:42.808494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b283-6db8-4921-b305-563070411cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:42.810793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b283-6db8-4921-b305-563070411cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:42.813259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b283-6db8-4921-b305-563070411cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:42.815680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b283-6db8-4921-b305-563070411cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:42.960057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406b283-6db8-4921-b305-563070411cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:42.962284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406b283-6db8-4921-b305-563070411cc3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:42.979777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:42.996620 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3262/6527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:15:43.127506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:43.493434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:44.413776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:45.774111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:45.775290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:45.775810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:45.849462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:45.876737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] MFA Rules not processed for user `3ae91cd00a554808ad5d1d56af80266d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:45.887885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:46.052139 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3266/6528] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:46.054399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:46.055188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:46.055652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:46.092502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] MFA Rules not processed for user `7dec6a381d98493c9cef244f20002949`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:46.099305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:46.329562 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3263/6529] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:46.353987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:46.355755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:46.541927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a056cc0-e280-48d5-97c9-669145a47862 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:46.549814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:46.550793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:46.551299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:46.553397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:46.578873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:46.580948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:46.626886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3267/6530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:49.155662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:49.159488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:49.334067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8a50-ea64-4698-bca4-f0beae0caa83 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:49.342214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:49.342867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:49.343193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:49.343555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:49.347467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:49.395145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:49.396398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:49.429418 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3264/6531] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:15:51.622950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:51.628285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:51.851428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25ff7-faca-451b-b0c7-fe5a8d320893 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:51.859394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:51.860541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:51.861152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:51.861750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] PATH_INFO: `/v3/users/a27aefd012a34168bf5e9e1b6d68195b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:51.868981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27aefd012a34168bf5e9e1b6d68195b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:51.875573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:51.981266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:52.295585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27aefd012a34168bf5e9e1b6d68195b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:52.309799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27aefd012a34168bf5e9e1b6d68195b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:52.311988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27aefd012a34168bf5e9e1b6d68195b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:52.313057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27aefd012a34168bf5e9e1b6d68195b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:52.345866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3f690d60-2b5e-4d57-b28e-affaa7b93425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27aefd012a34168bf5e9e1b6d68195b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:52.485462 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3268/6532] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:51 2022] DELETE /identity/v3/users/a27aefd012a34168bf5e9e1b6d68195b => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:53.209440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:53.236977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af90b9-5bc4-4ddf-b895-3021c62dc9b7 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:53.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:53.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:53.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:53.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:53.360761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] PATH_INFO: `/v3/projects/484053c22101496a920ce98bbc707f3d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:53.360761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=484053c22101496a920ce98bbc707f3d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:53.360761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:53.765710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484053c22101496a920ce98bbc707f3d', 'request_id': 'req-5296f56d-6952-4ede-b5db-4c1df83f9b15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:53.797378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484053c22101496a920ce98bbc707f3d', 'request_id': 'req-5296f56d-6952-4ede-b5db-4c1df83f9b15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:53.817248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484053c22101496a920ce98bbc707f3d', 'request_id': 'req-5296f56d-6952-4ede-b5db-4c1df83f9b15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:53.963080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] The token cache is being invalidate because project 484053c22101496a920ce98bbc707f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:53.963635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:53.966009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5296f56d-6952-4ede-b5db-4c1df83f9b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:53.971891 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3265/6533] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:53 2022] DELETE /identity/v3/projects/484053c22101496a920ce98bbc707f3d => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:53.973685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:53.975690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:53.976629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.009247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:54.010793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:54.113502 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3269/6534] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:54.121735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:54.122094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:54.122384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.194770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:54.196153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:54.217188 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3266/6535] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:54.221527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:54.236965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6badd-eca4-4994-ac20-6062a8abb968 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:54.248067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:54.248725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:54.249010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:54.249338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.250733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:54.251113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:54.253999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:54.275326 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3270/6536] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:54.277389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:54.318494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b584f-24e1-48de-b9f8-5b14c4ad404c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:54.336356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:54.337135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:54.337565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:54.337862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.338503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:54.340489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:54.482477 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3267/6537] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:54 2022] POST /identity/v3/projects => generated 397 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:54.483257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:54.503695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4874d75-28a3-45d9-8c85-bac09c9678a0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:54.659041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:54.660002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:54.660591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:54.661056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.661870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:54.668095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:54.885495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:54.896534 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3271/6538] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:54 2022] POST /identity/v3/users => generated 299 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:15:54.911165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1fb3-2714-4103-8383-35332b810fff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:54.914967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:54.915782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:54.916146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:54.916510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.917810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:54.919615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:54.944892 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3268/6539] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:54.947550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:54.966878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890585e0-0187-49cb-b477-75392be17ccb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:54.982227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:54.983490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:54.983832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:54.984114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:54.994729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:54.996546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:55.022239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3272/6540] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:15:55.026142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:55.042991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87638012-1a22-4a38-965a-1b703d53dd13 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:55.055826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8da9f-707e-4c9b-aed7-b65f11580634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:55.056522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8da9f-707e-4c9b-aed7-b65f11580634 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:55.056814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8da9f-707e-4c9b-aed7-b65f11580634 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:55.056947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:55.057072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8da9f-707e-4c9b-aed7-b65f11580634 admin admin] PATH_INFO: `/v3/projects/a8f9e8b0567547a1a507d7a3535227c1/users/c1bd5f8a50254c598ac51debcb68dd7f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:55.059779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:55.086547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf3698-ebf0-4ff3-baa7-646c6157295d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:55.095531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8da9f-707e-4c9b-aed7-b65f11580634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f9e8b0567547a1a507d7a3535227c1, user_id=c1bd5f8a50254c598ac51debcb68dd7f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:55.099048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8da9f-707e-4c9b-aed7-b65f11580634 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:55.108092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:55.109372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:55.109873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:55.110353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] PATH_INFO: `/v3/users/b69f87914d26428a9c4895f47a3cb4b0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:55.112030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69f87914d26428a9c4895f47a3cb4b0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:55.115003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:55.117328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:55.213881 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3269/6541] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:55 2022] PUT /identity/v3/projects/a8f9e8b0567547a1a507d7a3535227c1/users/c1bd5f8a50254c598ac51debcb68dd7f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:55.222572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:55.228973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:55.228973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:55.293734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:55.297104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:55.394981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:55.425889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69f87914d26428a9c4895f47a3cb4b0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:55.438301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69f87914d26428a9c4895f47a3cb4b0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:55.439468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69f87914d26428a9c4895f47a3cb4b0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:55.440106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69f87914d26428a9c4895f47a3cb4b0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:55.462995 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3270/6542] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:55.478263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:55.480491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-206c000e-d953-43cc-9eef-75e81e4a5f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69f87914d26428a9c4895f47a3cb4b0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:55.481587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:55.588669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402850f-9964-4d66-8e9f-e405c13827b4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:55.593469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:55.594199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:55.594649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:55.595065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:55.616521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:55.619437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:55.647708 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3273/6543] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:15:55 2022] DELETE /identity/v3/users/b69f87914d26428a9c4895f47a3cb4b0 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:55.651215 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3271/6544] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:55.654324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:55.654836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:55.656209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:55.695224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:55.698646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:55.829556 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3274/6545] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:55.848906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:55.870245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecad26c-f0ef-421c-adb3-8d11e65e46ec service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:55.993668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0e934-44de-4868-8da8-63a52ebe8211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:55.994770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e934-44de-4868-8da8-63a52ebe8211 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:55.995447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e934-44de-4868-8da8-63a52ebe8211 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:55.996105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0e934-44de-4868-8da8-63a52ebe8211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:56.008361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0e934-44de-4868-8da8-63a52ebe8211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:56.011295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0e934-44de-4868-8da8-63a52ebe8211 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:56.026752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3272/6546] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:15:57.037200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:57.042498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:57.069819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21982b-fd3a-4809-82dd-cc6fa9ac8520 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:57.076693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:57.078075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:57.078375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:57.078659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] PATH_INFO: `/v3/projects/36423ada893145ba9751e28c63ac2942` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:57.081346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36423ada893145ba9751e28c63ac2942)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:57.084010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:57.291307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36423ada893145ba9751e28c63ac2942', 'request_id': 'req-22c56960-51d4-4c65-b31d-9365527e7d08'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:57.310235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36423ada893145ba9751e28c63ac2942', 'request_id': 'req-22c56960-51d4-4c65-b31d-9365527e7d08'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:57.332072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36423ada893145ba9751e28c63ac2942', 'request_id': 'req-22c56960-51d4-4c65-b31d-9365527e7d08'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:57.445123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] The token cache is being invalidate because project 36423ada893145ba9751e28c63ac2942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:15:57.445686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:57.446905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-22c56960-51d4-4c65-b31d-9365527e7d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:15:57.449095 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3275/6547] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:15:57 2022] DELETE /identity/v3/projects/36423ada893145ba9751e28c63ac2942 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:57.454046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:57.455221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:57.458494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:57.491698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:57.494147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:57.638214 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3273/6548] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:57.645539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:57.645943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:57.646359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:57.676658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:57.719462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:57.721169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:57.743130 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3276/6549] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:15:57.748897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:57.761148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844d4ad-577a-48db-b219-bc7cd13f7294 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:57.772753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:57.773429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:57.774214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:57.774504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:57.776551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:15:57.776946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:57.779316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:57.802504 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3274/6550] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:15:57.806999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:57.820137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35cc55-a9c4-48c4-a37f-bb1732662455 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:57.831867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:57.832512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:57.832785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:57.833165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:57.833858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:57.849816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:58.021174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:58.022907 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3277/6551] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:15:57 2022] POST /identity/v3/projects => generated 363 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:58.033699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89bdee-65d5-4db9-884e-e991f9c7c704 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:58.044652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:15:58.146831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:58.156774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:58.157170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:58.157464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:58.158309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:58.161112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:58.309014 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3275/6552] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:15:58 2022] POST /identity/v3/users => generated 282 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:15:58.314156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:58.334402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98a57c-1c9c-4c2d-80fd-0f9f45793bf8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:58.345929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:58.346772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:58.349518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:58.350222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:58.352208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:58.356278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:58.392270 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3278/6553] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:58.393408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:58.415732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258394-71c0-4f7a-a296-a18f2ff39beb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:58.432031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53724806-d400-4418-a8e6-fea536ba2326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:58.433137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53724806-d400-4418-a8e6-fea536ba2326 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:58.433665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53724806-d400-4418-a8e6-fea536ba2326 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:58.434802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53724806-d400-4418-a8e6-fea536ba2326 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:58.436280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53724806-d400-4418-a8e6-fea536ba2326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:58.438808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53724806-d400-4418-a8e6-fea536ba2326 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:58.470738 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3276/6554] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:15:58.475408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:58.493754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2440-9fe3-4554-971e-1794f50bf33f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:58.514012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:58.514764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:58.519844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:58.519844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] PATH_INFO: `/v3/projects/232248dfdc77480199901c7fc7147e79/users/d6c49761d7ef4615b55c8edd9c782e12/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:58.565434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232248dfdc77480199901c7fc7147e79, user_id=d6c49761d7ef4615b55c8edd9c782e12, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:58.572907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:58.699083 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3279/6555] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:15:58 2022] PUT /identity/v3/projects/232248dfdc77480199901c7fc7147e79/users/d6c49761d7ef4615b55c8edd9c782e12/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:15:58.707244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:58.707531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:58.707972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:58.809168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] MFA Rules not processed for user `d6c49761d7ef4615b55c8edd9c782e12`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:15:58.811078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:59.048971 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3277/6556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:15:59.049392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:15:59.049392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:15:59.101348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559f1cf-b154-45a2-933c-5838e721b487 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:15:59.108872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b11ec-55b9-4186-8559-8c0cdffb1f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:15:59.109607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b11ec-55b9-4186-8559-8c0cdffb1f6f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:15:59.109894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b11ec-55b9-4186-8559-8c0cdffb1f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:15:59.110176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b11ec-55b9-4186-8559-8c0cdffb1f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:15:59.129091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b11ec-55b9-4186-8559-8c0cdffb1f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:15:59.131461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b11ec-55b9-4186-8559-8c0cdffb1f6f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:15:59.144944 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3280/6557] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:02.667123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:02.671590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:02.778678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ba6b0-3a0e-4d17-a0ed-69c2ee00d78e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:02.784749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:02.785394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:02.785682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:02.785964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:02.787859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:02.804198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:02.806043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c81d85-9bc6-41c5-8084-7a14e06be10b service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:02.831474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3278/6558] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:06.525600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae015a7-846b-4585-b528-3294bd454907 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:06.525600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae015a7-846b-4585-b528-3294bd454907 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:06.525600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae015a7-846b-4585-b528-3294bd454907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:06.571465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-aae015a7-846b-4585-b528-3294bd454907 None None] MFA Rules not processed for user `c1bd5f8a50254c598ac51debcb68dd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:06.572976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aae015a7-846b-4585-b528-3294bd454907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:06.701748 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3281/6559] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:06.715578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:06.715578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:06.715578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:06.725044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:06.738367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] MFA Rules not processed for user `c1bd5f8a50254c598ac51debcb68dd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:06.740001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:06.752353 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3279/6560] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:06.958949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae015a7-846b-4585-b528-3294bd454907 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:06.993382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae015a7-846b-4585-b528-3294bd454907 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:07.002702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:07.003997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:07.003997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:07.004219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:07.019050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:07.026774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:07.042825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3282/6561] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:08.843122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:08.844570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:08.987875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034343d-6d14-43ba-98d6-b86427498e20 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:09.000707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:09.001508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:09.002571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:09.002926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:09.005856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:09.037060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:09.040049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:09.069556 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3280/6562] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:09.582452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:09.596081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1045-e7bd-454d-b704-894fede24c9b service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:09.600585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:09.603102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:09.603682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:09.604212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:09.612283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:09.649058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:09.656400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:09.689051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3283/6563] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:09.954463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:09.981065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605fcbd-58d7-4870-b47c-72ecfa131dbc service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:09.992736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:09.993740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:09.994267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:09.994745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:10.001969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:10.022776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:10.024733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c4701-effe-4bdb-bc5d-8864542cc95e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:10.049373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3281/6564] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:12.572489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:12.581803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:12.587349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805e1b2-7fe6-4c1f-85c7-95165eccaab8 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:12.595326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:12.596416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:12.596941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:12.597425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:12.599817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:12.615880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:12.617425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:12.634815 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3284/6565] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:14.501375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:14.502293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:14.502892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:14.566862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:14.568909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:14.716354 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3282/6566] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:16:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:16:14.739245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:14.740742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:14.912166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d9fc-1003-41fc-a162-115d13e280c3 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:14.921517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:14.922834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:14.923435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:14.923900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:14.937029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:14.938925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:14.948753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3285/6567] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:16:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:17.140641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:17.166642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2d11-d46b-4804-8c0c-0e00834a0032 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:17.200050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:17.204828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:17.207446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:17.207798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:17.226808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:17.259122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:17.273721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:17.317619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3283/6568] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:24.944586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=36 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:25.980802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:26.036219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7585204-09b1-432d-ba4c-85f73acc0cc3 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:26.052853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:26.055197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:26.056089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:26.056887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:26.090032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:26.124121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:26.128965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:26.189402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3286/6569] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:27.292574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=68 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:31.541950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:31.544980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:31.627528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ba09-0234-418f-82c5-81139719853b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:31.633903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:31.634609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:31.634892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:31.635224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] PATH_INFO: `/v3/users/7dec6a381d98493c9cef244f20002949` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:31.636476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dec6a381d98493c9cef244f20002949)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:31.638406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:31.927135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dec6a381d98493c9cef244f20002949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:31.938670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dec6a381d98493c9cef244f20002949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:31.940629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dec6a381d98493c9cef244f20002949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:31.961591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dec6a381d98493c9cef244f20002949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:31.962513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dec6a381d98493c9cef244f20002949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:32.087259 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3284/6570] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:16:31 2022] DELETE /identity/v3/users/7dec6a381d98493c9cef244f20002949 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:32.560523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:32.574906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52f997-c76a-4ec2-b551-ca9d3abf5f83 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:32.649930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:32.650664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:32.651039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:32.651431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] PATH_INFO: `/v3/projects/208a457b167e497ab5fc0b63cee8b85c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:32.654454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208a457b167e497ab5fc0b63cee8b85c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:32.655245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:32.795215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208a457b167e497ab5fc0b63cee8b85c', 'request_id': 'req-d127bddd-32f4-4365-bee7-3e3c44de3e46'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:32.803651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208a457b167e497ab5fc0b63cee8b85c', 'request_id': 'req-d127bddd-32f4-4365-bee7-3e3c44de3e46'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:32.812177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208a457b167e497ab5fc0b63cee8b85c', 'request_id': 'req-d127bddd-32f4-4365-bee7-3e3c44de3e46'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:32.969014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] The token cache is being invalidate because project 208a457b167e497ab5fc0b63cee8b85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:16:32.969933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:32.971069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:32.973710 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3287/6571] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:16:32 2022] DELETE /identity/v3/projects/208a457b167e497ab5fc0b63cee8b85c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:32.978257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:32.979919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:32.994879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64bf69-f418-49b0-9875-2fd65bd3d9ba admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:33.143232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:33.146634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:33.146634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:33.146634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] PATH_INFO: `/v3/users/3ae91cd00a554808ad5d1d56af80266d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:33.146634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae91cd00a554808ad5d1d56af80266d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:33.148640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:33.201943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:33.570925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae91cd00a554808ad5d1d56af80266d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:33.580042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae91cd00a554808ad5d1d56af80266d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:33.580864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae91cd00a554808ad5d1d56af80266d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:33.593396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae91cd00a554808ad5d1d56af80266d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:33.594566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-56913abe-a253-4d38-8fe2-0b8be4bb7ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae91cd00a554808ad5d1d56af80266d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:33.679396 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3285/6572] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:16:32 2022] DELETE /identity/v3/users/3ae91cd00a554808ad5d1d56af80266d => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:34.116711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:34.118624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:34.134648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127bddd-32f4-4365-bee7-3e3c44de3e46 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:34.221160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:34.221889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:34.222171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:34.222438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] PATH_INFO: `/v3/projects/9afcd63bc0bb4c0d8bfc9d28cce454d6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:34.224365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afcd63bc0bb4c0d8bfc9d28cce454d6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:34.226560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:34.262202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:34.428709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afcd63bc0bb4c0d8bfc9d28cce454d6', 'request_id': 'req-a97512d2-fb9a-462c-9d19-0cd520712d87'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:34.436943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afcd63bc0bb4c0d8bfc9d28cce454d6', 'request_id': 'req-a97512d2-fb9a-462c-9d19-0cd520712d87'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:34.444561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afcd63bc0bb4c0d8bfc9d28cce454d6', 'request_id': 'req-a97512d2-fb9a-462c-9d19-0cd520712d87'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:34.566969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] The token cache is being invalidate because project 9afcd63bc0bb4c0d8bfc9d28cce454d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:16:34.567681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:34.569747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:34.584443 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3288/6573] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:16:34 2022] DELETE /identity/v3/projects/9afcd63bc0bb4c0d8bfc9d28cce454d6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:37.260965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:37.263463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:37.263947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:37.294903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:37.296943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:37.412781 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3286/6574] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:16:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:37.427331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:37.428776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:37.525703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97512d2-fb9a-462c-9d19-0cd520712d87 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:37.530661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:37.531327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:37.531611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:37.531886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:37.546615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:37.551686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:37.558367 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3289/6575] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:16:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:16:40.478243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:40.481024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:40.631116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9189d0-8293-41eb-a121-d0fe286f842f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:40.636853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:40.638509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:40.639077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:40.639600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] PATH_INFO: `/v3/users/c1bd5f8a50254c598ac51debcb68dd7f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:40.641106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bd5f8a50254c598ac51debcb68dd7f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:40.643527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:40.974514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:40.976517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bd5f8a50254c598ac51debcb68dd7f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:40.987996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bd5f8a50254c598ac51debcb68dd7f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:40.988910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bd5f8a50254c598ac51debcb68dd7f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:41.008887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bd5f8a50254c598ac51debcb68dd7f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:41.009656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a74e35a-215e-4926-a888-cb5e57ebb566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bd5f8a50254c598ac51debcb68dd7f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:41.146103 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3287/6576] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:16:40 2022] DELETE /identity/v3/users/c1bd5f8a50254c598ac51debcb68dd7f => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:41.588764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:41.602705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6075fb-c351-4f0e-a02b-3682593b0c4b service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:41.754022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:41.754804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:41.755204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:41.755849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] PATH_INFO: `/v3/projects/a8f9e8b0567547a1a507d7a3535227c1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:41.757928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f9e8b0567547a1a507d7a3535227c1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:41.760684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:41.928358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:41.940408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f9e8b0567547a1a507d7a3535227c1', 'request_id': 'req-b9544200-c01a-4824-8815-43acd51a6661'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:41.947546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f9e8b0567547a1a507d7a3535227c1', 'request_id': 'req-b9544200-c01a-4824-8815-43acd51a6661'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:41.955772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f9e8b0567547a1a507d7a3535227c1', 'request_id': 'req-b9544200-c01a-4824-8815-43acd51a6661'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:42.089863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] The token cache is being invalidate because project a8f9e8b0567547a1a507d7a3535227c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:16:42.090331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:42.091713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b9544200-c01a-4824-8815-43acd51a6661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:42.094540 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3290/6577] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:16:41 2022] DELETE /identity/v3/projects/a8f9e8b0567547a1a507d7a3535227c1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:42.102697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.103258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.103394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.153997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:42.155331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:42.268927 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3288/6578] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:42.281886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.281886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.281886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.308799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:42.313478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:42.330454 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3291/6579] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:42.336510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:42.343122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ce0d7-dedc-4c45-a805-3f8b5f11533a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:42.350808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:42.352991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.353474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.353788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:16:42.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:42.358717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:42.374594 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3289/6580] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:16:42.383065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:42.402728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d0e0-5667-4516-a4cb-d7fb44d2271d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:42.411660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:42.412441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.412839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.414525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.415309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:42.421535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:42.557524 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3292/6581] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:16:42 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:16:42.561622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:42.573175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3e51d-619d-4a77-9f56-22e56a7a4209 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:42.665707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:42.666827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.667360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.667856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.668731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:42.672806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:42.811254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:42.812375 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3290/6582] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:16:42 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:16:42.830422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c677e-e8ad-45e7-a28e-d70d67192ea9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:42.843538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:42.844520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.846633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.847282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.848138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:42.849828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:42.873964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3293/6583] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:16:42.884466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:42.899531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9650-dddc-449a-bd79-fe2253bad4d0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:42.908766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b390bea-4c49-4077-9b4b-3824714fcb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:42.909457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b390bea-4c49-4077-9b4b-3824714fcb78 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.909696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b390bea-4c49-4077-9b4b-3824714fcb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.909975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b390bea-4c49-4077-9b4b-3824714fcb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:42.910633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b390bea-4c49-4077-9b4b-3824714fcb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:42.912622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b390bea-4c49-4077-9b4b-3824714fcb78 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:42.926767 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3291/6584] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:16:42.931970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:42.976884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224a2d-7f4a-4318-a46d-c37c7db6dc67 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:42.983141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958d4f9-c173-48c7-a455-94bd52ce2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:42.984292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d4f9-c173-48c7-a455-94bd52ce2971 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:42.985741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d4f9-c173-48c7-a455-94bd52ce2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:42.986287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d4f9-c173-48c7-a455-94bd52ce2971 admin admin] PATH_INFO: `/v3/projects/ef884e8b4c124439bb5b14c191964b65/users/c0e9a9114a614271846751aa8992858a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:43.011406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958d4f9-c173-48c7-a455-94bd52ce2971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef884e8b4c124439bb5b14c191964b65, user_id=c0e9a9114a614271846751aa8992858a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:43.015837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958d4f9-c173-48c7-a455-94bd52ce2971 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:43.092535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3294/6585] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:16:42 2022] PUT /identity/v3/projects/ef884e8b4c124439bb5b14c191964b65/users/c0e9a9114a614271846751aa8992858a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:43.103397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:43.103982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:43.104181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:43.143095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] MFA Rules not processed for user `c0e9a9114a614271846751aa8992858a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:43.144838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:43.169742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:43.243145 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3292/6586] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:16:43.254684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:43.255548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:43.256047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:43.282206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] MFA Rules not processed for user `c0e9a9114a614271846751aa8992858a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:43.283473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:43.290818 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3295/6587] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:43.308284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:43.311419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:43.445406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dbe29-e964-4f85-9154-4072fef28b45 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:43.452363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abddbc-931c-4c7f-b3fa-2051a7a5826f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:43.453292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abddbc-931c-4c7f-b3fa-2051a7a5826f service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:43.453635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abddbc-931c-4c7f-b3fa-2051a7a5826f service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:43.453920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abddbc-931c-4c7f-b3fa-2051a7a5826f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:43.465657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abddbc-931c-4c7f-b3fa-2051a7a5826f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:43.467451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abddbc-931c-4c7f-b3fa-2051a7a5826f service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:43.480546 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3293/6588] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:53.371275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=40,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:54.343336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=53 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:55.453857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:55.548180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe32da-e1cb-4592-b7bf-70b709310ff3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:55.558300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:55.558300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:55.558300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:55.558300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] PATH_INFO: `/v3/users/c0e9a9114a614271846751aa8992858a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:55.559374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e9a9114a614271846751aa8992858a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:55.559374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:55.845535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e9a9114a614271846751aa8992858a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:55.855236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e9a9114a614271846751aa8992858a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:55.856507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e9a9114a614271846751aa8992858a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:55.857231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e9a9114a614271846751aa8992858a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:55.873454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e9a9114a614271846751aa8992858a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:56.246873 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3296/6589] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:16:55 2022] DELETE /identity/v3/users/c0e9a9114a614271846751aa8992858a => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:56.251999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:56.251999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:56.252650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:56.274260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:56.276452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:56.369793 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3294/6590] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:56.381957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:56.384522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:56.467299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd50c4-8b24-4fb9-8cce-b3113cae5363 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:56.473043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb37012-8655-4531-b81f-995b6b153628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:56.473043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37012-8655-4531-b81f-995b6b153628 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:56.473043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37012-8655-4531-b81f-995b6b153628 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:56.473043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb37012-8655-4531-b81f-995b6b153628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:56.484026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb37012-8655-4531-b81f-995b6b153628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:56.486673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb37012-8655-4531-b81f-995b6b153628 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:56.499426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3297/6591] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:16:57.191575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:57.193901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:57.226849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161bd19-d95d-4b95-8eef-409e1d92ea6c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:57.239903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:57.261669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:57.261669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:57.261669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] PATH_INFO: `/v3/projects/ef884e8b4c124439bb5b14c191964b65` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:57.261669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef884e8b4c124439bb5b14c191964b65)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:57.261669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:57.410820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef884e8b4c124439bb5b14c191964b65', 'request_id': 'req-22b234d7-e84a-4db0-84b8-bf9beb509559'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:57.418763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef884e8b4c124439bb5b14c191964b65', 'request_id': 'req-22b234d7-e84a-4db0-84b8-bf9beb509559'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:57.424752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef884e8b4c124439bb5b14c191964b65', 'request_id': 'req-22b234d7-e84a-4db0-84b8-bf9beb509559'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:57.544472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] The token cache is being invalidate because project ef884e8b4c124439bb5b14c191964b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:16:57.548784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:57.548784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-22b234d7-e84a-4db0-84b8-bf9beb509559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:16:57.548784 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3295/6592] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:16:57 2022] DELETE /identity/v3/projects/ef884e8b4c124439bb5b14c191964b65 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:16:57.552715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:57.553275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:57.553275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:57.580227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:57.581459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:57.608099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:57.661737 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3298/6593] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:57.671283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:57.671283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:57.671838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:57.694406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:57.694740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:57.703625 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3296/6594] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:57.707959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:57.722190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44131cd6-f15b-49d3-ad80-074a5c7ba454 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:57.727639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:57.728630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:57.729010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:57.729359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:57.730085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:16:57.730646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:57.732491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:57.747201 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3299/6595] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:16:57.750780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:57.770649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c63bd1-d135-4d10-a005-060c37e647ac None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:57.774522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:57.775312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:57.775921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:57.776524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:57.778403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:57.780836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:57.889384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3297/6596] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:16:57 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:16:57.890520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:57.903406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c3ed9-d9bf-42d9-a58a-74504ed1013d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:57.979728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:57.981180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:57.981180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:57.981180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:57.982205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:57.984330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:58.175088 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3300/6597] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:16:57 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:16:58.177625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:58.198638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aab5bb-f324-40fc-8b1b-c519349be119 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:58.203950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:58.204581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:58.204867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:58.205145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:58.205846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:58.207725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:58.226099 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3298/6598] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:16:58.226230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:58.243903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d692e2-537a-47d1-9453-31b1af070687 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:58.247705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c721d48-51e6-448c-a903-4609cfe0ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:58.248311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c721d48-51e6-448c-a903-4609cfe0ce56 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:58.248612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c721d48-51e6-448c-a903-4609cfe0ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:58.248889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c721d48-51e6-448c-a903-4609cfe0ce56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:58.249538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c721d48-51e6-448c-a903-4609cfe0ce56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:58.251212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c721d48-51e6-448c-a903-4609cfe0ce56 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:58.270276 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3301/6599] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:16:58.271315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:58.282946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3bbc-50ff-41e6-9db7-2963f71b1a67 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:58.288870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:58.290615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:58.291035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:58.301813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] PATH_INFO: `/v3/projects/2b869273c5a9475298fb6bffa028979d/users/a382ba34c82b4c92985855461bf50fea/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:58.312539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b869273c5a9475298fb6bffa028979d, user_id=a382ba34c82b4c92985855461bf50fea, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:58.315465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:58.419777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3299/6600] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:16:58 2022] PUT /identity/v3/projects/2b869273c5a9475298fb6bffa028979d/users/a382ba34c82b4c92985855461bf50fea/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:16:58.422164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda673-72f8-4e52-8156-8417f9221c6e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:58.422661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda673-72f8-4e52-8156-8417f9221c6e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:58.423156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda673-72f8-4e52-8156-8417f9221c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:58.445522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c9bda673-72f8-4e52-8156-8417f9221c6e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:16:58.446830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c9bda673-72f8-4e52-8156-8417f9221c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:58.528869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3302/6601] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:16:58.547336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:16:58.549556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:16:58.578864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:16:58.621804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710c051-20ba-4fc7-bc5c-56f9768f67d8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:16:58.643984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cc29b-d9ba-46d5-9208-923c4bea154c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:16:58.644630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cc29b-d9ba-46d5-9208-923c4bea154c service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:16:58.645052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cc29b-d9ba-46d5-9208-923c4bea154c service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:16:58.645345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cc29b-d9ba-46d5-9208-923c4bea154c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:16:58.660310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cc29b-d9ba-46d5-9208-923c4bea154c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:16:58.662560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cc29b-d9ba-46d5-9208-923c4bea154c service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:16:58.678264 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3300/6602] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:09.489338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:09.490187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:09.490187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:09.540200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] MFA Rules not processed for user `a382ba34c82b4c92985855461bf50fea`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:09.541509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:09.565130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:09.686103 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3303/6603] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:09.688495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:09.689217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:09.689217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:09.728983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] MFA Rules not processed for user `a382ba34c82b4c92985855461bf50fea`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:09.730362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:09.749960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3301/6604] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:09.776856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:09.778362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:09.956741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585749b-db91-4849-bacb-cfa2743e8583 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:09.966982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071e9cb-316f-491d-a7a5-51afddb3d98a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:09.967754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071e9cb-316f-491d-a7a5-51afddb3d98a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:09.968038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071e9cb-316f-491d-a7a5-51afddb3d98a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:09.968511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071e9cb-316f-491d-a7a5-51afddb3d98a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:09.990713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071e9cb-316f-491d-a7a5-51afddb3d98a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:09.990713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071e9cb-316f-491d-a7a5-51afddb3d98a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:10.029453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3304/6605] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:16.705270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:16.706063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:16.757612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d58de-541f-46a8-bc7b-78b77bf220e7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:16.766082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:16.767456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:16.767748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:16.768021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] PATH_INFO: `/v3/users/87a09826a4c149b19645ba0cd5ab37e0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:16.771153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a09826a4c149b19645ba0cd5ab37e0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:16.773206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:17.055556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a09826a4c149b19645ba0cd5ab37e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:17.074541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a09826a4c149b19645ba0cd5ab37e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:17.074541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a09826a4c149b19645ba0cd5ab37e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:17.096477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a09826a4c149b19645ba0cd5ab37e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:17.096477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a09826a4c149b19645ba0cd5ab37e0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:17.210480 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3302/6606] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:17:16 2022] DELETE /identity/v3/users/87a09826a4c149b19645ba0cd5ab37e0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:17:17.215958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:17.216452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:17.216452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:17.243207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:17.248514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:17.325047 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3305/6607] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:17.334743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:17.336366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:17.413808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8dd99a-5a9b-4b77-a50e-de3db8d408ce admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:17.417469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bc6e4-8adf-47b6-a65d-a34cdf7ad9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:17.420044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc6e4-8adf-47b6-a65d-a34cdf7ad9fb service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:17.420044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc6e4-8adf-47b6-a65d-a34cdf7ad9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:17.420044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bc6e4-8adf-47b6-a65d-a34cdf7ad9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:17.428266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bc6e4-8adf-47b6-a65d-a34cdf7ad9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:17.429716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bc6e4-8adf-47b6-a65d-a34cdf7ad9fb service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:17.445707 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3303/6608] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:17.839208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:17.840694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:17.854012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0087702-2256-4960-9e5d-0bb536d89b46 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:17.859196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:17.859806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:17.860087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:17.860367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] PATH_INFO: `/v3/projects/910e6fb181f4408680db643c0d1c4613` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:17.861575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=910e6fb181f4408680db643c0d1c4613)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:17.863746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:18.038806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:18.054428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910e6fb181f4408680db643c0d1c4613', 'request_id': 'req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:18.068809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910e6fb181f4408680db643c0d1c4613', 'request_id': 'req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:18.078331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910e6fb181f4408680db643c0d1c4613', 'request_id': 'req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:18.198470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] The token cache is being invalidate because project 910e6fb181f4408680db643c0d1c4613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:17:18.198684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:18.199417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0a7e0b41-e4f1-4a53-ad24-f93bce37d3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:18.212017 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3306/6609] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:17:17 2022] DELETE /identity/v3/projects/910e6fb181f4408680db643c0d1c4613 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:18.216073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.216942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.217361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.241443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:18.242917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:18.273507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:18.336253 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3304/6610] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:18.344268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.345295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.345817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.372113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:18.373444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:18.391157 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3307/6611] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:18.395326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:18.406995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110600d-c0ae-4576-98b5-3c9bba2d137e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:18.413267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:18.415308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.415598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.416045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.417536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:17:18.419900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:18.419900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:18.437537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3305/6612] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:17:18.438733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:18.450086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f675e-97f6-417f-9281-7c12f5c50178 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:18.457486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:18.458474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.458907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.459429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.460184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:18.462135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:18.606872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3308/6613] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:17:18 2022] POST /identity/v3/projects => generated 359 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:18.609080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:18.621059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc9357-66ea-454f-a6e7-f9cee4da7d1e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:18.705361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:18.706208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.706516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.706784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.707567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:18.709541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:18.879788 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3306/6614] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:17:18 2022] POST /identity/v3/users => generated 280 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:17:18.884708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:18.899944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662e746-9147-4251-9896-e2e27ae6ccb6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:18.913570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:18.915934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.916363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.916720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.917664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:18.920322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:18.934822 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3309/6615] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:17:18.938672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:18.952231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac37259-d716-46d1-938c-eaf61ae9a2ad admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:18.958659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a5c8-6f93-4c22-bf5a-fa160a1ba753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:18.959653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a5c8-6f93-4c22-bf5a-fa160a1ba753 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:18.960124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a5c8-6f93-4c22-bf5a-fa160a1ba753 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:18.960609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a5c8-6f93-4c22-bf5a-fa160a1ba753 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:18.961460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a5c8-6f93-4c22-bf5a-fa160a1ba753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:18.964393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a5c8-6f93-4c22-bf5a-fa160a1ba753 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:18.980631 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3307/6616] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:17:18.995945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:19.007685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf6622-a538-429f-a259-eb1f11d94c71 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:19.013586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:19.014287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:19.014572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:19.014871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] PATH_INFO: `/v3/projects/dba34e1faa904617850784f10182684c/users/c0ee65b2656f47a78bbbddf6b21a7149/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:19.038104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba34e1faa904617850784f10182684c, user_id=c0ee65b2656f47a78bbbddf6b21a7149, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:19.040973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:19.147946 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3310/6617] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:17:18 2022] PUT /identity/v3/projects/dba34e1faa904617850784f10182684c/users/c0ee65b2656f47a78bbbddf6b21a7149/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:19.160403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:19.161199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:19.161364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:19.213397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] MFA Rules not processed for user `c0ee65b2656f47a78bbbddf6b21a7149`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:19.215052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:19.332394 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3308/6618] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:19.360653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:19.363801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:19.473235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb84c-2b8d-45df-b894-d63e1c5341ec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:19.480074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:19.480074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:19.480074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:19.480074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:19.504375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:19.506654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:19.524343 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3311/6619] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:24.152172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:24.155749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:24.233303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:24.291879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc35-01d8-49db-a59c-10d1296342a2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:24.303654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:24.304882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:24.305377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:24.305854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] PATH_INFO: `/v3/users/3e904f27c02248389ae9ca86cb95c54a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:24.308458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e904f27c02248389ae9ca86cb95c54a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:24.311475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:24.619211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e904f27c02248389ae9ca86cb95c54a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:24.627747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e904f27c02248389ae9ca86cb95c54a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:24.628483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e904f27c02248389ae9ca86cb95c54a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:24.640807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e904f27c02248389ae9ca86cb95c54a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:24.641528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd7f95a-ff65-409f-ace9-5899b68e6a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e904f27c02248389ae9ca86cb95c54a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:24.829631 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3309/6620] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:17:24 2022] DELETE /identity/v3/users/3e904f27c02248389ae9ca86cb95c54a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:25.288493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:25.310646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734021a-8543-48f2-92c9-96472e8d2f50 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:25.404087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:25.404701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:25.404990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:25.405445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] PATH_INFO: `/v3/projects/aad114c7a41a47e785fd117e1103f168` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:25.408104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad114c7a41a47e785fd117e1103f168)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:25.410270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:25.432278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:25.650341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad114c7a41a47e785fd117e1103f168', 'request_id': 'req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:25.674105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad114c7a41a47e785fd117e1103f168', 'request_id': 'req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:25.696394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad114c7a41a47e785fd117e1103f168', 'request_id': 'req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:25.869136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] The token cache is being invalidate because project aad114c7a41a47e785fd117e1103f168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:17:25.874510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:25.879051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b886bfec-dd5c-4bab-8527-33d1e0bf5acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:25.882016 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3312/6621] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:17:25 2022] DELETE /identity/v3/projects/aad114c7a41a47e785fd117e1103f168 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:25.887552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:25.888360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:25.888360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:25.918006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:25.919396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:26.050883 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3310/6622] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:26.055385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.055385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.055385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.103269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:26.114516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:26.140493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:26.140800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3313/6623] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:26.155866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee7b9-4831-4dc3-b88a-4a7c1c3a0792 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:26.175326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:26.176707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.177832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.178727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.179885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:17:26.180604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:26.182475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:26.213503 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3311/6624] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:17:26.218218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:26.233787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6c52a-17a5-4a17-a53f-55e68388c587 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:26.245084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:26.246156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.246637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.247157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.248831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:26.251486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:26.359381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3314/6625] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:17:26 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:26.372805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:26.389760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e463d33-35b4-463d-8535-613a2dd583ce admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:26.489340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:26.489983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.490260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.490539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.491401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:26.493257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:26.502682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:26.627915 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3312/6626] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:17:26 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:26.632681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:26.651577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e9354-83e5-4924-bf5a-8facaf3f64ab admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:26.666700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:26.667592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.668282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.668762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.669646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:26.673093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:26.697902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3315/6627] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:17:26.703402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:26.720927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7de6-814d-4bd4-9c90-18f7735c3822 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:26.726972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b46e6-5808-4db1-946f-6d6eb1a3c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:26.728337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b46e6-5808-4db1-946f-6d6eb1a3c94d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.728337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b46e6-5808-4db1-946f-6d6eb1a3c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.728968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b46e6-5808-4db1-946f-6d6eb1a3c94d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.729734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b46e6-5808-4db1-946f-6d6eb1a3c94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:26.731836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b46e6-5808-4db1-946f-6d6eb1a3c94d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:26.759221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3313/6628] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:17:26.759352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:26.771449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390567-971c-4222-914e-0ac15d4a838e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:26.797729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:26.799055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:26.799499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:26.799917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] PATH_INFO: `/v3/projects/6ada69dd20964b7c8b982a6f32f6d90c/users/0776519cd0d045b094f50bc8e97ab94e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:26.836320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ada69dd20964b7c8b982a6f32f6d90c, user_id=0776519cd0d045b094f50bc8e97ab94e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:26.839690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:27.007894 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3316/6629] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:17:26 2022] PUT /identity/v3/projects/6ada69dd20964b7c8b982a6f32f6d90c/users/0776519cd0d045b094f50bc8e97ab94e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:27.014951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17ed5-aacd-433a-90bc-6856dfb616ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:27.015492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17ed5-aacd-433a-90bc-6856dfb616ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:27.015578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17ed5-aacd-433a-90bc-6856dfb616ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:27.075467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a2b17ed5-aacd-433a-90bc-6856dfb616ca None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:27.076682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a2b17ed5-aacd-433a-90bc-6856dfb616ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:27.233246 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3314/6630] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:27.271802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:27.276279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:27.372992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb265b-b978-4cd0-9400-16d59ee89278 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:27.378237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:27.378862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:27.379181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:27.379649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:27.394710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:27.396231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:27.410831 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3317/6631] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:17:38.496680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:38.957874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:39.736719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:39.737264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:39.737711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:39.787094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] MFA Rules not processed for user `0776519cd0d045b094f50bc8e97ab94e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:39.793073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:39.912940 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3315/6632] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:47.020997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:47.023352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:47.065335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca9a66-72b5-4e24-a271-bc80ee913d41 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:47.075450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:47.076052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:47.076342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:47.076630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] PATH_INFO: `/v3/users/a382ba34c82b4c92985855461bf50fea` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:47.081630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a382ba34c82b4c92985855461bf50fea)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:47.083777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:47.335590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a382ba34c82b4c92985855461bf50fea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:47.363758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a382ba34c82b4c92985855461bf50fea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:47.365119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a382ba34c82b4c92985855461bf50fea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:47.365930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a382ba34c82b4c92985855461bf50fea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:47.388038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3320f78a-3e98-48e8-a7d9-102cff5d1b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a382ba34c82b4c92985855461bf50fea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:47.538514 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3318/6633] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:17:47 2022] DELETE /identity/v3/users/a382ba34c82b4c92985855461bf50fea => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:48.802907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:48.867344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36988b-afa7-4f67-bd99-e84507e2daf6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:49.064490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:49.065260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:49.065646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:49.066052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] PATH_INFO: `/v3/projects/2b869273c5a9475298fb6bffa028979d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:49.067397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b869273c5a9475298fb6bffa028979d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:49.069737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:49.252152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b869273c5a9475298fb6bffa028979d', 'request_id': 'req-b8292516-386b-4211-b5f3-836ee1e393f3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:49.262200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b869273c5a9475298fb6bffa028979d', 'request_id': 'req-b8292516-386b-4211-b5f3-836ee1e393f3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:49.269669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b869273c5a9475298fb6bffa028979d', 'request_id': 'req-b8292516-386b-4211-b5f3-836ee1e393f3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:49.429403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] The token cache is being invalidate because project 2b869273c5a9475298fb6bffa028979d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:17:49.429976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:49.432682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b8292516-386b-4211-b5f3-836ee1e393f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:49.441630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3316/6634] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:17:48 2022] DELETE /identity/v3/projects/2b869273c5a9475298fb6bffa028979d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:49.445075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:49.445533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:49.445630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:49.504109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:49.505946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:49.608925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3319/6635] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:17:49.610445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:49.610741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:49.611413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:49.662880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:49.665291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:49.686174 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3317/6636] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:49.690747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:49.703336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e1aa-8ac2-43a1-b490-240ad16270f1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:49.709420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:49.710689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:49.711492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:49.713041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:49.713924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:17:49.714411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:49.716780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:49.739116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3320/6637] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:17:49.743582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:49.760567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355a3e-24f2-4296-a091-902269330b47 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:49.774862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:49.776498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:49.776793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:49.777357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:49.779656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:49.784470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:49.808813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:49.920329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:49.922932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:49.926989 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3318/6638] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:17:49 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:17:49.931867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:49.967708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35073-337c-4f23-90d3-4392acb8fe76 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:50.105520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d6c2b-259c-4358-ae15-d8d1a6e50367 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:50.119761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:50.120662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:50.123518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:50.128638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:50.128638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:50.131511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:50.154322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:50.155649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:50.156332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:50.161538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] PATH_INFO: `/v3/users/0776519cd0d045b094f50bc8e97ab94e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:50.163929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0776519cd0d045b094f50bc8e97ab94e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:50.167930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:50.173671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:50.331312 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3319/6639] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:17:49 2022] POST /identity/v3/users => generated 284 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:50.335608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:50.352372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18ee50-f7a4-4f6e-9683-e7de02b03c68 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:50.361414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:50.362743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:50.363240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:50.363656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:50.364634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:50.366581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:50.380371 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3320/6640] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:17:50.384661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:50.402042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbada9c-ae31-4b1e-8086-9684fff5e225 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:50.414320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:50.415550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:50.416613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:50.417224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:50.418305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:50.423765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:50.440649 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3321/6641] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:17:50.445520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:50.472467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0776519cd0d045b094f50bc8e97ab94e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:50.476268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7368-7304-4cae-b9fc-e57e03a9557e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:50.483865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b0e3-8ed5-4bf0-9f02-9ae6148e96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:50.487287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b0e3-8ed5-4bf0-9f02-9ae6148e96ae admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:50.487752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b0e3-8ed5-4bf0-9f02-9ae6148e96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:50.489064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b0e3-8ed5-4bf0-9f02-9ae6148e96ae admin admin] PATH_INFO: `/v3/projects/f2390b2ea3104bdab3ecdcae0dc415b7/users/acce3e06ce4d40ba8db7988456cf8787/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:50.490109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0776519cd0d045b094f50bc8e97ab94e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:50.492435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0776519cd0d045b094f50bc8e97ab94e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:50.493133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0776519cd0d045b094f50bc8e97ab94e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:50.527959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732b0e3-8ed5-4bf0-9f02-9ae6148e96ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2390b2ea3104bdab3ecdcae0dc415b7, user_id=acce3e06ce4d40ba8db7988456cf8787, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:50.531980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0776519cd0d045b094f50bc8e97ab94e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:50.532952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732b0e3-8ed5-4bf0-9f02-9ae6148e96ae admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:50.686091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3322/6642] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:17:50 2022] PUT /identity/v3/projects/f2390b2ea3104bdab3ecdcae0dc415b7/users/acce3e06ce4d40ba8db7988456cf8787/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:50.693900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:50.694209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:50.694911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:50.740663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:50.741617 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3321/6643] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:17:49 2022] DELETE /identity/v3/users/0776519cd0d045b094f50bc8e97ab94e => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:50.745729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:50.832987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:50.835972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:50.852726 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3323/6644] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:50.875307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:50.880285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.000687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68e09-373e-4b8a-935b-a96c32e51672 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:51.006574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:51.007480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.007872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.008262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.024595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083153-9ef3-44aa-aa7d-c21322cd2979 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:51.028052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:51.028492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:51.029158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.029440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.029983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] PATH_INFO: `/v3/users/d6c49761d7ef4615b55c8edd9c782e12` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.031054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:51.031597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c49761d7ef4615b55c8edd9c782e12)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:51.033803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:51.052910 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3324/6645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:51.374059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:51.376321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.381026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c49761d7ef4615b55c8edd9c782e12'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.397654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c49761d7ef4615b55c8edd9c782e12'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.398437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c49761d7ef4615b55c8edd9c782e12'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.399256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c49761d7ef4615b55c8edd9c782e12'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.399569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed52af-2038-4ef5-b58b-a7e2a8a9ad7d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:51.409263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:51.410204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.410700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.411830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] PATH_INFO: `/v3/projects/6ada69dd20964b7c8b982a6f32f6d90c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.413298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ada69dd20964b7c8b982a6f32f6d90c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:51.418828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:51.425864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ae4bd1b-f453-48d8-8d5a-5c05321dae45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c49761d7ef4615b55c8edd9c782e12'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.541107 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3322/6646] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:17:50 2022] DELETE /identity/v3/users/d6c49761d7ef4615b55c8edd9c782e12 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:17:51.546438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.547063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.547538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.582566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:51.585669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.593623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:51.634832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ada69dd20964b7c8b982a6f32f6d90c', 'request_id': 'req-81804f66-c00c-4544-9c87-dd798e8734e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.643282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ada69dd20964b7c8b982a6f32f6d90c', 'request_id': 'req-81804f66-c00c-4544-9c87-dd798e8734e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.651894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ada69dd20964b7c8b982a6f32f6d90c', 'request_id': 'req-81804f66-c00c-4544-9c87-dd798e8734e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.694259 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3323/6647] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:51.705892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:51.707695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.746748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] The token cache is being invalidate because project 6ada69dd20964b7c8b982a6f32f6d90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:17:51.747450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.748854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-81804f66-c00c-4544-9c87-dd798e8734e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:51.750782 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3325/6648] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:17:51 2022] DELETE /identity/v3/projects/6ada69dd20964b7c8b982a6f32f6d90c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:51.759285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889c39-7105-4578-b18c-051b74a24ca0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.759816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889c39-7105-4578-b18c-051b74a24ca0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.760298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889c39-7105-4578-b18c-051b74a24ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.798036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-13889c39-7105-4578-b18c-051b74a24ca0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:51.799768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13889c39-7105-4578-b18c-051b74a24ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.811945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1a1a9-2a58-4da4-aae2-6e59f85af1af None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:51.856144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:51.879086 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3326/6649] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:51.884977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.885388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.885829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.907715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:51.911423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.911423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.911423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.911423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.914137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:51.915612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:51.931134 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3327/6650] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:51.932495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:51.935321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:51.936358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:51.948459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3324/6651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:17:51.948904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d0fef-f80a-4238-b815-493e80454305 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:51.954445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:51.955156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:51.955415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:51.955671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:51.956335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:17:51.956647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:51.958365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:51.991637 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3328/6652] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:17:51.996431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.008115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0fdc-8ae0-4e06-89c6-504eea391582 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:52.013812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:52.014584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.014801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.015122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.015757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:52.018739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:52.145667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.159378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3325/6653] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:17:51 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:52.163612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575ede-f34d-444a-af7b-a0fbb90b6d79 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:52.230592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:52.231276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.232258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.232258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.232491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:52.234438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:52.428677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3329/6654] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:17:52 2022] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:52.433913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.449781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b4ee-2739-4fc4-97b3-61e64b827c22 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:52.454814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:52.455653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.455968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.456237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.456931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:52.459210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:52.470027 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3326/6655] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:17:52.477202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.484014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.487772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:52.489075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc8d61-f6f5-4344-b5c0-5957dfdd4173 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:52.495124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:52.495754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.496214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.496539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.497189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:52.499391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:52.514181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8d43-d166-40ff-95f1-5b02e1821767 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:52.520403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:52.521346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.521722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.521898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] PATH_INFO: `/v3/projects/232248dfdc77480199901c7fc7147e79` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.524182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=232248dfdc77480199901c7fc7147e79)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:52.525173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3330/6656] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:17:52.530085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.530369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:52.544218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c513-2c2a-4704-8dae-86974ac1b8a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:52.552410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5a8f-a729-4aaf-8051-b50d98ec570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:52.552410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5a8f-a729-4aaf-8051-b50d98ec570e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.552410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5a8f-a729-4aaf-8051-b50d98ec570e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.552410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5a8f-a729-4aaf-8051-b50d98ec570e admin admin] PATH_INFO: `/v3/projects/de956e8db0374a98bac334597d91f83e/users/9d57c50d371b41158a8c7baeda1c0b5f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.572896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5a8f-a729-4aaf-8051-b50d98ec570e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de956e8db0374a98bac334597d91f83e, user_id=9d57c50d371b41158a8c7baeda1c0b5f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:52.576058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5a8f-a729-4aaf-8051-b50d98ec570e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:52.626422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:52.679764 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3331/6657] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:17:52 2022] PUT /identity/v3/projects/de956e8db0374a98bac334597d91f83e/users/9d57c50d371b41158a8c7baeda1c0b5f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:52.692922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c967e-6f38-4ab4-89a1-9b69fa135437 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.696131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c967e-6f38-4ab4-89a1-9b69fa135437 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.696131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c967e-6f38-4ab4-89a1-9b69fa135437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.736835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fb4c967e-6f38-4ab4-89a1-9b69fa135437 None None] MFA Rules not processed for user `9d57c50d371b41158a8c7baeda1c0b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:52.738292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232248dfdc77480199901c7fc7147e79', 'request_id': 'req-95665e8f-406e-4480-b0a8-4c3e3840a5ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:52.738807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fb4c967e-6f38-4ab4-89a1-9b69fa135437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:52.745248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232248dfdc77480199901c7fc7147e79', 'request_id': 'req-95665e8f-406e-4480-b0a8-4c3e3840a5ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:52.754109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232248dfdc77480199901c7fc7147e79', 'request_id': 'req-95665e8f-406e-4480-b0a8-4c3e3840a5ca'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:52.817751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] The token cache is being invalidate because project 232248dfdc77480199901c7fc7147e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:17:52.818286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:52.818984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:52.820681 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3332/6658] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:52.827249 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3327/6659] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:17:52 2022] DELETE /identity/v3/projects/232248dfdc77480199901c7fc7147e79 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:52.828645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91395-c709-4b26-826c-524e2ab093ea None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.828870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91395-c709-4b26-826c-524e2ab093ea None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.829309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91395-c709-4b26-826c-524e2ab093ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.835961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.838783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:52.862477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-26f91395-c709-4b26-826c-524e2ab093ea None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:52.864204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26f91395-c709-4b26-826c-524e2ab093ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:52.946651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3333/6660] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:52.948343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:52.948681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:52.948971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:52.971529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:52.972988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:52.982656 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3334/6661] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:52.986901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:52.993136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665e8f-406e-4480-b0a8-4c3e3840a5ca admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.000460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.001454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.001851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.002325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.004319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:53.006737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9e3cc-8fcc-42a2-8764-a5c64c742543 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.016779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.017671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.018142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.018556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.019573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:17:53.020043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.021417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.023137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.024617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.036089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3328/6662] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:17:53.047533 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3335/6663] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:17:53.058472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.080080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f067f-ea8e-426f-861f-cb59b92d3020 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.095275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.095956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.096355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.096739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.097542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.099991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.101600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.103602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:53.132129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c338f3-51e7-4a3e-8a55-7084b6c994f6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.137880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.138750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.139241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.139588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] PATH_INFO: `/v3/users/9d57c50d371b41158a8c7baeda1c0b5f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.142024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d57c50d371b41158a8c7baeda1c0b5f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.145779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.310818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:53.312379 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3329/6664] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:17:53 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:53.316094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.395085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d57c50d371b41158a8c7baeda1c0b5f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:53.408934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d57c50d371b41158a8c7baeda1c0b5f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:53.409928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d57c50d371b41158a8c7baeda1c0b5f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:53.431242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c63ad-1a33-4c60-ba96-7b207642ac95 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.431458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d57c50d371b41158a8c7baeda1c0b5f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:53.432204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-14bdb65e-c063-4f44-a2c6-553b4120504f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d57c50d371b41158a8c7baeda1c0b5f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:53.437782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.438587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.439042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.439457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.440449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.444006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.559643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3336/6665] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:17:53 2022] DELETE /identity/v3/users/9d57c50d371b41158a8c7baeda1c0b5f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:53.563738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.564211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.564621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.582006 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3330/6666] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:17:53 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:53.588224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.590253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:53.594380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:53.596008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:53.623276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c4b99-e7b9-4a6e-b51a-ce6f2848a03d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.683220 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3337/6667] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:17:53.693223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.694696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:53.726574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.727821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.728109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.728391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.729048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.731324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.746658 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3331/6668] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:17:53.750788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.768436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93c651-8f7f-4cf5-bf01-be8e28054c62 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.773083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.773780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.774671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.775042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.777119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ba2b-536e-4a9c-acda-bffca8295ca1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.790446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.794623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.799699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48aaa2-b8e9-420c-8993-8d8d01d316a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.801759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48aaa2-b8e9-420c-8993-8d8d01d316a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.803112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48aaa2-b8e9-420c-8993-8d8d01d316a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.803600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48aaa2-b8e9-420c-8993-8d8d01d316a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.807592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48aaa2-b8e9-420c-8993-8d8d01d316a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.818883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48aaa2-b8e9-420c-8993-8d8d01d316a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.819076 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3338/6669] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:17:53.829578 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3332/6670] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:17:53.833737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:53.848509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f40df-49b8-4512-b131-495e71743bc9 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:53.856853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:53.859229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:53.859623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:53.860443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] PATH_INFO: `/v3/projects/75efdf524640431d814579e100dc0d4c/users/91bb55c485744eb785d38e354b08c434/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:53.884957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75efdf524640431d814579e100dc0d4c, user_id=91bb55c485744eb785d38e354b08c434, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:53.891232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:53.997373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3339/6671] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:17:53 2022] PUT /identity/v3/projects/75efdf524640431d814579e100dc0d4c/users/91bb55c485744eb785d38e354b08c434/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:54.010888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:54.011215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:54.011568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:54.042566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:54.052315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] MFA Rules not processed for user `91bb55c485744eb785d38e354b08c434`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:54.053661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:54.175826 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3333/6672] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:54.186310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:54.188400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:54.285960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80208366-5f62-44f7-bf52-0cf10a69bae4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:54.298521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da342e-e4ed-4f2a-9943-ef81f4e41bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:54.298521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da342e-e4ed-4f2a-9943-ef81f4e41bce service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:54.298521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da342e-e4ed-4f2a-9943-ef81f4e41bce service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:54.298521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da342e-e4ed-4f2a-9943-ef81f4e41bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:54.305208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da342e-e4ed-4f2a-9943-ef81f4e41bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:54.311262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da342e-e4ed-4f2a-9943-ef81f4e41bce service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:54.329191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3340/6673] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:54.411230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:55.070659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:55.073314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:55.177893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:55.178306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e36c8-8f88-4e88-b4c9-f72e984e1fd7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:55.182789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:55.183381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:55.183710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:55.193209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] PATH_INFO: `/v3/projects/de956e8db0374a98bac334597d91f83e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:55.194695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de956e8db0374a98bac334597d91f83e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:55.198085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:55.327191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de956e8db0374a98bac334597d91f83e', 'request_id': 'req-6a416757-b856-48e4-857d-c07e9175274a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:55.333955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de956e8db0374a98bac334597d91f83e', 'request_id': 'req-6a416757-b856-48e4-857d-c07e9175274a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:55.343623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de956e8db0374a98bac334597d91f83e', 'request_id': 'req-6a416757-b856-48e4-857d-c07e9175274a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:55.462333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] The token cache is being invalidate because project de956e8db0374a98bac334597d91f83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:17:55.462673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:55.465078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a416757-b856-48e4-857d-c07e9175274a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:17:55.470780 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3334/6674] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:17:55 2022] DELETE /identity/v3/projects/de956e8db0374a98bac334597d91f83e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:55.472586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:55.472878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:55.473154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:55.511403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:55.512832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:55.635259 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3341/6675] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:55.644341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:55.644949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:55.645389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:55.672587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:55.674215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:55.685531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3335/6676] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:55.693091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:55.706344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c58f-6544-4c81-887a-611042dcd019 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:55.712524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:55.713479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:55.713479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:55.718702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:55.718702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:17:55.718702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:55.718702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:55.735224 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3342/6677] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:17:55.742377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:55.754331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c4098-40a2-495d-96bf-5a4fbfe98fb9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:55.759569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:55.760184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:55.760467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:55.760737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:55.761374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:55.763628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:56.003290 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3336/6678] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:17:55 2022] POST /identity/v3/projects => generated 389 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:56.009291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:56.035911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f364a01-7424-4c27-8148-f919b5238c17 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:56.127212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:56.128241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:56.128767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:56.129245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:56.130573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:56.134328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:56.204355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:56.253683 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3343/6679] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:17:56 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:17:56.258247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:56.270725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd39806-7b4c-44e4-bad0-f6b72afeeaf6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:56.277241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:56.278230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:56.278819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:56.279362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:56.280511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:56.282736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:56.299459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3337/6680] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:17:56.303589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:56.332362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647836c1-2161-4aa1-8e35-dfc054d498ac admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:56.344139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4157a6-d46b-42c0-8d36-d6500a483112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:56.345477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4157a6-d46b-42c0-8d36-d6500a483112 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:56.345867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4157a6-d46b-42c0-8d36-d6500a483112 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:56.346250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4157a6-d46b-42c0-8d36-d6500a483112 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:56.347159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4157a6-d46b-42c0-8d36-d6500a483112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:56.349193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4157a6-d46b-42c0-8d36-d6500a483112 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:56.366766 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3344/6681] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:17:56.370905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:56.388970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb98ac-7c2b-4f83-9910-94a1f560ffb6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:56.400337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:56.402043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:56.402402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:56.403770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] PATH_INFO: `/v3/projects/75b360e0ffe64c3bb5897486a18eda10/users/226a6d965ff14deebdead8370fc00d3e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:56.422168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b360e0ffe64c3bb5897486a18eda10, user_id=226a6d965ff14deebdead8370fc00d3e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:56.425484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:56.553580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3338/6682] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:17:56 2022] PUT /identity/v3/projects/75b360e0ffe64c3bb5897486a18eda10/users/226a6d965ff14deebdead8370fc00d3e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:17:56.560686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210c241-737e-47f7-883c-fb6e8b459cb1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:56.560991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210c241-737e-47f7-883c-fb6e8b459cb1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:56.561275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210c241-737e-47f7-883c-fb6e8b459cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:56.607945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8210c241-737e-47f7-883c-fb6e8b459cb1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:56.609378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8210c241-737e-47f7-883c-fb6e8b459cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:56.681803 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3345/6683] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:56.691055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:56.694001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:56.790937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f9a5-04d0-4471-9835-b2ce82a35fa6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:56.801418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a94641-9c84-49c1-9bc7-2c4d269d4fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:56.802264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a94641-9c84-49c1-9bc7-2c4d269d4fff service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:56.802577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a94641-9c84-49c1-9bc7-2c4d269d4fff service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:56.804439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a94641-9c84-49c1-9bc7-2c4d269d4fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:56.831479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a94641-9c84-49c1-9bc7-2c4d269d4fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:56.834241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a94641-9c84-49c1-9bc7-2c4d269d4fff service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:56.854694 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3339/6684] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:17:57.106034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:17:59.542972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:59.544390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:59.544684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:59.588788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:59.591445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:59.721238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3346/6685] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:17:59.721425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211c96-2d5a-4955-862b-189cee8fe938 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:59.721425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211c96-2d5a-4955-862b-189cee8fe938 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:59.721425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211c96-2d5a-4955-862b-189cee8fe938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:59.746904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-47211c96-2d5a-4955-862b-189cee8fe938 None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:17:59.748190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-47211c96-2d5a-4955-862b-189cee8fe938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:59.762725 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3340/6686] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:17:59.775673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:17:59.777285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:17:59.913743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5ed95-3c66-46d5-a0c7-eac9ea5b7e6e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:17:59.923418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:17:59.924525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:17:59.924966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:17:59.925389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:17:59.947210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:17:59.951521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:17:59.967806 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3347/6687] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:17:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:09.734438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:09.961772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:12.074936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445ffd-f5ef-4b7e-bd26-01d0f844a4ff None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:12.074936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445ffd-f5ef-4b7e-bd26-01d0f844a4ff None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:12.074936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1445ffd-f5ef-4b7e-bd26-01d0f844a4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:12.135515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e1445ffd-f5ef-4b7e-bd26-01d0f844a4ff None None] MFA Rules not processed for user `226a6d965ff14deebdead8370fc00d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:12.136975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e1445ffd-f5ef-4b7e-bd26-01d0f844a4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:12.309110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3341/6688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:12.329114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:12.359969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38e2e-c68c-4e0e-84f9-c5102013b70e service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:12.383495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bffd45-1539-4004-9a9e-16e359486903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:12.394444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffd45-1539-4004-9a9e-16e359486903 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:12.394936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffd45-1539-4004-9a9e-16e359486903 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:12.399555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bffd45-1539-4004-9a9e-16e359486903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:12.426375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffd45-1539-4004-9a9e-16e359486903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:12.432380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bffd45-1539-4004-9a9e-16e359486903 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:12.474976 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3348/6689] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:18.004111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:18.004678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:18.004678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:18.025767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] MFA Rules not processed for user `226a6d965ff14deebdead8370fc00d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:18.027371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:18.041256 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3342/6690] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:21.337069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d015a-3f5e-458e-9ef2-d6de5d738834 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:21.338764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d015a-3f5e-458e-9ef2-d6de5d738834 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:21.339331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d015a-3f5e-458e-9ef2-d6de5d738834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:21.389025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4b7d015a-3f5e-458e-9ef2-d6de5d738834 None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:21.394297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4b7d015a-3f5e-458e-9ef2-d6de5d738834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:21.412468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3349/6691] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:18:22.718448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:22.720094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:22.974855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a542-f81f-4f70-b3f0-3ba4c09d6fd7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:22.982372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:22.983206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:22.983586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:22.984000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:22.986810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:23.003934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:23.006230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:23.021572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3343/6692] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:23.239584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:23.240502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:23.248078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:23.276201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:23.277486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:23.304393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3350/6693] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:23.360528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:23.385857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1af133-2f2a-46c7-98d9-019751998d7f service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:23.399072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:23.400381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:23.402176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:23.403122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:23.406861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:23.423523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:23.426135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:23.443561 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3344/6694] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:26.544459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:26.577452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ee95-6ef1-4819-aaae-382070367965 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:26.588570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:26.589532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:26.590030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:26.590520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:26.592952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:26.614179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:26.615960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03835ab5-e2fb-461b-9e4a-4a9e85c994d7 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:26.665271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3351/6695] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:29.742812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:29.745274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:29.764259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3ecb7-58b0-4d01-93d9-4d5b1af430e1 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:29.775388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:29.776871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:29.777161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:29.784701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] PATH_INFO: `/v3/users/91bb55c485744eb785d38e354b08c434` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:29.786535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bb55c485744eb785d38e354b08c434)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:29.791226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:30.027448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:30.031043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bb55c485744eb785d38e354b08c434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:30.048246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bb55c485744eb785d38e354b08c434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:30.049571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bb55c485744eb785d38e354b08c434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:30.050389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bb55c485744eb785d38e354b08c434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:30.071843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bb55c485744eb785d38e354b08c434'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:30.172645 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3345/6696] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:18:29 2022] DELETE /identity/v3/users/91bb55c485744eb785d38e354b08c434 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:18:30.174212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:30.174847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:30.174847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:30.197011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:30.198266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:30.271842 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3352/6697] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:18:30.281951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:30.283568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:30.384724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701edef-7dd1-46c7-b2da-8a3466e537c7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:30.391670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228e57b-cc22-4e56-b702-bc39cbde8c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:30.393676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228e57b-cc22-4e56-b702-bc39cbde8c80 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:30.393676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228e57b-cc22-4e56-b702-bc39cbde8c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:30.393676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228e57b-cc22-4e56-b702-bc39cbde8c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:30.403445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228e57b-cc22-4e56-b702-bc39cbde8c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:30.404921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228e57b-cc22-4e56-b702-bc39cbde8c80 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:30.417535 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3346/6698] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:30.923672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:30.925211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:30.937512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df5c32-4b24-4ff5-b302-f3a8e4ef540e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:30.942655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:30.943393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:30.943687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:30.944482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] PATH_INFO: `/v3/projects/75efdf524640431d814579e100dc0d4c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:30.945700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75efdf524640431d814579e100dc0d4c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:30.947665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.049515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75efdf524640431d814579e100dc0d4c', 'request_id': 'req-c1d5593a-90a8-4f45-a688-030c3ea02d77'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:31.057106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75efdf524640431d814579e100dc0d4c', 'request_id': 'req-c1d5593a-90a8-4f45-a688-030c3ea02d77'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:31.064860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75efdf524640431d814579e100dc0d4c', 'request_id': 'req-c1d5593a-90a8-4f45-a688-030c3ea02d77'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:31.140890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] The token cache is being invalidate because project 75efdf524640431d814579e100dc0d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:18:31.141368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:31.142134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c1d5593a-90a8-4f45-a688-030c3ea02d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:31.144021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3353/6699] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:18:30 2022] DELETE /identity/v3/projects/75efdf524640431d814579e100dc0d4c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:18:31.149576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.150069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.150148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.174503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:31.175933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:31.270247 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3347/6700] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:31.277883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.278397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.278474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.301205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:31.302452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:31.312677 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3354/6701] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:18:31.317643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:31.329603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a07ae4-0119-451a-8fa0-2f9067c7bbc1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:31.337633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:31.338453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.339968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.339968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.339968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:18:31.340207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:31.342562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.358289 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3348/6702] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:18:31.364299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:31.375594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cedb8-e8db-4a6c-9594-02247ea38ebf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:31.382118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:31.382745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.383059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.383339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.383981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:31.387408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.496879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3355/6703] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:18:31 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:18:31.501325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:31.516121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871f0f0-ac07-4ee6-802b-2fa4bcc632d9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:31.597888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:31.614963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:31.617346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.617775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.618067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.621283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:31.624062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.732888 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3349/6704] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:18:31 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:18:31.733976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:31.748239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fab6-6418-4f5d-b4a3-f1d662411603 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:31.765446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:31.766918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.767930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.768553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.769523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:31.772941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.786287 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3356/6705] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:18:31.790155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:31.804632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835f54f-b353-476c-beb6-456601f158f0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:31.811634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a937e-6c3d-47d9-9a36-64d14697a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:31.812645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a937e-6c3d-47d9-9a36-64d14697a11a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.813133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a937e-6c3d-47d9-9a36-64d14697a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.813580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a937e-6c3d-47d9-9a36-64d14697a11a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.815976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a937e-6c3d-47d9-9a36-64d14697a11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:31.817902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a937e-6c3d-47d9-9a36-64d14697a11a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.834394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3350/6706] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:18:31.838827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:31.848376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:31.854432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173c75-76a2-4bf0-9e42-f43ded396221 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:31.862297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:31.863763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.864225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.870477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] PATH_INFO: `/v3/projects/eadfe09bea3945539b59a123753398d3/users/b822541c9d7842fa93008329fdea59a2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:31.893068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadfe09bea3945539b59a123753398d3, user_id=b822541c9d7842fa93008329fdea59a2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:31.896222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:31.987167 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3357/6707] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:18:31 2022] PUT /identity/v3/projects/eadfe09bea3945539b59a123753398d3/users/b822541c9d7842fa93008329fdea59a2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:18:31.997754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:31.998049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:31.998331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:32.047423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] MFA Rules not processed for user `b822541c9d7842fa93008329fdea59a2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:32.048936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:32.127534 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3351/6708] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:32.148380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:32.150226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:32.226698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc821b-10db-46a7-9d05-f7389aaf9fb0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:32.232819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:32.233497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:32.233784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:32.234114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:32.244532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:32.245982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:32.258123 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3358/6709] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:34.862822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:34.870861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:34.992241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0b10a-444b-44bd-8794-723be2e908ee None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:35.001298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:35.001809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:35.002098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:35.002372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:35.004414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:35.071172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:35.073813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:35.076362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94e17a-0dd6-4ae6-9ca1-b667157a3e45 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:35.091313 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3352/6710] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:37.702590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:37.704685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:37.840326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b038-79f1-48fd-97e8-9583076674c6 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:37.856019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:37.856965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:37.857412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:37.857833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:37.860991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:37.892876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:37.896025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:37.940364 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3359/6711] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:47.084335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:47.914068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:48.736999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:48.737533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:48.737533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:48.764333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:48.766807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:48.915886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3353/6712] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:54.705338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:54.708816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:54.752003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbc6ae-fd0d-432e-8e6d-780b2aef2938 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:54.773589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:54.774229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:54.774521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:54.775136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:54.777052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:54.824400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:54.826381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc02a69-ad2c-46a5-a4ce-f547501efa89 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:54.846482 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3360/6713] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:58.004303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:58.100808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538472-6ee2-4b72-96d4-0c3ed666137e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:58.105638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:58.106414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:58.106787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:58.107179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] PATH_INFO: `/v3/users/b822541c9d7842fa93008329fdea59a2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:58.108486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b822541c9d7842fa93008329fdea59a2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:58.110521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:58.460246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b822541c9d7842fa93008329fdea59a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:58.471894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b822541c9d7842fa93008329fdea59a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:58.472662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b822541c9d7842fa93008329fdea59a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:58.473273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b822541c9d7842fa93008329fdea59a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:58.504836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b822541c9d7842fa93008329fdea59a2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:58.625523 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3354/6714] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:18:58 2022] DELETE /identity/v3/users/b822541c9d7842fa93008329fdea59a2 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:18:58.630667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:58.631565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:58.632023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:58.667546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:58.669224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:58.790267 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3361/6715] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:18:58.804818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:58.806361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:58.856125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:18:58.946758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680f48-dd49-447f-9252-9f489b3edcc4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:58.952100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1569f-b62e-473e-a151-51430bb43418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:58.952100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1569f-b62e-473e-a151-51430bb43418 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:58.952522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1569f-b62e-473e-a151-51430bb43418 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:58.952934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1569f-b62e-473e-a151-51430bb43418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:58.967393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1569f-b62e-473e-a151-51430bb43418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:58.968767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1569f-b62e-473e-a151-51430bb43418 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:58.985371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3355/6716] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:18:59.533927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:18:59.535629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:18:59.554545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4022-490b-4ccd-9198-042f31749d6d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:18:59.560561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:18:59.561472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:59.562314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:59.563792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] PATH_INFO: `/v3/projects/eadfe09bea3945539b59a123753398d3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:59.566112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadfe09bea3945539b59a123753398d3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:18:59.570777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:18:59.720342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadfe09bea3945539b59a123753398d3', 'request_id': 'req-f0159e36-2563-44ec-a724-9a484fda9e19'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:59.731849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadfe09bea3945539b59a123753398d3', 'request_id': 'req-f0159e36-2563-44ec-a724-9a484fda9e19'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:59.746028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadfe09bea3945539b59a123753398d3', 'request_id': 'req-f0159e36-2563-44ec-a724-9a484fda9e19'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:59.934053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] The token cache is being invalidate because project eadfe09bea3945539b59a123753398d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:18:59.934357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:59.935189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0159e36-2563-44ec-a724-9a484fda9e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:18:59.941317 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3362/6717] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:18:59 2022] DELETE /identity/v3/projects/eadfe09bea3945539b59a123753398d3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:18:59.943182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:18:59.943647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:18:59.943726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:18:59.969423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:18:59.969727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:00.069870 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3356/6718] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:00.080864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.081397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.081785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.105821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:00.107290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:00.124602 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3363/6719] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:00.125388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:00.137224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d8a98-5388-491b-be75-d4dc01f48a75 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:00.143808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:00.143808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.144091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.144367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.145956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:00.146221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:00.148311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:00.168633 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3357/6720] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:19:00.170696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:00.187261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02a633-fb6a-4163-99b6-15d4cba6646d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:00.194469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:00.195569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.196066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.196599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.197709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:00.199940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:00.334225 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3364/6721] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:00 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:00.367729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:00.386324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48e93-f946-4be2-8527-d39835d03f19 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:00.527566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:00.528180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.528464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.528877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.529769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:00.536496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:00.682284 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3358/6722] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:00 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:00.686470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:00.700886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a3515-b068-4291-8009-caff1223c79c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:00.714512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:00.719304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.719304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.719304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.719304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:00.720097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:00.736406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3365/6723] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:00.740921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:00.755552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8948185-5fda-449d-ad19-d53c43ada6fb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:00.761976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31941cc3-d946-44cd-a3be-a306b86c6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:00.762780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31941cc3-d946-44cd-a3be-a306b86c6c03 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.764258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31941cc3-d946-44cd-a3be-a306b86c6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.764656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31941cc3-d946-44cd-a3be-a306b86c6c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.765427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31941cc3-d946-44cd-a3be-a306b86c6c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:00.770680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31941cc3-d946-44cd-a3be-a306b86c6c03 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:00.787789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3359/6724] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:00.792209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:00.810335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607bada-2f37-4ab2-8890-96b28d6e15a3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:00.815512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:00.816086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.816086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.816479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] PATH_INFO: `/v3/projects/adb0b2fbc1974b78a1ca1f94516fd4f5/users/e38865d4587c4089889065ed70b41709/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:00.840886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb0b2fbc1974b78a1ca1f94516fd4f5, user_id=e38865d4587c4089889065ed70b41709, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:00.843627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:00.960978 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3366/6725] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:00 2022] PUT /identity/v3/projects/adb0b2fbc1974b78a1ca1f94516fd4f5/users/e38865d4587c4089889065ed70b41709/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:00.970950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fedd-a49e-45c1-b90d-89a482db3d6f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:00.972036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fedd-a49e-45c1-b90d-89a482db3d6f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:00.972764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fedd-a49e-45c1-b90d-89a482db3d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:01.038152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2fa5fedd-a49e-45c1-b90d-89a482db3d6f None None] MFA Rules not processed for user `e38865d4587c4089889065ed70b41709`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:01.039858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2fa5fedd-a49e-45c1-b90d-89a482db3d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:01.085180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:01.195187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3360/6726] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:01.204356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:01.206233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:01.232248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:01.311559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb43f-a5fd-49fd-bc22-eb0501222484 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:01.316448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:01.318336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:01.318336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:01.318522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:01.334160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:01.335586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:01.358562 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3367/6727] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:11.165697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:11.166619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:11.167105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:11.189311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:11.190737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:11.287153 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3361/6728] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:11.637872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:11.639604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:11.666093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7d9f-baf1-4f14-aa5a-e5a1c50a65a0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:11.669427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:11.670224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:11.670513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:11.670878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:11.672885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:11.687908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:11.689376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825423c-0f17-4f4d-9d57-cd4d7c561c37 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:11.700792 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3368/6729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:19:14.328713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:14.425777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f9fae-e663-4513-a112-9861aceccce2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:14.437919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:14.438591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:14.438858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:14.439285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] PATH_INFO: `/v3/users/e38865d4587c4089889065ed70b41709` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:14.440754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38865d4587c4089889065ed70b41709)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:14.442896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:14.678067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38865d4587c4089889065ed70b41709'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:14.691032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38865d4587c4089889065ed70b41709'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:14.693477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38865d4587c4089889065ed70b41709'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:14.694243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38865d4587c4089889065ed70b41709'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:14.710012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:14.712666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38865d4587c4089889065ed70b41709'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:14.809966 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3362/6730] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:14 2022] DELETE /identity/v3/users/e38865d4587c4089889065ed70b41709 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:14.812535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:14.813043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:14.813222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:14.834179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:14.835865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:14.918118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3369/6731] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:14.931371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:14.933115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:15.015578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08ccea-4a0f-4749-ada6-a8f248354880 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:15.020044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa8f14-b0d9-4643-b4d8-0fda8749674a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:15.020695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa8f14-b0d9-4643-b4d8-0fda8749674a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:15.020982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa8f14-b0d9-4643-b4d8-0fda8749674a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:15.021397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa8f14-b0d9-4643-b4d8-0fda8749674a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:15.034307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa8f14-b0d9-4643-b4d8-0fda8749674a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:15.036771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa8f14-b0d9-4643-b4d8-0fda8749674a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:15.055155 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3363/6732] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:15.714104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:15.719146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:15.745132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aae838-074e-4e5c-a97c-b5d15768efd6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:15.766453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:15.767398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:15.770295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:15.770732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] PATH_INFO: `/v3/projects/adb0b2fbc1974b78a1ca1f94516fd4f5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:15.772392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb0b2fbc1974b78a1ca1f94516fd4f5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:15.774721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:15.983814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb0b2fbc1974b78a1ca1f94516fd4f5', 'request_id': 'req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:15.991627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb0b2fbc1974b78a1ca1f94516fd4f5', 'request_id': 'req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:16.005192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb0b2fbc1974b78a1ca1f94516fd4f5', 'request_id': 'req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:16.121320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] The token cache is being invalidate because project adb0b2fbc1974b78a1ca1f94516fd4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:16.121679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:16.122520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ffc01e7a-1899-4b93-8dcb-ea70f3e7ca1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:16.124718 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3370/6733] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:15 2022] DELETE /identity/v3/projects/adb0b2fbc1974b78a1ca1f94516fd4f5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:16.133930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.134786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.134786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.161028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:16.162703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:16.250204 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3364/6734] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:16.260397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.260621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.260869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.288736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:16.289924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:16.304943 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3371/6735] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:16.306009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:16.322311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb4f68-14e9-4cac-a9b3-3565afec9071 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:16.329088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:16.329088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.329088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.329700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.330152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:16.330461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:16.332726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:16.354362 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3365/6736] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:19:16.356996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:16.373953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a89e2e-7b14-402d-8f6c-6cde717cd95c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:16.382337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:16.383802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.385133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.385842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.388451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:16.393727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:16.413778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:16.536887 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3372/6737] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:16 2022] POST /identity/v3/projects => generated 351 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:16.543714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:16.560172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a49b1-63b3-42d0-9057-a92e8b0273a3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:16.660079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:16.665654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.665654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.665654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.665654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:16.665654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:16.769322 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3366/6738] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:16 2022] POST /identity/v3/users => generated 276 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:16.773780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:16.809167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d62870-c3c2-4e3e-81ec-57b09187dc68 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:16.815535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:16.831286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.838042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.838042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.845855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:16.847718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:16.877882 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3373/6739] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:16.880183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:16.895925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b38f-3946-4ff4-aea8-ca79d6f2a30f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:16.911113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7763b0-4369-4e54-a8e1-14c88e350ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:16.911933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7763b0-4369-4e54-a8e1-14c88e350ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.912574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7763b0-4369-4e54-a8e1-14c88e350ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.912846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7763b0-4369-4e54-a8e1-14c88e350ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:16.913618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7763b0-4369-4e54-a8e1-14c88e350ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:16.915433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7763b0-4369-4e54-a8e1-14c88e350ac0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:16.917132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:16.945231 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3367/6740] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:16.949986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:16.980313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf07f3-7f53-41b4-863d-7eb498068f56 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:16.991618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:16.993957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:16.995324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:16.995884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] PATH_INFO: `/v3/projects/aa486aa5a909437999fe95ad10de6756/users/f6a9a7a5dbc74cb3893a2ec83c4f61dd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:17.025296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa486aa5a909437999fe95ad10de6756, user_id=f6a9a7a5dbc74cb3893a2ec83c4f61dd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:17.029530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:17.124744 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3374/6741] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:16 2022] PUT /identity/v3/projects/aa486aa5a909437999fe95ad10de6756/users/f6a9a7a5dbc74cb3893a2ec83c4f61dd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:17.136793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:17.137368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:17.137368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:17.187397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] MFA Rules not processed for user `f6a9a7a5dbc74cb3893a2ec83c4f61dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:17.188671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:17.297094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3368/6742] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:17.313691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:17.315526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:17.393253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dbc96-c130-43ae-bcea-40deb5c10a55 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:17.397976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361bb5-1d87-40ef-bfe5-6d89af1bcf6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:17.398726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361bb5-1d87-40ef-bfe5-6d89af1bcf6f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:17.399103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361bb5-1d87-40ef-bfe5-6d89af1bcf6f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:17.399479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361bb5-1d87-40ef-bfe5-6d89af1bcf6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:17.411650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361bb5-1d87-40ef-bfe5-6d89af1bcf6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:17.412948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361bb5-1d87-40ef-bfe5-6d89af1bcf6f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:17.426413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3375/6743] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:20.631906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:20.710074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa7846-de08-4240-b537-81a81e327a17 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:20.714604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:20.715337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:20.715620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:20.715892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] PATH_INFO: `/v3/users/f6a9a7a5dbc74cb3893a2ec83c4f61dd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:20.717011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a9a7a5dbc74cb3893a2ec83c4f61dd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:20.718933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:20.954010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a9a7a5dbc74cb3893a2ec83c4f61dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:20.967058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a9a7a5dbc74cb3893a2ec83c4f61dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:20.967854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a9a7a5dbc74cb3893a2ec83c4f61dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:20.968502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a9a7a5dbc74cb3893a2ec83c4f61dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:20.984618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a9a7a5dbc74cb3893a2ec83c4f61dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:21.105518 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3369/6744] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:20 2022] DELETE /identity/v3/users/f6a9a7a5dbc74cb3893a2ec83c4f61dd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:21.110201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:21.110736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:21.110736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:21.140767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:21.142258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:21.226483 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3376/6745] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:21.237058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:21.239490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:21.248064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:21.315638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f3195-8c82-47d7-8665-6c3f1457aac3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:21.325472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ec34-eaac-48dc-b137-e3de3591620e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:21.326122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ec34-eaac-48dc-b137-e3de3591620e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:21.328290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ec34-eaac-48dc-b137-e3de3591620e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:21.328290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ec34-eaac-48dc-b137-e3de3591620e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:21.337989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ec34-eaac-48dc-b137-e3de3591620e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:21.339490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ec34-eaac-48dc-b137-e3de3591620e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:21.357279 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3370/6746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:21.802357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:21.803986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:21.819851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61789c-4101-4bd2-92e3-bc1634c584d2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:21.824841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:21.825496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:21.825841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:21.826058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] PATH_INFO: `/v3/projects/aa486aa5a909437999fe95ad10de6756` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:21.827330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa486aa5a909437999fe95ad10de6756)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:21.829632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:21.966882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa486aa5a909437999fe95ad10de6756', 'request_id': 'req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:21.973763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa486aa5a909437999fe95ad10de6756', 'request_id': 'req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:21.975182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:21.983569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa486aa5a909437999fe95ad10de6756', 'request_id': 'req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.074862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] The token cache is being invalidate because project aa486aa5a909437999fe95ad10de6756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:22.075118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.075814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0661356b-a187-4e9a-a5a6-a8b991d5b5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.082882 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3377/6747] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:21 2022] DELETE /identity/v3/projects/aa486aa5a909437999fe95ad10de6756 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:22.086100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.087686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.088233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.115154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:22.115154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:22.182941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3371/6748] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:22.191875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.192436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.192436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.223163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:22.224396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:22.236578 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3378/6749] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:22.241621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.264225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80e625-71ba-4958-b4ab-9d22e34de85f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.279180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.279180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.279180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.279180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.279628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:22.279628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.279628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.301191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3372/6750] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:19:22.309659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.320626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280782e-616d-4ccb-9dbf-ca12d6fc0e97 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.325608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.326299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.326584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.326998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.327529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.329512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.514423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.517372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:22.530314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d69db-d8de-4d3d-b214-5d34ee392537 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.535863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.536513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.536809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.537069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] PATH_INFO: `/v3/users/c0ee65b2656f47a78bbbddf6b21a7149` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.538242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ee65b2656f47a78bbbddf6b21a7149)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.540233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.567501 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3379/6751] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:22 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:22.568995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.638934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd251aa2-f33e-47d3-a733-a376807349ad admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.643992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.646256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.646256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.646256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.646256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.647732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.674098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ee65b2656f47a78bbbddf6b21a7149'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.683704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ee65b2656f47a78bbbddf6b21a7149'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.684630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ee65b2656f47a78bbbddf6b21a7149'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.685389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ee65b2656f47a78bbbddf6b21a7149'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.703316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-61ef565f-7ffb-4092-bf9b-baf6ff108933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ee65b2656f47a78bbbddf6b21a7149'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:22.741904 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3380/6752] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:22 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:19:22.743290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.745052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:22.757941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6883670-0a47-45d4-8438-57c63570972d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.764101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.764753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.765326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.765326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.766160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.767699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.781954 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3381/6753] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:22.783225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.794625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621241f4-eef0-4782-b9f8-4ca1f91271ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.802965 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3373/6754] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:22 2022] DELETE /identity/v3/users/c0ee65b2656f47a78bbbddf6b21a7149 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:22.806584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.807148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.807680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.830992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:22.844476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:22.847057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:22.877836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.878462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.878753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.879166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.880639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.882048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.900643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3382/6755] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:22.900643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.911337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a808e-739c-4b60-a03d-22d234058bf0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:22.916779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:22.917451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:22.917738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:22.918118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] PATH_INFO: `/v3/projects/9e015e0a9846424da275a82d2d41b2b1/users/3e9f23c331e14e0c9d45e0932f5e6a41/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:22.924880 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3374/6756] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:22.935713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:22.936911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e015e0a9846424da275a82d2d41b2b1, user_id=3e9f23c331e14e0c9d45e0932f5e6a41, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:22.937248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:22.939743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:22.999368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d210b4-e721-4ed5-8b5c-8409b3045332 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.002998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9304-cb35-4b67-81cd-ee7500f0f7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.003683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9304-cb35-4b67-81cd-ee7500f0f7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.003966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9304-cb35-4b67-81cd-ee7500f0f7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.004621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9304-cb35-4b67-81cd-ee7500f0f7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.014435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec9304-cb35-4b67-81cd-ee7500f0f7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.015936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec9304-cb35-4b67-81cd-ee7500f0f7b3 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.026671 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3375/6757] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:19:23.059105 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3383/6758] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:22 2022] PUT /identity/v3/projects/9e015e0a9846424da275a82d2d41b2b1/users/3e9f23c331e14e0c9d45e0932f5e6a41/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:23.071004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.071366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.072140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.103495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] MFA Rules not processed for user `3e9f23c331e14e0c9d45e0932f5e6a41`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:23.104792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:23.187738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3376/6759] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:23.193332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:23.205002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:23.270501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf5962-0e01-478d-af18-cad17b792403 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.275632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049706-c658-4241-add2-f127846c115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.276251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049706-c658-4241-add2-f127846c115d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.276533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049706-c658-4241-add2-f127846c115d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.276843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049706-c658-4241-add2-f127846c115d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.277458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049706-c658-4241-add2-f127846c115d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.279438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049706-c658-4241-add2-f127846c115d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.404107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:23.406584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:23.413515 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3384/6760] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:23 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:23.419799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049706-c658-4241-add2-f127846c115d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:23.458378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676db18-49c7-4571-a099-6c7cae6b2fd5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.522528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049706-c658-4241-add2-f127846c115d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.529806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.530439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.530747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.531076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.531695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.533627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.539647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:23.561671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.562419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.562707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.562988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] PATH_INFO: `/v3/projects/dba34e1faa904617850784f10182684c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.564177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba34e1faa904617850784f10182684c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.566206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.628648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3385/6761] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:23 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:19:23.633098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:23.644237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6c5d0-dae9-4caf-8a77-eb646c69c1db admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.650147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.650774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.651101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.651381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.652431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.655044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.666746 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3386/6762] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:23.670919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:23.681848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c7ea6-0448-4b30-8e4c-288561ad7f0e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.687062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.689449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.689449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.689449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] PATH_INFO: `/v3/projects/068f1b4874a24d94bf761428137a799a/users/9a079ddd9a1d4591b028bba9d1e2521a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.698362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba34e1faa904617850784f10182684c', 'request_id': 'req-9cbe3446-b545-49ff-aaf9-554a375d99bb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:23.704387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba34e1faa904617850784f10182684c', 'request_id': 'req-9cbe3446-b545-49ff-aaf9-554a375d99bb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:23.705401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=068f1b4874a24d94bf761428137a799a, user_id=9a079ddd9a1d4591b028bba9d1e2521a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.708731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.713245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba34e1faa904617850784f10182684c', 'request_id': 'req-9cbe3446-b545-49ff-aaf9-554a375d99bb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:23.865285 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3387/6763] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:23 2022] PUT /identity/v3/projects/068f1b4874a24d94bf761428137a799a/users/9a079ddd9a1d4591b028bba9d1e2521a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:23.865601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] The token cache is being invalidate because project dba34e1faa904617850784f10182684c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:23.866286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:23.867491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9cbe3446-b545-49ff-aaf9-554a375d99bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:23.870467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3377/6764] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:23 2022] DELETE /identity/v3/projects/dba34e1faa904617850784f10182684c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:23.874422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:23.876559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:23.878430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac924d-8c8a-4640-bbd3-b40de4e15f8e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.878888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac924d-8c8a-4640-bbd3-b40de4e15f8e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.879261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac924d-8c8a-4640-bbd3-b40de4e15f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.916522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0eac924d-8c8a-4640-bbd3-b40de4e15f8e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:23.917847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0eac924d-8c8a-4640-bbd3-b40de4e15f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:23.966099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80432c-0a3b-4d18-9f92-a95c11c1c60b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:23.971914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:23.973348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:23.973514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:23.973792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:23.974745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:23.976864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:23.988250 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3388/6765] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:23.993263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.005156 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3378/6766] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:24.005995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3854-b865-403c-82fc-949266e28358 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.013220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099db07-d39e-4f55-9e36-4f6496cde9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.014006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.014146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099db07-d39e-4f55-9e36-4f6496cde9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.014315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.014425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099db07-d39e-4f55-9e36-4f6496cde9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.014576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.014681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099db07-d39e-4f55-9e36-4f6496cde9d8 admin admin] PATH_INFO: `/v3/projects/068f1b4874a24d94bf761428137a799a/users/9a079ddd9a1d4591b028bba9d1e2521a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.016561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099db07-d39e-4f55-9e36-4f6496cde9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068f1b4874a24d94bf761428137a799a, user_id=9a079ddd9a1d4591b028bba9d1e2521a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.020031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099db07-d39e-4f55-9e36-4f6496cde9d8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.031307 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3389/6767] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:23 2022] PUT /identity/v3/projects/068f1b4874a24d94bf761428137a799a/users/9a079ddd9a1d4591b028bba9d1e2521a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:24.047097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.047097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.052711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:24.052822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.052910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:24.084346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] MFA Rules not processed for user `9a079ddd9a1d4591b028bba9d1e2521a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:24.085853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:24.118921 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3379/6768] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:24.124289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.134619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267bad4-847a-4f10-bd87-c16e25794e78 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.139538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.140160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.140444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.140782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.141597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:24.141901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.143734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.151801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:24.162076 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3380/6769] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:19:24.163434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.166430 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3390/6770] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:24.174422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42c84-a936-4777-a95d-ed8102b2e0f3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.179704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.179895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.180392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.180679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.180955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.181128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:24.181596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.183548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.200236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:24.260521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eea5c-ec12-4da3-af17-bf7f92f1f11c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.264567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.265208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.265527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.265805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.276575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.278026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.290800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3381/6771] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:24 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:19:24.290996 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3391/6772] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:19:24.296833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.361928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.369279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcb4f-bccf-45c3-afdd-df72523c3249 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.373240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aebc38-8e5b-4ad8-a7a2-a89a5d453f01 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.376082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.376723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.377004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.377278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.377908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.378033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.379285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.379834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.380139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] PATH_INFO: `/v3/users/3e9f23c331e14e0c9d45e0932f5e6a41` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.380751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.381629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9f23c331e14e0c9d45e0932f5e6a41)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.384066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.537114 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3382/6773] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:24 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:24.541240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.551946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacde5bb-5be5-43fa-9ac1-469a5335a072 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.557471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.558133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.558418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.558697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.559388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.561036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.573665 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3383/6774] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:24.577450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.589155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350bdeb-6827-49a6-8bcd-29c26edd8500 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.594900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.595832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.596213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.596586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.597360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.599451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.611720 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3384/6775] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:24.617323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.629151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b1ea-8359-4ea5-a5c6-41a8be0174b5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.634393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1050-2f51-43c0-8fdd-812f52a8bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:24.635105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1050-2f51-43c0-8fdd-812f52a8bbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.635392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1050-2f51-43c0-8fdd-812f52a8bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.637609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1050-2f51-43c0-8fdd-812f52a8bbc1 admin admin] PATH_INFO: `/v3/projects/493e62dbe7e44e35869840ff9406a673/users/816b1f5e609d47ce985c1c3ee57a6e93/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.652343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d1050-2f51-43c0-8fdd-812f52a8bbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493e62dbe7e44e35869840ff9406a673, user_id=816b1f5e609d47ce985c1c3ee57a6e93, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:24.655155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d1050-2f51-43c0-8fdd-812f52a8bbc1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:24.719540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9f23c331e14e0c9d45e0932f5e6a41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:24.727955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9f23c331e14e0c9d45e0932f5e6a41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:24.731273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9f23c331e14e0c9d45e0932f5e6a41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:24.740797 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3385/6776] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:24 2022] PUT /identity/v3/projects/493e62dbe7e44e35869840ff9406a673/users/816b1f5e609d47ce985c1c3ee57a6e93/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:24.754292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.754847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.755141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.757473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9f23c331e14e0c9d45e0932f5e6a41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:24.757473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70836b55-2555-4527-a6d2-936adfd2288b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9f23c331e14e0c9d45e0932f5e6a41'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:24.785466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] MFA Rules not processed for user `816b1f5e609d47ce985c1c3ee57a6e93`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:24.786721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:24.834614 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3392/6777] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:24 2022] DELETE /identity/v3/users/3e9f23c331e14e0c9d45e0932f5e6a41 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:24.839041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:24.839381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:24.840706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:24.860660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:24.861914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:24.866888 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3386/6778] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:24.878248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.880260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:24.904618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:24.944686 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3393/6779] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:24.954801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:24.957661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78f91d-bf4a-4906-bea4-4a950e9ba328 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:24.997889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:25.026559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd0ddc-e548-41fd-b472-8041d677df83 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:25.030373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:25.030925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:25.031275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:25.031368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:25.031606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:25.031892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:25.031996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:25.032228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:25.044040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:25.045503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:25.056664 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3394/6780] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:19:25.103296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:25.104706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:25.117310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3387/6781] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:25.595042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:25.596511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:25.616754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665ae3f-a196-49f9-9a7e-b22fb5cf74a0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:25.623948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:25.624622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:25.624955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:25.625211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] PATH_INFO: `/v3/projects/9e015e0a9846424da275a82d2d41b2b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:25.626578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e015e0a9846424da275a82d2d41b2b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:25.631135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:25.807400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e015e0a9846424da275a82d2d41b2b1', 'request_id': 'req-93b29ffe-68ac-450d-a1cc-8f7077b27a20'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:25.817338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e015e0a9846424da275a82d2d41b2b1', 'request_id': 'req-93b29ffe-68ac-450d-a1cc-8f7077b27a20'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:25.821912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:25.825945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e015e0a9846424da275a82d2d41b2b1', 'request_id': 'req-93b29ffe-68ac-450d-a1cc-8f7077b27a20'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:25.937568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] The token cache is being invalidate because project 9e015e0a9846424da275a82d2d41b2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:25.938147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:25.942199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:25.945391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:25.946565 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3395/6782] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:25 2022] DELETE /identity/v3/projects/9e015e0a9846424da275a82d2d41b2b1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:25.969636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff933-5132-4976-8abf-b215eb1331c9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:26.049979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:26.051415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:26.051888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:26.052172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] PATH_INFO: `/v3/users/9a079ddd9a1d4591b028bba9d1e2521a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:26.053528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a079ddd9a1d4591b028bba9d1e2521a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:26.055576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:26.083067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:26.294284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a079ddd9a1d4591b028bba9d1e2521a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:26.304046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a079ddd9a1d4591b028bba9d1e2521a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:26.304837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a079ddd9a1d4591b028bba9d1e2521a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:26.305483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a079ddd9a1d4591b028bba9d1e2521a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:26.318880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7ff26f18-863c-403e-b6ee-f150b9b915d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a079ddd9a1d4591b028bba9d1e2521a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:26.397613 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3388/6783] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:25 2022] DELETE /identity/v3/users/9a079ddd9a1d4591b028bba9d1e2521a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:27.013850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:27.016989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:27.054801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29ffe-68ac-450d-a1cc-8f7077b27a20 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:27.139816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:27.140487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.140978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.141273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] PATH_INFO: `/v3/projects/068f1b4874a24d94bf761428137a799a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.143195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] RBAC: Authorizing `identity:delete_project(project_id=068f1b4874a24d94bf761428137a799a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:27.145774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:27.235336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b33c-3820-4be7-a836-5197962bdb22 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.235898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b33c-3820-4be7-a836-5197962bdb22 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.235898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b33c-3820-4be7-a836-5197962bdb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.261039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bf88b33c-3820-4be7-a836-5197962bdb22 None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:27.262535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bf88b33c-3820-4be7-a836-5197962bdb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:27.271865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068f1b4874a24d94bf761428137a799a', 'request_id': 'req-03357ffe-3e54-4e41-b5c7-8d55e876eaef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:27.280323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068f1b4874a24d94bf761428137a799a', 'request_id': 'req-03357ffe-3e54-4e41-b5c7-8d55e876eaef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:27.286952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068f1b4874a24d94bf761428137a799a', 'request_id': 'req-03357ffe-3e54-4e41-b5c7-8d55e876eaef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:27.334883 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3389/6784] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:27.385093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] The token cache is being invalidate because project 068f1b4874a24d94bf761428137a799a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:27.385375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:27.386045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03357ffe-3e54-4e41-b5c7-8d55e876eaef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:27.387643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3396/6785] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:27 2022] DELETE /identity/v3/projects/068f1b4874a24d94bf761428137a799a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:27.392980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.398727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.398727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.426990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:27.428805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:27.506638 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3390/6786] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:27.514342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.514544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.514811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.536810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:27.538045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:27.546799 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3397/6787] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:27.552417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:27.562562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080430c-a9fb-4e07-9683-de063d20e7ff None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:27.568251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:27.568858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.569140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.569412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.570061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:27.570369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:27.572009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:27.586990 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3391/6788] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:19:27.591486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:27.605217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fb7cd-748f-4ac9-8ddb-efb675317f62 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:27.610757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:27.612212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.612212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.612212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.613300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:27.615969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:27.680501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:27.683246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:27.738841 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3398/6789] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:27 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:27.744093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:27.759370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:27.791041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd7a5f-ef97-431f-94c3-5e4019574a5d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:27.834991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:27.853185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d804186-67bd-44f6-81ca-5a38ba745715 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:27.857413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:27.857981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:27.858285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.858568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.858692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:27.858849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.858958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:27.859175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:27.859955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:27.860732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:27.861817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:27.874774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:27.876286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:27.890468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3392/6790] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:19:28.012091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3399/6791] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:27 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:28.016533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.041412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56320d-e37a-45e8-8018-f7521a522f92 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:28.048369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:28.049004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.049284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.049983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.051092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:28.052727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:28.069089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3393/6792] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:28.070540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.081267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6a08-383f-416b-9747-c2ba0a91c294 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:28.086824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d6a69-58f2-45ca-b253-124c7eb5b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:28.087672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d6a69-58f2-45ca-b253-124c7eb5b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.087968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d6a69-58f2-45ca-b253-124c7eb5b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.088280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d6a69-58f2-45ca-b253-124c7eb5b6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.088939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d6a69-58f2-45ca-b253-124c7eb5b6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:28.090888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d6a69-58f2-45ca-b253-124c7eb5b6c1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:28.107053 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3400/6793] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:28.111790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.119859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf22a70-2092-497c-bbd4-eb7ad51073f0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:28.125029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:28.125752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.126101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.126455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] PATH_INFO: `/v3/projects/63aab600891f498e9696e154166b311a/users/27f9810e1a1441789ef95a3bd9138215/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.152398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63aab600891f498e9696e154166b311a, user_id=27f9810e1a1441789ef95a3bd9138215, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:28.155753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:28.322953 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3394/6794] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:28 2022] PUT /identity/v3/projects/63aab600891f498e9696e154166b311a/users/27f9810e1a1441789ef95a3bd9138215/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:28.335105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.335740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.336022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.375575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] MFA Rules not processed for user `27f9810e1a1441789ef95a3bd9138215`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:28.376831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:28.480520 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3401/6795] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:28.485353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.561802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3e6f-ea88-4e39-9f26-cfcf360c167f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:28.567280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:28.567930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.568218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.568493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.569174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:28.571127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:28.710993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3395/6796] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:28 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:19:28.715736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.727613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb1440-3b96-47ea-8d26-9047e85d3617 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:28.794963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:28.795638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.795927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.796205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.796864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:28.798911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:28.934913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3402/6797] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:28 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:28.939220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.953057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb079b-723a-4b45-b888-6299e372578e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:28.958343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:28.959161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:28.959574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:28.959981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:28.960703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:28.962416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:28.981570 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3396/6798] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:28.982411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:28.998064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa81a-d885-418d-8ace-825654ce709f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:29.006262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:29.006946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:29.007275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:29.007554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] PATH_INFO: `/v3/projects/477a0c67ede343ed911cc69d085cf03e/users/806a41afb3e240caa5e8bd475ed96256/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:29.024308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] RBAC: Authorizing `identity:create_grant(project_id=477a0c67ede343ed911cc69d085cf03e, user_id=806a41afb3e240caa5e8bd475ed96256, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:29.027611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:29.118773 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3403/6799] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:28 2022] PUT /identity/v3/projects/477a0c67ede343ed911cc69d085cf03e/users/806a41afb3e240caa5e8bd475ed96256/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:29.120601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:29.131935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2641c-78ba-4fec-a014-445415209dab admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:29.161517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:29.193019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e1ebf-5c36-4ee7-a807-231323649ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:29.193646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1ebf-5c36-4ee7-a807-231323649ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:29.193937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1ebf-5c36-4ee7-a807-231323649ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:29.194215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e1ebf-5c36-4ee7-a807-231323649ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:29.194856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1ebf-5c36-4ee7-a807-231323649ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:29.196550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e1ebf-5c36-4ee7-a807-231323649ae5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:29.206796 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3397/6800] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:29.211264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:29.221751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f92d9-26bd-4f90-9b04-9e106999221e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:29.226462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:29.227178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:29.227468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:29.227746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] PATH_INFO: `/v3/projects/477a0c67ede343ed911cc69d085cf03e/users/806a41afb3e240caa5e8bd475ed96256/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:29.229729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477a0c67ede343ed911cc69d085cf03e, user_id=806a41afb3e240caa5e8bd475ed96256, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:29.232429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:29.245758 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3404/6801] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:29 2022] PUT /identity/v3/projects/477a0c67ede343ed911cc69d085cf03e/users/806a41afb3e240caa5e8bd475ed96256/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:29.257825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831df4f4-a532-4807-acaa-6cde72edc499 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:29.258189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831df4f4-a532-4807-acaa-6cde72edc499 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:29.258560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831df4f4-a532-4807-acaa-6cde72edc499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:29.294421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-831df4f4-a532-4807-acaa-6cde72edc499 None None] MFA Rules not processed for user `806a41afb3e240caa5e8bd475ed96256`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:29.296959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-831df4f4-a532-4807-acaa-6cde72edc499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:29.376489 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3398/6802] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:29.388079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:29.390810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:29.397958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:29.457989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb12a01-8301-46ab-bf03-0689194ca893 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:29.463595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:29.464393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:29.465293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:29.465293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:29.478813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:29.480379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:29.492620 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3405/6803] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:30.138089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:30.138578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:30.138965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:30.174627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:30.176862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:30.277877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3399/6804] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:19:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:30.461622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:30.463256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:30.542789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6662b4-0a2d-4448-9ec7-6318d9ecf6dc service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:30.548115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcd21-b8cb-489b-b130-7a049bd3578b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:30.548745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd21-b8cb-489b-b130-7a049bd3578b service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:30.549026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd21-b8cb-489b-b130-7a049bd3578b service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:30.549309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd21-b8cb-489b-b130-7a049bd3578b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:30.558811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bcd21-b8cb-489b-b130-7a049bd3578b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:30.560456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bcd21-b8cb-489b-b130-7a049bd3578b service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:30.569426 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3406/6805] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:19:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:19:31.394334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:31.498290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:31.518741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db841cc-6853-47ce-a762-41e920f9d4fd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:31.525081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:31.526101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:31.526993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:31.527535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] PATH_INFO: `/v3/users/27f9810e1a1441789ef95a3bd9138215` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:31.529041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f9810e1a1441789ef95a3bd9138215)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:31.531335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:31.870764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f9810e1a1441789ef95a3bd9138215'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:31.891057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f9810e1a1441789ef95a3bd9138215'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:31.892092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f9810e1a1441789ef95a3bd9138215'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:31.893016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f9810e1a1441789ef95a3bd9138215'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:31.911124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f9810e1a1441789ef95a3bd9138215'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:32.029584 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3400/6806] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:31 2022] DELETE /identity/v3/users/27f9810e1a1441789ef95a3bd9138215 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:32.034097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:32.035225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:32.035317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:32.077620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:32.078907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:32.195069 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3407/6807] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:32.203061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:32.204460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:32.337174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc584d7-2a61-41c0-98b4-1f589c6656d5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:32.341500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:32.342146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:32.342435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:32.342714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:32.361754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:32.363705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:32.379795 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3401/6808] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:33.558225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:33.560411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:33.578156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc6e96-898a-47c1-875f-eacb5cadbf6e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:33.590665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:33.591633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:33.592109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:33.592545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] PATH_INFO: `/v3/projects/63aab600891f498e9696e154166b311a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:33.593962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63aab600891f498e9696e154166b311a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:33.596707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:33.733268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:33.752310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63aab600891f498e9696e154166b311a', 'request_id': 'req-2534594d-3c4a-463b-adb7-10e52d4b874a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:33.762189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63aab600891f498e9696e154166b311a', 'request_id': 'req-2534594d-3c4a-463b-adb7-10e52d4b874a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:33.769412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63aab600891f498e9696e154166b311a', 'request_id': 'req-2534594d-3c4a-463b-adb7-10e52d4b874a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:33.899168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] The token cache is being invalidate because project 63aab600891f498e9696e154166b311a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:33.899794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:33.900728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:33.904289 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3408/6809] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:33 2022] DELETE /identity/v3/projects/63aab600891f498e9696e154166b311a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:33.909892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:33.946843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefaa16-5068-4723-99ff-473ff2239fe9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:34.047501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:34.048369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:34.048757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:34.049035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] PATH_INFO: `/v3/users/806a41afb3e240caa5e8bd475ed96256` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:34.050876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=806a41afb3e240caa5e8bd475ed96256)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:34.058849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:34.121283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:34.378911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806a41afb3e240caa5e8bd475ed96256'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:34.392030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806a41afb3e240caa5e8bd475ed96256'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:34.393361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806a41afb3e240caa5e8bd475ed96256'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:34.395103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806a41afb3e240caa5e8bd475ed96256'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:34.422161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86a7eb3c-a6ee-41c1-9874-b878d5a3abcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806a41afb3e240caa5e8bd475ed96256'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:34.536621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3402/6810] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:33 2022] DELETE /identity/v3/users/806a41afb3e240caa5e8bd475ed96256 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:19:35.300309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:35.305875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:35.331834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534594d-3c4a-463b-adb7-10e52d4b874a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:35.491792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:35.506431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:35.506431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:35.506431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] PATH_INFO: `/v3/projects/477a0c67ede343ed911cc69d085cf03e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:35.510659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=477a0c67ede343ed911cc69d085cf03e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:35.512738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:35.731986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477a0c67ede343ed911cc69d085cf03e', 'request_id': 'req-388bbf35-30a5-49b2-90fc-b1f43c04f87c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:35.741021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477a0c67ede343ed911cc69d085cf03e', 'request_id': 'req-388bbf35-30a5-49b2-90fc-b1f43c04f87c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:35.754499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477a0c67ede343ed911cc69d085cf03e', 'request_id': 'req-388bbf35-30a5-49b2-90fc-b1f43c04f87c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:35.888714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] The token cache is being invalidate because project 477a0c67ede343ed911cc69d085cf03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:35.889123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:35.890053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-388bbf35-30a5-49b2-90fc-b1f43c04f87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:35.892258 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3409/6811] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:35 2022] DELETE /identity/v3/projects/477a0c67ede343ed911cc69d085cf03e => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:35.897024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:35.897764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:35.897764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:35.935080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:35.936369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:36.050296 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3403/6812] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:36.058731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.059045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.059336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.097833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:36.099572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:36.109024 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3410/6813] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:36.114195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:36.127042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04ef31-1dd5-4ce6-8e6d-89316be93ab0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:36.132582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:36.137351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.137351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.137351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.137351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:36.137351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:36.137351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:36.158060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:36.165105 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3404/6814] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:19:36.172208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbcfd7-d2b2-47d5-8a49-66a8ef26454b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:36.183798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:36.184595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.185427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.185427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.186550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:36.188681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:36.333482 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3411/6815] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:36 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:36.338434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:36.353418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a5ecb-48a0-4df6-b2d9-01b3e5f9d1ae admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:36.447700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:36.448415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.448629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.449340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.450009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:36.452594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:36.702726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3405/6816] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:36 2022] POST /identity/v3/users => generated 292 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:36.703869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:36.717597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65b20d-85aa-4bf8-b795-3bfdb0a92830 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:36.730441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:36.731194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.731468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.731749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.732573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:36.734189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:36.750688 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3412/6817] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:36.752359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:36.765292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ba8f6-d8e8-4eaa-889f-3a6b413c3d92 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:36.773083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c86a7f-8f2f-4b03-a3ac-79cd56a58fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:36.773781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c86a7f-8f2f-4b03-a3ac-79cd56a58fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.774002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c86a7f-8f2f-4b03-a3ac-79cd56a58fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.774274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c86a7f-8f2f-4b03-a3ac-79cd56a58fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.774916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c86a7f-8f2f-4b03-a3ac-79cd56a58fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:36.776686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c86a7f-8f2f-4b03-a3ac-79cd56a58fe3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:36.778980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:36.790648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3406/6818] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:36.794976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:36.813677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33941acf-d40e-4d15-860c-4b1efed04fe1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:36.825930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:36.827430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:36.827570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:36.828039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] PATH_INFO: `/v3/projects/349b59222491484fb4e225ccff7d4b62/users/d25507cda3a84eff852a5d17e09eae6d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:36.841146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:36.857685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=349b59222491484fb4e225ccff7d4b62, user_id=d25507cda3a84eff852a5d17e09eae6d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:36.864054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:37.019249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3413/6819] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:36 2022] PUT /identity/v3/projects/349b59222491484fb4e225ccff7d4b62/users/d25507cda3a84eff852a5d17e09eae6d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:37.032923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:37.033485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:37.033485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:37.071071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] MFA Rules not processed for user `d25507cda3a84eff852a5d17e09eae6d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:37.072510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:37.226378 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3407/6820] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:37.231099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:37.312255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154c94d-c384-4f93-81bc-ba7addf008d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:37.318163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:37.318799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:37.319111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:37.319394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:37.320197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:37.322333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:37.450584 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3414/6821] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:37 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:37.452277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:37.466488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e213c3c-011d-4596-8a34-4879094c614f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:37.547054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:37.547661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:37.547661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:37.548028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:37.548736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:37.551368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:37.703899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3408/6822] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:37 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:37.705237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:37.718903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f22f-a7d8-40ba-bd5c-2a721307414e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:37.724619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:37.725261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:37.725545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:37.725821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:37.726473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:37.728205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:37.745662 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3415/6823] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:37.750132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:37.764670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b8aa8-0025-4c3a-8df6-d5eb7e25446b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:37.780243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:37.780243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:37.780243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:37.780243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] PATH_INFO: `/v3/projects/0e6c26b4a23348b6b0f7944c57b1ffbb/users/439dad5518544aadb3ce68d81a403bbd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:37.797130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6c26b4a23348b6b0f7944c57b1ffbb, user_id=439dad5518544aadb3ce68d81a403bbd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:37.804966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:37.967268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3409/6824] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:37 2022] PUT /identity/v3/projects/0e6c26b4a23348b6b0f7944c57b1ffbb/users/439dad5518544aadb3ce68d81a403bbd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:37.971380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:37.986558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8dd96-50a3-4625-b41a-e3112fc79cf3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:38.080057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3698be-b13a-42d9-b9e4-202610767adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:38.081260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3698be-b13a-42d9-b9e4-202610767adb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:38.082150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3698be-b13a-42d9-b9e4-202610767adb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:38.082761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3698be-b13a-42d9-b9e4-202610767adb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:38.083980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3698be-b13a-42d9-b9e4-202610767adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:38.086048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3698be-b13a-42d9-b9e4-202610767adb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:38.103735 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3416/6825] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:38.108216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:38.120421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd3ef-a0a3-4a1f-8b06-a59b6f641a12 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:38.125673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:38.126334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:38.126617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:38.127600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] PATH_INFO: `/v3/projects/0e6c26b4a23348b6b0f7944c57b1ffbb/users/439dad5518544aadb3ce68d81a403bbd/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:38.131599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6c26b4a23348b6b0f7944c57b1ffbb, user_id=439dad5518544aadb3ce68d81a403bbd, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:38.135997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:38.149765 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3410/6826] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:38 2022] PUT /identity/v3/projects/0e6c26b4a23348b6b0f7944c57b1ffbb/users/439dad5518544aadb3ce68d81a403bbd/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:38.163766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:38.164442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:38.164767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:38.220374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] MFA Rules not processed for user `439dad5518544aadb3ce68d81a403bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:38.221998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:38.332829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:38.363643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3417/6827] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:38.376215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:38.401337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:38.453408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:38.480722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f20c30-99b8-4d6a-9df4-4790e621c844 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:38.485325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e77ae-b9db-49aa-8c1c-0cbac52ff9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:38.485959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e77ae-b9db-49aa-8c1c-0cbac52ff9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:38.486458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e77ae-b9db-49aa-8c1c-0cbac52ff9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:38.486856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e77ae-b9db-49aa-8c1c-0cbac52ff9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:38.573859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e77ae-b9db-49aa-8c1c-0cbac52ff9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:38.575848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e77ae-b9db-49aa-8c1c-0cbac52ff9c5 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:38.587130 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3411/6828] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:46.228402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:46.229913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:46.301818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9b11d-bee6-48b4-8f4e-701e7cac5225 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:46.306503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:46.307100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:46.307381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:46.307658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] PATH_INFO: `/v3/users/816b1f5e609d47ce985c1c3ee57a6e93` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:46.308810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816b1f5e609d47ce985c1c3ee57a6e93)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:46.310767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:46.512832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816b1f5e609d47ce985c1c3ee57a6e93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:46.521127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816b1f5e609d47ce985c1c3ee57a6e93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:46.522011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816b1f5e609d47ce985c1c3ee57a6e93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:46.536707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816b1f5e609d47ce985c1c3ee57a6e93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:46.537434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816b1f5e609d47ce985c1c3ee57a6e93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:46.633628 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3418/6829] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:46 2022] DELETE /identity/v3/users/816b1f5e609d47ce985c1c3ee57a6e93 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:46.638481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:46.639200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:46.639200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:46.666347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:46.667688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:46.738028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3412/6830] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:46.749685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:46.752553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:46.818716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240d74c-1ef9-4fa9-bc9a-3c24edf232c7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:46.822464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ef0fb-52fb-4430-b80b-769ae19246f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:46.823100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ef0fb-52fb-4430-b80b-769ae19246f1 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:46.823434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ef0fb-52fb-4430-b80b-769ae19246f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:46.823865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ef0fb-52fb-4430-b80b-769ae19246f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:46.834461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ef0fb-52fb-4430-b80b-769ae19246f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:46.835855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ef0fb-52fb-4430-b80b-769ae19246f1 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:46.845981 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3419/6831] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:47.109710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:47.109710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:47.126268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156aae-380b-47b9-9aa1-aaa79f8592eb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:47.132973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:47.133583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:47.133953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:47.134168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] PATH_INFO: `/v3/projects/493e62dbe7e44e35869840ff9406a673` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:47.135618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=493e62dbe7e44e35869840ff9406a673)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:47.137530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:47.286849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493e62dbe7e44e35869840ff9406a673', 'request_id': 'req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:47.293770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493e62dbe7e44e35869840ff9406a673', 'request_id': 'req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:47.304665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493e62dbe7e44e35869840ff9406a673', 'request_id': 'req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:47.389449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] The token cache is being invalidate because project 493e62dbe7e44e35869840ff9406a673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:47.389683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:47.390566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-07ee4a58-fe8a-4b33-b95a-53ba7eeda21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:47.394163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3413/6832] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:47 2022] DELETE /identity/v3/projects/493e62dbe7e44e35869840ff9406a673 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:47.399611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09833-9680-417e-b361-84f368b14810 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:47.400188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09833-9680-417e-b361-84f368b14810 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:47.400775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09833-9680-417e-b361-84f368b14810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:47.411323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:47.423207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1ce09833-9680-417e-b361-84f368b14810 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:47.424434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ce09833-9680-417e-b361-84f368b14810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:47.493555 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3420/6833] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:47.583693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:47.584042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:47.584291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:47.605322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:47.606550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:47.618681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3414/6834] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:47.619936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09833-9680-417e-b361-84f368b14810 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:47.630589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09833-9680-417e-b361-84f368b14810 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:47.635383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:47.636044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:47.636315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:47.636602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:47.637260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:47.637572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:47.639228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:47.653251 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3421/6835] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:19:47.658145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:47.673801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790b9ee-cc28-4505-aea0-cf8ce7dcf081 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:47.684781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:47.685419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:47.685816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:47.686104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:47.686758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:47.688762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:47.695676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:47.803353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3415/6836] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:47 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:47.807442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:47.833705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d5d0-72bf-4357-9aad-cce782a7f123 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:47.903266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:47.903824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:47.904146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:47.904485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:47.905150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:47.907252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:48.042271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3422/6837] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:47 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:48.046507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:48.058587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93afbbf-59c4-4f05-a8de-903c4541897b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:48.071650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:48.072295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:48.072579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:48.072856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:48.073514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:48.075284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:48.090412 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3416/6838] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:48.094614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:48.109311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3335c-b8d5-4be6-9fcd-9a8d71dbdea4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:48.115375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6313d3-0623-4b3f-8235-7b087d8ad5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:48.115996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6313d3-0623-4b3f-8235-7b087d8ad5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:48.116289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6313d3-0623-4b3f-8235-7b087d8ad5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:48.116567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6313d3-0623-4b3f-8235-7b087d8ad5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:48.117334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6313d3-0623-4b3f-8235-7b087d8ad5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:48.118954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6313d3-0623-4b3f-8235-7b087d8ad5e1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:48.135173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3423/6839] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:48.144457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:48.157953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab7a95-364e-4d92-8807-9645cc848296 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:48.173532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:48.177233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:48.178199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:48.178875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] PATH_INFO: `/v3/projects/64fca1c52fa1412da4cd0d71f68db02e/users/e3d2d518d2104490b95447690937d38b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:48.198911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fca1c52fa1412da4cd0d71f68db02e, user_id=e3d2d518d2104490b95447690937d38b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:48.202920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:48.321159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3417/6840] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:48 2022] PUT /identity/v3/projects/64fca1c52fa1412da4cd0d71f68db02e/users/e3d2d518d2104490b95447690937d38b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:48.322439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:48.322736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:48.323051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:48.375398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] MFA Rules not processed for user `e3d2d518d2104490b95447690937d38b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:48.375398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:48.460138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:48.468431 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3424/6841] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:48.493656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:48.496573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:48.583449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55175-6e7c-4c26-a91d-2cc54b3c4043 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:48.587746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98aa81-8cc6-45af-a3c4-32425928d1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:48.588255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98aa81-8cc6-45af-a3c4-32425928d1fc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:48.588654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98aa81-8cc6-45af-a3c4-32425928d1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:48.588967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98aa81-8cc6-45af-a3c4-32425928d1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:48.607320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98aa81-8cc6-45af-a3c4-32425928d1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:48.608896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98aa81-8cc6-45af-a3c4-32425928d1fc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:48.619752 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3418/6842] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:48.641552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:48.729151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e06359-5252-43d4-b6fd-d14594ca7510 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:48.734199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:48.734861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:48.735184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:48.735465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] PATH_INFO: `/v3/users/e3d2d518d2104490b95447690937d38b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:48.736654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d2d518d2104490b95447690937d38b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:48.739161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:49.038111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d2d518d2104490b95447690937d38b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:49.058437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d2d518d2104490b95447690937d38b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:49.058437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d2d518d2104490b95447690937d38b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:49.071848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d2d518d2104490b95447690937d38b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:49.073142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d2d518d2104490b95447690937d38b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:49.231469 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3425/6843] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:19:48 2022] DELETE /identity/v3/users/e3d2d518d2104490b95447690937d38b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:49.236180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:49.236644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:49.236756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:49.257803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:49.259322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:49.323151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3419/6844] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:49.332837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:49.334439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:49.405495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01881ff2-6a44-4b13-b687-a7ab8da315d7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:49.409307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cb419-972e-4a84-8a4c-37be6018516e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:49.409930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cb419-972e-4a84-8a4c-37be6018516e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:49.410216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cb419-972e-4a84-8a4c-37be6018516e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:49.410492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cb419-972e-4a84-8a4c-37be6018516e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:49.420567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cb419-972e-4a84-8a4c-37be6018516e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:49.422202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cb419-972e-4a84-8a4c-37be6018516e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:49.432782 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3426/6845] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:50.035510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:50.039700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:50.061739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878db4f3-f807-4d19-9350-0df307d2c8fe None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:50.072256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:50.072980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.073251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.073711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] PATH_INFO: `/v3/projects/64fca1c52fa1412da4cd0d71f68db02e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.075448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fca1c52fa1412da4cd0d71f68db02e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:50.077690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:50.302895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fca1c52fa1412da4cd0d71f68db02e', 'request_id': 'req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:50.304487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:50.309610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fca1c52fa1412da4cd0d71f68db02e', 'request_id': 'req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:50.316695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fca1c52fa1412da4cd0d71f68db02e', 'request_id': 'req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:50.423658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] The token cache is being invalidate because project 64fca1c52fa1412da4cd0d71f68db02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:19:50.423982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:50.424677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-394ba70a-a2b9-4061-bff9-e74a5d2d2fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:19:50.426210 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3420/6846] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:19:50 2022] DELETE /identity/v3/projects/64fca1c52fa1412da4cd0d71f68db02e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:50.431369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.432085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.432085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.452600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:50.453819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:50.472341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:50.517487 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3427/6847] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:50.527473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.527763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.530721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.548807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:50.550138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:50.558765 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3421/6848] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:50.562925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:50.575128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53d575-c1e2-4603-ba4b-51c26c71df8b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:50.579822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:50.580502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.580786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.581630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.582291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:19:50.582599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:50.584253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:50.598198 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3428/6849] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:19:50.604064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:50.620562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e69c86-796e-4f51-91e9-705256400f37 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:50.626145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:50.626977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.627452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.628704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.629789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:50.632113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:50.782767 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3422/6850] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:19:50 2022] POST /identity/v3/projects => generated 357 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:50.787053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:50.802014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a9ca-4b98-4514-9072-8ce78d87eb47 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:50.865644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:50.866368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.866664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.866952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.867651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:50.869592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:50.973047 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3429/6851] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:19:50 2022] POST /identity/v3/users => generated 279 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:19:50.977198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:50.989468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72785a6-a7c3-4591-9eee-7dd5de5c8708 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:50.994941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:50.995895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:50.996264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:50.996783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:50.997505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:50.999421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:51.011495 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3423/6852] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:19:51.016078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:51.028451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973265-e9e2-45c3-8874-5dc65fd2f38e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:51.033319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe9e5-914f-4530-af8d-1f25ac3ac162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:51.034452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe9e5-914f-4530-af8d-1f25ac3ac162 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:51.034736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe9e5-914f-4530-af8d-1f25ac3ac162 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:51.035030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe9e5-914f-4530-af8d-1f25ac3ac162 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:51.035698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fe9e5-914f-4530-af8d-1f25ac3ac162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:51.041248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fe9e5-914f-4530-af8d-1f25ac3ac162 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:51.049241 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3430/6853] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:19:51.054284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:51.067617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc7fa1-7dde-4db6-bdff-a0bd134129a5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:51.069661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:51.070337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:51.070672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:51.071052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] PATH_INFO: `/v3/projects/06af51034970407ea0cf72ae8de1562f/users/1f1992c601804ffe96acf2b5888f8597/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:51.088492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06af51034970407ea0cf72ae8de1562f, user_id=1f1992c601804ffe96acf2b5888f8597, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:51.092696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:51.222492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3424/6854] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:19:51 2022] PUT /identity/v3/projects/06af51034970407ea0cf72ae8de1562f/users/1f1992c601804ffe96acf2b5888f8597/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:19:51.228200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:51.228500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:51.228783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:51.273119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] MFA Rules not processed for user `1f1992c601804ffe96acf2b5888f8597`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:51.274521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:51.346932 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3431/6855] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:19:51.357994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:51.359758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:51.429123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d0c3-4df9-49fa-8051-6ae499811d1d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:51.434016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f12ae-6ef1-4f92-9910-bd6549ae898f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:51.434647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f12ae-6ef1-4f92-9910-bd6549ae898f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:51.434936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f12ae-6ef1-4f92-9910-bd6549ae898f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:51.435268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f12ae-6ef1-4f92-9910-bd6549ae898f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:51.445663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f12ae-6ef1-4f92-9910-bd6549ae898f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:51.447228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f12ae-6ef1-4f92-9910-bd6549ae898f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:51.459829 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3425/6856] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:52.235863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:52.238748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:52.267747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:52.324758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cf944-263e-4293-9b22-3689cc0afd2f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:52.328784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:52.329466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:52.329772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:52.330042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:52.332130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:52.404762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:52.406328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693ff51-11b5-40f6-932e-3bf918d27661 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:52.416972 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3432/6857] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:19:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:19:54.985309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:54.989223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:54.989223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:55.006901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:55.008178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:55.068458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3426/6858] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:19:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:56.793305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:56.793854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:56.793854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:56.820311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:19:56.821678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:56.904163 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3433/6859] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:19:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:19:56.919195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:19:56.921622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:19:56.957273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:19:57.018516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019750e-a617-43ed-9c37-297eb96768fb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:19:57.024311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31706c73-083c-4d83-8312-d6f5d12f9766 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:19:57.024947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31706c73-083c-4d83-8312-d6f5d12f9766 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:19:57.025232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31706c73-083c-4d83-8312-d6f5d12f9766 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:19:57.025510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31706c73-083c-4d83-8312-d6f5d12f9766 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:19:57.039303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31706c73-083c-4d83-8312-d6f5d12f9766 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:19:57.040880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31706c73-083c-4d83-8312-d6f5d12f9766 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:19:57.050415 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3427/6860] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:19:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:20:06.894814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=67 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:07.478041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:07.561793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7c34d-026c-4181-baab-1db9fd0eaccd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:07.571827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:07.573028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:07.573446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:07.573897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] PATH_INFO: `/v3/users/1f1992c601804ffe96acf2b5888f8597` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:07.577466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1992c601804ffe96acf2b5888f8597)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:07.581475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:07.801904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1992c601804ffe96acf2b5888f8597'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:07.812540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1992c601804ffe96acf2b5888f8597'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:07.813589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1992c601804ffe96acf2b5888f8597'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:07.828184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=22 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:07.832163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1992c601804ffe96acf2b5888f8597'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:07.832958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1992c601804ffe96acf2b5888f8597'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:07.987228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3434/6861] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:20:07 2022] DELETE /identity/v3/users/1f1992c601804ffe96acf2b5888f8597 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:07.988590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:07.988982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:07.989385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.030853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:08.035748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:08.109559 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3428/6862] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:08.121284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:08.122834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:08.196171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f95d1d-fe50-4797-b429-23d6c0973a88 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:08.199867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c935-e21f-4845-96f1-4614e5d1b7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:08.200626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c935-e21f-4845-96f1-4614e5d1b7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:08.200916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c935-e21f-4845-96f1-4614e5d1b7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:08.201194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c935-e21f-4845-96f1-4614e5d1b7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.211296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c935-e21f-4845-96f1-4614e5d1b7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:08.213263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c935-e21f-4845-96f1-4614e5d1b7a1 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:08.223222 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3435/6863] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:08.520525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:08.522326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:08.541315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cc4cd-be68-4abf-8b99-9c510c1449e4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:08.542990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:08.543751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:08.544044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:08.544320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] PATH_INFO: `/v3/projects/06af51034970407ea0cf72ae8de1562f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.545563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06af51034970407ea0cf72ae8de1562f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:08.547671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:08.654283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06af51034970407ea0cf72ae8de1562f', 'request_id': 'req-e15b9002-d714-43ed-84bb-50a227c7b266'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:08.661112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06af51034970407ea0cf72ae8de1562f', 'request_id': 'req-e15b9002-d714-43ed-84bb-50a227c7b266'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:08.667673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06af51034970407ea0cf72ae8de1562f', 'request_id': 'req-e15b9002-d714-43ed-84bb-50a227c7b266'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:08.770369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] The token cache is being invalidate because project 06af51034970407ea0cf72ae8de1562f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:20:08.770703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:08.771379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e15b9002-d714-43ed-84bb-50a227c7b266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:08.772929 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3429/6864] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:20:08 2022] DELETE /identity/v3/projects/06af51034970407ea0cf72ae8de1562f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:08.777844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:08.778135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:08.778416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.799500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:08.800724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:08.819546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:08.866044 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3436/6865] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:08.873809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:08.874327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:08.874430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.896745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:08.897959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:08.906492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3430/6866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:08.911766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:08.922105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9429ee1-57c3-458b-826e-a357e9a50d82 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:08.927658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:08.929145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:08.929145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:08.929145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.929518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:20:08.929882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:08.931675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:08.944119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3437/6867] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:20:08.948579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:08.960420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce26dd-4e17-48dc-8a62-bb8e5c678446 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:08.965483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:08.966104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:08.966386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:08.966663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:08.967553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:08.972953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:09.052587 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3431/6868] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:08 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:09.057203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:09.068553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4192f-8586-4e4e-aaff-d7a42c141e67 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:09.146085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:09.147364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.156674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.156674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.156674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:09.156674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:09.334151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3438/6869] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:09 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:09.348889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:09.350477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032039dd-b4c5-45ac-b6f1-1f247016602f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:09.357055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:09.357796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.358087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.358363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.359050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:09.360662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:09.374545 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3432/6870] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:09.378011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:09.390286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f05a-7e00-4f03-bc01-bbff0eace211 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:09.398513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415ddde-7b10-4a24-b98c-c133f5c4c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:09.399178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ddde-7b10-4a24-b98c-c133f5c4c431 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.399470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ddde-7b10-4a24-b98c-c133f5c4c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.399744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415ddde-7b10-4a24-b98c-c133f5c4c431 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.400394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415ddde-7b10-4a24-b98c-c133f5c4c431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:09.402080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415ddde-7b10-4a24-b98c-c133f5c4c431 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:09.415709 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3439/6871] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:09.420184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:09.431522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c96ce-df9f-4a36-92f6-88b078672137 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:09.436365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:09.440727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.440727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.440727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] PATH_INFO: `/v3/projects/6de10a2c91d44d968674a18b7c941ebb/users/e4ab475ab42f46748691a2760f8478ef/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.458977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de10a2c91d44d968674a18b7c941ebb, user_id=e4ab475ab42f46748691a2760f8478ef, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:09.465456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:09.564820 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3433/6872] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:09 2022] PUT /identity/v3/projects/6de10a2c91d44d968674a18b7c941ebb/users/e4ab475ab42f46748691a2760f8478ef/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:09.577061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.579619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.579619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.608977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] MFA Rules not processed for user `e4ab475ab42f46748691a2760f8478ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:09.610228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:09.680877 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3440/6873] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:09.700216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:09.702103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:09.725871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:09.767340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068695-5543-43cd-828f-eda845f68faf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:09.771272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338056ba-5be7-4ae2-9424-f86a470b5bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:09.771920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338056ba-5be7-4ae2-9424-f86a470b5bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.772209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338056ba-5be7-4ae2-9424-f86a470b5bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.772492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338056ba-5be7-4ae2-9424-f86a470b5bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.781924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338056ba-5be7-4ae2-9424-f86a470b5bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:09.784066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338056ba-5be7-4ae2-9424-f86a470b5bd9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:09.794090 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3434/6874] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:09.807638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:09.827826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:09.873208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f9642-46b2-4e2c-b8e2-ad3a61c7ff0d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:09.878082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:09.878730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:09.879025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:09.879575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] PATH_INFO: `/v3/users/e4ab475ab42f46748691a2760f8478ef` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:09.880734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ab475ab42f46748691a2760f8478ef)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:09.882789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:10.082175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ab475ab42f46748691a2760f8478ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:10.091121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ab475ab42f46748691a2760f8478ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:10.091121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ab475ab42f46748691a2760f8478ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:10.106877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ab475ab42f46748691a2760f8478ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:10.106877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ab475ab42f46748691a2760f8478ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:10.170304 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3441/6875] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:20:09 2022] DELETE /identity/v3/users/e4ab475ab42f46748691a2760f8478ef => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:10.174999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:10.175527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:10.175632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:10.197329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:10.202314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:10.270250 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3435/6876] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:10.280142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:10.281625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:10.352361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c02769-509a-4668-a3a8-550de790ae80 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:10.357110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cbd01-1641-49f0-8837-47ce54b0b92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:10.358576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cbd01-1641-49f0-8837-47ce54b0b92f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:10.358576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cbd01-1641-49f0-8837-47ce54b0b92f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:10.358576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cbd01-1641-49f0-8837-47ce54b0b92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:10.368315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cbd01-1641-49f0-8837-47ce54b0b92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:10.369864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cbd01-1641-49f0-8837-47ce54b0b92f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:10.381249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3442/6877] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:10.970040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:10.971686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:10.992618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9256-9ebd-405a-919b-bb5e1bd4fed7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:10.997403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:10.998120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:10.998497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:10.999226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] PATH_INFO: `/v3/projects/6de10a2c91d44d968674a18b7c941ebb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:11.001243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de10a2c91d44d968674a18b7c941ebb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:11.005680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:11.136570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de10a2c91d44d968674a18b7c941ebb', 'request_id': 'req-c374d557-8b80-4875-9bcd-97b01c818620'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:11.143560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de10a2c91d44d968674a18b7c941ebb', 'request_id': 'req-c374d557-8b80-4875-9bcd-97b01c818620'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:11.151748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de10a2c91d44d968674a18b7c941ebb', 'request_id': 'req-c374d557-8b80-4875-9bcd-97b01c818620'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:11.616435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] The token cache is being invalidate because project 6de10a2c91d44d968674a18b7c941ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:20:11.632107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:11.632107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c374d557-8b80-4875-9bcd-97b01c818620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:11.632107 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3436/6878] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:20:10 2022] DELETE /identity/v3/projects/6de10a2c91d44d968674a18b7c941ebb => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:11.641715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:11.642796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:11.642796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:11.669626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:11.670850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:11.708677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:11.742077 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3443/6879] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:11.752102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:11.752396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:11.752970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:11.789385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:11.792526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:11.819051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3437/6880] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:11.825381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:11.834838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fff2bf-8c40-4881-bb00-ff0ae32889d3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:11.839830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:11.840568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:11.840856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:11.841133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:11.846953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:20:11.846953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:11.846953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:11.857817 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3444/6881] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:20:11.864561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:11.884814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ed33b-259c-423e-97c4-a3a48d71db11 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:11.891634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:11.892891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:11.893142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:11.893418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:11.894518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:11.896584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:12.029864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3438/6882] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:11 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:12.034713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:12.047343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612c904-ae1e-4786-9150-2d5aff883b39 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:12.139330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:12.139803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.140087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.140367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.151354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:12.151354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:12.238493 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3445/6883] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:12 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:12.242830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:12.254235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282751-3d1a-4e20-bede-14335be95fbc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:12.259135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:12.259838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.260122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.260399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.261047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:12.262659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:12.274920 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3439/6884] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:12.279277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:12.290092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a3fef-e22c-4764-b8dd-01d6f5a7ef64 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:12.295108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f881aab-6c82-408e-b792-4433517879f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:12.295816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881aab-6c82-408e-b792-4433517879f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.296269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881aab-6c82-408e-b792-4433517879f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.296555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f881aab-6c82-408e-b792-4433517879f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.297199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f881aab-6c82-408e-b792-4433517879f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:12.298832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f881aab-6c82-408e-b792-4433517879f8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:12.310843 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3446/6885] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:20:12.315860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:12.329088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce15681-6be5-4755-b270-c5bd0d6ddd70 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:12.335797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:12.336489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.336788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.337118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] PATH_INFO: `/v3/projects/a6ce1e90c3b34ad680374931c418d3f5/users/c06b52e0ef05414eb777eac277d8e800/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.340611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:12.355432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ce1e90c3b34ad680374931c418d3f5, user_id=c06b52e0ef05414eb777eac277d8e800, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:12.358193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:12.428078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3440/6886] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:12 2022] PUT /identity/v3/projects/a6ce1e90c3b34ad680374931c418d3f5/users/c06b52e0ef05414eb777eac277d8e800/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:12.438611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.447758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.447758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.469261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] MFA Rules not processed for user `c06b52e0ef05414eb777eac277d8e800`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:12.470506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:12.545080 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3447/6887] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:12.550351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:12.644323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f9cd3-20dc-4bc0-9f23-c2f98da723f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:12.649529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:12.650150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.650436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.650714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.651399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:12.653356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:12.800230 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3441/6888] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:12 2022] POST /identity/v3/projects => generated 379 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:12.804545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:12.816669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e136-e733-4991-8cff-ebe56c79dea6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:12.879083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:12.905358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:12.905987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:12.906273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:12.906552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:12.907320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:12.909790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.004877 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3448/6889] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:12 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:13.009101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:13.021697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acdff4-0f4d-49b9-b015-9aa2ae44aeba admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:13.027912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:13.028544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.028828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.029201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.030137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:13.031832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.044467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3442/6890] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:13.052609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:13.060349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57d65-92c9-436c-be4a-242468fb13c2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:13.065765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:13.066439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.066728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.067095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] PATH_INFO: `/v3/projects/0522bf6ff8c34e8e918e0a41a454bc50/users/2bce6b35e1ea4a48b29b2055840a048a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.083916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0522bf6ff8c34e8e918e0a41a454bc50, user_id=2bce6b35e1ea4a48b29b2055840a048a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:13.086618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.170185 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3449/6891] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:13 2022] PUT /identity/v3/projects/0522bf6ff8c34e8e918e0a41a454bc50/users/2bce6b35e1ea4a48b29b2055840a048a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:13.181853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:13.184778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e519b-b9f8-4e04-b0d6-8e532e88d94a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:13.269585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5042568-de6f-4362-b52e-609bc49ff6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:13.270292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042568-de6f-4362-b52e-609bc49ff6cb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.270582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042568-de6f-4362-b52e-609bc49ff6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.270859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042568-de6f-4362-b52e-609bc49ff6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.271545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042568-de6f-4362-b52e-609bc49ff6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:13.273296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042568-de6f-4362-b52e-609bc49ff6cb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.286879 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3443/6892] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:13.290819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:13.304376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd3f87-3779-4763-9b95-4b3d967c5637 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:13.310483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:13.311208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.311506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.311797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] PATH_INFO: `/v3/projects/0522bf6ff8c34e8e918e0a41a454bc50/users/2bce6b35e1ea4a48b29b2055840a048a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.314002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0522bf6ff8c34e8e918e0a41a454bc50, user_id=2bce6b35e1ea4a48b29b2055840a048a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:13.316791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.331179 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3450/6893] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:13 2022] PUT /identity/v3/projects/0522bf6ff8c34e8e918e0a41a454bc50/users/2bce6b35e1ea4a48b29b2055840a048a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:13.342783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.343107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.343393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.374801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] MFA Rules not processed for user `2bce6b35e1ea4a48b29b2055840a048a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:13.376075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:13.423378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:13.450447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3444/6894] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:13.462943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:13.464763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:13.530119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60b50b-80e9-464b-ba85-7bb6dc2de24c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:13.534979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8c3d8-1dd3-4762-a89f-1953b521f23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:13.535647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c3d8-1dd3-4762-a89f-1953b521f23e service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.535943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c3d8-1dd3-4762-a89f-1953b521f23e service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.536224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c3d8-1dd3-4762-a89f-1953b521f23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.547669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c3d8-1dd3-4762-a89f-1953b521f23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:13.549196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c3d8-1dd3-4762-a89f-1953b521f23e service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.559928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3451/6895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:13.820370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:13.851495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223086b3-62ca-4586-9aa3-65e068e1ae17 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:13.857805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7c364-2c7b-4d13-b5a0-7ebb936fa148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:13.858721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7c364-2c7b-4d13-b5a0-7ebb936fa148 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:13.859518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7c364-2c7b-4d13-b5a0-7ebb936fa148 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:13.859977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7c364-2c7b-4d13-b5a0-7ebb936fa148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:13.968521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7c364-2c7b-4d13-b5a0-7ebb936fa148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:13.970572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7c364-2c7b-4d13-b5a0-7ebb936fa148 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:13.987512 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3445/6896] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:15.621550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:15.621997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:15.622119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:15.648761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] MFA Rules not processed for user `acce3e06ce4d40ba8db7988456cf8787`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:15.649993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:15.717734 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3452/6897] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:16.059853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:16.065001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:16.065001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:16.085120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:16.086999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:16.153946 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3446/6898] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:16.168186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:16.170083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:16.214342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:16.249394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b16bc-5da0-4be8-8cd0-3c7e59352c32 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:16.256066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:16.256688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:16.257002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:16.257279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:16.266133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:16.268387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:16.277172 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3453/6899] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:20:23.512232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:23.513771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:23.587592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7fe55-9922-43ff-a8e6-eff2898817df None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:23.591729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:23.592715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:23.593127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:23.593621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:23.596143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:23.649069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:23.725348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:23.725348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:23.752282 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3447/6900] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:25.026193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:25.038454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b87d6f-7837-4b88-a96a-57bb667fa0e9 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:25.042142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:25.042779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:25.043084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:25.043361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:25.045097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:25.061346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:25.062840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d5547-9874-411f-a5ef-20052f20db6d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:25.076187 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3454/6901] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:33.731621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=22 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:35.069041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=22 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:36.260518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:36.324951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e39133-497a-4e6f-840f-db72b9fe15b1 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:36.329886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:36.330996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:36.330996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:36.331243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] PATH_INFO: `/v3/users/c06b52e0ef05414eb777eac277d8e800` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:36.332251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06b52e0ef05414eb777eac277d8e800)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:36.334165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:36.464867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06b52e0ef05414eb777eac277d8e800'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:36.472871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06b52e0ef05414eb777eac277d8e800'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:36.473556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06b52e0ef05414eb777eac277d8e800'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:36.474180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06b52e0ef05414eb777eac277d8e800'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:36.486374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06b52e0ef05414eb777eac277d8e800'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:36.529980 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3448/6902] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:20:36 2022] DELETE /identity/v3/users/c06b52e0ef05414eb777eac277d8e800 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:36.534627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:36.537870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:36.537870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:36.555764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:36.556961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:36.617787 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3455/6903] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:36.627685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:36.630135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:36.697054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430b939-da4e-44b5-996d-0407d56f0bb7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:36.701036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:36.701658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:36.701946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:36.702226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:36.712077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:36.713534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:36.724475 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3449/6904] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:37.332659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:37.338486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:37.347041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1e66-b29c-4138-b1fc-6a7cf780c406 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:37.353322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:37.355747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:37.355747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:37.355747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] PATH_INFO: `/v3/projects/a6ce1e90c3b34ad680374931c418d3f5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:37.355747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ce1e90c3b34ad680374931c418d3f5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:37.357594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:37.491630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ce1e90c3b34ad680374931c418d3f5', 'request_id': 'req-2f3c79c1-de63-4b61-a114-93b31a658125'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.497940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ce1e90c3b34ad680374931c418d3f5', 'request_id': 'req-2f3c79c1-de63-4b61-a114-93b31a658125'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.503689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ce1e90c3b34ad680374931c418d3f5', 'request_id': 'req-2f3c79c1-de63-4b61-a114-93b31a658125'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.592790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] The token cache is being invalidate because project a6ce1e90c3b34ad680374931c418d3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:20:37.593435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.593639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.595235 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3456/6905] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:20:37 2022] DELETE /identity/v3/projects/a6ce1e90c3b34ad680374931c418d3f5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:37.599966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:37.610103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bffab-e11c-451a-8590-0501f45f5003 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:37.629064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:37.666607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:37.667265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:37.667550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:37.667824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] PATH_INFO: `/v3/users/2bce6b35e1ea4a48b29b2055840a048a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:37.668932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bce6b35e1ea4a48b29b2055840a048a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:37.670853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:37.904261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bce6b35e1ea4a48b29b2055840a048a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.915631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bce6b35e1ea4a48b29b2055840a048a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.916697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bce6b35e1ea4a48b29b2055840a048a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.917958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bce6b35e1ea4a48b29b2055840a048a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.931748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fb6cf674-0544-41ed-81f0-e438e283f01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bce6b35e1ea4a48b29b2055840a048a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:37.999027 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3450/6906] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:20:37 2022] DELETE /identity/v3/users/2bce6b35e1ea4a48b29b2055840a048a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:38.395675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:38.397107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:38.411890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c79c1-de63-4b61-a114-93b31a658125 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:38.471827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:38.472969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:38.473251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:38.473522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] PATH_INFO: `/v3/projects/0522bf6ff8c34e8e918e0a41a454bc50` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:38.474649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0522bf6ff8c34e8e918e0a41a454bc50)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:38.476756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:38.594728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:38.611878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0522bf6ff8c34e8e918e0a41a454bc50', 'request_id': 'req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:38.619619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0522bf6ff8c34e8e918e0a41a454bc50', 'request_id': 'req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:38.625282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0522bf6ff8c34e8e918e0a41a454bc50', 'request_id': 'req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:38.735402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] The token cache is being invalidate because project 0522bf6ff8c34e8e918e0a41a454bc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:20:38.735614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:38.736287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dcfc1a12-aed8-4f04-b66b-72150cd0b6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:38.737793 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3457/6907] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:20:38 2022] DELETE /identity/v3/projects/0522bf6ff8c34e8e918e0a41a454bc50 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:20:38.742845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350efd-e276-4749-ae9a-38248519244f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:38.743354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350efd-e276-4749-ae9a-38248519244f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:38.743459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350efd-e276-4749-ae9a-38248519244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:38.763984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a6350efd-e276-4749-ae9a-38248519244f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:38.765215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a6350efd-e276-4749-ae9a-38248519244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:38.826258 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3451/6908] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:38.833906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:38.834203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:38.834488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:38.855079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:38.856304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:38.865026 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3458/6909] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:38.869301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350efd-e276-4749-ae9a-38248519244f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:38.879168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350efd-e276-4749-ae9a-38248519244f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:38.884487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:38.885099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:38.885388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:38.885669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:38.886320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:20:38.886629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:38.888272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:38.900493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3452/6910] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:20:38.907384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:38.918968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d8d5-d7f8-41f5-971f-bc20f869ce73 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:38.924589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:38.925379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:38.925630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:38.925936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:38.927376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:38.929337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:38.995334 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3459/6911] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:38 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:38.999767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.010109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e25ca-fa7f-4ab1-9bf5-952d3289a224 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.043820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:39.074914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.075958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.076297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.076576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.077200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.079238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.162730 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3453/6912] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:38 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:39.165214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.178885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d16b7-bfff-43cf-ad32-06fb5d156030 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.183916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.184547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.184845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.185222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.185873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.187514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.198155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3460/6913] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:39.202357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.213974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038ab41-cc57-4893-81a1-95b4533c6d4b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.219121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576b99e-be41-4a3f-8dc5-8b934e95f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.219925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b99e-be41-4a3f-8dc5-8b934e95f56a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.220050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b99e-be41-4a3f-8dc5-8b934e95f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.220343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b99e-be41-4a3f-8dc5-8b934e95f56a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.220969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576b99e-be41-4a3f-8dc5-8b934e95f56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.222706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576b99e-be41-4a3f-8dc5-8b934e95f56a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.235177 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3454/6914] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:39.239649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.249788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d025-8685-4c99-bdcb-dbaf1535bef8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.254581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.255273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.255560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.256131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] PATH_INFO: `/v3/projects/16ec907218c4486d88a04c4f8c3d76b3/users/0904738cc4ac420595dcd9bdf3ea552f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.271513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ec907218c4486d88a04c4f8c3d76b3, user_id=0904738cc4ac420595dcd9bdf3ea552f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.274163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.370910 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3461/6915] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:39 2022] PUT /identity/v3/projects/16ec907218c4486d88a04c4f8c3d76b3/users/0904738cc4ac420595dcd9bdf3ea552f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:39.383443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.383729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.384004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.414256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] MFA Rules not processed for user `0904738cc4ac420595dcd9bdf3ea552f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:39.415521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:39.486068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3455/6916] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:39.491298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.556275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d623-c1b2-4dca-acfc-35de55a4b46d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.560964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.561566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.561845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.562141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.562776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.564707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.687522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3462/6917] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:39 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:39.691741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.703289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061b657-95a9-4901-91c8-17aa4d127d91 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.771371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.771992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.772254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.772529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.773190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.775150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.840069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3456/6918] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:39 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:39.844027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.856219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bf6d0-110c-4907-b5e5-1d360c241310 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.861550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.862139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.862427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.862690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.863470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.865601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:39.879252 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3463/6919] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:39.884327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:39.901867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aab00e-be30-49b8-b0a5-4f6568368a2e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:39.911368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:39.911934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:39.912215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:39.912492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] PATH_INFO: `/v3/projects/9e393472e8894e0c8bb58acfd66686f2/users/ad977d51671e4cc8bf6f7932de9adde2/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:39.931382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e393472e8894e0c8bb58acfd66686f2, user_id=ad977d51671e4cc8bf6f7932de9adde2, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:39.934532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:40.074488 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3457/6920] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:39 2022] PUT /identity/v3/projects/9e393472e8894e0c8bb58acfd66686f2/users/ad977d51671e4cc8bf6f7932de9adde2/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:20:40.078541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:40.089091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddc76b-6a16-4b0b-bf09-7136aa1973cc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:40.109869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:40.147880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2580af-2259-4961-b93b-dbcac7bc85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:40.148494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2580af-2259-4961-b93b-dbcac7bc85c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:40.148779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2580af-2259-4961-b93b-dbcac7bc85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:40.149056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2580af-2259-4961-b93b-dbcac7bc85c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:40.149694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2580af-2259-4961-b93b-dbcac7bc85c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:40.151316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2580af-2259-4961-b93b-dbcac7bc85c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:40.161438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3464/6921] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:40.165669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:40.171335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:40.177805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0e0a-c895-4487-8423-18dc456b7773 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:40.182501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:40.183251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:40.183537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:40.183809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] PATH_INFO: `/v3/projects/9e393472e8894e0c8bb58acfd66686f2/users/ad977d51671e4cc8bf6f7932de9adde2/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:40.185784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e393472e8894e0c8bb58acfd66686f2, user_id=ad977d51671e4cc8bf6f7932de9adde2, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:40.188613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:40.200714 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3458/6922] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:40 2022] PUT /identity/v3/projects/9e393472e8894e0c8bb58acfd66686f2/users/ad977d51671e4cc8bf6f7932de9adde2/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:40.211908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:40.212222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:40.212506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:40.242246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] MFA Rules not processed for user `ad977d51671e4cc8bf6f7932de9adde2`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:40.244185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:40.319889 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3465/6923] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:40.331250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:40.333172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:40.408405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fb4d-7f9a-4415-a522-ffc905ea1b10 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:40.412737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab50d3e-3ed9-4295-a225-66877d2c6fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:40.413360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab50d3e-3ed9-4295-a225-66877d2c6fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:40.413647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab50d3e-3ed9-4295-a225-66877d2c6fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:40.413925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab50d3e-3ed9-4295-a225-66877d2c6fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:40.440861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab50d3e-3ed9-4295-a225-66877d2c6fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:40.442327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab50d3e-3ed9-4295-a225-66877d2c6fe1 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:40.452681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3459/6924] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:43.486187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:43.556118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cad9-fb89-4515-b068-3008bbb5d05d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:43.560995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:43.561644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:43.561927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:43.562208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] PATH_INFO: `/v3/users/0904738cc4ac420595dcd9bdf3ea552f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:43.563411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0904738cc4ac420595dcd9bdf3ea552f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:43.571445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:43.788979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0904738cc4ac420595dcd9bdf3ea552f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:43.790243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:43.796423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0904738cc4ac420595dcd9bdf3ea552f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:43.797120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0904738cc4ac420595dcd9bdf3ea552f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:43.810594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0904738cc4ac420595dcd9bdf3ea552f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:43.811727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0904738cc4ac420595dcd9bdf3ea552f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:44.004960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3466/6925] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:20:43 2022] DELETE /identity/v3/users/0904738cc4ac420595dcd9bdf3ea552f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:44.009849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:44.010354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:44.010452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:44.029729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:44.030982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:44.099857 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3460/6926] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:44.110115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:44.111649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:44.174598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280230a-2e7b-4286-9fc0-13e3fcadde40 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:44.178965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:44.181588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:44.181588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:44.181588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:44.189978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:44.191451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:44.202968 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3467/6927] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:44.595396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:44.596829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:44.610459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5b0e-38f3-4e8a-ace8-5069ade4549c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:44.616121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:44.616782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:44.617069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:44.617372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] PATH_INFO: `/v3/projects/16ec907218c4486d88a04c4f8c3d76b3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:44.618565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ec907218c4486d88a04c4f8c3d76b3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:44.620560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:44.726893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ec907218c4486d88a04c4f8c3d76b3', 'request_id': 'req-5206a4f2-5b88-4b15-bcce-da0804391bee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:44.732761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ec907218c4486d88a04c4f8c3d76b3', 'request_id': 'req-5206a4f2-5b88-4b15-bcce-da0804391bee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:44.739330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ec907218c4486d88a04c4f8c3d76b3', 'request_id': 'req-5206a4f2-5b88-4b15-bcce-da0804391bee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:44.839240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] The token cache is being invalidate because project 16ec907218c4486d88a04c4f8c3d76b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:20:44.839545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:44.840192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:44.841698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3461/6928] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:20:44 2022] DELETE /identity/v3/projects/16ec907218c4486d88a04c4f8c3d76b3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:44.845842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:44.856105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6fda0-d3bd-4aed-8037-2a7525a93bd2 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:44.917147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:44.917787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:44.918071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:44.918346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] PATH_INFO: `/v3/users/ad977d51671e4cc8bf6f7932de9adde2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:44.919544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad977d51671e4cc8bf6f7932de9adde2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:44.921567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:45.196344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad977d51671e4cc8bf6f7932de9adde2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.203283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad977d51671e4cc8bf6f7932de9adde2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.203959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad977d51671e4cc8bf6f7932de9adde2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.214434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:45.216457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad977d51671e4cc8bf6f7932de9adde2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.217152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f6144a5a-64e2-44e2-8bbe-5dc2a3286956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad977d51671e4cc8bf6f7932de9adde2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.326086 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3468/6929] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:20:44 2022] DELETE /identity/v3/users/ad977d51671e4cc8bf6f7932de9adde2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:45.709826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:45.711444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:45.725726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a4f2-5b88-4b15-bcce-da0804391bee admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:45.738209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:45.784110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:45.784755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:45.785045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:45.785328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] PATH_INFO: `/v3/projects/9e393472e8894e0c8bb58acfd66686f2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:45.786463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e393472e8894e0c8bb58acfd66686f2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:45.789129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:45.901966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e393472e8894e0c8bb58acfd66686f2', 'request_id': 'req-5b116d47-b8cb-4fd3-b146-44f266dba5ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.907563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e393472e8894e0c8bb58acfd66686f2', 'request_id': 'req-5b116d47-b8cb-4fd3-b146-44f266dba5ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:45.914859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e393472e8894e0c8bb58acfd66686f2', 'request_id': 'req-5b116d47-b8cb-4fd3-b146-44f266dba5ee'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:46.004574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] The token cache is being invalidate because project 9e393472e8894e0c8bb58acfd66686f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:20:46.004796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:46.005423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5b116d47-b8cb-4fd3-b146-44f266dba5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:20:46.007227 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3462/6930] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:20:45 2022] DELETE /identity/v3/projects/9e393472e8894e0c8bb58acfd66686f2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:46.012163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.012639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.012738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.034040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:46.035160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:46.098205 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3469/6931] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:46.106764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.107119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.107399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.127623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:46.128869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:46.137824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3463/6932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:46.142108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.152688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628678ce-b633-4c9c-8610-3d2dbd06ca6c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.157428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.158033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.158319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.158598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.159317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:20:46.159627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.161253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.174307 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3470/6933] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:20:46.178524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.188154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4dc75-0bad-49f6-8ad4-0d2614c4cec2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.192898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.194040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.194322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.194596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.195256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.197170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.326217 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3464/6934] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:46 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:46.327234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.338625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728ffe-89e9-45d3-80da-a99a0592327b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.399385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.400000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.400312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.400587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.401224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.403233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.519676 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3471/6935] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:46 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:46.523570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.534225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411135b0-e2c7-4f71-8578-391954a435a4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.538921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.539644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.539926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.540200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.540862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.542455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.553038 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3465/6936] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:46.556985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.567277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f726be9-a41a-421b-886b-b59db0a8ab2f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.572611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e20a73-2e4e-4b36-bb2a-c1b093b5d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.573261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20a73-2e4e-4b36-bb2a-c1b093b5d1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.573545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20a73-2e4e-4b36-bb2a-c1b093b5d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.573819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20a73-2e4e-4b36-bb2a-c1b093b5d1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.574449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e20a73-2e4e-4b36-bb2a-c1b093b5d1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.576097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e20a73-2e4e-4b36-bb2a-c1b093b5d1d6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.587963 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3472/6937] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:46.592266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.602575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b1e9-d8c4-4044-8d87-a5b75b818ece admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.607163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.607807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.608090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.608369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] PATH_INFO: `/v3/projects/303bd7f016fc4fe4a418a5452c85f74d/users/236b8011d72b482eb6a61f27130aeb84/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.623539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=303bd7f016fc4fe4a418a5452c85f74d, user_id=236b8011d72b482eb6a61f27130aeb84, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.626204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.696515 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3466/6938] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:46 2022] PUT /identity/v3/projects/303bd7f016fc4fe4a418a5452c85f74d/users/236b8011d72b482eb6a61f27130aeb84/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:46.702184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61baa30-db34-445b-9ead-2c7c169a4b1c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.702499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61baa30-db34-445b-9ead-2c7c169a4b1c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.702785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61baa30-db34-445b-9ead-2c7c169a4b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.721857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a61baa30-db34-445b-9ead-2c7c169a4b1c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:46.723105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a61baa30-db34-445b-9ead-2c7c169a4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:46.772302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:46.784322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3473/6939] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:46.793976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:46.795728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:46.843596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:46.858038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93e94-97b0-4ae4-9601-27849bec73fe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:46.862339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:46.863051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:46.863340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:46.866447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:46.873811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:46.875292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:46.885244 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3467/6940] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:48.203850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.204417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.204417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.237586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] MFA Rules not processed for user `236b8011d72b482eb6a61f27130aeb84`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:48.238925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:48.328803 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3474/6941] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:48.333926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:48.345597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b656a6-589c-4df3-974d-d3792ac52511 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:48.356736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:48.357336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.357619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.357895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.358536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:48.360527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:48.454332 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3468/6942] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:20:48 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:48.455890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:48.467954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658eb93-d7cc-498d-b095-10bc89574f63 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:48.528219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:48.528960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.529248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.529533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.530191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:48.532161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:48.649595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3475/6943] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:20:48 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:20:48.653252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:48.664274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b455d3e-fad0-41fe-98b1-03d97a71fbbc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:48.671586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:48.672234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.672512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.672790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.673520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:48.675183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:48.687915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3469/6944] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:20:48.691940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:48.707001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad71e-893e-4863-a39a-792ec02df7e5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:48.708430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:48.709660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.709945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.710219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] PATH_INFO: `/v3/projects/a1df65c40b1e4787bc1a7fe1ada137a8/users/48a9a2ac4a2f40d09f040c78fcc739b5/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.729195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1df65c40b1e4787bc1a7fe1ada137a8, user_id=48a9a2ac4a2f40d09f040c78fcc739b5, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:48.731984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:48.798603 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3476/6945] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:48 2022] PUT /identity/v3/projects/a1df65c40b1e4787bc1a7fe1ada137a8/users/48a9a2ac4a2f40d09f040c78fcc739b5/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:48.803058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:48.813493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c5f4c-01a8-4986-8d07-661cf81d0613 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:48.872181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde26ed-7d10-4f99-aafb-b66ae3a9e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:48.872795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde26ed-7d10-4f99-aafb-b66ae3a9e43d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.873081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde26ed-7d10-4f99-aafb-b66ae3a9e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.873359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde26ed-7d10-4f99-aafb-b66ae3a9e43d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.874006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde26ed-7d10-4f99-aafb-b66ae3a9e43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:48.875637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde26ed-7d10-4f99-aafb-b66ae3a9e43d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:48.895501 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3470/6946] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:20:48.896865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:48.911376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed2787-ae8a-4d7d-af9e-eab8e268eb4f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:48.916535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16cb68-c0af-47fe-afba-de789c060adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:48.917285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16cb68-c0af-47fe-afba-de789c060adf admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:48.917640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16cb68-c0af-47fe-afba-de789c060adf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:48.917990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16cb68-c0af-47fe-afba-de789c060adf admin admin] PATH_INFO: `/v3/projects/a1df65c40b1e4787bc1a7fe1ada137a8/users/48a9a2ac4a2f40d09f040c78fcc739b5/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:48.920097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16cb68-c0af-47fe-afba-de789c060adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1df65c40b1e4787bc1a7fe1ada137a8, user_id=48a9a2ac4a2f40d09f040c78fcc739b5, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:48.922894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16cb68-c0af-47fe-afba-de789c060adf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:48.934904 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3477/6947] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:20:48 2022] PUT /identity/v3/projects/a1df65c40b1e4787bc1a7fe1ada137a8/users/48a9a2ac4a2f40d09f040c78fcc739b5/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:20:50.486395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:50.487000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:50.487306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:50.524626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] MFA Rules not processed for user `48a9a2ac4a2f40d09f040c78fcc739b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:50.526170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:50.649472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3471/6948] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:50.663051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:50.664292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:50.664718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:50.690563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] MFA Rules not processed for user `236b8011d72b482eb6a61f27130aeb84`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:50.692088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:50.733426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:50.779039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3478/6949] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:20:50.791280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:50.792790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:50.843091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:20:50.887873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7238097-2e22-4c31-a0cb-01282b924158 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:50.893599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eef206-33bb-40d0-abb4-876348ec4524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:50.894216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eef206-33bb-40d0-abb4-876348ec4524 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:50.894518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eef206-33bb-40d0-abb4-876348ec4524 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:50.894966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eef206-33bb-40d0-abb4-876348ec4524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:50.904057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eef206-33bb-40d0-abb4-876348ec4524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:50.905697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eef206-33bb-40d0-abb4-876348ec4524 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:50.914946 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3472/6950] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:51.940592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:20:51.942126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:52.017279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b1cf-f7cc-4571-85ed-74a481deaef8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:20:52.022918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:20:52.023630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:52.023920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:52.024381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:52.027041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:52.043292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:20:52.044918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:20:52.057219 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3479/6951] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:20:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:20:59.429478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210cf8-aa10-4b17-901d-98d9552c3f4d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:20:59.429976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210cf8-aa10-4b17-901d-98d9552c3f4d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:20:59.430104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210cf8-aa10-4b17-901d-98d9552c3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:20:59.450405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-45210cf8-aa10-4b17-901d-98d9552c3f4d None None] MFA Rules not processed for user `226a6d965ff14deebdead8370fc00d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:20:59.451643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-45210cf8-aa10-4b17-901d-98d9552c3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:20:59.507790 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3473/6952] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:21:01.319717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:01.321204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:01.389845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba2d8-6bb2-4058-aa12-95a27ebc5c0d service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:01.394639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:01.395315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:01.395601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:01.395880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] PATH_INFO: `/v3/users/d25507cda3a84eff852a5d17e09eae6d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:01.397701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25507cda3a84eff852a5d17e09eae6d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:01.401131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:01.662830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25507cda3a84eff852a5d17e09eae6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:01.672352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25507cda3a84eff852a5d17e09eae6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:01.673198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25507cda3a84eff852a5d17e09eae6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:01.687734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:01.689128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25507cda3a84eff852a5d17e09eae6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:01.689989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25507cda3a84eff852a5d17e09eae6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:01.764441 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3480/6953] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:21:01 2022] DELETE /identity/v3/users/d25507cda3a84eff852a5d17e09eae6d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:21:01.769023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:01.769683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:01.769683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:01.791644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:01.793197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:01.901800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3474/6954] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:21:01.928612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:01.932762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:02.039836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b16ba9-88d2-4580-9a34-49f06df4c2d7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:02.046465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:02.047610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:02.048055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:02.048489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:02.062459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:02.064070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:02.092940 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3481/6955] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:21:02.530440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:02.532274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:02.546134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae406-4e9a-4170-9ff6-6394e8e5d78e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:02.552958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:02.553863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:02.554329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:02.564152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] PATH_INFO: `/v3/projects/349b59222491484fb4e225ccff7d4b62` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:02.564152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=349b59222491484fb4e225ccff7d4b62)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:02.566407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:02.799986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349b59222491484fb4e225ccff7d4b62', 'request_id': 'req-2b3cc3de-4c83-4662-a90c-54eba2d683ed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:02.808983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349b59222491484fb4e225ccff7d4b62', 'request_id': 'req-2b3cc3de-4c83-4662-a90c-54eba2d683ed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:02.810386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:02.816618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349b59222491484fb4e225ccff7d4b62', 'request_id': 'req-2b3cc3de-4c83-4662-a90c-54eba2d683ed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:02.963504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] The token cache is being invalidate because project 349b59222491484fb4e225ccff7d4b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:21:02.964090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:02.964968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:02.966768 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3475/6956] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:21:02 2022] DELETE /identity/v3/projects/349b59222491484fb4e225ccff7d4b62 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:21:02.976117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:02.990770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39734d39-eaae-4f43-8c78-ef9f6fa416ca service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:03.066453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:03.067256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:03.067546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:03.067825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] PATH_INFO: `/v3/users/439dad5518544aadb3ce68d81a403bbd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:03.069797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] RBAC: Authorizing `identity:delete_user(user_id=439dad5518544aadb3ce68d81a403bbd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:03.072105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:03.284745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439dad5518544aadb3ce68d81a403bbd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:03.292061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439dad5518544aadb3ce68d81a403bbd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:03.292775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439dad5518544aadb3ce68d81a403bbd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:03.307703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439dad5518544aadb3ce68d81a403bbd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:03.308763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439dad5518544aadb3ce68d81a403bbd'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:03.462689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3482/6957] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:21:02 2022] DELETE /identity/v3/users/439dad5518544aadb3ce68d81a403bbd => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:21:04.213353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:04.215411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:04.327696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cc3de-4c83-4662-a90c-54eba2d683ed admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:04.418322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:04.420680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:04.435846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:04.437105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:04.437592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:04.439258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:04.441173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:04.441871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:04.489292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:04.492561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46b6ef-d09f-45ec-a90e-0bd3c00b5125 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:04.515709 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3476/6958] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:21:04.532790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ce4-6229-4707-b1b1-2c2c07cb473c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:04.555688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:04.556489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:04.556888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:04.557237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] PATH_INFO: `/v3/projects/0e6c26b4a23348b6b0f7944c57b1ffbb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:04.558561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6c26b4a23348b6b0f7944c57b1ffbb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:04.564055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:04.690278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6c26b4a23348b6b0f7944c57b1ffbb', 'request_id': 'req-2d54b713-3846-48a7-9d0b-1a7c83d85aad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:04.697998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6c26b4a23348b6b0f7944c57b1ffbb', 'request_id': 'req-2d54b713-3846-48a7-9d0b-1a7c83d85aad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:04.704900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6c26b4a23348b6b0f7944c57b1ffbb', 'request_id': 'req-2d54b713-3846-48a7-9d0b-1a7c83d85aad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:04.806679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] The token cache is being invalidate because project 0e6c26b4a23348b6b0f7944c57b1ffbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:21:04.806904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:04.807584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2d54b713-3846-48a7-9d0b-1a7c83d85aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:04.809108 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3483/6959] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:21:04 2022] DELETE /identity/v3/projects/0e6c26b4a23348b6b0f7944c57b1ffbb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:21:04.814567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:04.814930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:04.815364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:04.839509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:04.839715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:04.908955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3477/6960] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:21:04.917486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:04.918065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:04.918186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:04.946090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:04.947643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:04.968024 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3484/6961] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:21:04.969764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:04.985033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac85eb-6c97-4031-aee5-c87db57954bf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:04.995807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:04.996428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:04.997038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:04.997038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:04.997760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:21:04.998065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:04.999822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.009399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:05.018510 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3478/6962] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:21:05.022127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:05.033258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a89158-58bf-41e9-9d41-4b42d9b657b0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:05.042646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:05.043506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.043860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.044205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.044872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:05.046977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.178767 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3485/6963] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:21:05 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:21:05.182683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:05.196824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f20c3-7500-4c58-be68-793f0daf411b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:05.276231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:05.277254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.277488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.277799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.278450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:05.280725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.413174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3479/6964] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:21:05 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:21:05.417592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:05.430646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bf817-724d-4e00-909d-1800312eb87b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:05.436936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:05.438143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.438143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.438143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.438740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:05.440414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.451866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3486/6965] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:21:05.457124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:05.469369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e72820-05d9-4c20-9c33-4d89a29f137b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:05.475862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09435350-c5ca-4d44-a878-62516de417b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:05.476582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435350-c5ca-4d44-a878-62516de417b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.476927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435350-c5ca-4d44-a878-62516de417b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.477264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09435350-c5ca-4d44-a878-62516de417b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.477981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09435350-c5ca-4d44-a878-62516de417b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:05.484033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09435350-c5ca-4d44-a878-62516de417b0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.492293 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3480/6966] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:21:05.496852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:05.512580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d798-4c0c-4cdc-95e7-2699fb25f382 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:05.514590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:05.515373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.515731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.516080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] PATH_INFO: `/v3/projects/995f136d06074af89facc72f6a4f04df/users/1e9a7fe0713e4433a5c7c9487a1699fe/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.533785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995f136d06074af89facc72f6a4f04df, user_id=1e9a7fe0713e4433a5c7c9487a1699fe, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:05.536603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.659429 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3487/6967] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:21:05 2022] PUT /identity/v3/projects/995f136d06074af89facc72f6a4f04df/users/1e9a7fe0713e4433a5c7c9487a1699fe/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:21:05.669534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.669864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.670176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.704287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] MFA Rules not processed for user `1e9a7fe0713e4433a5c7c9487a1699fe`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:05.705642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:05.799175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3481/6968] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:21:05.810861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:05.816588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:05.867141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:05.898138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10274a-48ef-4db1-838f-2a271ab83691 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:05.903591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:05.906780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:05.906780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:05.906780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:05.915863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:05.918207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:05.936165 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3488/6969] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:12.118589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:12.120327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:12.227902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1569366-dbf0-4efe-a66e-34f23da482f3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:12.232562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:12.233639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:12.233639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:12.233978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] PATH_INFO: `/v3/users/acce3e06ce4d40ba8db7988456cf8787` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:12.235137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acce3e06ce4d40ba8db7988456cf8787)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:12.237403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:12.245356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:12.546657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:12.548263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:12.569816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acce3e06ce4d40ba8db7988456cf8787'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:12.584797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acce3e06ce4d40ba8db7988456cf8787'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:12.587420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acce3e06ce4d40ba8db7988456cf8787'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:12.590909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acce3e06ce4d40ba8db7988456cf8787'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:12.620091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acce3e06ce4d40ba8db7988456cf8787'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:12.637861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b78cb-b4df-4b76-bdf0-ea68f8fcdaec service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:12.638387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:12.638840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:12.639218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:12.639674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:12.641628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:12.656144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:12.658140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:12.671464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3489/6970] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:21:12.720955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3482/6971] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:21:12 2022] DELETE /identity/v3/users/acce3e06ce4d40ba8db7988456cf8787 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:21:12.932704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:12.934823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:13.013683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66ff2c-0ebd-470f-bb91-df871b3d7ed9 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:13.072616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:13.073330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:13.073680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:13.074028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:13.075927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:13.096191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:13.098005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:13.140439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:13.156253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:13.158580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f6f3e-7623-4460-9ade-988fa32f5439 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:13.170370 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3490/6972] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:13.330909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd58d-0375-4f65-944f-4f115cd06bb9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:13.336570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:13.337212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:13.337491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:13.337923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] PATH_INFO: `/v3/projects/f2390b2ea3104bdab3ecdcae0dc415b7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:13.340293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2390b2ea3104bdab3ecdcae0dc415b7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:13.341080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:13.508801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'request_id': 'req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:13.515750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'request_id': 'req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:13.523073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2390b2ea3104bdab3ecdcae0dc415b7', 'request_id': 'req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:13.594137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] The token cache is being invalidate because project f2390b2ea3104bdab3ecdcae0dc415b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:21:13.594419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:13.595107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ca032fb1-4d1d-410d-a1b9-164e0197cbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:21:13.596648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3483/6973] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:21:13 2022] DELETE /identity/v3/projects/f2390b2ea3104bdab3ecdcae0dc415b7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:21:13.602149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945663-6e7a-479a-8594-a86445825f4a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:13.602862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945663-6e7a-479a-8594-a86445825f4a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:13.602862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945663-6e7a-479a-8594-a86445825f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:13.623789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-23945663-6e7a-479a-8594-a86445825f4a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:13.625035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-23945663-6e7a-479a-8594-a86445825f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:13.695757 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3491/6974] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:21:13.706188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:13.706188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:13.706188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:13.727987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:13.729930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:13.739472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3484/6975] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:21:13.744617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945663-6e7a-479a-8594-a86445825f4a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:13.755088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945663-6e7a-479a-8594-a86445825f4a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:13.761011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:13.761651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:13.761936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:13.762212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:13.762867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:21:13.763230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:13.764877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:13.778004 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3492/6976] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:21:13.782562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:13.792524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe20812-dec6-4282-92b6-d4e4c0635e11 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:13.797670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:13.798289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:13.798575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:13.798848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:13.799514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:13.801416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:13.807755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:13.929136 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3485/6977] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:21:13 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:21:13.934886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:13.948316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15078-21ae-4ac1-a446-238f4e54566c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:14.017451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:14.018165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:14.018582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:14.018953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:14.019714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:14.022151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:14.139189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3493/6978] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:21:13 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:21:14.143147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:14.167392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfca34-f3da-496c-b01e-459e496ba78c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:14.167392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:14.167392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:14.167392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:14.167850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:14.168360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:14.170146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:14.184179 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3486/6979] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:21:14.189923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:14.204807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b1650-ee4e-42e5-b8af-3acae67ced63 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:14.217432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f45331-8eb6-455c-bcee-769aaea9bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:14.217432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f45331-8eb6-455c-bcee-769aaea9bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:14.217432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f45331-8eb6-455c-bcee-769aaea9bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:14.217432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f45331-8eb6-455c-bcee-769aaea9bba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:14.218864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f45331-8eb6-455c-bcee-769aaea9bba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:14.218864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f45331-8eb6-455c-bcee-769aaea9bba0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:14.235111 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3494/6980] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:21:14.236744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:14.249502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee17a2-59ff-4c51-b6ef-bc6375227b5d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:14.257302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:14.258313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:14.258792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:14.259183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] PATH_INFO: `/v3/projects/b56b93d575b74ba584c4bd399dfe2a6c/users/4251298aaf4e4207bdcab24fbdf30728/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:14.290226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56b93d575b74ba584c4bd399dfe2a6c, user_id=4251298aaf4e4207bdcab24fbdf30728, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:14.294431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:14.392002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3487/6981] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:21:14 2022] PUT /identity/v3/projects/b56b93d575b74ba584c4bd399dfe2a6c/users/4251298aaf4e4207bdcab24fbdf30728/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:21:14.400179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:14.400497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:14.400931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:14.421363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:14.422584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:14.509560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:14.532042 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3495/6982] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:21:14.543699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:14.547296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:14.620654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661021c-b2dc-459b-bf25-6642f840230f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:14.624845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03017658-736a-4b4d-aec8-ca1cef62ffe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:14.625468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03017658-736a-4b4d-aec8-ca1cef62ffe9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:14.625768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03017658-736a-4b4d-aec8-ca1cef62ffe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:14.626018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03017658-736a-4b4d-aec8-ca1cef62ffe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:14.640110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03017658-736a-4b4d-aec8-ca1cef62ffe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:14.641727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03017658-736a-4b4d-aec8-ca1cef62ffe9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:14.660260 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3488/6983] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:15.973453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:15.975848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:16.161849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302d731-b7d6-4093-9390-d77ae3773b93 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:16.176672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:16.177586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:16.178066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:16.178429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:16.182694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:16.256257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:16.260152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:16.280278 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3496/6984] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:21.886925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1436af-9437-4e2d-a7fc-9e8d8e78e252 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:21.887499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1436af-9437-4e2d-a7fc-9e8d8e78e252 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:21.887588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1436af-9437-4e2d-a7fc-9e8d8e78e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:21.939352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ec1436af-9437-4e2d-a7fc-9e8d8e78e252 None None] MFA Rules not processed for user `4251298aaf4e4207bdcab24fbdf30728`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:21.941801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ec1436af-9437-4e2d-a7fc-9e8d8e78e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:22.067792 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3489/6985] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:21:22.085288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:22.086874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:22.107043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cccad3-79bc-48c6-8d90-b109be3294a6 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:22.113010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:22.113856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:22.114339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:22.114821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:22.128614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:22.130539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:22.142311 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3497/6986] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:24.940667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:24.941612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:24.941612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:24.982272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] MFA Rules not processed for user `4251298aaf4e4207bdcab24fbdf30728`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:21:24.983816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:24.991789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3490/6987] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:21:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:21:29.703431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:29.727202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bed3f-575c-4c93-89e1-e12b2cd8d1f0 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:29.731911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:29.732536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:29.732819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:29.733095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:29.734871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:29.752266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:29.754757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:29.766417 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3498/6988] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:30.757945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:21:30.794689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f7a0-e55d-4c36-b2c6-9bbb56ae5394 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:21:30.802221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:21:30.803548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:21:30.803888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:21:30.804135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:21:30.805977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:21:30.824545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:21:30.826740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b69a0-87a8-456d-b9ad-0f70d5098d3a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:21:30.843598 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3491/6989] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:21:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:21:39.759539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=48 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:21:40.835221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:04.898890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:04.900508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:04.926680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69f316-d785-4b3e-8392-0c6b69b32363 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:04.931511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:04.932204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:04.932494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:04.932772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] PATH_INFO: `/v3/users/1e9a7fe0713e4433a5c7c9487a1699fe` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:04.934024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9a7fe0713e4433a5c7c9487a1699fe)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:04.936019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:05.115722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9a7fe0713e4433a5c7c9487a1699fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:05.124500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9a7fe0713e4433a5c7c9487a1699fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:05.125570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9a7fe0713e4433a5c7c9487a1699fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:05.139699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9a7fe0713e4433a5c7c9487a1699fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:05.140558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9a7fe0713e4433a5c7c9487a1699fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:05.201045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3499/6990] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:04 2022] DELETE /identity/v3/users/1e9a7fe0713e4433a5c7c9487a1699fe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:05.206516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:05.207070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:05.207412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:05.228773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:05.230008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:05.300782 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3492/6991] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:22:05.308470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:05.311398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:05.410607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508194-842c-4059-b50b-95e75a4b9939 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:05.414433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:05.415083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:05.415375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:05.415654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:05.426340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:05.428012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:05.442402 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3500/6992] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:06.139097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:06.140756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:06.149963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:06.151444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:06.173880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189f49-757e-4800-95aa-01393e1a7e81 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:06.184712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:06.185632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.186110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.186540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] PATH_INFO: `/v3/projects/995f136d06074af89facc72f6a4f04df` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.189129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995f136d06074af89facc72f6a4f04df)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:06.193320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:06.262505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a01aa-5e38-42ab-bc68-1941f32e6393 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:06.271612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:06.271612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.271612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.271612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.273375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:06.288572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:06.290476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2465e-0974-4541-84c6-b5af1be4852f service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:06.305548 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3493/6993] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:06.336728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995f136d06074af89facc72f6a4f04df', 'request_id': 'req-70df82db-2d6d-4fc4-85f8-a1724b799352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:06.339671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:06.347946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995f136d06074af89facc72f6a4f04df', 'request_id': 'req-70df82db-2d6d-4fc4-85f8-a1724b799352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:06.356669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995f136d06074af89facc72f6a4f04df', 'request_id': 'req-70df82db-2d6d-4fc4-85f8-a1724b799352'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:06.445776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] The token cache is being invalidate because project 995f136d06074af89facc72f6a4f04df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:06.446214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:06.447103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70df82db-2d6d-4fc4-85f8-a1724b799352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:06.449216 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3501/6994] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:06 2022] DELETE /identity/v3/projects/995f136d06074af89facc72f6a4f04df => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:22:06.455845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.456526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.456811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.482138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:06.483454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:06.565221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3494/6995] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:22:06.573165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.573523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.573816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.596014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:06.597330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:06.606504 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3502/6996] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:06.611620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:06.621756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbefc95-2f8a-4d87-9087-6f8e7465efda None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:06.627302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:06.627913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.628198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.628469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.629113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:22:06.629413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:06.631021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:06.644259 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3495/6997] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:22:06.648276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:06.658044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9299b-fa47-4d84-b3e9-38b5791e5b9f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:06.664297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:06.665163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.665519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.665869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.666691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:06.668773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:06.789471 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3503/6998] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:22:06 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:06.791409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:06.805113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b872f-0fb8-459b-8c65-3c50002c10a7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:06.850292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:06.901651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:06.902263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:06.902551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:06.902851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:06.903542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:06.905600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:07.001460 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3496/6999] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:22:06 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:07.006937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:07.018038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043a91-aaaf-47e6-a7a9-b156415e00c9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:07.022768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:07.023473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:07.023845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:07.024293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:07.026722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:07.026722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:07.044573 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3504/7000] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:07.048003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:07.061103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89ae66-48f1-4b77-a792-7dcccd564124 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:07.067144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cad89-dc7a-4c0b-bf1e-18c718460fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:07.067757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cad89-dc7a-4c0b-bf1e-18c718460fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:07.068097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cad89-dc7a-4c0b-bf1e-18c718460fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:07.068374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cad89-dc7a-4c0b-bf1e-18c718460fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:07.069090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cad89-dc7a-4c0b-bf1e-18c718460fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:07.074903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cad89-dc7a-4c0b-bf1e-18c718460fb3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:07.089819 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3497/7001] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:07.091685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:07.102598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56a3cd-7577-4d8e-9e81-ce619bf609cb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:07.107350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:07.108038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:07.108503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:07.108788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] PATH_INFO: `/v3/projects/c99417c87d7a4bc182fc787c54bbf3c9/users/4eddefe7253d4a5e8d22bf91e971a6c4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:07.125220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99417c87d7a4bc182fc787c54bbf3c9, user_id=4eddefe7253d4a5e8d22bf91e971a6c4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:07.128433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:07.211098 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3505/7002] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:07 2022] PUT /identity/v3/projects/c99417c87d7a4bc182fc787c54bbf3c9/users/4eddefe7253d4a5e8d22bf91e971a6c4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:07.222524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340527b7-8c85-4fba-919f-5f6ac3c57eed None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:07.222911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340527b7-8c85-4fba-919f-5f6ac3c57eed None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:07.223278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340527b7-8c85-4fba-919f-5f6ac3c57eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:07.253615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-340527b7-8c85-4fba-919f-5f6ac3c57eed None None] MFA Rules not processed for user `4eddefe7253d4a5e8d22bf91e971a6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:07.254952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-340527b7-8c85-4fba-919f-5f6ac3c57eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:07.320934 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3498/7003] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:07.332864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:07.334593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:07.406240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cea29-92d3-4bfb-9d3e-f343f6221a33 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:07.419263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:07.419263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:07.419263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:07.419263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:07.421208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:07.422643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:07.432084 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3506/7004] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:12.421448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:12.422412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:12.422412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:12.483187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:12.484423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:12.553157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:12.559721 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3499/7005] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:22:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:12.722070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:12.724236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:12.817707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:12.838029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f482c-26a0-4338-a051-8c5e74a59ac1 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:12.843307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:12.843970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:12.844256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:12.844527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:12.855090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:12.857509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:12.869634 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3507/7006] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:22:15.161931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:15.166008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:15.273549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82efa8e-6d02-4262-bb81-253e91ea5327 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:15.279437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:15.280412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:15.280882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:15.281340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] PATH_INFO: `/v3/users/236b8011d72b482eb6a61f27130aeb84` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:15.283305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236b8011d72b482eb6a61f27130aeb84)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:15.286298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:15.502612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236b8011d72b482eb6a61f27130aeb84'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:15.510159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236b8011d72b482eb6a61f27130aeb84'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:15.511218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236b8011d72b482eb6a61f27130aeb84'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:15.511834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236b8011d72b482eb6a61f27130aeb84'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:15.529535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236b8011d72b482eb6a61f27130aeb84'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:15.591913 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3500/7007] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:15 2022] DELETE /identity/v3/users/236b8011d72b482eb6a61f27130aeb84 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:15.961325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:15.980195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f316ee-4b8b-471c-aeec-3a56eb64ff0d service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:16.145792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:16.154160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:16.154160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:16.154160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] PATH_INFO: `/v3/projects/303bd7f016fc4fe4a418a5452c85f74d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:16.154160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=303bd7f016fc4fe4a418a5452c85f74d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:16.154160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:16.355392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303bd7f016fc4fe4a418a5452c85f74d', 'request_id': 'req-ca64209f-1dfa-4519-a3a7-f4c35c44f520'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:16.365796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303bd7f016fc4fe4a418a5452c85f74d', 'request_id': 'req-ca64209f-1dfa-4519-a3a7-f4c35c44f520'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:16.376171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303bd7f016fc4fe4a418a5452c85f74d', 'request_id': 'req-ca64209f-1dfa-4519-a3a7-f4c35c44f520'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:16.463149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] The token cache is being invalidate because project 303bd7f016fc4fe4a418a5452c85f74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:16.463149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:16.463149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:16.472119 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3508/7008] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:15 2022] DELETE /identity/v3/projects/303bd7f016fc4fe4a418a5452c85f74d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:16.473122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:16.474841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:16.512069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98ba30-9b25-465d-82ee-e152b6662c74 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:16.604792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:16.608899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:16.610714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:16.611980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] PATH_INFO: `/v3/users/48a9a2ac4a2f40d09f040c78fcc739b5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:16.614470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a9a2ac4a2f40d09f040c78fcc739b5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:16.618380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:16.655484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:17.104630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a9a2ac4a2f40d09f040c78fcc739b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.112705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a9a2ac4a2f40d09f040c78fcc739b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.113557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a9a2ac4a2f40d09f040c78fcc739b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.114486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a9a2ac4a2f40d09f040c78fcc739b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.133729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-af115a95-cc1b-4853-b3e5-dcc461ab3584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a9a2ac4a2f40d09f040c78fcc739b5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.221131 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3501/7009] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:16 2022] DELETE /identity/v3/users/48a9a2ac4a2f40d09f040c78fcc739b5 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:17.624705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:17.626982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:17.649450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64209f-1dfa-4519-a3a7-f4c35c44f520 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:17.762023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:17.762923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:17.763432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:17.764093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] PATH_INFO: `/v3/projects/a1df65c40b1e4787bc1a7fe1ada137a8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:17.765723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1df65c40b1e4787bc1a7fe1ada137a8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:17.768557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:17.800996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:17.976014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1df65c40b1e4787bc1a7fe1ada137a8', 'request_id': 'req-0c516a46-3696-4a15-959a-f852874cecec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.983849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1df65c40b1e4787bc1a7fe1ada137a8', 'request_id': 'req-0c516a46-3696-4a15-959a-f852874cecec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:17.994005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1df65c40b1e4787bc1a7fe1ada137a8', 'request_id': 'req-0c516a46-3696-4a15-959a-f852874cecec'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:18.100462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] The token cache is being invalidate because project a1df65c40b1e4787bc1a7fe1ada137a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:18.101017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:18.102222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0c516a46-3696-4a15-959a-f852874cecec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:18.104879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3509/7010] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:17 2022] DELETE /identity/v3/projects/a1df65c40b1e4787bc1a7fe1ada137a8 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:18.116520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.119331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.119331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.148685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:18.153798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:18.254585 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3502/7011] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:22:18.266541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.266978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.267222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.307386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:18.308756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:18.322873 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3510/7012] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:18.327456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:18.342978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74468bad-c1f4-4f36-9d0f-a394c27f3a13 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:18.372885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:18.373760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.374459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.374778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.375560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:22:18.376090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:18.379357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:18.405034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3503/7013] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:22:18.406165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:18.421299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a32768-20ab-4343-adff-12ec889d18e0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:18.437832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:18.438473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.438783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.439103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.439820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:18.447749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:18.547067 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3511/7014] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:22:18 2022] POST /identity/v3/projects => generated 359 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:18.552879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:18.584521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d00aff-722d-4f08-8ac9-8cc0a3c13001 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:18.692876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:18.695935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.696600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.696961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.699840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:18.704303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:18.823324 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3504/7015] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:22:18 2022] POST /identity/v3/users => generated 280 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:18.827384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:18.850802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dedee2-2353-448e-b566-b37f982b564b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:18.857659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:18.858542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.858986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.859443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.862523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:18.862523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:18.895632 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3512/7016] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:22:18.895815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:18.913724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a8de-8106-4e08-8e7d-5626d7c2c14a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:18.923834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53687e40-2ef0-4827-9682-a62ed0501914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:18.924816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687e40-2ef0-4827-9682-a62ed0501914 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.926214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687e40-2ef0-4827-9682-a62ed0501914 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.927426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687e40-2ef0-4827-9682-a62ed0501914 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:18.928413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53687e40-2ef0-4827-9682-a62ed0501914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:18.930315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53687e40-2ef0-4827-9682-a62ed0501914 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:18.953739 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3505/7017] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:18.957903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:18.978166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce877c0-e9a1-4760-9cfa-5cd642cb94b7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:18.991574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:18.995054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:18.995054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:18.995054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] PATH_INFO: `/v3/projects/0259db41e1ee415381aeb11b0787460e/users/e00c938ba5b64f0eac791e0737fee0b2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:19.021792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0259db41e1ee415381aeb11b0787460e, user_id=e00c938ba5b64f0eac791e0737fee0b2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:19.025326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:19.158387 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3513/7018] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:18 2022] PUT /identity/v3/projects/0259db41e1ee415381aeb11b0787460e/users/e00c938ba5b64f0eac791e0737fee0b2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:19.169288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdda598-18bc-496e-9737-200c956810bf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:19.169861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdda598-18bc-496e-9737-200c956810bf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:19.169861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdda598-18bc-496e-9737-200c956810bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:19.182499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:19.233819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3fdda598-18bc-496e-9737-200c956810bf None None] MFA Rules not processed for user `e00c938ba5b64f0eac791e0737fee0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:19.234542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3fdda598-18bc-496e-9737-200c956810bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:19.416050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3506/7019] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:19.778946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:19.780954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:19.866871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494459-353e-4a25-b3fc-a0029b367f2a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:19.873853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942ff5d-7eeb-4ac5-9119-8d7720f4fd06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:19.874848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942ff5d-7eeb-4ac5-9119-8d7720f4fd06 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:19.875331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942ff5d-7eeb-4ac5-9119-8d7720f4fd06 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:19.875762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942ff5d-7eeb-4ac5-9119-8d7720f4fd06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:19.892199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942ff5d-7eeb-4ac5-9119-8d7720f4fd06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:19.893774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942ff5d-7eeb-4ac5-9119-8d7720f4fd06 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:19.910343 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3514/7020] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:19.936784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdda598-18bc-496e-9737-200c956810bf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:20.080340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdda598-18bc-496e-9737-200c956810bf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:20.087629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:20.088412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:20.088961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:20.089349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] PATH_INFO: `/v3/users/e00c938ba5b64f0eac791e0737fee0b2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:20.090598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00c938ba5b64f0eac791e0737fee0b2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:20.093095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:20.311809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00c938ba5b64f0eac791e0737fee0b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:20.323989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00c938ba5b64f0eac791e0737fee0b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:20.326375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00c938ba5b64f0eac791e0737fee0b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:20.328687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00c938ba5b64f0eac791e0737fee0b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:20.355650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00c938ba5b64f0eac791e0737fee0b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:20.479034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3507/7021] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:19 2022] DELETE /identity/v3/users/e00c938ba5b64f0eac791e0737fee0b2 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:22:20.483551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:20.483853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:20.484196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:20.508254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:20.509513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:20.562010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:20.616173 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3515/7022] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:20.647589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:20.649998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:20.675674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:20.732536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9669f5-1e46-4d9b-8a3b-fb5efc58ce02 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:20.737881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c0a-d255-4ecd-a60a-e9756e93e6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:20.738501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c0a-d255-4ecd-a60a-e9756e93e6bf service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:20.738788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c0a-d255-4ecd-a60a-e9756e93e6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:20.739108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c0a-d255-4ecd-a60a-e9756e93e6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:20.749166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c0a-d255-4ecd-a60a-e9756e93e6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:20.750629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c0a-d255-4ecd-a60a-e9756e93e6bf service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:20.761669 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3508/7023] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:21.393377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:21.395677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:21.411744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c964de-cf53-405f-9bcc-3de5c4745e29 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:21.417672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:21.418534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:21.423307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:21.423307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] PATH_INFO: `/v3/projects/0259db41e1ee415381aeb11b0787460e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:21.423307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0259db41e1ee415381aeb11b0787460e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:21.424352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:21.592177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0259db41e1ee415381aeb11b0787460e', 'request_id': 'req-5be36520-2a50-492f-ae70-7984408060b7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:21.600855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0259db41e1ee415381aeb11b0787460e', 'request_id': 'req-5be36520-2a50-492f-ae70-7984408060b7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:21.616058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0259db41e1ee415381aeb11b0787460e', 'request_id': 'req-5be36520-2a50-492f-ae70-7984408060b7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:21.754227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] The token cache is being invalidate because project 0259db41e1ee415381aeb11b0787460e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:21.755194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:21.756152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5be36520-2a50-492f-ae70-7984408060b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:21.762269 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3516/7024] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:21 2022] DELETE /identity/v3/projects/0259db41e1ee415381aeb11b0787460e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:21.764785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:21.765298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:21.765599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:21.794301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:21.796114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:21.897113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3509/7025] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:21.899305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:21.899750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:21.900095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:21.926491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:21.929356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:21.948009 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3517/7026] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:21.948416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:21.960852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fd0a9-1742-4b22-940a-8aaf59c4efa2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:21.969354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:21.969354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:21.969354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:21.969354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:21.970375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:22:21.970375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:21.970375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:21.984253 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3510/7027] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:22:21.989183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:22.000919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae376439-ae0d-449a-9be2-1dfc13b1fcf0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:22.012570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:22.013273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.013571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.013863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.014522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:22.016626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:22.114165 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3518/7028] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:22:21 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:22.118334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:22.132776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43592b8a-de30-4ae1-8549-99ca88343307 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:22.226002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:22.226909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.227399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.227679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.228325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:22.230332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:22.355495 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3511/7029] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:22:22 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:22:22.359639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:22.374307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edde59f-d5bb-48ab-b5ae-03f12b443600 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:22.380958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:22.381713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.386401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.386401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.386401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:22.386401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:22.401954 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3519/7030] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:22:22.407188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:22.422858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c24b07-d938-4371-9eac-41d5c2482bc7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:22.430841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833dd43-7d01-48a8-8abe-b073a8467a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:22.431585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833dd43-7d01-48a8-8abe-b073a8467a69 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.432020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833dd43-7d01-48a8-8abe-b073a8467a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.432395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833dd43-7d01-48a8-8abe-b073a8467a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.433176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833dd43-7d01-48a8-8abe-b073a8467a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:22.434896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833dd43-7d01-48a8-8abe-b073a8467a69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:22.453860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3512/7031] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:22.472487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:22.488341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb47b4-67e7-4c98-a93b-e3f989785833 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:22.493249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:22.494017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.494376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.494750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] PATH_INFO: `/v3/projects/c68eec8502e9451b946462adfcc17014/users/fe7a44f0f8804ece9c80fe34486865a3/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.517591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68eec8502e9451b946462adfcc17014, user_id=fe7a44f0f8804ece9c80fe34486865a3, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:22.520608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:22.586624 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3520/7032] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:22 2022] PUT /identity/v3/projects/c68eec8502e9451b946462adfcc17014/users/fe7a44f0f8804ece9c80fe34486865a3/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:22.598449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.598741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.599166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.634461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] MFA Rules not processed for user `fe7a44f0f8804ece9c80fe34486865a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:22.635674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:22.647078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:22.736673 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3513/7033] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:22.755769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:22.758452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:22.855522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982835a-b115-4c64-a430-4b91256054d1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:22.859819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144128-3c2d-46cb-b380-fca6c4ef52f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:22.860606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144128-3c2d-46cb-b380-fca6c4ef52f8 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:22.860971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144128-3c2d-46cb-b380-fca6c4ef52f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:22.861320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144128-3c2d-46cb-b380-fca6c4ef52f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:22.874347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144128-3c2d-46cb-b380-fca6c4ef52f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:22.876237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144128-3c2d-46cb-b380-fca6c4ef52f8 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:22.887426 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3521/7034] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:27.068574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:27.070090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:27.148652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edad8b-071e-415d-a827-0a44a73c6861 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:27.152925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:27.153640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:27.154020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:27.154349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:27.156263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:27.232023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:27.233638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:27.244069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3514/7035] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:28.004481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:28.005069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:28.005524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:28.013592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:28.026096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] MFA Rules not processed for user `fe7a44f0f8804ece9c80fe34486865a3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:28.027338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:28.034513 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3522/7036] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:33.489702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:33.491488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:33.583310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d36bda-41c3-46b2-a1b3-1eebc05daefd service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:33.588716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:33.589874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:33.590471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:33.591088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:33.593426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:33.600262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:33.696184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:33.697954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:33.744542 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3515/7037] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:34.032962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:34.038566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:34.075294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502404f-82d7-49a5-87e3-24f01e01b144 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:34.077337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:34.078211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:34.078732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:34.079254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:34.081708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:34.098732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:34.101265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:34.113732 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3523/7038] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:34.308572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:34.322399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0841-d048-4f2c-8fa9-0f6ee8c63d0c service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:34.326527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:34.327194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:34.327640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:34.327923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:34.329719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:34.348147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:34.349728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab371a-27b4-4ad7-97a3-36a2d4004a1d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:34.364687 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3516/7039] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:35.521498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:35.524000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:35.548393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f767b97-678a-4977-be1a-eec80690b575 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:35.554036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:35.555579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:35.559148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:35.559148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] PATH_INFO: `/v3/users/4eddefe7253d4a5e8d22bf91e971a6c4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:35.559148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eddefe7253d4a5e8d22bf91e971a6c4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:35.560206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:35.782018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eddefe7253d4a5e8d22bf91e971a6c4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:35.790985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eddefe7253d4a5e8d22bf91e971a6c4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:35.791743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eddefe7253d4a5e8d22bf91e971a6c4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:35.804069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eddefe7253d4a5e8d22bf91e971a6c4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:35.804740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eddefe7253d4a5e8d22bf91e971a6c4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:35.892977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3524/7040] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:35 2022] DELETE /identity/v3/users/4eddefe7253d4a5e8d22bf91e971a6c4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:35.896361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:35.896772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:35.896994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:35.921400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:35.922739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:36.034369 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3517/7041] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:36.047913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:36.052644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:36.150881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faacfe9-baf9-4398-8dce-2adf6a083669 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:36.155531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541db664-1069-41ec-9236-a8e6d996b7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:36.156160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db664-1069-41ec-9236-a8e6d996b7ef service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:36.156442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db664-1069-41ec-9236-a8e6d996b7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:36.156715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db664-1069-41ec-9236-a8e6d996b7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:36.167715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541db664-1069-41ec-9236-a8e6d996b7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:36.169165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541db664-1069-41ec-9236-a8e6d996b7ef service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:36.186772 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3525/7042] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:37.674639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:37.676351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:37.688918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216f0fa-4e2d-48c0-963b-d3d3959a1581 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:37.695070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:37.695770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:37.696027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:37.697527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] PATH_INFO: `/v3/projects/c99417c87d7a4bc182fc787c54bbf3c9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:37.698779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99417c87d7a4bc182fc787c54bbf3c9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:37.701035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:37.820700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99417c87d7a4bc182fc787c54bbf3c9', 'request_id': 'req-1daad56a-a1f0-4587-b2eb-d3e3816deed3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:37.827337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99417c87d7a4bc182fc787c54bbf3c9', 'request_id': 'req-1daad56a-a1f0-4587-b2eb-d3e3816deed3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:37.834968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99417c87d7a4bc182fc787c54bbf3c9', 'request_id': 'req-1daad56a-a1f0-4587-b2eb-d3e3816deed3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:37.839551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:37.922090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] The token cache is being invalidate because project c99417c87d7a4bc182fc787c54bbf3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:37.922500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:37.926313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:37.926313 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3518/7043] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:37 2022] DELETE /identity/v3/projects/c99417c87d7a4bc182fc787c54bbf3c9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:37.932069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cef80-10fc-440a-ac0d-04893711e388 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:37.932560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cef80-10fc-440a-ac0d-04893711e388 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:37.932696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cef80-10fc-440a-ac0d-04893711e388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:37.964750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6c7cef80-10fc-440a-ac0d-04893711e388 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:37.966221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6c7cef80-10fc-440a-ac0d-04893711e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:38.075104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.076659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:38.092829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:38.116497 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3526/7044] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:38.130267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.133281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.133281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.169798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:38.171190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:38.188139 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3527/7045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:38.190143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.229866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211adcf7-1cf2-4bf0-a0b8-94a39462ad7a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.231363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daad56a-a1f0-4587-b2eb-d3e3816deed3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.238728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.238728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.238728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.238728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.239226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:22:38.239226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.239979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.241179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.241925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.242898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.243306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] PATH_INFO: `/v3/users/36f490bcb6d643fa99b73ffa55d37c5e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.245633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f490bcb6d643fa99b73ffa55d37c5e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.248325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.260528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3528/7046] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:22:38.266498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.286536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba31ba-c649-4684-9f96-5992c69264a8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.296050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.296915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.297282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.297868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.298699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.301269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.427094 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3529/7047] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:38.428557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.483447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f490bcb6d643fa99b73ffa55d37c5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:38.499306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f490bcb6d643fa99b73ffa55d37c5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:38.502452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f490bcb6d643fa99b73ffa55d37c5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:38.504662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f490bcb6d643fa99b73ffa55d37c5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:38.525659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f490bcb6d643fa99b73ffa55d37c5e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:38.528948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02be18-c070-4e69-97ae-f2e84e1722d6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.533261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.534106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.534526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.534942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.535706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.538058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.597019 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3519/7048] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:38 2022] DELETE /identity/v3/users/36f490bcb6d643fa99b73ffa55d37c5e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:38.629012 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3530/7049] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:22:38 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:22:38.630940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.633188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:38.810486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861fc3d-084c-42c1-99b4-c50d28315cee admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.816901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.817599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.818018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.818299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.819061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.820799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.836654 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3520/7050] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:38.838250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.855618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c017d12-56b8-4dd1-ad7e-1045efe39f1e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.862862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991813a-70e9-4f3c-becb-c13735351159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.863615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991813a-70e9-4f3c-becb-c13735351159 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.863896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991813a-70e9-4f3c-becb-c13735351159 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.864172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991813a-70e9-4f3c-becb-c13735351159 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.864875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991813a-70e9-4f3c-becb-c13735351159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.868349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991813a-70e9-4f3c-becb-c13735351159 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.885515 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3531/7051] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:38.886257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:38.899496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c4df7-9523-401f-bd35-20e92de6504f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:38.909019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:38.910693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.912763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.912763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] PATH_INFO: `/v3/projects/1024642393fb41d8a1b832e22f602d89/users/3503433d906a4c0582f2daeac30566e3/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.916919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:38.930743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1024642393fb41d8a1b832e22f602d89, user_id=3503433d906a4c0582f2daeac30566e3, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:38.933000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108e0a-37ef-43ef-bff2-e0a5a92cad6e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:38.933474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108e0a-37ef-43ef-bff2-e0a5a92cad6e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:38.933591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108e0a-37ef-43ef-bff2-e0a5a92cad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:38.933851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:38.959327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0b108e0a-37ef-43ef-bff2-e0a5a92cad6e None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:38.960853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0b108e0a-37ef-43ef-bff2-e0a5a92cad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:39.001668 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3521/7052] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:38 2022] PUT /identity/v3/projects/1024642393fb41d8a1b832e22f602d89/users/3503433d906a4c0582f2daeac30566e3/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:22:39.002914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:39.007860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:39.038748 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3532/7053] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:22:39.040237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:39.040537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:39.040819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:39.062611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:39.063890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:39.104715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3f578-dfb1-4d5e-94aa-260a6c5a670e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:39.109766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:39.111156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:39.111912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:39.112328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:39.112679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] PATH_INFO: `/v3/projects/30cea8e2c3b9438ea6a50fb852468a7b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:39.114195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cea8e2c3b9438ea6a50fb852468a7b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:39.116266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:39.149340 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3533/7054] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:39.156451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:39.156451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:39.237821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cea8e2c3b9438ea6a50fb852468a7b', 'request_id': 'req-4f04726f-9296-44d1-9bb6-34de3ded411f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.253406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cea8e2c3b9438ea6a50fb852468a7b', 'request_id': 'req-4f04726f-9296-44d1-9bb6-34de3ded411f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.257455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bb561-0fa6-4e89-b744-62d9d717abb6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:39.261764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cea8e2c3b9438ea6a50fb852468a7b', 'request_id': 'req-4f04726f-9296-44d1-9bb6-34de3ded411f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.329688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:39.330777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:39.331134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:39.331458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:39.332782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] The token cache is being invalidate because project 30cea8e2c3b9438ea6a50fb852468a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:39.333174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.333831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.335618 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3522/7055] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:39 2022] DELETE /identity/v3/projects/30cea8e2c3b9438ea6a50fb852468a7b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:39.338863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:39.338863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:39.408147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:39.409679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:39.415258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04726f-9296-44d1-9bb6-34de3ded411f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:39.418922 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3534/7056] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:22:39.419864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:39.420228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:39.421035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:39.421131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:39.422146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:39.423973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:39.452071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:39.468386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:39.516880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf532-d0cd-4212-8ee4-0c5e43d956cb service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:39.527450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:39.528104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:39.528481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:39.528637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] PATH_INFO: `/v3/users/8edd949d1caa49428039942ef7e61114` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:39.535766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edd949d1caa49428039942ef7e61114)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:39.540094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:39.548476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:39.555620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:39.574767 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3523/7057] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:39.874273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edd949d1caa49428039942ef7e61114'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.883872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edd949d1caa49428039942ef7e61114'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.884738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edd949d1caa49428039942ef7e61114'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.916642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edd949d1caa49428039942ef7e61114'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:39.919374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e1f535d2-9698-4da7-940d-789869d389ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edd949d1caa49428039942ef7e61114'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:40.032523 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3535/7058] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:22:39 2022] DELETE /identity/v3/users/8edd949d1caa49428039942ef7e61114 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:40.455061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:40.463915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:40.482571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9c6b7-0d3c-4c6c-8a34-72039d805c16 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:40.589786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:40.590511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:40.590845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:40.591063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] PATH_INFO: `/v3/projects/7d18243ce3f34e568e50af39ddd3ff15` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:40.592493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d18243ce3f34e568e50af39ddd3ff15)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:40.594467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:40.754806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d18243ce3f34e568e50af39ddd3ff15', 'request_id': 'req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:40.770509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d18243ce3f34e568e50af39ddd3ff15', 'request_id': 'req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:40.858271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d18243ce3f34e568e50af39ddd3ff15', 'request_id': 'req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:41.043168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] The token cache is being invalidate because project 7d18243ce3f34e568e50af39ddd3ff15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:22:41.043556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:41.047297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54a44bd7-b46c-4a88-81ab-ab693c9bf0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:22:41.053145 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3524/7059] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:22:40 2022] DELETE /identity/v3/projects/7d18243ce3f34e568e50af39ddd3ff15 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:41.058455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:41.058997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:41.058997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:41.147226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:41.148909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:41.278249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3536/7060] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:41.280578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:41.285412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:41.285412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:41.325328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:41.326840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:41.359498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3525/7061] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:41.362172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:41.381956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb869cd-3a31-401d-95aa-545648d44852 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:41.394305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:41.397836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:41.398271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:41.398685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:41.400018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:22:41.404497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:41.406441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:41.463984 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3537/7062] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:22:41.465389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:41.522352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f55714-7cf6-493c-b2f7-cad66777bb12 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:41.541051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:41.541986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:41.542180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:41.542517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:41.543206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:41.546024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:41.752703 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3526/7063] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:22:41 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:41.757262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:41.779323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4949f-0c04-40e1-9c22-4da2bbca1c91 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:41.840390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:41.872710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:41.874729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:41.874729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:41.874729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:41.874729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:41.876653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:41.984507 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3538/7064] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:22:41 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:41.985817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:42.004352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3489dc-6e5e-4f15-92e8-fc0202702fed admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:42.012989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:42.013624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:42.013923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:42.014179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:42.014827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:42.016472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:42.052404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3527/7065] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:22:42.054671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:42.068068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97f2a-e216-425c-9e09-837175fc312d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:42.073489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333828-c686-4f8f-90ba-4275c7a1982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:42.074941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333828-c686-4f8f-90ba-4275c7a1982e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:42.075248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333828-c686-4f8f-90ba-4275c7a1982e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:42.075537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333828-c686-4f8f-90ba-4275c7a1982e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:42.076205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333828-c686-4f8f-90ba-4275c7a1982e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:42.077829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333828-c686-4f8f-90ba-4275c7a1982e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:42.093612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3539/7066] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:42.097759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:42.109167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68682292-7d4b-47d2-8777-abfebfc2867a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:42.119670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:42.124833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:42.124833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:42.124833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] PATH_INFO: `/v3/projects/f18c44a020d9419886827314045b3200/users/3732e9811bcf44749081ff7049a2c0df/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:42.158294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:42.162972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18c44a020d9419886827314045b3200, user_id=3732e9811bcf44749081ff7049a2c0df, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:42.167623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:42.309963 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3528/7067] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:42 2022] PUT /identity/v3/projects/f18c44a020d9419886827314045b3200/users/3732e9811bcf44749081ff7049a2c0df/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:22:42.319766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1b734-6269-45e8-8ed7-f1816ac13b35 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:42.319766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1b734-6269-45e8-8ed7-f1816ac13b35 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:42.319766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1b734-6269-45e8-8ed7-f1816ac13b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:42.379741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-73b1b734-6269-45e8-8ed7-f1816ac13b35 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:42.380135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73b1b734-6269-45e8-8ed7-f1816ac13b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:42.507073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3540/7068] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:22:42.520047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:42.522946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:42.709116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56110-8896-4c6a-8dcc-35c9f18cd9fc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:42.716670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:42.717732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:42.718245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:42.718747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:42.741541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:42.743560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:42.758328 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3529/7069] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:22:50.800908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0914-377f-4c88-a398-b31067bf2741 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:50.801546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0914-377f-4c88-a398-b31067bf2741 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:50.802092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0914-377f-4c88-a398-b31067bf2741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:50.854934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4f3b0914-377f-4c88-a398-b31067bf2741 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:50.858714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f3b0914-377f-4c88-a398-b31067bf2741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:51.109680 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3541/7070] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:51.184443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:51.184443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:51.415672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e929d-68af-4517-8357-c575f685718e service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:51.431652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:51.432855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:51.432855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:51.433156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:51.449241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:51.459609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:51.485527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3530/7071] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:22:51.567993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:51.568285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:51.568564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:51.639705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] MFA Rules not processed for user `3503433d906a4c0582f2daeac30566e3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:51.641096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:51.758048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:51.805870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3542/7072] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:51.806870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:51.808513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:51.840870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b69b6-7515-45ff-9bb6-c1eff4bace29 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:51.856558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:51.857209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:51.860923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:51.860923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:51.860923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:51.860923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:51.981676 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3531/7073] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:22:51 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:51.984017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:52.009597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad5ce7-82df-421a-ac23-f75bc157fd39 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:52.168278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:52.169354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:52.169921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:52.170425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:52.171488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:52.174123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:52.277369 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3543/7074] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:22:51 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:22:52.280196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:52.294856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7211-1a58-4c8c-980c-d7be201e4ce4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:52.302253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:52.303815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:52.303815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:52.303815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:52.304774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:52.306546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:52.321763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3532/7075] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:52.325686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:52.342306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b663475-ccdc-48ce-bda3-848646bc5569 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:52.348805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:52.349581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:52.350155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:52.350545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] PATH_INFO: `/v3/projects/ee9006d65fd344a2bae0091569fec0ce/users/0751d82710814469a1184ef84cc18d49/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:52.386425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9006d65fd344a2bae0091569fec0ce, user_id=0751d82710814469a1184ef84cc18d49, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:52.389438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:52.522363 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3544/7076] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:52 2022] PUT /identity/v3/projects/ee9006d65fd344a2bae0091569fec0ce/users/0751d82710814469a1184ef84cc18d49/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:52.525104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:52.539251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b4c8c-f21d-4730-b0a0-716f2ec756c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:52.620754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:52.686495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd071455-3544-4a9e-9519-a5227cbdaa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:52.687502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd071455-3544-4a9e-9519-a5227cbdaa9c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:52.688006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd071455-3544-4a9e-9519-a5227cbdaa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:52.688523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd071455-3544-4a9e-9519-a5227cbdaa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:52.689244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd071455-3544-4a9e-9519-a5227cbdaa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:52.690976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd071455-3544-4a9e-9519-a5227cbdaa9c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:52.705300 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3533/7077] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:22:52.707048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:52.721853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6ac81-14d1-46e6-aab2-5586e7d5f8ef admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:52.732790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:52.734575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:52.735120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:52.735587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] PATH_INFO: `/v3/projects/ee9006d65fd344a2bae0091569fec0ce/users/0751d82710814469a1184ef84cc18d49/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:52.741599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9006d65fd344a2bae0091569fec0ce, user_id=0751d82710814469a1184ef84cc18d49, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:52.744463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:52.757022 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3545/7078] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:22:52 2022] PUT /identity/v3/projects/ee9006d65fd344a2bae0091569fec0ce/users/0751d82710814469a1184ef84cc18d49/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:22:52.989664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398694a-2ddc-431c-a5cf-ea02f5c6e843 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:52.989964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398694a-2ddc-431c-a5cf-ea02f5c6e843 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:52.990252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398694a-2ddc-431c-a5cf-ea02f5c6e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:53.018322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b398694a-2ddc-431c-a5cf-ea02f5c6e843 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:53.020142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b398694a-2ddc-431c-a5cf-ea02f5c6e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:53.161875 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3534/7079] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:22:53.177959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:53.324080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070adb0-3d2d-4d22-bbe4-b345d8328087 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:53.349137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:53.354077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:53.355098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:53.355391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:53.383990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:53.387637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:53.401881 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3546/7080] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:22:54.246287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b745d-9182-46b3-bfb1-b2f310d5523e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:54.246844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b745d-9182-46b3-bfb1-b2f310d5523e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:54.251647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b745d-9182-46b3-bfb1-b2f310d5523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:54.309495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-386b745d-9182-46b3-bfb1-b2f310d5523e None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:54.310764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-386b745d-9182-46b3-bfb1-b2f310d5523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:54.333990 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3535/7081] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:54.354586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:54.370807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188d25f-f56e-43af-921e-829467242d72 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:54.389278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef98e94-b869-4064-8b72-d74493097143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:54.390164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef98e94-b869-4064-8b72-d74493097143 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:54.391372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef98e94-b869-4064-8b72-d74493097143 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:54.391900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef98e94-b869-4064-8b72-d74493097143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:54.420829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef98e94-b869-4064-8b72-d74493097143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:54.425928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef98e94-b869-4064-8b72-d74493097143 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:54.436648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3547/7082] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:22:54.467627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:54.467920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:54.468204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:54.509524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] MFA Rules not processed for user `3732e9811bcf44749081ff7049a2c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:54.512408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:54.646587 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3536/7083] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:54.659467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12096a38-3196-44ab-ac5c-f8a19c22b6ea None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:54.660597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12096a38-3196-44ab-ac5c-f8a19c22b6ea None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:54.660886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12096a38-3196-44ab-ac5c-f8a19c22b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:54.691376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-12096a38-3196-44ab-ac5c-f8a19c22b6ea None None] MFA Rules not processed for user `3732e9811bcf44749081ff7049a2c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:54.696635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12096a38-3196-44ab-ac5c-f8a19c22b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:54.711756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3548/7084] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:54.732606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:54.735801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:54.876655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30773fd-e282-45b2-88b3-8389d11a57e6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:54.889316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:54.889970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:54.890413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:54.890696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:54.901469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:54.902834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:54.909297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:54.917576 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3537/7085] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:22:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:22:55.698216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493eace-d9a4-45f3-8773-838ac0ff302b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:55.698745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493eace-d9a4-45f3-8773-838ac0ff302b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:55.698745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493eace-d9a4-45f3-8773-838ac0ff302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:55.725578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:22:55.742831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e493eace-d9a4-45f3-8773-838ac0ff302b None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:55.744229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e493eace-d9a4-45f3-8773-838ac0ff302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:55.760695 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3549/7086] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:55.777822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:55.794690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859275c2-4ecd-4cbd-83e9-3158c1471f61 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:55.801343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:55.801970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:55.802256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:55.802742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:55.818630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:55.819288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:55.830285 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3538/7087] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:22:58.689012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:58.693511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:58.693511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:58.746481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:22:58.747905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:22:58.760366 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3550/7088] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:22:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:22:58.788491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:22:58.812181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac8603-a7d5-4d97-a907-5c9f1a033f4b service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:22:58.845979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9579c6-8a6f-4032-85b7-bc8553a16794 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:22:58.847896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9579c6-8a6f-4032-85b7-bc8553a16794 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:22:58.848575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9579c6-8a6f-4032-85b7-bc8553a16794 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:22:58.849088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9579c6-8a6f-4032-85b7-bc8553a16794 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:22:58.862563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9579c6-8a6f-4032-85b7-bc8553a16794 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:22:58.864823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9579c6-8a6f-4032-85b7-bc8553a16794 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:22:58.888547 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3539/7089] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:22:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:23:03.088955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:03.090904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:03.231061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290758a-aec6-4c20-a579-0a4704da1238 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:03.236690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:03.237342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:03.237648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:03.238540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] PATH_INFO: `/v3/users/fe7a44f0f8804ece9c80fe34486865a3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:03.239829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7a44f0f8804ece9c80fe34486865a3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:03.241805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:03.411784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7a44f0f8804ece9c80fe34486865a3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:03.419172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7a44f0f8804ece9c80fe34486865a3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:03.419982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7a44f0f8804ece9c80fe34486865a3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:03.433119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7a44f0f8804ece9c80fe34486865a3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:03.433931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-03bc81b6-671f-47ae-a569-e52fffbb8202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7a44f0f8804ece9c80fe34486865a3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:03.508542 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3551/7090] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:23:03 2022] DELETE /identity/v3/users/fe7a44f0f8804ece9c80fe34486865a3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:03.510075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:03.510548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:03.514415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:03.537990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:03.539353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:03.583588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:03.583890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:03.584174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:03.603860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3540/7091] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:03.613774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:03.615183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:03.625670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] MFA Rules not processed for user `0751d82710814469a1184ef84cc18d49`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:03.627843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:03.692354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd473389-f59c-449f-87ae-4d721db8fa50 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:03.703397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:03.704975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:03.705219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:03.705523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:03.718407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:03.720103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:03.739237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3541/7092] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:23:03.807439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:03.824006 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3552/7093] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:03.838698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:03.840414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:04.147703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107627-1736-4177-be43-8729710046f5 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:04.156000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483423e5-0a1a-44d1-ac85-cdf5b9f4c05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:04.156996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483423e5-0a1a-44d1-ac85-cdf5b9f4c05c service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:04.157509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483423e5-0a1a-44d1-ac85-cdf5b9f4c05c service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:04.157900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483423e5-0a1a-44d1-ac85-cdf5b9f4c05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:04.171189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483423e5-0a1a-44d1-ac85-cdf5b9f4c05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:04.173358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483423e5-0a1a-44d1-ac85-cdf5b9f4c05c service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:04.187733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3542/7094] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:23:04.207254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:04.208884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:04.245351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d655c-35df-410c-9678-f7ed934e4ff5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:04.254565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:04.255590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:04.256061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:04.256573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] PATH_INFO: `/v3/projects/c68eec8502e9451b946462adfcc17014` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:04.258478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68eec8502e9451b946462adfcc17014)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:04.260735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:04.515427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68eec8502e9451b946462adfcc17014', 'request_id': 'req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:04.527988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68eec8502e9451b946462adfcc17014', 'request_id': 'req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:04.536863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68eec8502e9451b946462adfcc17014', 'request_id': 'req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:04.629314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] The token cache is being invalidate because project c68eec8502e9451b946462adfcc17014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:23:04.630198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:04.630680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-06f09ff0-218a-4eeb-817e-bd50cd54fe9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:04.636990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3553/7095] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:23:04 2022] DELETE /identity/v3/projects/c68eec8502e9451b946462adfcc17014 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:04.639600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:04.640933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:04.641884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:04.669540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:04.701447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:04.714499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:04.843080 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3543/7096] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:04.852676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a671-98ad-4568-9e18-80429898933e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:04.853752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a671-98ad-4568-9e18-80429898933e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:04.854704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a671-98ad-4568-9e18-80429898933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:04.892306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-acb1a671-98ad-4568-9e18-80429898933e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:04.892585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-acb1a671-98ad-4568-9e18-80429898933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:04.907850 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3554/7097] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:23:04.913772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:04.934268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85f4f-4d0f-4291-a5db-a193e8f6cdea None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:04.951889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:04.952692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:04.953081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:04.953554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:04.954681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:23:04.955257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:04.958912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:04.982328 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3544/7098] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:23:04.986959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a671-98ad-4568-9e18-80429898933e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:04.998183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a671-98ad-4568-9e18-80429898933e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:05.010089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:05.010089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.010089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.010089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.010546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:05.010546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:05.114716 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3555/7099] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:23:04 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:23:05.119828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:05.143659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550faac5-ed85-4fc3-bec6-66336f95a0f1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:05.241012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:05.241912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.242400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.242836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.243689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:05.246266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:05.410722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3545/7100] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:23:05 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:23:05.415724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:05.430394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4a5e-734b-47d9-9fa3-eb62f7b15401 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:05.437384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:05.438003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.438282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.438771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.439673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:05.443885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:05.462559 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3556/7101] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:23:05.468301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:05.492921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa8daf-aa3c-4684-9b3b-d287bc3e2bea admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:05.504141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55237448-5225-4e11-a20a-222379d3386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:05.505099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237448-5225-4e11-a20a-222379d3386b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.505552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237448-5225-4e11-a20a-222379d3386b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.506092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237448-5225-4e11-a20a-222379d3386b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.507641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55237448-5225-4e11-a20a-222379d3386b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:05.510342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55237448-5225-4e11-a20a-222379d3386b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:05.531876 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3546/7102] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:23:05.537767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:05.557022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965174e-e22e-4b25-ae1b-c377ded4e6c0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:05.557022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:05.557022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.558931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.558931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] PATH_INFO: `/v3/projects/9d6767d15bea403e985c76bf6f2f0905/users/d1ac283e33a040a5ae2b6c85610c16db/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.578191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6767d15bea403e985c76bf6f2f0905, user_id=d1ac283e33a040a5ae2b6c85610c16db, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:05.582349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:05.714533 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3557/7103] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:23:05 2022] PUT /identity/v3/projects/9d6767d15bea403e985c76bf6f2f0905/users/d1ac283e33a040a5ae2b6c85610c16db/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:23:05.715039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107809-a5b0-4198-9ec3-0549b76fab51 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.715039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107809-a5b0-4198-9ec3-0549b76fab51 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.715039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107809-a5b0-4198-9ec3-0549b76fab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.735142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7a107809-a5b0-4198-9ec3-0549b76fab51 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:05.736440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7a107809-a5b0-4198-9ec3-0549b76fab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:05.815197 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3547/7104] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:23:05.825941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:05.827859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:05.917030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18ed32-e1ba-463d-b90c-5a6325b318a8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:05.923194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:05.924393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:05.924868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:05.925918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:05.952783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:05.954267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:05.982295 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3558/7105] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:23:15.806581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:15.974612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:16.234651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:16.234651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:16.235057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:16.285445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] MFA Rules not processed for user `d1ac283e33a040a5ae2b6c85610c16db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:16.287568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:16.405527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3548/7106] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:16.414748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:16.439831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b788-92ea-4757-9ab7-7e23aa8c2f2e service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:16.457995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:16.459956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:16.460611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:16.461256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:16.462408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:16.464731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:16.576331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3559/7107] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:23:16 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:23:16.580427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:16.608986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dcd2d-fed6-4363-b662-82c5280bf742 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:16.732015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:16.733046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:16.733512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:16.733973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:16.735346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:16.738874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:16.880998 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3549/7108] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:23:16 2022] POST /identity/v3/users => generated 298 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:23:16.889915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:16.918652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd19be-3b8d-4e95-a0f4-0b926e550a48 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:16.923133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:16.924303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:16.925886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:16.926390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:16.930022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:16.934187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:16.958723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:16.974326 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3560/7109] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:23:16.975164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc7c69-407c-4aa7-8e71-1e9f8b645ee3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:16.980107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:16.980813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:16.981102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:16.981384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] PATH_INFO: `/v3/projects/245c6a95d2c448e4b0df37db1a2dd2ee/users/dc31d3ef125048b2b22ff5bc4a7b170e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:17.001781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=245c6a95d2c448e4b0df37db1a2dd2ee, user_id=dc31d3ef125048b2b22ff5bc4a7b170e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:17.005304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:17.082434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:17.096429 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3550/7110] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:23:16 2022] PUT /identity/v3/projects/245c6a95d2c448e4b0df37db1a2dd2ee/users/dc31d3ef125048b2b22ff5bc4a7b170e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:17.121356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2704fac-6d1c-4b27-832b-c0a507f5f0a3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:17.234040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e301ab-294e-4dca-90a8-77bee1169c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:17.234739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e301ab-294e-4dca-90a8-77bee1169c94 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:17.234919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e301ab-294e-4dca-90a8-77bee1169c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:17.235213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e301ab-294e-4dca-90a8-77bee1169c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:17.235870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e301ab-294e-4dca-90a8-77bee1169c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:17.238214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e301ab-294e-4dca-90a8-77bee1169c94 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:17.250840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3561/7111] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:23:17.258595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:17.270862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76ca1-fe4f-4a17-a5f8-6d6611fe0aef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:17.276415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:17.277097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:17.277384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:17.277663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] PATH_INFO: `/v3/projects/245c6a95d2c448e4b0df37db1a2dd2ee/users/dc31d3ef125048b2b22ff5bc4a7b170e/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:17.279812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=245c6a95d2c448e4b0df37db1a2dd2ee, user_id=dc31d3ef125048b2b22ff5bc4a7b170e, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:17.282539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:17.302076 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3551/7112] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:23:17 2022] PUT /identity/v3/projects/245c6a95d2c448e4b0df37db1a2dd2ee/users/dc31d3ef125048b2b22ff5bc4a7b170e/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:23:19.500590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:19.501439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:19.501676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:19.559855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:19.566119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:19.569907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] MFA Rules not processed for user `3732e9811bcf44749081ff7049a2c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:19.573325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:19.671647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:19.723784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2816f-9cd6-41a3-a8a7-ef75470eba36 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:19.734764 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3562/7113] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:19.737258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:19.738381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:19.738769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:19.739187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] PATH_INFO: `/v3/users/3503433d906a4c0582f2daeac30566e3` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:19.740793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3503433d906a4c0582f2daeac30566e3)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:19.744951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:19.949342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3503433d906a4c0582f2daeac30566e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:19.968538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3503433d906a4c0582f2daeac30566e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:19.969808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3503433d906a4c0582f2daeac30566e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:19.971205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3503433d906a4c0582f2daeac30566e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:20.021679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3503433d906a4c0582f2daeac30566e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:20.084410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3552/7114] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:23:19 2022] DELETE /identity/v3/users/3503433d906a4c0582f2daeac30566e3 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:20.688511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:20.770683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56957-09e8-407c-a305-55962f7f4e7f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:20.989120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:20.989936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:20.990225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:20.990903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] PATH_INFO: `/v3/projects/1024642393fb41d8a1b832e22f602d89` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:20.991876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1024642393fb41d8a1b832e22f602d89)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:20.994280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:21.011424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:21.178041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1024642393fb41d8a1b832e22f602d89', 'request_id': 'req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:21.210015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1024642393fb41d8a1b832e22f602d89', 'request_id': 'req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:21.239235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1024642393fb41d8a1b832e22f602d89', 'request_id': 'req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:21.328313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] The token cache is being invalidate because project 1024642393fb41d8a1b832e22f602d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:23:21.334012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:21.334012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:21.334495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3563/7115] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:23:20 2022] DELETE /identity/v3/projects/1024642393fb41d8a1b832e22f602d89 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:21.336303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:21.339082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:21.401199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346aa4-d2aa-4a8f-a96f-87412c078b29 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:21.611745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:21.612416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:21.612751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:21.613220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] PATH_INFO: `/v3/users/0751d82710814469a1184ef84cc18d49` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:21.616422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0751d82710814469a1184ef84cc18d49)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:21.623763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:22.018042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0751d82710814469a1184ef84cc18d49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:22.031243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0751d82710814469a1184ef84cc18d49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:22.032472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0751d82710814469a1184ef84cc18d49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:22.033470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0751d82710814469a1184ef84cc18d49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:22.064049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:22.089037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e610cc4-c671-4aa5-91ac-7ed94c317399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0751d82710814469a1184ef84cc18d49'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:22.197096 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3553/7116] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:23:21 2022] DELETE /identity/v3/users/0751d82710814469a1184ef84cc18d49 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:22.647645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:22.649655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:22.701747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726e55-72f9-4b46-bdb3-4df0c5670ffb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:22.868075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:22.868957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:22.869077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:22.869321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] PATH_INFO: `/v3/projects/ee9006d65fd344a2bae0091569fec0ce` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:22.901847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9006d65fd344a2bae0091569fec0ce)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:22.910734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:23.135784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9006d65fd344a2bae0091569fec0ce', 'request_id': 'req-2a1daad0-b471-43c3-b028-d0946d017910'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:23.145349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9006d65fd344a2bae0091569fec0ce', 'request_id': 'req-2a1daad0-b471-43c3-b028-d0946d017910'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:23.154810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9006d65fd344a2bae0091569fec0ce', 'request_id': 'req-2a1daad0-b471-43c3-b028-d0946d017910'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:23.270122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] The token cache is being invalidate because project ee9006d65fd344a2bae0091569fec0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:23:23.288686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:23.288686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:23.288686 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3564/7117] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:23:22 2022] DELETE /identity/v3/projects/ee9006d65fd344a2bae0091569fec0ce => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:27.999045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:28.003508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:28.004001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:28.038938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] MFA Rules not processed for user `dc31d3ef125048b2b22ff5bc4a7b170e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:28.040373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:28.168849 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3554/7118] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:28.186277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:28.189562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:28.247183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:28.308278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1daad0-b471-43c3-b028-d0946d017910 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:28.312959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:28.320546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:28.320546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:28.320546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:28.320546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:28.448689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:28.450890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:28.474577 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3565/7119] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:23:33.269533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:33.271176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:33.377571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce8fec-8cea-4645-b7af-38ff5518ffc6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:33.383585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:33.384207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:33.384493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:33.384772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:33.386536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:33.402064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:33.403723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:33.417150 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3555/7120] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:23:35.562236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:35.566014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:35.674650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84087bac-7f28-4d47-ae03-a7d5423ad31e service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:35.679199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:35.679963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:35.680221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:35.680587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:35.682420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:35.753397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:35.754955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:35.765578 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3566/7121] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:23:43.229982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:43.243582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163942-dbae-441b-83d2-162bdafdb49d service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:43.248735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:43.249332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:43.249613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:43.249887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:43.251673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:43.268423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:43.270598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:43.285458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3556/7122] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:23:45.765560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:47.966169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:47.967977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:48.038217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3002-21e8-434c-a875-9dbf22a7d212 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:48.043320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:48.043998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:48.044283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:48.044608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] PATH_INFO: `/v3/users/3732e9811bcf44749081ff7049a2c0df` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:48.045757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3732e9811bcf44749081ff7049a2c0df)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:48.047734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:48.297604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3732e9811bcf44749081ff7049a2c0df'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.305337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3732e9811bcf44749081ff7049a2c0df'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.306036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3732e9811bcf44749081ff7049a2c0df'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.321768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3732e9811bcf44749081ff7049a2c0df'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.322634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f3a323ea-479d-43f5-8c4c-e16d49ca1ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3732e9811bcf44749081ff7049a2c0df'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.484537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3567/7123] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:23:47 2022] DELETE /identity/v3/users/3732e9811bcf44749081ff7049a2c0df => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:48.744607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:48.757224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8d991-46df-4a96-b822-c82a19238ccf service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:48.791729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:48.820886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:48.821530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:48.821820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:48.822100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] PATH_INFO: `/v3/projects/f18c44a020d9419886827314045b3200` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:48.823306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18c44a020d9419886827314045b3200)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:48.825340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:48.952737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18c44a020d9419886827314045b3200', 'request_id': 'req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.960816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18c44a020d9419886827314045b3200', 'request_id': 'req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:48.967695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18c44a020d9419886827314045b3200', 'request_id': 'req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:49.032464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] The token cache is being invalidate because project f18c44a020d9419886827314045b3200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:23:49.032764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:49.033651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd5d5c7-7a63-4ab4-afb3-7d7ca0b931fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:23:49.035359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3557/7124] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:23:48 2022] DELETE /identity/v3/projects/f18c44a020d9419886827314045b3200 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:49.040387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.040930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.040930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.061071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:49.062271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:49.126199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3568/7125] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:49.135857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.136150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.136430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.159130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:49.160482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:49.172132 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3558/7126] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:49.175092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.186691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5be1f-cf0d-4766-9dd3-c5076113156c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.192460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.193098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.193386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.193664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.194347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:23:49.194657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.196380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.212453 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3569/7127] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:23:49.217049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.228319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62980d75-8e25-45be-84f0-1ca240beed90 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.233057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.233701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.233983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.234256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.234890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.236843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.342426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3559/7128] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:23:49.345212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.360793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3efd5-8eeb-4f55-9192-f240aced703d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.361066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:49.421121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.421735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.422016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.422362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.422920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.424944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.562755 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3570/7129] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:23:49 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:23:49.567334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.579154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd2a05-fa57-4138-8796-858b73aaa0f2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.584031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.584632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.584913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.585185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.585817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.587500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.598937 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3560/7130] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:23:49.603662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.614583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1fe87-a49d-46df-bd02-9c4331289bf0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.619326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800af75f-3c2b-4f58-bdfd-75aa54dac37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.619923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800af75f-3c2b-4f58-bdfd-75aa54dac37a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.620205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800af75f-3c2b-4f58-bdfd-75aa54dac37a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.620482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800af75f-3c2b-4f58-bdfd-75aa54dac37a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.621120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800af75f-3c2b-4f58-bdfd-75aa54dac37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.622826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800af75f-3c2b-4f58-bdfd-75aa54dac37a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.634027 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3571/7131] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:23:49.639492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.650597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6d10-5727-4cbc-958a-427dd105cf9f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.655925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.656589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.656852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.657125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] PATH_INFO: `/v3/projects/2f6a64ebac2146b9a92c0ed0ac76a5fb/users/5458eb197e36456fb7785c8625ed3140/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.672814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6a64ebac2146b9a92c0ed0ac76a5fb, user_id=5458eb197e36456fb7785c8625ed3140, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.676157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.757785 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3561/7132] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:23:49 2022] PUT /identity/v3/projects/2f6a64ebac2146b9a92c0ed0ac76a5fb/users/5458eb197e36456fb7785c8625ed3140/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:23:49.763995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c43ca-811e-4614-8847-f6a53d4f2104 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.764551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c43ca-811e-4614-8847-f6a53d4f2104 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.764829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c43ca-811e-4614-8847-f6a53d4f2104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.786508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-af7c43ca-811e-4614-8847-f6a53d4f2104 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:49.787775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af7c43ca-811e-4614-8847-f6a53d4f2104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:49.849711 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3572/7133] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:49.865036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:49.866659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:49.938291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52cc19-23dc-4c19-818c-8212b38482b4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:49.942151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:49.943024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:49.943320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:49.943604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:49.952876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:49.954335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:49.964656 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3562/7134] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:23:57.299627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043fe4-d484-44cd-90ba-5d0eebeb4021 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:57.300131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043fe4-d484-44cd-90ba-5d0eebeb4021 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:57.300253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043fe4-d484-44cd-90ba-5d0eebeb4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:57.330911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d5043fe4-d484-44cd-90ba-5d0eebeb4021 None None] MFA Rules not processed for user `5458eb197e36456fb7785c8625ed3140`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:23:57.336603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d5043fe4-d484-44cd-90ba-5d0eebeb4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:57.409368 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3573/7135] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:23:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:23:57.427093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:23:57.429290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:23:57.435594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:23:57.527228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c9c26-bbd7-4349-9b93-a281708189f5 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:23:57.533101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:23:57.533658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:23:57.533960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:23:57.534236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:23:57.542803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:23:57.544408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:23:57.554331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3563/7136] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:23:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:24:00.148189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:00.148747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:00.148747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:00.330775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] MFA Rules not processed for user `5458eb197e36456fb7785c8625ed3140`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:00.332984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:00.340481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3574/7137] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:07.579727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:07.591965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d534d-e127-4038-a612-8e92cdf8042a service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:07.595591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:07.596174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:07.596453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:07.596724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:07.598423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:07.611206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:07.612650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:07.622627 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3564/7138] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:24:10.162706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:11.681906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:11.683370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:11.789524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baea92a-0fb8-47a1-ac6d-15836a7b5e57 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:11.795303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:11.795935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:11.796221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:11.796688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:11.798660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:11.813084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:11.814686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:11.828877 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3575/7139] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:24:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:24:11.874992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:11.877462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:11.895303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b5ea1-8dfd-4322-a301-54873ad38177 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:11.901386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:11.903309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:11.903309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:11.903309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] PATH_INFO: `/v3/users/226a6d965ff14deebdead8370fc00d3e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:11.912645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=226a6d965ff14deebdead8370fc00d3e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:11.914655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:12.241865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226a6d965ff14deebdead8370fc00d3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.251245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226a6d965ff14deebdead8370fc00d3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.252011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226a6d965ff14deebdead8370fc00d3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.252730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226a6d965ff14deebdead8370fc00d3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.266874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0c689c0f-6792-48f7-9a02-ae802596ba9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226a6d965ff14deebdead8370fc00d3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.417452 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3565/7140] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:11 2022] DELETE /identity/v3/users/226a6d965ff14deebdead8370fc00d3e => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:12.706878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:12.718387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc6271-4d61-4421-be60-8d28a42725e3 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:12.780021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:12.780673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:12.781584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:12.781873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] PATH_INFO: `/v3/projects/75b360e0ffe64c3bb5897486a18eda10` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:12.783347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b360e0ffe64c3bb5897486a18eda10)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:12.785619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:12.937385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b360e0ffe64c3bb5897486a18eda10', 'request_id': 'req-db3a3342-e903-4d7a-930e-d7ca31ab0c16'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.945454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b360e0ffe64c3bb5897486a18eda10', 'request_id': 'req-db3a3342-e903-4d7a-930e-d7ca31ab0c16'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:12.959867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b360e0ffe64c3bb5897486a18eda10', 'request_id': 'req-db3a3342-e903-4d7a-930e-d7ca31ab0c16'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:13.009250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] The token cache is being invalidate because project 75b360e0ffe64c3bb5897486a18eda10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:13.009893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:13.010879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-db3a3342-e903-4d7a-930e-d7ca31ab0c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:13.016197 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3576/7141] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:12 2022] DELETE /identity/v3/projects/75b360e0ffe64c3bb5897486a18eda10 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:13.019603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.020614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.021066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.051198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:13.053128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:13.118434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:13.150925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3566/7142] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:13.158449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.158817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.159199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.221417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:13.222776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:13.251851 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3577/7143] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:13.256240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:13.270056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfc63-c41f-4dd2-ac0e-b8928cc15a3c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:13.276755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:13.277666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.278361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.278820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.279667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:24:13.280759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:13.283099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:13.302320 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3567/7144] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:24:13.309514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:13.342309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117ac82-3754-479d-a444-0332f9f2eaa2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:13.351340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:13.352866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.354017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.354426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.355502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:13.358476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:13.378704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:13.519479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3578/7145] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:13.524099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:13.535157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b602de-5ad4-4633-9df5-5f09d45c9183 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:13.607455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:13.608085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.608371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.608647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.609496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:13.611549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:13.875555 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3568/7146] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:13 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:13.876151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:13.876151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433e7ac-8f6d-4683-b295-ad7712ad1ee1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:13.876151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:13.876151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.877474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.877474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.877474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:13.877474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:13.877474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3579/7147] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:24:13.877854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:13.877854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc3c0-0389-4762-8003-fbc8ab892586 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:13.877854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98315781-48b9-49c5-b542-48b71b71073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:13.877854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98315781-48b9-49c5-b542-48b71b71073f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.878179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98315781-48b9-49c5-b542-48b71b71073f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.878179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98315781-48b9-49c5-b542-48b71b71073f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.878179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98315781-48b9-49c5-b542-48b71b71073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:13.878179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98315781-48b9-49c5-b542-48b71b71073f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:13.878179 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3569/7148] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:24:13.879966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:13.892825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e8a6-0f1c-4d1b-bc9c-c84fb1885dc4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:13.898316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:13.898997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:13.899428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:13.899825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] PATH_INFO: `/v3/projects/5359d400fe21491392bc90f3e70658a8/users/39d68b1ba0ea403e8d9096a0115e57c5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:13.919039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5359d400fe21491392bc90f3e70658a8, user_id=39d68b1ba0ea403e8d9096a0115e57c5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:13.921824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:13.999764 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3580/7149] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:13 2022] PUT /identity/v3/projects/5359d400fe21491392bc90f3e70658a8/users/39d68b1ba0ea403e8d9096a0115e57c5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:14.010177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:14.010473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:14.010755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:14.047456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] MFA Rules not processed for user `39d68b1ba0ea403e8d9096a0115e57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:14.049426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:14.176459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3570/7150] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:14.181060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:14.283807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1285c-0259-4f64-a53c-974c56803506 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:14.291290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:14.292076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:14.292467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:14.292850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:14.293603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:14.295668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:14.468950 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3581/7151] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:14 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:14.470476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:14.482857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c849-b667-4e51-90fa-535da5d12dbe None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:14.553458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:14.583965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:14.584878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:14.585376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:14.585661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:14.586338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:14.588695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:14.717490 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3571/7152] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:14 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:14.721950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:14.736415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83c75-98ab-4bc8-b7c4-c6b0c069fd61 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:14.741564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:14.742358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:14.742694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:14.742979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:14.752914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:14.752914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:14.773118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3582/7153] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:14.777271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:14.790119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7584b-ba6e-4a54-b671-dd2a49c997a3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:14.796954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:14.798218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:14.798901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:14.799375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] PATH_INFO: `/v3/projects/dae49bb9640b452b89100e79ff4db7bf/users/94355f5969af41b786e8bcc67c176141/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:14.820039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae49bb9640b452b89100e79ff4db7bf, user_id=94355f5969af41b786e8bcc67c176141, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:14.825602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:14.940483 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3572/7154] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:14 2022] PUT /identity/v3/projects/dae49bb9640b452b89100e79ff4db7bf/users/94355f5969af41b786e8bcc67c176141/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:14.946414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:14.956989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291159b-1748-42e7-b1f2-7901196929f4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.022930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec322ac-98e6-4eff-ac27-1d20117aae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.023697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec322ac-98e6-4eff-ac27-1d20117aae41 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.024061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec322ac-98e6-4eff-ac27-1d20117aae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.024416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec322ac-98e6-4eff-ac27-1d20117aae41 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.025143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec322ac-98e6-4eff-ac27-1d20117aae41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.026819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec322ac-98e6-4eff-ac27-1d20117aae41 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.037276 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3583/7155] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:15.041519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:15.052723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341954c5-7a6a-4fb8-916a-3f7ef32dfdd5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.057569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.058227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.058510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.058805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] PATH_INFO: `/v3/projects/dae49bb9640b452b89100e79ff4db7bf/users/94355f5969af41b786e8bcc67c176141/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.061214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae49bb9640b452b89100e79ff4db7bf, user_id=94355f5969af41b786e8bcc67c176141, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.063702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.074990 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3573/7156] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:15 2022] PUT /identity/v3/projects/dae49bb9640b452b89100e79ff4db7bf/users/94355f5969af41b786e8bcc67c176141/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:15.086257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.086588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.086926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.122896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] MFA Rules not processed for user `94355f5969af41b786e8bcc67c176141`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:15.124299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:15.140840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:15.223394 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3584/7157] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:15.228852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:15.242269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656079c0-6b21-48a9-bfd1-f893e9a6d35d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.247334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.248024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.248311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.248584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.249231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.251247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.329944 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3574/7158] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:24:15 2022] POST /identity/v3/projects => generated 349 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:15.334600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:15.344818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fcfb6-c085-419e-bcba-6dbadcbd39a0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.484672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.485331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.485629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.485912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.486844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.488526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.604602 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3585/7159] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:24:15 2022] POST /identity/v3/projects => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:15.609023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:15.629167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142183-150a-4608-a5fe-ead3cdeaf9d5 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.740557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.742812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.743231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.750368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/users/39d68b1ba0ea403e8d9096a0115e57c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.750368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:get_user(user_id=39d68b1ba0ea403e8d9096a0115e57c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.750368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.750368 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3575/7160] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:24:15 2022] GET /identity/v3/users/39d68b1ba0ea403e8d9096a0115e57c5 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:15.755981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:15.772397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1481-8f63-445e-8f02-beaf2303adf8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.779865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.780740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.781217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.781690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.782583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.784692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.894718 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3586/7161] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 6 11:24:15 2022] POST /identity/v3/credentials => generated 429 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:15.896073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:15.906954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf3f0a-1a44-47cc-b48b-0a308d482246 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:15.913663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:15.914416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:15.915001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:15.917111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials/86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:15.924111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.924111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.926377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:15.928280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:15.992356 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3576/7162] 10.222.0.20 () {60 vars in 1358 bytes} [Tue Sep 6 11:24:15 2022] PATCH /identity/v3/credentials/86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52 => generated 435 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:15.997843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.011192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83e8a-8b71-451b-a462-b0e81bccbd11 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.019510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.020618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.020970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.021330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials/86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.023963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.025874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.028642 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3587/7163] 10.222.0.20 () {58 vars in 1335 bytes} [Tue Sep 6 11:24:15 2022] GET /identity/v3/credentials/86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52 => generated 435 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:16.033082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.044733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1e86c-2eaf-41b4-b5a6-6affb4c68ef9 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.050044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.050690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.050977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.051682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials/86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.053865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.055944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.238602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3577/7164] 10.222.0.20 () {58 vars in 1338 bytes} [Tue Sep 6 11:24:16 2022] DELETE /identity/v3/credentials/86c514d87349bcfed7b7c226890d949c68a172f47120c6fa4953e055592bac52 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:16.245483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.256457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f37a-5da7-4399-b7a1-aa488addac91 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.261095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.261689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.261976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.262253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.262896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.264694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.348479 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3588/7165] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 6 11:24:16 2022] POST /identity/v3/credentials => generated 430 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:16.353186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.363362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953404e-b9da-488e-8fe4-3edae1ff9dff tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.372016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.372016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.372016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.372508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.372508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.374478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.526901 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3578/7166] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 6 11:24:16 2022] POST /identity/v3/credentials => generated 430 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:16.528088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.538852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44a11d-5b87-4160-9b7d-522cfbaf6ea6 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.543536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.544137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.544423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.544709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.546457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.548062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.556108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.557776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.559333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.560949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.562780 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3589/7167] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 11:24:16 2022] GET /identity/v3/credentials => generated 945 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:24:16.567096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.577608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62f100-7d9c-4d08-b872-64aa192a1574 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.589074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.589074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.589074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.589434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials/6f91cb046ddb0f2b07c7f2877adec16c824348af74251a4f014c293e2dda1365` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.589434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=6f91cb046ddb0f2b07c7f2877adec16c824348af74251a4f014c293e2dda1365)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.589434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.649368 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3579/7168] 10.222.0.20 () {58 vars in 1338 bytes} [Tue Sep 6 11:24:16 2022] DELETE /identity/v3/credentials/6f91cb046ddb0f2b07c7f2877adec16c824348af74251a4f014c293e2dda1365 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:16.653641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.664563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73653-be2a-4716-959b-6b0d5be569f8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.670552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.671577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.671577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.671779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/credentials/184e2e0d135c5016f474186f5d61b81aec44a14068a3bb77a06913d2c1c61cf2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.673753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=184e2e0d135c5016f474186f5d61b81aec44a14068a3bb77a06913d2c1c61cf2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.675637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.804548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3590/7169] 10.222.0.20 () {58 vars in 1338 bytes} [Tue Sep 6 11:24:16 2022] DELETE /identity/v3/credentials/184e2e0d135c5016f474186f5d61b81aec44a14068a3bb77a06913d2c1c61cf2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:16.809959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:16.820709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a1405-27dd-461b-a1f1-7f1f2a8c36b8 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:16.825631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:16.826356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:16.826674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:16.826992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/projects/b985d3bae1ab4bb3955d545aa8b2bc3f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:16.828596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b985d3bae1ab4bb3955d545aa8b2bc3f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:16.831199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:16.851715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:16.952524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b985d3bae1ab4bb3955d545aa8b2bc3f', 'request_id': 'req-0b290b07-48b9-4bcc-beee-3af421ecc171'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:16.958533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b985d3bae1ab4bb3955d545aa8b2bc3f', 'request_id': 'req-0b290b07-48b9-4bcc-beee-3af421ecc171'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:16.966061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b985d3bae1ab4bb3955d545aa8b2bc3f', 'request_id': 'req-0b290b07-48b9-4bcc-beee-3af421ecc171'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.031270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] The token cache is being invalidate because project b985d3bae1ab4bb3955d545aa8b2bc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:17.031576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.032346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.034065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3580/7170] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:16 2022] DELETE /identity/v3/projects/b985d3bae1ab4bb3955d545aa8b2bc3f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:17.038718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:17.040627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:17.054792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25e054-94dc-471e-b31f-b7ea14375888 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:17.110150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:17.126454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94355f5969af41b786e8bcc67c176141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dae49bb9640b452b89100e79ff4db7bf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:17.128489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:17.128489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:17.128489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] PATH_INFO: `/v3/projects/5c2c5af27bbd4ef2accc88e5a0c89f2e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:17.128789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c2c5af27bbd4ef2accc88e5a0c89f2e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:17.130758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:17.256474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2c5af27bbd4ef2accc88e5a0c89f2e', 'request_id': 'req-3c71b214-b0b1-4fb5-806c-00fbed167072'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.264079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2c5af27bbd4ef2accc88e5a0c89f2e', 'request_id': 'req-3c71b214-b0b1-4fb5-806c-00fbed167072'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.280378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2c5af27bbd4ef2accc88e5a0c89f2e', 'request_id': 'req-3c71b214-b0b1-4fb5-806c-00fbed167072'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.363966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] The token cache is being invalidate because project 5c2c5af27bbd4ef2accc88e5a0c89f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:17.364348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.365265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3c71b214-b0b1-4fb5-806c-00fbed167072 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.366964 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3591/7171] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:17 2022] DELETE /identity/v3/projects/5c2c5af27bbd4ef2accc88e5a0c89f2e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:17.371191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:17.374119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:17.443942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b290b07-48b9-4bcc-beee-3af421ecc171 tempest-CredentialsTestJSON-104273689 tempest-CredentialsTestJSON-104273689-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:17.502060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:17.502771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:17.503083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:17.503359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] PATH_INFO: `/v3/users/39d68b1ba0ea403e8d9096a0115e57c5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:17.504500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d68b1ba0ea403e8d9096a0115e57c5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:17.507129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:17.730385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d68b1ba0ea403e8d9096a0115e57c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.739985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:17.743228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d68b1ba0ea403e8d9096a0115e57c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.743965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d68b1ba0ea403e8d9096a0115e57c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.744603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d68b1ba0ea403e8d9096a0115e57c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.763664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d68b1ba0ea403e8d9096a0115e57c5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:17.861099 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3581/7172] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:17 2022] DELETE /identity/v3/users/39d68b1ba0ea403e8d9096a0115e57c5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:17.866477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:17.866810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:17.867335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:17.887858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:17.889084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:17.956641 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3592/7173] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:17.966935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:17.972966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:18.034178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8b5d-18b5-4532-80f1-f8bb7982abdf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:18.038502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:18.039152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:18.039434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:18.039707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:18.049582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:18.051107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:18.065523 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3582/7174] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:24:18.547298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:18.548927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:18.561934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55dbb9-3968-4335-96b9-9b122029bd23 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:18.566908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:18.568177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:18.568476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:18.568737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] PATH_INFO: `/v3/projects/5359d400fe21491392bc90f3e70658a8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:18.569875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5359d400fe21491392bc90f3e70658a8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:18.571914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:18.732600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5359d400fe21491392bc90f3e70658a8', 'request_id': 'req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:18.741081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5359d400fe21491392bc90f3e70658a8', 'request_id': 'req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:18.746848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5359d400fe21491392bc90f3e70658a8', 'request_id': 'req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:18.750459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:18.946103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] The token cache is being invalidate because project 5359d400fe21491392bc90f3e70658a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:18.946320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:18.946978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-504cb22c-f8e9-472e-9a3f-f3bdc7b31c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:18.948595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3593/7175] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:18 2022] DELETE /identity/v3/projects/5359d400fe21491392bc90f3e70658a8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:18.952684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:18.964503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caeed0-72f9-4f6e-ac24-006544e5ffe1 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:19.000276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:19.000716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:19.001028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:19.022041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] MFA Rules not processed for user `4251298aaf4e4207bdcab24fbdf30728`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:19.023380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:19.033722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:19.034415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:19.034917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:19.035243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] PATH_INFO: `/v3/users/94355f5969af41b786e8bcc67c176141` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:19.040469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94355f5969af41b786e8bcc67c176141)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:19.040469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:19.080230 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3594/7176] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:24:19.329673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94355f5969af41b786e8bcc67c176141'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:19.345316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94355f5969af41b786e8bcc67c176141'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:19.346090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94355f5969af41b786e8bcc67c176141'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:19.346748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94355f5969af41b786e8bcc67c176141'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:19.367381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94355f5969af41b786e8bcc67c176141'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:19.369070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:19.408904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:19.410396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:19.456061 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3583/7177] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:18 2022] DELETE /identity/v3/users/94355f5969af41b786e8bcc67c176141 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:19.476119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff249d1-fe7a-44c5-b2ac-72dc404074ca None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:19.538640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:19.539325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:19.539613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:19.539892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:19.541778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:19.554128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:19.562762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd68a1-d6d8-47f1-b3a8-47a7bed24164 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:19.566806 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3595/7178] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:24:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:24:19.976048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:19.977682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:20.064146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918131c-842c-4939-88d1-2a7d6af7091f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:20.070760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:20.071516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:20.071810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:20.072103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] PATH_INFO: `/v3/projects/dae49bb9640b452b89100e79ff4db7bf` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:20.073370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae49bb9640b452b89100e79ff4db7bf)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:20.075617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:20.227280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae49bb9640b452b89100e79ff4db7bf', 'request_id': 'req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:20.233697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae49bb9640b452b89100e79ff4db7bf', 'request_id': 'req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:20.240373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae49bb9640b452b89100e79ff4db7bf', 'request_id': 'req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:20.393657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] The token cache is being invalidate because project dae49bb9640b452b89100e79ff4db7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:20.393970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:20.394999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a8e8a9b-9fd1-4a1d-b180-fd8488a08ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:20.397325 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3584/7179] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:19 2022] DELETE /identity/v3/projects/dae49bb9640b452b89100e79ff4db7bf => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:20.402608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:20.402898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:20.403256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:20.427302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:20.427302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:20.498446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:20.506886 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3596/7180] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:24:20.514887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:20.515256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:20.515869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:20.538222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:20.539486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:20.547884 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3585/7181] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:20.553564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:20.566094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e18ec6-decd-436e-a37b-bfd5ded86302 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:20.572112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:20.573118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:20.575266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:20.575266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:20.575266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:24:20.575854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:20.577599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:20.590973 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3597/7182] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:20.596386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:20.608849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672341aa-4c12-44aa-9712-da66f29b53c3 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:20.613750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:20.614355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:20.614648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:20.614921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:20.615586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:20.617501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:20.727043 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3586/7183] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:20 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:20.731218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:20.742676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58739c98-a439-4934-8438-25fe93f260b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:20.810630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:20.812436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:20.812436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:20.812436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:20.812820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:20.814501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:20.975821 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3598/7184] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:20 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:20.980190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:20.991642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921a93-0c95-4d95-ab9b-f9ce0fd0bf41 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.005391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.005391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.005391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.005391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.006741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.007824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.027924 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3587/7185] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:21.030175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.044914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ca44a-7c80-4113-8f09-84d3b0633909 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.050288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce731fb-8f79-4a02-88c9-659fe7688af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.050939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce731fb-8f79-4a02-88c9-659fe7688af2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.051394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce731fb-8f79-4a02-88c9-659fe7688af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.051544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce731fb-8f79-4a02-88c9-659fe7688af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.052120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce731fb-8f79-4a02-88c9-659fe7688af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.053900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce731fb-8f79-4a02-88c9-659fe7688af2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.065833 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3599/7186] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:21.070679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.081349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3c22-d39c-4ebb-984a-4b2505de25bf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.086721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.087417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.087700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.087998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] PATH_INFO: `/v3/projects/6390255af8254c1580ed4cdafd777846/users/0665678483564eeba1a6300da4a57952/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.103520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6390255af8254c1580ed4cdafd777846, user_id=0665678483564eeba1a6300da4a57952, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.106182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.180834 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3588/7187] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:21 2022] PUT /identity/v3/projects/6390255af8254c1580ed4cdafd777846/users/0665678483564eeba1a6300da4a57952/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:21.192350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.192624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.192902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.226553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] MFA Rules not processed for user `0665678483564eeba1a6300da4a57952`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:21.227908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:21.299452 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3600/7188] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:21.304451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.326344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:21.372297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e1d2-6e0e-44a0-ac8d-dc53ed21ef37 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.377408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.378028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.378314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.378623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.379592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.381806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.494633 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3589/7189] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:21 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:21.496065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.508123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14241d14-9837-49ac-9f4e-3dc281289e0a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.586750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:21.593884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.594501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.594782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.595088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.595730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.597630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.720415 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3601/7190] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:21 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:21.721658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.732515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6eea4-69a4-4773-b9de-d7181b6d4bda admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.737036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.737632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.738059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.738335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.738963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.741177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.752066 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3590/7191] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:24:21.756341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.766794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a329c2-0453-4351-8f6f-158b959f694f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.771364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.772141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.772328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.772580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] PATH_INFO: `/v3/projects/74f90b883d5a40f1b489884a427c06e5/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.786985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f90b883d5a40f1b489884a427c06e5, user_id=eed303eccc964f0f8eb8e0892ef17c34, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.790312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.868135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3602/7192] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:21 2022] PUT /identity/v3/projects/74f90b883d5a40f1b489884a427c06e5/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:21.873863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.884520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e8e4-b7ab-40b9-8329-2fef39607a8c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.945273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ca9c-1215-441e-9448-05d03c0fba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.945904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ca9c-1215-441e-9448-05d03c0fba9a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.946184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ca9c-1215-441e-9448-05d03c0fba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.946458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ca9c-1215-441e-9448-05d03c0fba9a admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.947138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ca9c-1215-441e-9448-05d03c0fba9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.954113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ca9c-1215-441e-9448-05d03c0fba9a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.959051 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3591/7193] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:21.964162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:21.976621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a3e2-dbde-4392-b41f-1a9363c87028 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:21.981451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:21.982108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:21.982389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:21.982663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] PATH_INFO: `/v3/projects/74f90b883d5a40f1b489884a427c06e5/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:21.985034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f90b883d5a40f1b489884a427c06e5, user_id=eed303eccc964f0f8eb8e0892ef17c34, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:21.988033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:21.999756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3603/7194] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:21 2022] PUT /identity/v3/projects/74f90b883d5a40f1b489884a427c06e5/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:22.009878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.010356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.010491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.039880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] MFA Rules not processed for user `eed303eccc964f0f8eb8e0892ef17c34`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:22.041258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:22.112248 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3592/7195] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:22.117110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.182857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dfd77-a8d9-4d17-af7b-a4c8acc0d181 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:22.188248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:22.188864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.190476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.190476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.190476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:22.191989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:22.306225 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3604/7196] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:22 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:22.307442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.320849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709a256-434b-429c-bb1c-7a6bba3d3266 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:22.331524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:22.380996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:22.381610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.381893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.382194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.382816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:22.384790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:22.477450 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3593/7197] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:22 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:22.481358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.491858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233532-c6ea-4f83-9bde-cf3588ecee53 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:22.496691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:22.498047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.498047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.498047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.498572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:22.500208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:22.512341 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3605/7198] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:22.517097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.528408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d4881-7dbb-4385-978e-064b144a3d71 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:22.533398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d9b05-c955-4534-9fc5-f55bf77ff877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:22.534005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9b05-c955-4534-9fc5-f55bf77ff877 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.534293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9b05-c955-4534-9fc5-f55bf77ff877 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.534568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9b05-c955-4534-9fc5-f55bf77ff877 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.535311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d9b05-c955-4534-9fc5-f55bf77ff877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:22.536915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d9b05-c955-4534-9fc5-f55bf77ff877 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:22.547431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3594/7199] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:24:22.551527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.562924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b250e-9a14-4715-958e-7d52a002308d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:22.568424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:22.569484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.569891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.570008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] PATH_INFO: `/v3/projects/94105165dddb442e8d1b34abf7386a02/users/a208297c233745d9bddcf4a62a60d37b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.586234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94105165dddb442e8d1b34abf7386a02, user_id=a208297c233745d9bddcf4a62a60d37b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:22.589310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:22.645686 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3606/7200] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:22 2022] PUT /identity/v3/projects/94105165dddb442e8d1b34abf7386a02/users/a208297c233745d9bddcf4a62a60d37b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:22.651139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.651413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.651693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.681353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] MFA Rules not processed for user `a208297c233745d9bddcf4a62a60d37b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:22.682558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:22.749194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3595/7201] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:22.754204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.817260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:22.822972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b35ea-4b00-4574-b72b-11edbc6fdca6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:22.827890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:22.828510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:22.828802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:22.829086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:22.829894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:22.831576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:22.947741 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3607/7202] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:24:22 2022] POST /identity/v3/domains => generated 276 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:22.951880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:22.963168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d68d6c-c0ee-42d3-9de5-1764d86e33af None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:23.030050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:23.031657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:23.032144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:23.032646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:23.033543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:23.035454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:23.118463 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3596/7203] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:24:22 2022] POST /identity/v3/roles => generated 238 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:23.122864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:23.134877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e8ab3-1508-4336-bb7f-0da7efb52804 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:23.140813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:23.141493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:23.141771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:23.142082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/4f87575410564b21a5165538fe76d73a/users/a208297c233745d9bddcf4a62a60d37b/roles/c080a8e62d0641138190ac056512f807` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:23.155646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4f87575410564b21a5165538fe76d73a, user_id=a208297c233745d9bddcf4a62a60d37b, role_id=c080a8e62d0641138190ac056512f807)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:23.158314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:23.238279 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3608/7204] 10.222.0.20 () {60 vars in 1480 bytes} [Tue Sep 6 11:24:23 2022] PUT /identity/v3/domains/4f87575410564b21a5165538fe76d73a/users/a208297c233745d9bddcf4a62a60d37b/roles/c080a8e62d0641138190ac056512f807 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:23.244166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:23.257670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37017db3-d99c-4d5c-9464-4a332375e300 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:23.273565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:23.322052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:23.322603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:23.322891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:23.323203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:23.323860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:23.325463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:23.541741 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3597/7205] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:24:23 2022] POST /identity/v3/domains => generated 276 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:23.542880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:23.554103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75850d58-2ad0-427c-a15a-20fa81336965 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:23.616970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:23.617780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:23.618063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:23.618350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:23.619346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:23.621080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:23.723965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3609/7206] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:24:23 2022] POST /identity/v3/roles => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:23.731090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:23.741324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1273bc-0913-4f61-8972-278120e0cd47 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:23.746602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:23.757272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:23.757704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:23.758022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:23.758702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:23.760678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:23.893750 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3598/7207] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:24:23 2022] POST /identity/v3/groups => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:23.898171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:23.909098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e9d72-a518-45b8-aae1-e47b7504d177 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:23.915949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:23.916611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:23.918743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:23.918743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups/e104c57e865949cebf3de8b8b0667d09/users/a208297c233745d9bddcf4a62a60d37b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:23.923702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e104c57e865949cebf3de8b8b0667d09, user_id=a208297c233745d9bddcf4a62a60d37b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:23.925530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:24.009411 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3610/7208] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 11:24:23 2022] PUT /identity/v3/groups/e104c57e865949cebf3de8b8b0667d09/users/a208297c233745d9bddcf4a62a60d37b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:24.013914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:24.025964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26993-35e1-42ab-a1f4-f12fd783ee06 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:24.087711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:24.088420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:24.088648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:24.088926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/150c677bd5354c4ca2880229199b9a71/groups/e104c57e865949cebf3de8b8b0667d09/roles/8ecea708885b4151aa0f389fc20f06e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:24.091178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=150c677bd5354c4ca2880229199b9a71, group_id=e104c57e865949cebf3de8b8b0667d09, role_id=8ecea708885b4151aa0f389fc20f06e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:24.093979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:24.163801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3599/7209] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:24 2022] PUT /identity/v3/domains/150c677bd5354c4ca2880229199b9a71/groups/e104c57e865949cebf3de8b8b0667d09/roles/8ecea708885b4151aa0f389fc20f06e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:24.168228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:24.180563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d4863-e469-417e-a558-1cfd11f078e3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:24.250192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:24.250822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:24.251142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:24.251426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:24.252112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:24.253714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:24.352299 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3611/7210] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:24:24 2022] POST /identity/v3/domains => generated 274 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:24.353790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:24.367714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43466ed2-080d-41b1-ad23-28fca7ae2f53 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:24.432915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:24.433541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:24.433831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:24.434108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:24.434773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:24.436430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:24.546867 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3600/7211] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:24:24 2022] POST /identity/v3/roles => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:24.551179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:24.561808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a3fc6-6bd9-4d8f-a081-131139c677aa tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:24.566350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:24.567166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:24.567454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:24.567735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/6488ebfceb824010a655b1ee125ae0fe/users/a208297c233745d9bddcf4a62a60d37b/roles/4b5030ec01b64e39ae39b2dff4e6dd95` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:24.580979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6488ebfceb824010a655b1ee125ae0fe, user_id=a208297c233745d9bddcf4a62a60d37b, role_id=4b5030ec01b64e39ae39b2dff4e6dd95)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:24.583666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:24.699208 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3612/7212] 10.222.0.20 () {60 vars in 1480 bytes} [Tue Sep 6 11:24:24 2022] PUT /identity/v3/domains/6488ebfceb824010a655b1ee125ae0fe/users/a208297c233745d9bddcf4a62a60d37b/roles/4b5030ec01b64e39ae39b2dff4e6dd95 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:24.709933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:24.722667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5f3ef-3070-4f42-842e-c65c72abe2d3 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:24.736782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:24.789679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:24.790308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:24.790703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:24.790984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:24.791688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:24.793344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:24.868021 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3601/7213] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:24:24 2022] POST /identity/v3/domains => generated 277 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:24.871940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:24.887689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d7d0-6924-41b6-8417-0a568f5e0b21 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:24.896148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:24.963711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:24.964339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:24.964714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:24.965000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:24.965690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:24.967533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:25.040395 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3613/7214] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:24:24 2022] POST /identity/v3/roles => generated 239 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:25.045136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:25.058699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f48e7-0a3e-4c7e-994c-faa41e4e11ca tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:25.064250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:25.066448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:25.066448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:25.066448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:25.066448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:25.068120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:25.158029 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3602/7215] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:24:25 2022] POST /identity/v3/groups => generated 327 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:25.163426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:25.185002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711266a-452a-4b62-9ad9-8c2ecddf2f8c tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:25.191717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:25.192625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:25.193090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:25.194343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/users/a208297c233745d9bddcf4a62a60d37b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:25.202420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5f4fdaa3383b4b389520ce14c1ef5ae0, user_id=a208297c233745d9bddcf4a62a60d37b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:25.206323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:25.352705 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3614/7216] 10.222.0.20 () {60 vars in 1360 bytes} [Tue Sep 6 11:24:25 2022] PUT /identity/v3/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/users/a208297c233745d9bddcf4a62a60d37b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:25.357381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:25.370145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f64cc5-d3b1-46fe-9a52-505ee83b4ec0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:25.444621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:25.445217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:25.445508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:25.445791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/5ec20606a1284c50a6ede815f6498515/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/roles/74c5581795994be58862c8ee6e909525` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:25.448054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5ec20606a1284c50a6ede815f6498515, group_id=5f4fdaa3383b4b389520ce14c1ef5ae0, role_id=74c5581795994be58862c8ee6e909525)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:25.450747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:25.538110 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3603/7217] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:25 2022] PUT /identity/v3/domains/5ec20606a1284c50a6ede815f6498515/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/roles/74c5581795994be58862c8ee6e909525 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:25.542365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:25.648608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6097c6-89ad-4282-a0b7-502e5062c107 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:25.710381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:25.735723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a208297c233745d9bddcf4a62a60d37b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94105165dddb442e8d1b34abf7386a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:25.736339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:25.736625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:25.736906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] PATH_INFO: `/v3/auth/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:25.737471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:25.738538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:25.809114 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3615/7218] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 11:24:25 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:25.813680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:25.880181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6652aa3-709a-4e20-858a-53aacc990b64 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:25.885401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:25.886144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:25.886676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:25.886961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/5ec20606a1284c50a6ede815f6498515/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/roles/74c5581795994be58862c8ee6e909525` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:25.889318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5ec20606a1284c50a6ede815f6498515, group_id=5f4fdaa3383b4b389520ce14c1ef5ae0, role_id=74c5581795994be58862c8ee6e909525)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:25.892345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:25.898911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 74c5581795994be58862c8ee6e909525 was removed from group 5f4fdaa3383b4b389520ce14c1ef5ae0 on domain 5ec20606a1284c50a6ede815f6498515. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:25.899239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:25.899919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:25.976493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3604/7219] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:24:25 2022] DELETE /identity/v3/domains/5ec20606a1284c50a6ede815f6498515/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/roles/74c5581795994be58862c8ee6e909525 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:25.979421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:25.981238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:25.996416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f465d46-6b99-4645-99ae-085dc11726f2 tempest-TokensV3TestJSON-742082201 tempest-TokensV3TestJSON-742082201-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:26.055321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:26.055984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:26.056276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:26.056561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/users/a208297c233745d9bddcf4a62a60d37b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:26.058242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=5f4fdaa3383b4b389520ce14c1ef5ae0, user_id=a208297c233745d9bddcf4a62a60d37b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:26.061100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:26.162071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.306225 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3616/7220] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 11:24:25 2022] DELETE /identity/v3/groups/5f4fdaa3383b4b389520ce14c1ef5ae0/users/a208297c233745d9bddcf4a62a60d37b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:26.310643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:26.321498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5c3b0-a14b-4dff-a791-66ceed32b80a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:26.329489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:26.379236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:26.379928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:26.380213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:26.380490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups/5f4fdaa3383b4b389520ce14c1ef5ae0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:26.382191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5f4fdaa3383b4b389520ce14c1ef5ae0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:26.384296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:26.506481 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3605/7221] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:24:26 2022] DELETE /identity/v3/groups/5f4fdaa3383b4b389520ce14c1ef5ae0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:26.510638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:26.521343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3deef8-45f0-401d-86a8-2fb99333b189 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:26.596513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:26.597176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:26.597468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:26.597752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles/74c5581795994be58862c8ee6e909525` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:26.599208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_role(role_id=74c5581795994be58862c8ee6e909525)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:26.601045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:26.602984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:26.746758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 74c5581795994be58862c8ee6e909525 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:26.746758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.748103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.750253 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3617/7222] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:26 2022] DELETE /identity/v3/roles/74c5581795994be58862c8ee6e909525 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:26.754324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:26.756850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:26.769666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0cb58-16ec-4309-adf2-fe86e0ebecf7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:26.829316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:26.836078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:26.836078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:26.836078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/5ec20606a1284c50a6ede815f6498515` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:26.836078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5ec20606a1284c50a6ede815f6498515)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:26.836078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:26.855269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5ec20606a1284c50a6ede815f6498515'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.856016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5ec20606a1284c50a6ede815f6498515'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.949857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5ec20606a1284c50a6ede815f6498515'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.950488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5ec20606a1284c50a6ede815f6498515'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:26.952928 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3606/7223] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:26 2022] PATCH /identity/v3/domains/5ec20606a1284c50a6ede815f6498515 => generated 278 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:26.957048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:26.967485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a936f7-4c4b-4a21-971f-49d96f62e3a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:27.024147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:27.024850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:27.025134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:27.025414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/5ec20606a1284c50a6ede815f6498515` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:27.036328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5ec20606a1284c50a6ede815f6498515)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:27.038459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:27.062782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5ec20606a1284c50a6ede815f6498515'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.073286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5ec20606a1284c50a6ede815f6498515'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.176524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec20606a1284c50a6ede815f6498515', 'request_id': 'req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.186003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec20606a1284c50a6ede815f6498515', 'request_id': 'req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.191649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec20606a1284c50a6ede815f6498515', 'request_id': 'req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.265011 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] The token cache is being invalidate because project 5ec20606a1284c50a6ede815f6498515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:27.265307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.266224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.274064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5ec20606a1284c50a6ede815f6498515', 'request_id': 'req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.274927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5ec20606a1284c50a6ede815f6498515', 'request_id': 'req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.278279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5ec20606a1284c50a6ede815f6498515', 'request_id': 'req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.284029 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3618/7224] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:24:26 2022] DELETE /identity/v3/domains/5ec20606a1284c50a6ede815f6498515 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:27.289277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:27.290712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:27.304380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76b679-30c6-4c39-a285-f142dd5d9f24 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:27.338402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:27.364020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:27.364737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:27.365029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:27.365320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/6488ebfceb824010a655b1ee125ae0fe/users/a208297c233745d9bddcf4a62a60d37b/roles/4b5030ec01b64e39ae39b2dff4e6dd95` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:27.367874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6488ebfceb824010a655b1ee125ae0fe, user_id=a208297c233745d9bddcf4a62a60d37b, role_id=4b5030ec01b64e39ae39b2dff4e6dd95)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:27.371569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:27.377981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 4b5030ec01b64e39ae39b2dff4e6dd95 was removed from user a208297c233745d9bddcf4a62a60d37b on domain 6488ebfceb824010a655b1ee125ae0fe. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:27.378369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.379164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.637237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3607/7225] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 6 11:24:27 2022] DELETE /identity/v3/domains/6488ebfceb824010a655b1ee125ae0fe/users/a208297c233745d9bddcf4a62a60d37b/roles/4b5030ec01b64e39ae39b2dff4e6dd95 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:27.641900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:27.643624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:27.652067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:27.657801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f4f4-5e3e-4316-bd0e-be7f9c37eacf tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:27.725522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:27.726384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:27.726546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:27.726820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles/4b5030ec01b64e39ae39b2dff4e6dd95` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:27.728282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4b5030ec01b64e39ae39b2dff4e6dd95)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:27.729901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:27.836976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 4b5030ec01b64e39ae39b2dff4e6dd95 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:27.837640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.837952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.839816 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3619/7226] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:27 2022] DELETE /identity/v3/roles/4b5030ec01b64e39ae39b2dff4e6dd95 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:27.844493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:27.846495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:27.859728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1299a8-c354-4d02-9f93-e81579b8ffe5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:27.922739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:27.923421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:27.923708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:27.923989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/6488ebfceb824010a655b1ee125ae0fe` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:27.925299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6488ebfceb824010a655b1ee125ae0fe)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:27.926909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:27.949389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:27.951333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.035447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.036056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.038426 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3608/7227] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:27 2022] PATCH /identity/v3/domains/6488ebfceb824010a655b1ee125ae0fe => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:28.042605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:28.044118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:28.057478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264364c3-6b6e-4b51-8e36-c16933b33a02 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:28.132279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:28.132546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:28.132839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:28.133126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/6488ebfceb824010a655b1ee125ae0fe` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:28.145152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6488ebfceb824010a655b1ee125ae0fe)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:28.146837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:28.176108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.189784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.275522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:28.288758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe', 'request_id': 'req-99409c72-8fc0-4807-a01c-650a7e5b18c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.297013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe', 'request_id': 'req-99409c72-8fc0-4807-a01c-650a7e5b18c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.302578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe', 'request_id': 'req-99409c72-8fc0-4807-a01c-650a7e5b18c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.368034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] The token cache is being invalidate because project 6488ebfceb824010a655b1ee125ae0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:28.368246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.368891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.377382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe', 'request_id': 'req-99409c72-8fc0-4807-a01c-650a7e5b18c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.378424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe', 'request_id': 'req-99409c72-8fc0-4807-a01c-650a7e5b18c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.383228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6488ebfceb824010a655b1ee125ae0fe', 'request_id': 'req-99409c72-8fc0-4807-a01c-650a7e5b18c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.389414 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3620/7228] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:24:28 2022] DELETE /identity/v3/domains/6488ebfceb824010a655b1ee125ae0fe => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:28.393920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:28.395443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:28.408011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6ee0-ac22-40ec-9f44-48764dd42931 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:28.472448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:28.472989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:28.473387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:28.473712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/150c677bd5354c4ca2880229199b9a71/groups/e104c57e865949cebf3de8b8b0667d09/roles/8ecea708885b4151aa0f389fc20f06e1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:28.476787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=150c677bd5354c4ca2880229199b9a71, group_id=e104c57e865949cebf3de8b8b0667d09, role_id=8ecea708885b4151aa0f389fc20f06e1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:28.479767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:28.496520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 8ecea708885b4151aa0f389fc20f06e1 was removed from group e104c57e865949cebf3de8b8b0667d09 on domain 150c677bd5354c4ca2880229199b9a71. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:28.496520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.496520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.588181 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3609/7229] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:24:28 2022] DELETE /identity/v3/domains/150c677bd5354c4ca2880229199b9a71/groups/e104c57e865949cebf3de8b8b0667d09/roles/8ecea708885b4151aa0f389fc20f06e1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:28.592305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:28.594148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:28.610598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409c72-8fc0-4807-a01c-650a7e5b18c7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:28.674520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:28.675372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:28.675723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:28.675947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups/e104c57e865949cebf3de8b8b0667d09/users/a208297c233745d9bddcf4a62a60d37b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:28.677622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=e104c57e865949cebf3de8b8b0667d09, user_id=a208297c233745d9bddcf4a62a60d37b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:28.680188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:28.756138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:28.862303 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3621/7230] 10.222.0.20 () {58 vars in 1344 bytes} [Tue Sep 6 11:24:28 2022] DELETE /identity/v3/groups/e104c57e865949cebf3de8b8b0667d09/users/a208297c233745d9bddcf4a62a60d37b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:28.867302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:28.868831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:28.883672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc3ec-01cc-4055-bcd8-4e44f75a86c4 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:28.905847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:28.949080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:28.949805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:28.950558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:28.950961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/groups/e104c57e865949cebf3de8b8b0667d09` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:28.952763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e104c57e865949cebf3de8b8b0667d09)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:28.954845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:29.089722 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3610/7231] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:24:28 2022] DELETE /identity/v3/groups/e104c57e865949cebf3de8b8b0667d09 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:29.093835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:29.105097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ab61-0fde-490c-b792-fa215d70c5a7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:29.165309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:29.165947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:29.166275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:29.166553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles/8ecea708885b4151aa0f389fc20f06e1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:29.168002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ecea708885b4151aa0f389fc20f06e1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:29.170231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:29.200598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:29.259983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 8ecea708885b4151aa0f389fc20f06e1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:29.260279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.260950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.262907 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3622/7232] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:29 2022] DELETE /identity/v3/roles/8ecea708885b4151aa0f389fc20f06e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:29.267341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:29.269100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:29.282747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa4ed-b073-4a46-ac8d-6561d47ecafe tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:29.340101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:29.341027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:29.342311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:29.342931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/150c677bd5354c4ca2880229199b9a71` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:29.344351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=150c677bd5354c4ca2880229199b9a71)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:29.345970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:29.373017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '150c677bd5354c4ca2880229199b9a71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.378176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '150c677bd5354c4ca2880229199b9a71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.448379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '150c677bd5354c4ca2880229199b9a71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.449023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '150c677bd5354c4ca2880229199b9a71'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.454566 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3611/7233] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:29 2022] PATCH /identity/v3/domains/150c677bd5354c4ca2880229199b9a71 => generated 277 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:29.455937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:29.467227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa29e-21c9-4bd5-971c-4be9ecb619c2 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:29.530482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:29.531173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:29.531467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:29.531746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/150c677bd5354c4ca2880229199b9a71` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:29.543228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=150c677bd5354c4ca2880229199b9a71)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:29.545339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:29.568851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '150c677bd5354c4ca2880229199b9a71'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.579560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '150c677bd5354c4ca2880229199b9a71'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.708878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150c677bd5354c4ca2880229199b9a71', 'request_id': 'req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.715668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150c677bd5354c4ca2880229199b9a71', 'request_id': 'req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.721877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150c677bd5354c4ca2880229199b9a71', 'request_id': 'req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.788458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] The token cache is being invalidate because project 150c677bd5354c4ca2880229199b9a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:29.788976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.789679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.801171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '150c677bd5354c4ca2880229199b9a71', 'request_id': 'req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.802336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '150c677bd5354c4ca2880229199b9a71', 'request_id': 'req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.807253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '150c677bd5354c4ca2880229199b9a71', 'request_id': 'req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.813658 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3623/7234] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:24:29 2022] DELETE /identity/v3/domains/150c677bd5354c4ca2880229199b9a71 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:29.817702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:29.819868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:29.833254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be77ea-b85a-4116-a31a-64e267aaf1a5 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:29.879317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:29.898071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:29.898857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:29.899228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:29.899517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/4f87575410564b21a5165538fe76d73a/users/a208297c233745d9bddcf4a62a60d37b/roles/c080a8e62d0641138190ac056512f807` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:29.901713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4f87575410564b21a5165538fe76d73a, user_id=a208297c233745d9bddcf4a62a60d37b, role_id=c080a8e62d0641138190ac056512f807)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:29.907113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:29.913516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role c080a8e62d0641138190ac056512f807 was removed from user a208297c233745d9bddcf4a62a60d37b on domain 4f87575410564b21a5165538fe76d73a. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:29.913516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.913516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:29.976283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3612/7235] 10.222.0.20 () {58 vars in 1464 bytes} [Tue Sep 6 11:24:29 2022] DELETE /identity/v3/domains/4f87575410564b21a5165538fe76d73a/users/a208297c233745d9bddcf4a62a60d37b/roles/c080a8e62d0641138190ac056512f807 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:29.981292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:29.982758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:29.997943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6253-71c8-4e8f-8b22-a3d42c66ed6d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:30.029859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:30.073579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:30.074217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:30.074504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:30.074783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles/c080a8e62d0641138190ac056512f807` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:30.076229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c080a8e62d0641138190ac056512f807)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:30.077835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:30.162298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role c080a8e62d0641138190ac056512f807 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:30.162597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.163917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.165843 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3624/7236] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:29 2022] DELETE /identity/v3/roles/c080a8e62d0641138190ac056512f807 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:30.170059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:30.171581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:30.186131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd6883-16f6-4bd0-b0de-0f757f24d181 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:30.249220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:30.250107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:30.250482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:30.250771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/4f87575410564b21a5165538fe76d73a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:30.252371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4f87575410564b21a5165538fe76d73a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:30.254208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:30.283798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4f87575410564b21a5165538fe76d73a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.284538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4f87575410564b21a5165538fe76d73a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.385814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4f87575410564b21a5165538fe76d73a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.390016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4f87575410564b21a5165538fe76d73a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.390016 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3613/7237] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:30 2022] PATCH /identity/v3/domains/4f87575410564b21a5165538fe76d73a => generated 277 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:30.394850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:30.396913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:30.414820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104fdc1-6249-4439-8cf6-d9b93a75a81b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:30.482014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:30.482700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:30.482994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:30.483314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/4f87575410564b21a5165538fe76d73a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:30.495780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4f87575410564b21a5165538fe76d73a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:30.497925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:30.528914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4f87575410564b21a5165538fe76d73a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.543686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4f87575410564b21a5165538fe76d73a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.671807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f87575410564b21a5165538fe76d73a', 'request_id': 'req-d30fbba4-abcb-446b-86d2-e29c11c50f56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.679712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f87575410564b21a5165538fe76d73a', 'request_id': 'req-d30fbba4-abcb-446b-86d2-e29c11c50f56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.685447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f87575410564b21a5165538fe76d73a', 'request_id': 'req-d30fbba4-abcb-446b-86d2-e29c11c50f56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.689017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:30.757513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] The token cache is being invalidate because project 4f87575410564b21a5165538fe76d73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:30.757727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.758359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.768120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4f87575410564b21a5165538fe76d73a', 'request_id': 'req-d30fbba4-abcb-446b-86d2-e29c11c50f56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.768899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4f87575410564b21a5165538fe76d73a', 'request_id': 'req-d30fbba4-abcb-446b-86d2-e29c11c50f56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.773167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4f87575410564b21a5165538fe76d73a', 'request_id': 'req-d30fbba4-abcb-446b-86d2-e29c11c50f56'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:30.779128 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3625/7238] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:24:30 2022] DELETE /identity/v3/domains/4f87575410564b21a5165538fe76d73a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:30.785192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:30.787194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:30.800117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a353d8a-7216-4cc3-9422-e493abdd65f0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:30.858506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:30.859159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:30.859451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:30.859734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:30.860371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:30.862050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:30.873121 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3614/7239] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:30.876902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:30.880617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:30.892967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fbba4-abcb-446b-86d2-e29c11c50f56 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:30.898620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:30.899323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:30.899611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:30.899896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/6390255af8254c1580ed4cdafd777846/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:30.901875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6390255af8254c1580ed4cdafd777846, user_id=eed303eccc964f0f8eb8e0892ef17c34, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:30.905241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.008758 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3626/7240] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:30 2022] PUT /identity/v3/projects/6390255af8254c1580ed4cdafd777846/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:31.013139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:31.025250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c2aa9-f93e-4f6d-9d2c-06a4ae1f0b2d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:31.060442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:31.086735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:31.087378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:31.087662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:31.087938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:31.088500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:31.089568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.142416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3615/7241] 10.222.0.20 () {58 vars in 1146 bytes} [Tue Sep 6 11:24:31 2022] GET /identity/v3/auth/projects => generated 824 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:31.147697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:31.163551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44ab99-88a1-452e-8728-627d76e060ba tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:31.167973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:31.168635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:31.168923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:31.169204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/6390255af8254c1580ed4cdafd777846/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:31.172270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6390255af8254c1580ed4cdafd777846, user_id=eed303eccc964f0f8eb8e0892ef17c34, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:31.175034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.183265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role 46571a7e08c246cc9af7ce6c064eecdb was removed from user eed303eccc964f0f8eb8e0892ef17c34 on project 6390255af8254c1580ed4cdafd777846. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:31.186668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:31.186668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:31.277012 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3627/7242] 10.222.0.20 () {58 vars in 1467 bytes} [Tue Sep 6 11:24:31 2022] DELETE /identity/v3/projects/6390255af8254c1580ed4cdafd777846/users/eed303eccc964f0f8eb8e0892ef17c34/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:31.282662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:31.284645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:31.297596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2fe68-5f80-48fd-ba85-f1029fabdaa0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:31.366877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:31.367520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:31.367806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:31.368080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:31.368714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:31.370753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.478416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3616/7243] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:31 2022] POST /identity/v3/users => generated 321 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:31.482889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:31.498825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420009-918d-4410-a705-29d07aaa0d41 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:31.504818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:31.505458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:31.505747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:31.506032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:31.506837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:31.508819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.584765 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3628/7244] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:31 2022] POST /identity/v3/projects => generated 362 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:31.590254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:31.602597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b802e0-d4f6-4c8d-96c7-f7f2e0f46a8d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:31.676727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:31.678280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:31.679453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:31.679817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:31.680537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:31.682880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.823592 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3617/7245] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:31 2022] POST /identity/v3/projects => generated 363 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:31.824863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:31.840378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c725-cdaa-4f06-bc15-c00d46bf8ba0 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:31.912387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:31.913768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:31.914058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:31.914332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:31.915245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:31.916902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:31.997522 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3629/7246] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Sep 6 11:24:31 2022] POST /identity/v3/roles => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:32.002733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:32.013805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e70ee1-5bf8-4582-a7d1-0d24f00e142b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:32.019188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe144126-36a7-4aec-a0c5-e6190b5e141b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:32.019878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144126-36a7-4aec-a0c5-e6190b5e141b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.020166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144126-36a7-4aec-a0c5-e6190b5e141b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.020449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144126-36a7-4aec-a0c5-e6190b5e141b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/48a1c1afb2d64c9ca795fcebf9c55915/users/1f08dc3dc0ea4de09dfa00aa7703ce27/roles/fb5257a6b90a4834a11ad189a82e5471` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.029814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:32.037682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe144126-36a7-4aec-a0c5-e6190b5e141b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(project_id=48a1c1afb2d64c9ca795fcebf9c55915, user_id=1f08dc3dc0ea4de09dfa00aa7703ce27, role_id=fb5257a6b90a4834a11ad189a82e5471)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:32.041031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe144126-36a7-4aec-a0c5-e6190b5e141b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:32.169394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3618/7247] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:32 2022] PUT /identity/v3/projects/48a1c1afb2d64c9ca795fcebf9c55915/users/1f08dc3dc0ea4de09dfa00aa7703ce27/roles/fb5257a6b90a4834a11ad189a82e5471 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:32.174301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:32.185059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248738c5-ff52-4a7f-9316-73f06dcc955f tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:32.253346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73623450-b24b-400e-8105-1a7c74087b37 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:32.254168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623450-b24b-400e-8105-1a7c74087b37 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.254463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623450-b24b-400e-8105-1a7c74087b37 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.254745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623450-b24b-400e-8105-1a7c74087b37 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/d804f930275e406d8b6efe8f61129e52/users/1f08dc3dc0ea4de09dfa00aa7703ce27/roles/fb5257a6b90a4834a11ad189a82e5471` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.257841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623450-b24b-400e-8105-1a7c74087b37 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d804f930275e406d8b6efe8f61129e52, user_id=1f08dc3dc0ea4de09dfa00aa7703ce27, role_id=fb5257a6b90a4834a11ad189a82e5471)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:32.260609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623450-b24b-400e-8105-1a7c74087b37 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:32.380529 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3630/7248] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:32 2022] PUT /identity/v3/projects/d804f930275e406d8b6efe8f61129e52/users/1f08dc3dc0ea4de09dfa00aa7703ce27/roles/fb5257a6b90a4834a11ad189a82e5471 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:32.385392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.385690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.386064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.415774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] MFA Rules not processed for user `1f08dc3dc0ea4de09dfa00aa7703ce27`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:32.416944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:32.420756 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3619/7249] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:32 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:32.425290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e27f74-951f-4cf0-80ed-24a871d660df None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.425611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e27f74-951f-4cf0-80ed-24a871d660df None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.425891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e27f74-951f-4cf0-80ed-24a871d660df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.437639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e4e27f74-951f-4cf0-80ed-24a871d660df None None] MFA Rules not processed for user `1f08dc3dc0ea4de09dfa00aa7703ce27`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:32.438831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e4e27f74-951f-4cf0-80ed-24a871d660df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:32.455531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:32.544054 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3631/7250] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Sep 06 11:24:32.548177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:32.631522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3af8d-8efc-4899-b16a-9c849e6258e4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:32.637753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:32.638403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.638691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.638974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.648680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:32.650705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:32.827734 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3620/7251] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Sep 6 11:24:32 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:32.832273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.832565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.832843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.845063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] MFA Rules not processed for user `1f08dc3dc0ea4de09dfa00aa7703ce27`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:32.846417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:32.939072 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3632/7252] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Sep 06 11:24:32.943162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:32.953440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715afc4-78e7-4919-bfe1-88bfd3ce4bbb tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:32.958971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:32.959642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:32.959932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:32.960214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/roles/fb5257a6b90a4834a11ad189a82e5471` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:32.961601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fb5257a6b90a4834a11ad189a82e5471)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:32.963370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:33.145687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invalidating the token cache because role fb5257a6b90a4834a11ad189a82e5471 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:33.146187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.146967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.149816 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3621/7253] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:32 2022] DELETE /identity/v3/roles/fb5257a6b90a4834a11ad189a82e5471 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:33.154427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:33.166466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813c05-f76e-40fe-8e82-1e15c4e4ce90 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:33.236823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:33.237516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:33.237800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:33.238083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/d804f930275e406d8b6efe8f61129e52` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:33.239272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d804f930275e406d8b6efe8f61129e52)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:33.241348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:33.426889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd804f930275e406d8b6efe8f61129e52', 'request_id': 'req-1ebadbdc-a567-4418-a5ad-c97f98a267f7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.434631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd804f930275e406d8b6efe8f61129e52', 'request_id': 'req-1ebadbdc-a567-4418-a5ad-c97f98a267f7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.439566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:33.446469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd804f930275e406d8b6efe8f61129e52', 'request_id': 'req-1ebadbdc-a567-4418-a5ad-c97f98a267f7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.557804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] The token cache is being invalidate because project d804f930275e406d8b6efe8f61129e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:33.558110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.558801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.561460 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3633/7254] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:33 2022] DELETE /identity/v3/projects/d804f930275e406d8b6efe8f61129e52 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:33.564998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:33.566663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:33.581439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf87414-93b7-40f3-bf31-328250fe163a tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:33.645711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:33.650246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:33.650246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:33.650246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/d804f930275e406d8b6efe8f61129e52` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:33.656253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d804f930275e406d8b6efe8f61129e52)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:33.658180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Could not find project: d804f930275e406d8b6efe8f61129e52.: keystone.exception.ProjectNotFound: Could not find project: d804f930275e406d8b6efe8f61129e52. Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Sep 06 11:24:33.669947 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d804f930275e406d8b6efe8f61129e52. Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:33.674473 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3622/7255] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:33 2022] DELETE /identity/v3/projects/d804f930275e406d8b6efe8f61129e52 => generated 113 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 06 11:24:33.675591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:33.677034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:33.690882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadbdc-a567-4418-a5ad-c97f98a267f7 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:33.695723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:33.696398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:33.698946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:33.698946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/projects/48a1c1afb2d64c9ca795fcebf9c55915` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:33.698946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48a1c1afb2d64c9ca795fcebf9c55915)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:33.700040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:33.821573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a1c1afb2d64c9ca795fcebf9c55915', 'request_id': 'req-a55d8600-c65f-4f38-8dd0-5baf4208119d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.827789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a1c1afb2d64c9ca795fcebf9c55915', 'request_id': 'req-a55d8600-c65f-4f38-8dd0-5baf4208119d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.840514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a1c1afb2d64c9ca795fcebf9c55915', 'request_id': 'req-a55d8600-c65f-4f38-8dd0-5baf4208119d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.990488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] The token cache is being invalidate because project 48a1c1afb2d64c9ca795fcebf9c55915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:33.990810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.992041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:33.993539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3634/7256] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:33 2022] DELETE /identity/v3/projects/48a1c1afb2d64c9ca795fcebf9c55915 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:33.997869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:33.999628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:34.012489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93a15-187d-478f-99b6-63e94edf20a8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:34.021617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:34.068966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:34.069633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:34.069924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:34.070204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/users/1f08dc3dc0ea4de09dfa00aa7703ce27` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:34.071375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1f08dc3dc0ea4de09dfa00aa7703ce27)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:34.073317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:34.259577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f08dc3dc0ea4de09dfa00aa7703ce27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.273357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f08dc3dc0ea4de09dfa00aa7703ce27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.274287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f08dc3dc0ea4de09dfa00aa7703ce27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.275067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f08dc3dc0ea4de09dfa00aa7703ce27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.292693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f08dc3dc0ea4de09dfa00aa7703ce27'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.416153 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3623/7257] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:33 2022] DELETE /identity/v3/users/1f08dc3dc0ea4de09dfa00aa7703ce27 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:34.421344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:34.431915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8600-c65f-4f38-8dd0-5baf4208119d tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:34.496630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:34.497277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:34.497565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:34.497848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/5ec20606a1284c50a6ede815f6498515` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:34.505567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Could not find domain: 5ec20606a1284c50a6ede815f6498515.: keystone.exception.DomainNotFound: Could not find domain: 5ec20606a1284c50a6ede815f6498515. Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5ec20606a1284c50a6ede815f6498515. Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:34.515098 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:34.516792 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5ec20606a1284c50a6ede815f6498515. Sep 06 11:24:34.518043 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:34.519614 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3635/7258] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:34 2022] PATCH /identity/v3/domains/5ec20606a1284c50a6ede815f6498515 => generated 112 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:24:34.519712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:34.519712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:34.532754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedfc95-fc7e-4a1b-80cb-da31c7b3c7ea tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:34.538269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:34.539446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:34.539737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:34.540098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/6488ebfceb824010a655b1ee125ae0fe` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:34.553691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Could not find domain: 6488ebfceb824010a655b1ee125ae0fe.: keystone.exception.DomainNotFound: Could not find domain: 6488ebfceb824010a655b1ee125ae0fe. Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6488ebfceb824010a655b1ee125ae0fe. Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:34.558810 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:34.568433 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6488ebfceb824010a655b1ee125ae0fe. Sep 06 11:24:34.570202 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:34.571493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3624/7259] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:34 2022] PATCH /identity/v3/domains/6488ebfceb824010a655b1ee125ae0fe => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:24:34.571637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:34.582025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3e552-68cf-4900-b6b4-748431e7e52e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:34.587337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:34.587965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:34.588259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:34.588544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/150c677bd5354c4ca2880229199b9a71` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:34.595942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Could not find domain: 150c677bd5354c4ca2880229199b9a71.: keystone.exception.DomainNotFound: Could not find domain: 150c677bd5354c4ca2880229199b9a71. Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 150c677bd5354c4ca2880229199b9a71. Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:34.600939 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:34.602338 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 150c677bd5354c4ca2880229199b9a71. Sep 06 11:24:34.603652 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:34.605286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3636/7260] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:34 2022] PATCH /identity/v3/domains/150c677bd5354c4ca2880229199b9a71 => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:24:34.606144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:34.617578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02445-68f1-486d-8d79-c536a4fac8e8 tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:34.624991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912242c-a59c-44ab-bb61-cda1a4d4901b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed303eccc964f0f8eb8e0892ef17c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74f90b883d5a40f1b489884a427c06e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:34.625656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912242c-a59c-44ab-bb61-cda1a4d4901b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:34.625945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912242c-a59c-44ab-bb61-cda1a4d4901b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:34.626220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912242c-a59c-44ab-bb61-cda1a4d4901b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] PATH_INFO: `/v3/domains/4f87575410564b21a5165538fe76d73a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:34.640229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912242c-a59c-44ab-bb61-cda1a4d4901b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-f912242c-a59c-44ab-bb61-cda1a4d4901b tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Could not find domain: 4f87575410564b21a5165538fe76d73a.: keystone.exception.DomainNotFound: Could not find domain: 4f87575410564b21a5165538fe76d73a. Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4f87575410564b21a5165538fe76d73a. Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:34.640428 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:34.641936 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4f87575410564b21a5165538fe76d73a. Sep 06 11:24:34.643450 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:34.644799 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3625/7261] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:24:34 2022] PATCH /identity/v3/domains/4f87575410564b21a5165538fe76d73a => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:24:34.645974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:34.648387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:34.720491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839df5c-15a8-454d-ac3b-07fa3f527f0e tempest-TokensV3TestJSON-670175979 tempest-TokensV3TestJSON-670175979-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:34.725345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:34.725987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:34.726304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:34.726585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] PATH_INFO: `/v3/users/0665678483564eeba1a6300da4a57952` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:34.727979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0665678483564eeba1a6300da4a57952)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:34.730068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:34.731869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:34.920616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0665678483564eeba1a6300da4a57952'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.931803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0665678483564eeba1a6300da4a57952'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.932618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0665678483564eeba1a6300da4a57952'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.947493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0665678483564eeba1a6300da4a57952'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:34.948244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0665678483564eeba1a6300da4a57952'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:35.015117 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3637/7262] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:34 2022] DELETE /identity/v3/users/0665678483564eeba1a6300da4a57952 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:35.019862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:35.020391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:35.020391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:35.039571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:35.040839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:35.102524 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3626/7263] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:35.112499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:35.113957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:35.177227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d595e-166b-4b2b-bdb5-aee5343402a7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:35.181512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:35.182133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:35.182415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:35.182710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:35.191977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:35.193412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:35.203023 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3638/7264] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:24:35.663520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:35.664227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:35.679168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c90d0f-1ed7-4970-9d62-4d05c444de0c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:35.684719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:35.685326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:35.685660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:35.685940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] PATH_INFO: `/v3/projects/6390255af8254c1580ed4cdafd777846` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:35.687265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6390255af8254c1580ed4cdafd777846)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:35.689339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:35.701943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:35.800779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6390255af8254c1580ed4cdafd777846', 'request_id': 'req-1de21726-edd7-47c6-b7b1-eb694ae48fec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:35.807152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6390255af8254c1580ed4cdafd777846', 'request_id': 'req-1de21726-edd7-47c6-b7b1-eb694ae48fec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:35.818284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6390255af8254c1580ed4cdafd777846', 'request_id': 'req-1de21726-edd7-47c6-b7b1-eb694ae48fec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:35.951307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] The token cache is being invalidate because project 6390255af8254c1580ed4cdafd777846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:35.951545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:35.952184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:35.953957 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3627/7265] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:35 2022] DELETE /identity/v3/projects/6390255af8254c1580ed4cdafd777846 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:35.958185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:35.968596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f4eb-0fbe-40e2-ae4d-95263aae0431 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:36.029873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:36.030518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:36.030803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:36.031485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] PATH_INFO: `/v3/users/eed303eccc964f0f8eb8e0892ef17c34` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:36.032292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed303eccc964f0f8eb8e0892ef17c34)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:36.034386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:36.059367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:36.269059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed303eccc964f0f8eb8e0892ef17c34'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:36.276259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed303eccc964f0f8eb8e0892ef17c34'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:36.276990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed303eccc964f0f8eb8e0892ef17c34'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:36.293482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed303eccc964f0f8eb8e0892ef17c34'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:36.294413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed303eccc964f0f8eb8e0892ef17c34'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:36.466463 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3639/7266] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:35 2022] DELETE /identity/v3/users/eed303eccc964f0f8eb8e0892ef17c34 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:36.981537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:36.983754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:36.998300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de21726-edd7-47c6-b7b1-eb694ae48fec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:37.070087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:37.070758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:37.071075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:37.071359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] PATH_INFO: `/v3/projects/74f90b883d5a40f1b489884a427c06e5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:37.072638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f90b883d5a40f1b489884a427c06e5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:37.074706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:37.226415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f90b883d5a40f1b489884a427c06e5', 'request_id': 'req-74f4ea53-c984-4928-af22-796d81c7bf70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.231974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f90b883d5a40f1b489884a427c06e5', 'request_id': 'req-74f4ea53-c984-4928-af22-796d81c7bf70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.238448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f90b883d5a40f1b489884a427c06e5', 'request_id': 'req-74f4ea53-c984-4928-af22-796d81c7bf70'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.328193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] The token cache is being invalidate because project 74f90b883d5a40f1b489884a427c06e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:37.328488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.329124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.330669 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3628/7267] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:36 2022] DELETE /identity/v3/projects/74f90b883d5a40f1b489884a427c06e5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:37.334825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:37.336382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:37.349741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7864e6-08d4-4581-b380-9d0009f13f95 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:37.426757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:37.427451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:37.427741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:37.428086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] PATH_INFO: `/v3/users/a208297c233745d9bddcf4a62a60d37b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:37.429807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a208297c233745d9bddcf4a62a60d37b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:37.432601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:37.668977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.679656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.680415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.693551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.694406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-df4d2737-a253-403d-933a-4729d35b6178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a208297c233745d9bddcf4a62a60d37b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:37.780544 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3640/7268] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:37 2022] DELETE /identity/v3/users/a208297c233745d9bddcf4a62a60d37b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:38.239741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:38.249171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:38.254754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4ea53-c984-4928-af22-796d81c7bf70 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:38.284470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:38.317318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:38.317954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:38.318235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:38.318510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] PATH_INFO: `/v3/projects/94105165dddb442e8d1b34abf7386a02` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:38.320143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=94105165dddb442e8d1b34abf7386a02)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:38.323514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:38.440137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94105165dddb442e8d1b34abf7386a02', 'request_id': 'req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:38.446279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94105165dddb442e8d1b34abf7386a02', 'request_id': 'req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:38.452659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94105165dddb442e8d1b34abf7386a02', 'request_id': 'req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:38.532535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] The token cache is being invalidate because project 94105165dddb442e8d1b34abf7386a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:38.533640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:38.534439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7f4a5622-e02e-4f72-90f6-f11ac6f51dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:38.536087 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3629/7269] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:38 2022] DELETE /identity/v3/projects/94105165dddb442e8d1b34abf7386a02 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:38.542841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:38.543447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:38.543568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:38.565447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:38.566698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:38.580737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:38.630294 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3641/7270] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:38.638919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:38.639236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:38.639520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:38.661065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:38.670139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:38.671109 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3630/7271] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:38.676113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:38.686981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2d297-f1fc-4530-9a83-95dd7d1fee9d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:38.692040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:38.692650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:38.693395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:38.693677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:38.694991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:24:38.695338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:38.696992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:38.710326 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3642/7272] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:24:38.714946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:38.724678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda493c7-978d-4615-bc1b-3b26bf7a102f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:38.730163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:38.730802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:38.731231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:38.731515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:38.732158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:38.734183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:38.867911 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3631/7273] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:38 2022] POST /identity/v3/projects => generated 359 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:38.872109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:38.883394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742085e8-395a-4ed6-97aa-ebd74aa8aa7e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:38.947979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:38.948600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:38.948891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:38.949168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:38.949804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:38.951781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.028949 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3643/7274] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:38 2022] POST /identity/v3/users => generated 280 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:39.030230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.041255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805dce-5396-4bc1-bddf-87efd3792f5b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.045995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.046606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.046891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.047216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.047859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.049475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.065966 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3632/7275] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:39.070154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.080730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46cfb5-b1f2-498c-926a-0091c392d4b5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.085422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12635bb-c5c8-4b0d-a397-a8f93a79cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.087791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12635bb-c5c8-4b0d-a397-a8f93a79cbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.087791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12635bb-c5c8-4b0d-a397-a8f93a79cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.087791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12635bb-c5c8-4b0d-a397-a8f93a79cbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.087791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12635bb-c5c8-4b0d-a397-a8f93a79cbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.088834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12635bb-c5c8-4b0d-a397-a8f93a79cbb0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.099383 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3644/7276] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:39.104117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.114039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089029-831f-4491-9076-a9ee91f82179 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.119346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfb6e3-0cca-43f8-a91d-ace90d9e4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.119925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfb6e3-0cca-43f8-a91d-ace90d9e4cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.120204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfb6e3-0cca-43f8-a91d-ace90d9e4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.120476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfb6e3-0cca-43f8-a91d-ace90d9e4cc0 admin admin] PATH_INFO: `/v3/projects/cb88c7c407fc43138f96dc642a11338d/users/8b66cb7975264029b360f09c1f848bb0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.134862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfb6e3-0cca-43f8-a91d-ace90d9e4cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb88c7c407fc43138f96dc642a11338d, user_id=8b66cb7975264029b360f09c1f848bb0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.137540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfb6e3-0cca-43f8-a91d-ace90d9e4cc0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.237677 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3633/7277] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:39 2022] PUT /identity/v3/projects/cb88c7c407fc43138f96dc642a11338d/users/8b66cb7975264029b360f09c1f848bb0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:39.248779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725c68-7c2c-4e48-87c6-d81afb73b998 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.249064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725c68-7c2c-4e48-87c6-d81afb73b998 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.249340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725c68-7c2c-4e48-87c6-d81afb73b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.277987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-15725c68-7c2c-4e48-87c6-d81afb73b998 None None] MFA Rules not processed for user `8b66cb7975264029b360f09c1f848bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:39.279252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-15725c68-7c2c-4e48-87c6-d81afb73b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:39.363147 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3645/7278] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:39.368569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.369134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.369134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.389431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] MFA Rules not processed for user `8b66cb7975264029b360f09c1f848bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:39.391432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:39.394069 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3634/7279] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:39 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:39.400044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.400334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.400646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.420820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] MFA Rules not processed for user `8b66cb7975264029b360f09c1f848bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:39.422026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:39.425351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3646/7280] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:39 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:39.429436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.442128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca679a5-d68a-48bf-9492-9200f52fbcde None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.456140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.456140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `HEAD` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.456140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.456611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.464430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorizing `identity:check_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.466130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.473830 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3635/7281] 10.222.0.20 () {56 vars in 1264 bytes} [Tue Sep 6 11:24:39 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Sep 06 11:24:39.478569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.489804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be0984-ef25-4974-a06e-d5d5c4c5116c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.494353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.494977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.495293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.495570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.499568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:39.501752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.503552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.509451 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3647/7282] 10.222.0.20 () {56 vars in 1263 bytes} [Tue Sep 6 11:24:39 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:39.513385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.523265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed8ae9-eaf1-4a3a-af3a-bfcea031c37b tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.532474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c42f8-e068-4895-a4c5-e8409a4d1084 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.533816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c42f8-e068-4895-a4c5-e8409a4d1084 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.534444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c42f8-e068-4895-a4c5-e8409a4d1084 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.535173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c42f8-e068-4895-a4c5-e8409a4d1084 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.545821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c42f8-e068-4895-a4c5-e8409a4d1084 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.547416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c42f8-e068-4895-a4c5-e8409a4d1084 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.683690 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3636/7283] 10.222.0.20 () {56 vars in 1266 bytes} [Tue Sep 6 11:24:39 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:39.687659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.697960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5fa9-9b89-44b9-a57e-cc352a38ef93 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.702181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.702770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `HEAD` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.703076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.703355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.705642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Sep 06 11:24:39.750277 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 06 11:24:39.751692 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:39.752998 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3648/7284] 10.222.0.20 () {56 vars in 1264 bytes} [Tue Sep 6 11:24:39 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Sep 06 11:24:39.758189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.758484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.758765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.778823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] MFA Rules not processed for user `8b66cb7975264029b360f09c1f848bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:39.780144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:39.783494 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3637/7285] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:39 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:39.787605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.798022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80dad-662c-43ce-9609-30cff9bd28dc tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.802246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.802837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.803148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.803431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.810085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.812029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.823837 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3649/7286] 10.222.0.20 () {56 vars in 1263 bytes} [Tue Sep 6 11:24:39 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 11:24:39.825258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.840620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcd4f1-15e4-4a9e-9831-f4b8b515afe9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.845021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.845642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.845933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.846213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:39.850963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:39.853669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:39.855277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:39.980964 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3638/7287] 10.222.0.20 () {56 vars in 1266 bytes} [Tue Sep 6 11:24:39 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:39.984968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:39.994373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17cab8-6a82-4580-b518-826cf0a6272a tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:39.998652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7153e80-740f-4a3b-a4ce-414fffca3aa7 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b66cb7975264029b360f09c1f848bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb88c7c407fc43138f96dc642a11338d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:39.999291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153e80-740f-4a3b-a4ce-414fffca3aa7 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:39.999572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153e80-740f-4a3b-a4ce-414fffca3aa7 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:39.999847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153e80-740f-4a3b-a4ce-414fffca3aa7 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:40.001611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7153e80-740f-4a3b-a4ce-414fffca3aa7 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-e7153e80-740f-4a3b-a4ce-414fffca3aa7 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 06 11:24:40.013830 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 06 11:24:40.015231 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:40.016758 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3650/7288] 10.222.0.20 () {56 vars in 1263 bytes} [Tue Sep 6 11:24:39 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 11:24:40.020111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:40.083339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc765166-187c-42d8-b074-49f7b99f5540 tempest-TokensV3Test-705425403 tempest-TokensV3Test-705425403-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:40.088062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:40.088692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:40.088982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:40.089259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] PATH_INFO: `/v3/users/8b66cb7975264029b360f09c1f848bb0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:40.090385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b66cb7975264029b360f09c1f848bb0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:40.092344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:40.395383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b66cb7975264029b360f09c1f848bb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:40.402652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b66cb7975264029b360f09c1f848bb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:40.403391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b66cb7975264029b360f09c1f848bb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:40.404000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b66cb7975264029b360f09c1f848bb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:40.416700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b66cb7975264029b360f09c1f848bb0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:40.523639 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3639/7289] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:24:40 2022] DELETE /identity/v3/users/8b66cb7975264029b360f09c1f848bb0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:40.528499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:40.528786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:40.529061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:40.559662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:40.560879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:40.620525 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3651/7290] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:40.630293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:40.631741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:40.698877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105563c-4cf9-448a-9b0e-d4dfb58dfdcd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:40.702703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300a5c-9404-443e-a6fa-4227661d9930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:40.703365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300a5c-9404-443e-a6fa-4227661d9930 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:40.703650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300a5c-9404-443e-a6fa-4227661d9930 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:40.707838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300a5c-9404-443e-a6fa-4227661d9930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:40.714932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300a5c-9404-443e-a6fa-4227661d9930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:40.716205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300a5c-9404-443e-a6fa-4227661d9930 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:40.727902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3640/7291] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:24:41.473377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:41.474884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:41.488838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851f5cb-f233-430e-ad5f-4d829669461a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:41.494270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:41.494910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:41.495238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:41.495519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] PATH_INFO: `/v3/projects/cb88c7c407fc43138f96dc642a11338d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:41.496679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb88c7c407fc43138f96dc642a11338d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:41.498987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:41.636669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb88c7c407fc43138f96dc642a11338d', 'request_id': 'req-cf1e73da-cc8a-4873-88b0-927316eedb50'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:41.651249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb88c7c407fc43138f96dc642a11338d', 'request_id': 'req-cf1e73da-cc8a-4873-88b0-927316eedb50'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:41.657273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb88c7c407fc43138f96dc642a11338d', 'request_id': 'req-cf1e73da-cc8a-4873-88b0-927316eedb50'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:41.705584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] The token cache is being invalidate because project cb88c7c407fc43138f96dc642a11338d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:24:41.705884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:41.706595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cf1e73da-cc8a-4873-88b0-927316eedb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:41.708255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3652/7292] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:24:41 2022] DELETE /identity/v3/projects/cb88c7c407fc43138f96dc642a11338d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:41.713320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:41.713803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:41.713923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:41.734607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:41.735919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:41.742939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:41.798229 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3641/7293] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:41.807944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:41.808237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:41.808517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:41.829653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:41.830922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:41.839248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3653/7294] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:41.843483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:41.853152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ee8be-c209-43e9-9e8b-d63d26be4748 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:41.857762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:41.858355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:41.858634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:41.858910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:41.859583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:24:41.859885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:41.861522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:41.873961 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3642/7295] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:24:41.877692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:41.887586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9032b60-bad4-4144-a36d-fa12703cf0fb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:41.892434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:41.893029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:41.893310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:41.893583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:41.894222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:41.896202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:42.069729 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3654/7296] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:24:41 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:24:42.073995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:42.084533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46fdbb-7a72-4ad5-9610-4873d6770460 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:42.142747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:42.143437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:42.143728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:42.144008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:42.144633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:42.146562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:42.265952 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3643/7297] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:24:42 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:24:42.272984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:42.284062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519e4db-cb95-4e8a-a930-28d71bc3f1e1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:42.288775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:42.289372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:42.289773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:42.290585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:42.291258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:42.292867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:42.302994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3655/7298] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:42.307389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:42.317619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e240e-b7ca-46a1-8d61-1828d888cc9b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:42.322585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913e97b-686d-4738-adc0-d46ebda3d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:42.323162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e97b-686d-4738-adc0-d46ebda3d497 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:42.323447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e97b-686d-4738-adc0-d46ebda3d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:42.323782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913e97b-686d-4738-adc0-d46ebda3d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:42.324435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e97b-686d-4738-adc0-d46ebda3d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:42.326051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913e97b-686d-4738-adc0-d46ebda3d497 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:42.338194 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3644/7299] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:24:42.348045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:42.359232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6520-1921-406c-9a2e-9557c73eb378 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:42.364960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:42.365668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:42.365952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:42.366229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] PATH_INFO: `/v3/projects/cecc6e4c0eb44aafa2b08d505e5f9a68/users/bc86e2e8528e47458153fd7699f98323/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:42.369693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:42.381718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecc6e4c0eb44aafa2b08d505e5f9a68, user_id=bc86e2e8528e47458153fd7699f98323, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:24:42.384422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:24:42.523397 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3656/7300] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:24:42 2022] PUT /identity/v3/projects/cecc6e4c0eb44aafa2b08d505e5f9a68/users/bc86e2e8528e47458153fd7699f98323/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:42.541028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b47f-cde2-42a6-8df6-2e9ba8fc28fd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:42.541320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b47f-cde2-42a6-8df6-2e9ba8fc28fd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:42.541622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b47f-cde2-42a6-8df6-2e9ba8fc28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:42.570754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8835b47f-cde2-42a6-8df6-2e9ba8fc28fd None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:42.572094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8835b47f-cde2-42a6-8df6-2e9ba8fc28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:42.638488 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3645/7301] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:42.643660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:42.654987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5340a4-269e-4cfd-8449-b5d2a93f73e8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:42.661968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151ce30-6fd8-45c8-a17c-565310a9f13a tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:42.661968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151ce30-6fd8-45c8-a17c-565310a9f13a tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:42.661968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151ce30-6fd8-45c8-a17c-565310a9f13a tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:42.662314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151ce30-6fd8-45c8-a17c-565310a9f13a tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:42.807288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6151ce30-6fd8-45c8-a17c-565310a9f13a tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:42.951959 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3657/7302] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:42 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:43.957612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:43.958082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:43.958182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:43.969064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:24:43.987420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:43.988567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:43.996261 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3646/7303] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:43 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:44.001294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:44.001862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:44.001862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:44.023113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:44.024351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:44.053676 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3658/7304] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:44.058086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:44.069790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34e7c-444c-434d-8673-174aa3c8540f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:44.074445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:44.075123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:44.075410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:44.075684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:44.153279 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 06 11:24:44.154424 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:24:44.155815 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3647/7305] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:44 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 188 bytes in 97 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 11:24:44.158685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:44.167840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037f109-d8b2-4e10-b894-428e6bb47ada None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:44.172115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a14f-7b4a-45c3-804d-9d45bc1c8b60 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:44.172748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a14f-7b4a-45c3-804d-9d45bc1c8b60 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:44.173037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a14f-7b4a-45c3-804d-9d45bc1c8b60 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:44.179729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a14f-7b4a-45c3-804d-9d45bc1c8b60 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-f037a14f-7b4a-45c3-804d-9d45bc1c8b60 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:24:44.211722 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Sep 06 11:24:44.213479 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:24:44.214826 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3659/7306] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:44 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 188 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 06 11:24:44.217638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:44.227599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890c0fe-a7d1-4132-96b2-6118c2642dfb tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:44.232020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472188e4-2a45-4a28-a7bb-0a7a66d85388 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:44.232725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472188e4-2a45-4a28-a7bb-0a7a66d85388 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:44.232921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472188e4-2a45-4a28-a7bb-0a7a66d85388 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:44.233192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472188e4-2a45-4a28-a7bb-0a7a66d85388 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:44.385098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-472188e4-2a45-4a28-a7bb-0a7a66d85388 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:44.483692 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3648/7307] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:44 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:45.488527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:45.489157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:45.489157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:45.509669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:45.510966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:45.514110 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3660/7308] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:45 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:45.519267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377d7a-ac77-44c5-91f9-23f08e98abf3 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:45.524200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377d7a-ac77-44c5-91f9-23f08e98abf3 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:45.524200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377d7a-ac77-44c5-91f9-23f08e98abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:45.540206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a4377d7a-ac77-44c5-91f9-23f08e98abf3 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:45.541979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a4377d7a-ac77-44c5-91f9-23f08e98abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:45.548821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3649/7309] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:45.553062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:45.564140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dfefa-5276-4043-88a0-268f96b8eba2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:45.568422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa34987-8748-460e-87aa-1b6a68615559 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:45.569049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa34987-8748-460e-87aa-1b6a68615559 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:45.569339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa34987-8748-460e-87aa-1b6a68615559 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:45.569621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa34987-8748-460e-87aa-1b6a68615559 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:45.683651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6fa34987-8748-460e-87aa-1b6a68615559 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:45.814976 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3661/7310] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:45 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:46.820772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:46.821357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:46.821357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:46.842849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:46.844151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:46.847340 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3650/7311] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:46 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:46.852091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fabbb-800a-4d83-af45-0ab8d6ba7ea0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:46.852645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fabbb-800a-4d83-af45-0ab8d6ba7ea0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:46.852758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fabbb-800a-4d83-af45-0ab8d6ba7ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:46.873340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e48fabbb-800a-4d83-af45-0ab8d6ba7ea0 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:46.874577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e48fabbb-800a-4d83-af45-0ab8d6ba7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:46.881698 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3662/7312] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:46.885911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:46.897824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60248f-7013-46e6-89da-dbee3d98e57c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:46.902666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0359-7fd5-4fa3-a973-259e3fbf39a5 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:46.903352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0359-7fd5-4fa3-a973-259e3fbf39a5 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:46.903644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0359-7fd5-4fa3-a973-259e3fbf39a5 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:46.903910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0359-7fd5-4fa3-a973-259e3fbf39a5 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:47.072612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dee0359-7fd5-4fa3-a973-259e3fbf39a5 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:47.152996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3651/7313] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:46 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:24:48.158070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:48.158685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:48.158685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:48.179699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:48.179898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:48.183035 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3663/7314] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:48 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:48.188271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe4c2-5b8b-4cc8-97aa-b111528a93e1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:48.188785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe4c2-5b8b-4cc8-97aa-b111528a93e1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:48.188906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe4c2-5b8b-4cc8-97aa-b111528a93e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:48.209471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-515fe4c2-5b8b-4cc8-97aa-b111528a93e1 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:48.210684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-515fe4c2-5b8b-4cc8-97aa-b111528a93e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:48.218308 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3652/7315] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:48.223307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:24:48.241898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148d72-9d3c-47c6-a2b0-4cede1027fe2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:24:48.245951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfabb1-71ce-4d64-bae1-a432c1e0271e tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:24:48.246620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfabb1-71ce-4d64-bae1-a432c1e0271e tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:48.246903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfabb1-71ce-4d64-bae1-a432c1e0271e tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:48.247222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfabb1-71ce-4d64-bae1-a432c1e0271e tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:48.362504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-53dfabb1-71ce-4d64-bae1-a432c1e0271e tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:24:48.437971 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3664/7316] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:24:48 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:24:49.443886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a39d-cc43-429d-8ecb-ee2ae4412be4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:49.444450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a39d-cc43-429d-8ecb-ee2ae4412be4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:49.444450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a39d-cc43-429d-8ecb-ee2ae4412be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:49.463994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d631a39d-cc43-429d-8ecb-ee2ae4412be4 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:49.465203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d631a39d-cc43-429d-8ecb-ee2ae4412be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:49.468967 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3653/7317] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:50.480064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45b8c-ab69-461a-a5ed-4d7606f5beec None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:50.480640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45b8c-ab69-461a-a5ed-4d7606f5beec None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:50.480640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a45b8c-ab69-461a-a5ed-4d7606f5beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:50.502701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-38a45b8c-ab69-461a-a5ed-4d7606f5beec None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:50.504550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-38a45b8c-ab69-461a-a5ed-4d7606f5beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:50.514941 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3665/7318] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:24:50.522393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cffdb-4aa8-4bae-9f41-f3947cdfe2e5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:50.523028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cffdb-4aa8-4bae-9f41-f3947cdfe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:50.523558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cffdb-4aa8-4bae-9f41-f3947cdfe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:50.553477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2a8cffdb-4aa8-4bae-9f41-f3947cdfe2e5 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:24:50.553477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2a8cffdb-4aa8-4bae-9f41-f3947cdfe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:24:50.556108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3654/7319] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:50 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:24:50.561399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c408b-0267-4821-b546-69c2528c6cd7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:50.561698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c408b-0267-4821-b546-69c2528c6cd7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:50.561996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c408b-0267-4821-b546-69c2528c6cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:50.719615 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.server.flask.application [None req-ca8c408b-0267-4821-b546-69c2528c6cd7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 06 11:24:50.721493 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3666/7320] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 161 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 06 11:24:50.725680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b633-78be-40b2-aa2d-7ce95d5d80a0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:50.726004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b633-78be-40b2-aa2d-7ce95d5d80a0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:50.726286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4b633-78be-40b2-aa2d-7ce95d5d80a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:50.864177 ncdv-master-1 devstack@keystone.service[92878]: WARNING keystone.server.flask.application [None req-40e4b633-78be-40b2-aa2d-7ce95d5d80a0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 06 11:24:50.864897 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3655/7321] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 140 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 06 11:24:50.869359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a484620-9734-4c5e-b9a7-91c471aa6c5b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:24:50.871169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a484620-9734-4c5e-b9a7-91c471aa6c5b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:24:50.871489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a484620-9734-4c5e-b9a7-91c471aa6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:24:50.896770 ncdv-master-1 devstack@keystone.service[92879]: WARNING keystone.server.flask.application [None req-2a484620-9734-4c5e-b9a7-91c471aa6c5b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 06 11:24:50.898398 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3667/7322] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:24:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 30 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Sep 06 11:25:00.855791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=61,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:00.890093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:UPDATE=4,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:01.914746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba45f-9d44-4061-9278-cdf18b1afcf6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:01.915292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba45f-9d44-4061-9278-cdf18b1afcf6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:01.915292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ba45f-9d44-4061-9278-cdf18b1afcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:02.110386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a69ba45f-9d44-4061-9278-cdf18b1afcf6 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:02.112498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a69ba45f-9d44-4061-9278-cdf18b1afcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:02.124152 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3656/7323] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:25:02.128080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a484620-9734-4c5e-b9a7-91c471aa6c5b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:02.145234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a484620-9734-4c5e-b9a7-91c471aa6c5b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:02.150884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:02.151626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:02.151920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:02.152223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:02.282793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:02.415804 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3668/7324] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:25:02 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:02.914128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24974ad3-3dbd-49b7-accd-78c7d94af138 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:02.914552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24974ad3-3dbd-49b7-accd-78c7d94af138 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:02.914887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24974ad3-3dbd-49b7-accd-78c7d94af138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:02.942045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-24974ad3-3dbd-49b7-accd-78c7d94af138 None None] MFA Rules not processed for user `5458eb197e36456fb7785c8625ed3140`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:02.943831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-24974ad3-3dbd-49b7-accd-78c7d94af138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:03.013800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3657/7325] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:03.362699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:03.364545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:03.433486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefb172-9806-451c-ab42-30a3512e3d9f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:03.433486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefb172-9806-451c-ab42-30a3512e3d9f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:03.433486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefb172-9806-451c-ab42-30a3512e3d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:03.447397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-edefb172-9806-451c-ab42-30a3512e3d9f None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:03.448613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-edefb172-9806-451c-ab42-30a3512e3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:03.451780 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3658/7326] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:25:03.456714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b807-b306-4c44-a666-c2d763db5250 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:03.457008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b807-b306-4c44-a666-c2d763db5250 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:03.457287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b807-b306-4c44-a666-c2d763db5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:03.470250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed5a-1860-4888-9e62-a2cbe4244d24 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:03.473891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:03.474631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:03.475105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:03.475775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:03.477705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-7ed3b807-b306-4c44-a666-c2d763db5250 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 06 11:25:03.487220 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self.check_revocation(token) Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:03.493347 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3659/7327] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:03 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 11:25:03.495163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780db4b-022b-4cf0-af5f-61231369f262 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:03.496635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780db4b-022b-4cf0-af5f-61231369f262 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:03.496635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780db4b-022b-4cf0-af5f-61231369f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:03.496987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:03.497643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7def9-9113-4670-bd70-b4438ec8ff94 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:03.512297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3669/7328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:03.663826 ncdv-master-1 devstack@keystone.service[92878]: WARNING keystone.server.flask.application [None req-6780db4b-022b-4cf0-af5f-61231369f262 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 06 11:25:03.665686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3660/7329] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 174 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 06 11:25:03.671371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83769a5-edab-4147-9032-25f7b507a890 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:03.671754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83769a5-edab-4147-9032-25f7b507a890 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:03.672120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83769a5-edab-4147-9032-25f7b507a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:03.800279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f83769a5-edab-4147-9032-25f7b507a890 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:03.800279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f83769a5-edab-4147-9032-25f7b507a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:03.806244 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3670/7330] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:25:03.810575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780db4b-022b-4cf0-af5f-61231369f262 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:03.824730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780db4b-022b-4cf0-af5f-61231369f262 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:03.829588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd36491-e742-4d01-ba76-c1438ac92bf8 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:03.830263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36491-e742-4d01-ba76-c1438ac92bf8 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:03.830551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36491-e742-4d01-ba76-c1438ac92bf8 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:03.830830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36491-e742-4d01-ba76-c1438ac92bf8 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:03.992007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-bcd36491-e742-4d01-ba76-c1438ac92bf8 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:04.107045 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3661/7331] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:25:03 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:05.113870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:05.114697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:05.114697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:05.137723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:05.139133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:05.142660 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3671/7332] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:05 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 11:25:05.149665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5aff-1c28-48e4-b967-08af138080b8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:05.149665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5aff-1c28-48e4-b967-08af138080b8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:05.149665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5aff-1c28-48e4-b967-08af138080b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:05.169052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-37ce5aff-1c28-48e4-b967-08af138080b8 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:05.170264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37ce5aff-1c28-48e4-b967-08af138080b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:05.177294 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3662/7333] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:05.181684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:05.193290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a843-e321-4ee2-a051-cff4f809fc04 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:05.197381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e2b9e-f59b-4268-a00a-76f23237b3f3 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:05.198053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e2b9e-f59b-4268-a00a-76f23237b3f3 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:05.198345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e2b9e-f59b-4268-a00a-76f23237b3f3 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:05.198628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e2b9e-f59b-4268-a00a-76f23237b3f3 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:05.335457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4a4e2b9e-f59b-4268-a00a-76f23237b3f3 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:05.421795 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3672/7334] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:25:05 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:06.426866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40b932-e605-4740-a137-6babe99660ce None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:06.427374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40b932-e605-4740-a137-6babe99660ce None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:06.427374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40b932-e605-4740-a137-6babe99660ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:06.448736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2f40b932-e605-4740-a137-6babe99660ce None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:06.450318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2f40b932-e605-4740-a137-6babe99660ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:06.457104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3663/7335] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:06 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:25:06.461825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36b75f-7c1b-402a-9b57-9e10b9809bf6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:06.462450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36b75f-7c1b-402a-9b57-9e10b9809bf6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:06.462636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36b75f-7c1b-402a-9b57-9e10b9809bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:06.486963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2f36b75f-7c1b-402a-9b57-9e10b9809bf6 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:06.488328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2f36b75f-7c1b-402a-9b57-9e10b9809bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:06.496513 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3673/7336] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:06.502812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40b932-e605-4740-a137-6babe99660ce None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:06.528377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40b932-e605-4740-a137-6babe99660ce None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:06.533151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dc22b-9a4c-4a53-8235-2ce172edc081 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc86e2e8528e47458153fd7699f98323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:06.533964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc22b-9a4c-4a53-8235-2ce172edc081 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:06.534454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc22b-9a4c-4a53-8235-2ce172edc081 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:06.535402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc22b-9a4c-4a53-8235-2ce172edc081 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323/password` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:06.705858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-268dc22b-9a4c-4a53-8235-2ce172edc081 tempest-IdentityV3UsersTest-1098386809 tempest-IdentityV3UsersTest-1098386809-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:06.803955 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3664/7337] 10.222.0.20 () {60 vars in 1269 bytes} [Tue Sep 6 11:25:06 2022] POST /identity/v3/users/bc86e2e8528e47458153fd7699f98323/password => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:07.810624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:07.810624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:07.810624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:07.835258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:07.837291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:07.841783 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3674/7338] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:07 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 11:25:08.848787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b52ec-5391-4ae3-9b55-2cfa90b3481e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:08.849406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b52ec-5391-4ae3-9b55-2cfa90b3481e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:08.849406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b52ec-5391-4ae3-9b55-2cfa90b3481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:08.870940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-402b52ec-5391-4ae3-9b55-2cfa90b3481e None None] MFA Rules not processed for user `bc86e2e8528e47458153fd7699f98323`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:08.873054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-402b52ec-5391-4ae3-9b55-2cfa90b3481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:08.881688 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3665/7339] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:25:08.887480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:08.937482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:08.983837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0800cb-dc38-4294-86b2-1e5fdb5147e6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:08.989183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:08.991310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:08.991310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:08.991310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] PATH_INFO: `/v3/users/bc86e2e8528e47458153fd7699f98323` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:08.991644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc86e2e8528e47458153fd7699f98323)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:08.993505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:09.259422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:09.268747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:09.269523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:09.282535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:09.283289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc86e2e8528e47458153fd7699f98323'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:09.374569 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3675/7340] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:08 2022] DELETE /identity/v3/users/bc86e2e8528e47458153fd7699f98323 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:09.379112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:09.379428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:09.379711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:09.418477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:09.427670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:09.428908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:09.499832 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3666/7341] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:09.510830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:09.512328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:09.590796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bda3e-b087-4141-9eee-e48e1a2270d0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:09.596487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75592-e036-44a8-930f-eb79d555c1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:09.598481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75592-e036-44a8-930f-eb79d555c1db service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:09.598777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75592-e036-44a8-930f-eb79d555c1db service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:09.599100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75592-e036-44a8-930f-eb79d555c1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:09.618033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a75592-e036-44a8-930f-eb79d555c1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:09.619659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a75592-e036-44a8-930f-eb79d555c1db service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:09.636296 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3676/7342] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:10.096155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:10.098299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:10.113429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228a22-9fd0-4a1f-8bad-86d7e8a5ac58 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:10.118093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:10.118726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.119020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.119337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] PATH_INFO: `/v3/projects/cecc6e4c0eb44aafa2b08d505e5f9a68` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.120417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecc6e4c0eb44aafa2b08d505e5f9a68)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:10.122483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:10.262683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'request_id': 'req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:10.269150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'request_id': 'req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:10.275484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecc6e4c0eb44aafa2b08d505e5f9a68', 'request_id': 'req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:10.369169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] The token cache is being invalidate because project cecc6e4c0eb44aafa2b08d505e5f9a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:10.369463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:10.370276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e2bd78da-3cc3-45d2-901d-3fc65a9c733a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:10.371996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3667/7343] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:25:10 2022] DELETE /identity/v3/projects/cecc6e4c0eb44aafa2b08d505e5f9a68 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:10.379246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.379885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.380132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.445360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:10.446599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:10.455845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:10.511509 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3677/7344] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:10.520527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.520818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.521098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.542317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:10.543662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:10.552950 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3668/7345] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:10.557196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:10.568423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabb30d-8f50-40fc-bec6-4205df1cb7b8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:10.581111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:10.582345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.582626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.582948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.583645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:25:10.583950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:10.585661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:10.600293 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3678/7346] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:10.604634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:10.614375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5933f4-e6e8-430b-b3d2-33ca4cc0b966 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:10.627237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:10.627237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.627237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.627237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.627875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:10.627875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:10.725021 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3669/7347] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:10 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:10.729110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:10.739607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595ebdc-9226-4e73-a631-c8ab34e262ec admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:10.805889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:10.806556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.806838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.807298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.808027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:10.809939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:10.926357 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3679/7348] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:10 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:10.927977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:10.939157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c9f6-d9ea-46dc-b7b0-fc7861395e69 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:10.943842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:10.944451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.944735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.945013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.945685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:10.947409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:10.958444 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3670/7349] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:10.962568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:10.974656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48299a-0d1d-454f-a6e3-d39df35aac1f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:10.979786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e4a42-a034-49c6-94f6-fcea31526133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:10.986710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4a42-a034-49c6-94f6-fcea31526133 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:10.986710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4a42-a034-49c6-94f6-fcea31526133 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:10.986710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4a42-a034-49c6-94f6-fcea31526133 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:10.986710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e4a42-a034-49c6-94f6-fcea31526133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:10.986710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e4a42-a034-49c6-94f6-fcea31526133 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:10.995199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3680/7350] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:10.999901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:11.011284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd0764-25ef-4ada-8026-26afc78292cb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:11.018207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:11.019553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:11.019844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:11.020251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] PATH_INFO: `/v3/projects/f3b4de2bcf8a415aa69a2230ac5a3822/users/ed6c208bbdbc4121ba5628f6970b1150/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:11.038788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b4de2bcf8a415aa69a2230ac5a3822, user_id=ed6c208bbdbc4121ba5628f6970b1150, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:11.042437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:11.228402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3671/7351] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:10 2022] PUT /identity/v3/projects/f3b4de2bcf8a415aa69a2230ac5a3822/users/ed6c208bbdbc4121ba5628f6970b1150/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:11.243902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:11.244214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:11.244544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:11.276009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] MFA Rules not processed for user `ed6c208bbdbc4121ba5628f6970b1150`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:11.277238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:11.342784 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3681/7352] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:11.354331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:11.356266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:11.377164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:11.426542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac035e-d058-4c3f-930f-9bb02270a551 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:11.430489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8222a58-ad24-4e0a-bea0-7732685a6caf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:11.431154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222a58-ad24-4e0a-bea0-7732685a6caf service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:11.431444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222a58-ad24-4e0a-bea0-7732685a6caf service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:11.431713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222a58-ad24-4e0a-bea0-7732685a6caf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:11.441367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8222a58-ad24-4e0a-bea0-7732685a6caf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:11.443059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8222a58-ad24-4e0a-bea0-7732685a6caf service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:11.452458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3672/7353] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:11.571092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:11.584748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:11.643390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b051dd-6bd8-484d-ada4-c6bfc9f61ac9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:11.648504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:11.649178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:11.649483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:11.649769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] PATH_INFO: `/v3/users/ed6c208bbdbc4121ba5628f6970b1150` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:11.651078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6c208bbdbc4121ba5628f6970b1150)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:11.653843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:11.862931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6c208bbdbc4121ba5628f6970b1150'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:11.870601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6c208bbdbc4121ba5628f6970b1150'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:11.871306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6c208bbdbc4121ba5628f6970b1150'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:11.893622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6c208bbdbc4121ba5628f6970b1150'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:11.894419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6c208bbdbc4121ba5628f6970b1150'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:11.958701 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3682/7354] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:11 2022] DELETE /identity/v3/users/ed6c208bbdbc4121ba5628f6970b1150 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:11.963699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:11.963993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:11.964276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:11.990030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:11.991320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:12.054440 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3673/7355] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:25:12.064107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:12.069151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:12.128458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1023-c704-4582-8108-c6d60a7f4f7f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:12.132205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8b483-5de8-420e-af9c-faf23a6ae2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:12.132823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b483-5de8-420e-af9c-faf23a6ae2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:12.133109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b483-5de8-420e-af9c-faf23a6ae2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:12.133389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b483-5de8-420e-af9c-faf23a6ae2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:12.143780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8b483-5de8-420e-af9c-faf23a6ae2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:12.146191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8b483-5de8-420e-af9c-faf23a6ae2a7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:12.157162 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3683/7356] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:12.618268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:12.621867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:12.634319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b540a8-7621-43e7-ab44-e0619e3da032 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:12.643439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:12.643439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:12.643439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:12.643439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] PATH_INFO: `/v3/projects/f3b4de2bcf8a415aa69a2230ac5a3822` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:12.644666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b4de2bcf8a415aa69a2230ac5a3822)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:12.647292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:12.820632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b4de2bcf8a415aa69a2230ac5a3822', 'request_id': 'req-1fe96f16-2719-423a-8a4b-73e959305ef8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:12.828883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b4de2bcf8a415aa69a2230ac5a3822', 'request_id': 'req-1fe96f16-2719-423a-8a4b-73e959305ef8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:12.836629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b4de2bcf8a415aa69a2230ac5a3822', 'request_id': 'req-1fe96f16-2719-423a-8a4b-73e959305ef8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:12.964163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] The token cache is being invalidate because project f3b4de2bcf8a415aa69a2230ac5a3822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:12.964640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:12.965249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1fe96f16-2719-423a-8a4b-73e959305ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:12.970427 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3674/7357] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:25:12 2022] DELETE /identity/v3/projects/f3b4de2bcf8a415aa69a2230ac5a3822 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:12.972682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:12.973158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:12.973158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:12.995615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:12.996990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:13.030765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:13.075083 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3684/7358] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:13.085146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.086068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.086493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.120434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:13.122556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:13.138612 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3675/7359] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:13.144018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.157731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875e357-cf7c-42ff-bac3-a83a84e282ff None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.163984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.164660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.164946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.165223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.165943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:25:13.166302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.168177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:13.181236 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3685/7360] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:13.186656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.199324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916579d-cba5-4d90-a13e-dd3a1fe2396b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.205488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.206100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.206434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.206722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.207973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.210101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:13.331726 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3676/7361] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:13 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:13.336985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.359195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17b4b-06fd-4f1d-9e80-16c2d874e5f1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.441993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.442748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.443052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.443334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.443973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.445902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:13.537947 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3686/7362] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:13 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:13.542516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.556255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f7e0-45ce-4c59-a852-7fc28e56e846 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.561413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.567750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.567750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.567750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.567750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.567750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:13.590086 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3677/7363] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:13.591866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.604225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d732d11-c946-4120-aa30-2c1b4c6dd06e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.610227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331e440-13d0-486b-bafd-d53bb69cd458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.610842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e440-13d0-486b-bafd-d53bb69cd458 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.611166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e440-13d0-486b-bafd-d53bb69cd458 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.611445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e440-13d0-486b-bafd-d53bb69cd458 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.612093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331e440-13d0-486b-bafd-d53bb69cd458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.613833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331e440-13d0-486b-bafd-d53bb69cd458 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:13.626088 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3687/7364] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:13.630891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.636858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:13.642799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbebdf7-6926-4948-938a-84b216b7e845 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.649076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.651637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.651637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.651637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] PATH_INFO: `/v3/projects/3e35f5b1ed2941929bc456ec07588d67/users/0facce94e348439d9aeb881902cc614f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.665362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e35f5b1ed2941929bc456ec07588d67, user_id=0facce94e348439d9aeb881902cc614f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.668055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:13.742650 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3678/7365] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:13 2022] PUT /identity/v3/projects/3e35f5b1ed2941929bc456ec07588d67/users/0facce94e348439d9aeb881902cc614f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:13.753286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.753591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.753870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.787044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] MFA Rules not processed for user `0facce94e348439d9aeb881902cc614f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:13.788294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:13.857515 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3688/7366] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:13.862385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:13.926040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9179d4-bfcb-4447-a30a-e103bc6afb79 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:13.931390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:13.931997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:13.932287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:13.932568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:13.933214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:13.935170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:14.064553 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3679/7367] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:13 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:25:14.065902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:14.076733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4e100-654f-4ee0-a1ac-6d007e300950 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:14.102216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:14.141975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:14.144433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.144433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.144433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.144433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:14.146549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:14.283619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3689/7368] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:14 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:14.287684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:14.298231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c8e70-b9a3-41b1-9140-0b61dcfed960 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:14.302804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:14.305008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.305008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.305008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.305008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:14.306344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:14.317787 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3680/7369] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:14.322285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:14.334748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b966b-3fd1-4ae0-99bc-ad439a45cda0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:14.339719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e7a4a-a635-46ee-9790-4a3dadbea117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:14.340329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7a4a-a635-46ee-9790-4a3dadbea117 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.340619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7a4a-a635-46ee-9790-4a3dadbea117 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.340901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e7a4a-a635-46ee-9790-4a3dadbea117 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.341549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e7a4a-a635-46ee-9790-4a3dadbea117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:14.343201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e7a4a-a635-46ee-9790-4a3dadbea117 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:14.353640 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3690/7370] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:14.358397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:14.369146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105da2-1a8e-4e30-920f-6d21c0c46a48 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:14.373931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:14.374573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.374856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.375175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] PATH_INFO: `/v3/projects/37899387c20c4da48fdb86d3f2c4b6ee/users/ffed560fc988420099aacbeae5fe9568/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.391174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37899387c20c4da48fdb86d3f2c4b6ee, user_id=ffed560fc988420099aacbeae5fe9568, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:14.394201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:14.467899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3681/7371] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:14 2022] PUT /identity/v3/projects/37899387c20c4da48fdb86d3f2c4b6ee/users/ffed560fc988420099aacbeae5fe9568/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:14.478924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.479272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.479559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.523684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] MFA Rules not processed for user `ffed560fc988420099aacbeae5fe9568`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:14.525218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:14.619817 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3691/7372] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:14.624382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:14.699538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24011-9dbd-4e67-97ad-61bd3fb16b7c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:14.708173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:14.709003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.709370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.709823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.710801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:14.713743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:14.828266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3682/7373] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:14 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:14.832815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:14.846535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc1994-c821-48aa-a83a-f0631fece28a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:14.940965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:14.942055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:14.942470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:14.942749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:14.943487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:14.945776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:15.038620 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3692/7374] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:14 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:15.045333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:15.055333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454f2c5-315c-4d68-a565-691274d74674 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:15.060073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:15.060710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:15.060959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:15.061234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:15.061870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:15.065320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:15.082682 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3683/7375] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:15.086988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:15.099943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b67f8-5d1d-46b3-a00e-30f1ad21c842 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:15.106291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:15.107127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:15.107493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:15.107944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] PATH_INFO: `/v3/projects/918838a7fb754862b64180940986d291/users/b18fa5b6eee148c1978a5c7239cccc05/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:15.129185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918838a7fb754862b64180940986d291, user_id=b18fa5b6eee148c1978a5c7239cccc05, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:15.132467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:15.203388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:15.209789 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3693/7376] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:15 2022] PUT /identity/v3/projects/918838a7fb754862b64180940986d291/users/b18fa5b6eee148c1978a5c7239cccc05/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:15.214048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:15.221414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:15.230908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e468479-ccea-4a2b-ac3a-c6247d5c7980 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:15.311796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb70b6-7d57-4491-b667-7b7725e113a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:15.312540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb70b6-7d57-4491-b667-7b7725e113a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:15.314084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb70b6-7d57-4491-b667-7b7725e113a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:15.314084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb70b6-7d57-4491-b667-7b7725e113a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:15.314084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb70b6-7d57-4491-b667-7b7725e113a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:15.316287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb70b6-7d57-4491-b667-7b7725e113a0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:15.335262 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3684/7377] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:15.338253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:15.362315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390b492-d747-4c7f-ac57-1c32c54b4e32 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:15.368847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:15.369593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:15.369884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:15.370219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] PATH_INFO: `/v3/projects/918838a7fb754862b64180940986d291/users/b18fa5b6eee148c1978a5c7239cccc05/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:15.372185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918838a7fb754862b64180940986d291, user_id=b18fa5b6eee148c1978a5c7239cccc05, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:15.374998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:15.386437 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3694/7378] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:15 2022] PUT /identity/v3/projects/918838a7fb754862b64180940986d291/users/b18fa5b6eee148c1978a5c7239cccc05/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:15.399298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211539-ffab-4664-9016-41b8a88009bc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:15.399917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211539-ffab-4664-9016-41b8a88009bc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:15.400524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211539-ffab-4664-9016-41b8a88009bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:15.442861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-56211539-ffab-4664-9016-41b8a88009bc None None] MFA Rules not processed for user `b18fa5b6eee148c1978a5c7239cccc05`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:15.445584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56211539-ffab-4664-9016-41b8a88009bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:15.528280 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3685/7379] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:15.539799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:15.541694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:15.616568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57972a6-658c-4d41-b78f-7f764152cfb0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:15.620618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:15.621232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:15.621511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:15.621780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:15.689101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:15.690723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:15.701153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3695/7380] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:22.921111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:22.921622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:22.921838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:22.943229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] MFA Rules not processed for user `d1ac283e33a040a5ae2b6c85610c16db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:22.944502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:22.999810 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3686/7381] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:24.528018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:24.532868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:24.546427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac661e-f31d-4fdb-811a-b6b7fd5982c3 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:24.552062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:24.552788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:24.553298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:24.553670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:24.555654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:24.681575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:24.683455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:24.702391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3696/7382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:25.923193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:25.939657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b4fa-3e46-4317-9500-2a12804243c2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:25.944326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:25.945301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:25.946052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:25.946640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:25.951399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:25.975454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:25.977245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:26.000680 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3687/7383] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:26.120595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:26.134425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764933-b37d-452a-8c1b-178ffb25bd9f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:26.139876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:26.140903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:26.141594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:26.142039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:26.156158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:26.158175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:26.173875 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3697/7384] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:34.261662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:34.274620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c8315-5420-4023-9c98-577717590daa service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:34.279058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:34.279777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:34.280112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:34.280465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:34.294477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:34.340711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:34.342150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:34.353219 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3688/7385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:36.167506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:43.037425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:43.050549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ef111-74f9-4860-9c9e-38856d796fb3 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:43.054516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:43.055162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:43.055516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:43.058085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:43.062333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:43.068746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:43.135502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:43.136957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0229cb-bbd2-4a5a-ae10-e413dac01aaa service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:43.148184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674370e-bcba-4671-afc1-72786172ea34 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:43.150223 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3698/7386] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:43.153198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:43.153872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:43.154310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:43.154740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] PATH_INFO: `/v3/users/0facce94e348439d9aeb881902cc614f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:43.156079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0facce94e348439d9aeb881902cc614f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:43.158012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:43.402627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0facce94e348439d9aeb881902cc614f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:43.411267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0facce94e348439d9aeb881902cc614f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:43.412021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0facce94e348439d9aeb881902cc614f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:43.412675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0facce94e348439d9aeb881902cc614f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:43.426489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0facce94e348439d9aeb881902cc614f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:43.541472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3689/7387] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:43 2022] DELETE /identity/v3/users/0facce94e348439d9aeb881902cc614f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:43.546237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:43.546473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:43.546755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:43.567330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:43.568549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:43.640897 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3699/7388] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:43.652582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:43.654219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:43.692560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:43.719920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ab87a-844b-44f1-8966-509fb8471dac admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:43.724184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:43.724851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:43.725135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:43.725412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:43.735944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:43.737682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:43.750109 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3690/7389] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:25:43.996249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:43.999556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:44.020511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b063fdb-065b-4f65-991b-04f5ddbf9e99 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:44.033744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:44.036902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:44.036902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:44.036902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] PATH_INFO: `/v3/projects/3e35f5b1ed2941929bc456ec07588d67` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:44.037312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e35f5b1ed2941929bc456ec07588d67)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:44.038987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:44.164702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e35f5b1ed2941929bc456ec07588d67', 'request_id': 'req-b7c43088-abe0-4f6a-8966-875b503d7f17'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.174410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e35f5b1ed2941929bc456ec07588d67', 'request_id': 'req-b7c43088-abe0-4f6a-8966-875b503d7f17'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.181782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e35f5b1ed2941929bc456ec07588d67', 'request_id': 'req-b7c43088-abe0-4f6a-8966-875b503d7f17'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.271500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] The token cache is being invalidate because project 3e35f5b1ed2941929bc456ec07588d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:44.271804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.272580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.274221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3700/7390] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:25:43 2022] DELETE /identity/v3/projects/3e35f5b1ed2941929bc456ec07588d67 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:44.278432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:44.289216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a064aa8-c4b8-447d-a1cb-6485008b2719 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:44.347654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:44.348280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:44.348561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:44.348837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] PATH_INFO: `/v3/users/ffed560fc988420099aacbeae5fe9568` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:44.349937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffed560fc988420099aacbeae5fe9568)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:44.352005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:44.631089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffed560fc988420099aacbeae5fe9568'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.647477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffed560fc988420099aacbeae5fe9568'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.648511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffed560fc988420099aacbeae5fe9568'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.651396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffed560fc988420099aacbeae5fe9568'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.669815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffed560fc988420099aacbeae5fe9568'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:44.788078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3691/7391] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:44 2022] DELETE /identity/v3/users/ffed560fc988420099aacbeae5fe9568 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:45.584162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:45.585684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:45.603280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c43088-abe0-4f6a-8966-875b503d7f17 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:45.626607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:45.752925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:45.753724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:45.754012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:45.757112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] PATH_INFO: `/v3/projects/37899387c20c4da48fdb86d3f2c4b6ee` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:45.762885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37899387c20c4da48fdb86d3f2c4b6ee)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:45.767946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:45.987454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37899387c20c4da48fdb86d3f2c4b6ee', 'request_id': 'req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.008419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37899387c20c4da48fdb86d3f2c4b6ee', 'request_id': 'req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.026632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37899387c20c4da48fdb86d3f2c4b6ee', 'request_id': 'req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.110884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] The token cache is being invalidate because project 37899387c20c4da48fdb86d3f2c4b6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:46.111225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.111931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.114345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3701/7392] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:25:45 2022] DELETE /identity/v3/projects/37899387c20c4da48fdb86d3f2c4b6ee => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:46.118401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:46.119946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:46.135898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82950a-cef3-4209-b31f-eb297a65f617 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:46.229712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:46.249142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:46.249986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:46.250382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:46.250809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] PATH_INFO: `/v3/users/b18fa5b6eee148c1978a5c7239cccc05` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:46.252297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18fa5b6eee148c1978a5c7239cccc05)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:46.254678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:46.511090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18fa5b6eee148c1978a5c7239cccc05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.519551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18fa5b6eee148c1978a5c7239cccc05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.524232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18fa5b6eee148c1978a5c7239cccc05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.524232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18fa5b6eee148c1978a5c7239cccc05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.544974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d3dc2fe9-73b9-410a-bc83-1843954ca1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18fa5b6eee148c1978a5c7239cccc05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:46.643505 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3692/7393] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:46 2022] DELETE /identity/v3/users/b18fa5b6eee148c1978a5c7239cccc05 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:47.786639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:47.789533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:47.817764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6bc7-ed47-4452-ad4b-8ef0f6df152d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:47.961528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:47.962242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:47.962531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:47.962814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] PATH_INFO: `/v3/projects/918838a7fb754862b64180940986d291` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:47.964403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=918838a7fb754862b64180940986d291)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:47.968777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:48.106303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918838a7fb754862b64180940986d291', 'request_id': 'req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:48.107901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:48.122083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918838a7fb754862b64180940986d291', 'request_id': 'req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:48.128711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918838a7fb754862b64180940986d291', 'request_id': 'req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:48.191675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] The token cache is being invalidate because project 918838a7fb754862b64180940986d291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:48.191912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:48.192680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1ff62023-5ec5-4b61-aba0-a5dd7442f2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:48.194925 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3702/7394] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:25:47 2022] DELETE /identity/v3/projects/918838a7fb754862b64180940986d291 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:48.199763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.200914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.204112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.250575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:48.253294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:48.360813 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3693/7395] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:48.369216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.369592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.369945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.411541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:48.413022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:48.427064 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3703/7396] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:48.429333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:48.448493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb383e-9b00-41c9-917c-31a4f0a3abc2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:48.465827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:48.466408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.467295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.467295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.467787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:25:48.468136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:48.469747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:48.499847 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3694/7397] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:48.504554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:48.517210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fcab-2ed2-4336-9fd9-011d5ce95fa1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:48.527379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:48.528672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.529192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.529820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.530719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:48.532886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:48.681595 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3704/7398] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:48 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:48.687892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:48.698473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008854-a82b-42f0-8e62-9f8ea6944f33 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:48.780569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:48.781201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.781487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.781765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.782482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:48.784425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:48.795372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:48.925927 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3695/7399] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:48 2022] POST /identity/v3/users => generated 303 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:48.929832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:48.941975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6793f-6bd3-43b0-964b-bccb5f7d0eb2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:48.946787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:48.947542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.947877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.948025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.948858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:48.953227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:48.971986 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3705/7400] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:48.977367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:48.988082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79212-7615-4ed9-8056-10ff17c614e9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:48.993051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2b9f-6ce9-4dcd-9994-bb6e5beedc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:48.993667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2b9f-6ce9-4dcd-9994-bb6e5beedc69 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:48.993949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2b9f-6ce9-4dcd-9994-bb6e5beedc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:48.994219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2b9f-6ce9-4dcd-9994-bb6e5beedc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:48.994946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2b9f-6ce9-4dcd-9994-bb6e5beedc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:48.996592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2b9f-6ce9-4dcd-9994-bb6e5beedc69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:49.011057 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3696/7401] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:49.014513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:49.028878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c46ac-add6-42dc-a075-aa4b309b6dc7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:49.042031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:49.042717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:49.043322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:49.043435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] PATH_INFO: `/v3/projects/1cb5703c3d154f74b1fe7a36f101bd95/users/bef4a21849d7469187177b3fd2425f90/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:49.059663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb5703c3d154f74b1fe7a36f101bd95, user_id=bef4a21849d7469187177b3fd2425f90, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:49.062414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:49.186959 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3706/7402] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:49 2022] PUT /identity/v3/projects/1cb5703c3d154f74b1fe7a36f101bd95/users/bef4a21849d7469187177b3fd2425f90/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:49.199040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:49.199282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:49.199760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:49.231481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] MFA Rules not processed for user `bef4a21849d7469187177b3fd2425f90`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:49.232725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:49.303757 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3697/7403] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:49.308457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:49.391436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef9a7e-4154-4de4-9b4f-fd32ba76b22b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:49.396623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:49.397255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:49.397528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:49.397813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:49.398467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:49.400492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:49.514483 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3707/7404] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:49 2022] POST /identity/v3/projects => generated 405 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:25:49.518731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:49.530176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a8fb3-7c87-4d69-8eee-31143c3bea6a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:49.611740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:49.612496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:49.612953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:49.614008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:49.614701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:49.616890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:49.740998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:49.741572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3698/7405] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:49 2022] POST /identity/v3/users => generated 309 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:49.752705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73293dd-cb08-4d59-9d19-5240870cf296 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:49.759756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:49.760386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:49.760712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:49.760947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:49.761595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:49.763739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:49.779438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3708/7406] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:49.780469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:49.790864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61132f0f-2a29-4d24-8219-544c12f8044a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:49.795584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:49.796284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:49.796570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:49.796850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] PATH_INFO: `/v3/projects/0af345cd62774ccaa6b5c8570f7989b6/users/5629fae8487c44388a8fbcaa04140095/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:49.812457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af345cd62774ccaa6b5c8570f7989b6, user_id=5629fae8487c44388a8fbcaa04140095, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:49.815242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:49.938611 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3699/7407] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:49 2022] PUT /identity/v3/projects/0af345cd62774ccaa6b5c8570f7989b6/users/5629fae8487c44388a8fbcaa04140095/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:49.942807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:49.957182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc424604-48c3-4912-b748-d13c5c50360b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:50.008069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:50.020716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9bf5-8a7f-4c87-8af7-f6bef9368038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:50.021267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9bf5-8a7f-4c87-8af7-f6bef9368038 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:50.021555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9bf5-8a7f-4c87-8af7-f6bef9368038 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:50.021832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9bf5-8a7f-4c87-8af7-f6bef9368038 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:50.022470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad9bf5-8a7f-4c87-8af7-f6bef9368038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:50.024124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad9bf5-8a7f-4c87-8af7-f6bef9368038 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:50.034357 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3709/7408] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:50.038567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:50.049275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bba15-f818-456f-a0d7-f6950a1c1fde admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:50.054587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:50.055289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:50.055568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:50.055847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] PATH_INFO: `/v3/projects/0af345cd62774ccaa6b5c8570f7989b6/users/5629fae8487c44388a8fbcaa04140095/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:50.057773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af345cd62774ccaa6b5c8570f7989b6, user_id=5629fae8487c44388a8fbcaa04140095, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:50.060472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:50.073621 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3700/7409] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:50 2022] PUT /identity/v3/projects/0af345cd62774ccaa6b5c8570f7989b6/users/5629fae8487c44388a8fbcaa04140095/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:50.090836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:50.091541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:50.091883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:50.124971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] MFA Rules not processed for user `5629fae8487c44388a8fbcaa04140095`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:50.127065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:50.198800 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3710/7410] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:50.208653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:50.210194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:50.210584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:50.211913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:50.238716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:50.279786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4a785-dce8-43fc-b612-e097a654902a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:50.280332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6381-cc1f-4ea0-a14e-c8ed48c64f76 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:50.284489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:50.285277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:50.285444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:50.285543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:50.285643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:50.285725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:50.285820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:50.285980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] PATH_INFO: `/v3/users/4251298aaf4e4207bdcab24fbdf30728` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:50.287226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4251298aaf4e4207bdcab24fbdf30728)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:50.289105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:50.349323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:50.350951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:50.361184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3711/7411] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:50 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:25:50.471988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4251298aaf4e4207bdcab24fbdf30728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:50.480125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4251298aaf4e4207bdcab24fbdf30728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:50.481203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4251298aaf4e4207bdcab24fbdf30728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:50.481898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4251298aaf4e4207bdcab24fbdf30728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:50.501081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4251298aaf4e4207bdcab24fbdf30728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:50.586107 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3701/7412] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:50 2022] DELETE /identity/v3/users/4251298aaf4e4207bdcab24fbdf30728 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:50.944017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:50.955577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d09bee-8bfe-476e-ae3c-e3c53249c49d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:50.978183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:51.030891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.031574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.031862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.032167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] PATH_INFO: `/v3/projects/b56b93d575b74ba584c4bd399dfe2a6c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.033327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56b93d575b74ba584c4bd399dfe2a6c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.036049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.051953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.051953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:51.137534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f309f2-4a60-4d52-bbb2-9571b4468b89 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.143811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.144413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.144698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.144977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.146800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:51.153170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56b93d575b74ba584c4bd399dfe2a6c', 'request_id': 'req-0487da71-8494-47ba-a02e-b98cf73224f1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:51.160130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56b93d575b74ba584c4bd399dfe2a6c', 'request_id': 'req-0487da71-8494-47ba-a02e-b98cf73224f1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:51.166778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56b93d575b74ba584c4bd399dfe2a6c', 'request_id': 'req-0487da71-8494-47ba-a02e-b98cf73224f1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:51.189035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:51.213251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.214903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4021d01-c261-4461-9be8-8a42e48812b9 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.225476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3702/7413] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:25:51 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:25:51.248387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] The token cache is being invalidate because project b56b93d575b74ba584c4bd399dfe2a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:51.250996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:51.250996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0487da71-8494-47ba-a02e-b98cf73224f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:51.250996 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3712/7414] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:25:50 2022] DELETE /identity/v3/projects/b56b93d575b74ba584c4bd399dfe2a6c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:51.258703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.262454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.262454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.285373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:51.285373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:51.347544 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3703/7415] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:25:51.355612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.355972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.356254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.376912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:51.378118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:51.386844 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3713/7416] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:51.391331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.403196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83215d-5179-4d45-8a12-b7fc0816a8c6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.408679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.409409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.410175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.410463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.411174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:25:51.411481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.413119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.429659 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3704/7417] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:25:51.430855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.442496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101e92-6641-4af4-a03c-3a8d705d1034 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.447680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.448304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.448587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.448862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.449508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.451470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.540013 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3714/7418] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:51 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:51.541323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.551803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee79880-9e9a-49ea-9b21-82dde09cbd8d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.619053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.619586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.619873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.620148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.620776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.623170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.691235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.691488 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3705/7419] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:51 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:51.707542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faeb53-02cb-4631-9b37-4297dbf07b66 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.713056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.713704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.713993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.714280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.714927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.719314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.729484 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3715/7420] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:51.733423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.744977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0f13-76d2-45c1-9af6-82350e2050c5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.750200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc6e07-57e1-41bf-bde2-ceb8a34a34a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.750859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6e07-57e1-41bf-bde2-ceb8a34a34a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.751198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6e07-57e1-41bf-bde2-ceb8a34a34a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.751475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6e07-57e1-41bf-bde2-ceb8a34a34a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.752117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc6e07-57e1-41bf-bde2-ceb8a34a34a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.754378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc6e07-57e1-41bf-bde2-ceb8a34a34a7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.771435 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3706/7421] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:51.772493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:51.783560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced45-eeda-4996-a664-02f907ab551d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:51.789211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:51.789975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.790330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.790677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] PATH_INFO: `/v3/projects/c6c0afd04d98432e8108be7bec9d50ad/users/f9cfcbadc17b42178214ffea2c20dda9/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.807744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c0afd04d98432e8108be7bec9d50ad, user_id=f9cfcbadc17b42178214ffea2c20dda9, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:51.816643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:51.917435 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3716/7422] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:51 2022] PUT /identity/v3/projects/c6c0afd04d98432e8108be7bec9d50ad/users/f9cfcbadc17b42178214ffea2c20dda9/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:51.927972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:51.928333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:51.928686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:51.968280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] MFA Rules not processed for user `f9cfcbadc17b42178214ffea2c20dda9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:51.969724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:52.002339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:52.045203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3707/7423] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:52.049679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.125922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:52.139599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06c4cc-66c7-42af-b115-94bd4550b7d6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.146069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.146687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.150455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.150455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.150455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.150455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:52.301663 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3717/7424] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:25:52 2022] POST /identity/v3/projects => generated 367 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:52.302803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.314563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fa54e-eb4e-4513-956c-7eaa1027b9b8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.384976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.386212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.386522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.390339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.390339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.390339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:52.479299 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3708/7425] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:52 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:25:52.483283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.494603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c77cf-31ca-4317-92bc-d83af1f9ec23 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.504942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.504942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.504942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.504942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.505319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.505319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:52.516615 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3718/7426] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:52.521345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.539304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02982ddc-2e38-4e48-ac6b-9a6bbbc08b01 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.544649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.545577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.546020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.546444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] PATH_INFO: `/v3/projects/33dd5fd52de245c48d3834130aa2ba1e/users/ad0d8608893b40d9b166d8c25465930d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.564673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dd5fd52de245c48d3834130aa2ba1e, user_id=ad0d8608893b40d9b166d8c25465930d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.567744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:52.683986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3709/7427] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:52 2022] PUT /identity/v3/projects/33dd5fd52de245c48d3834130aa2ba1e/users/ad0d8608893b40d9b166d8c25465930d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:52.688259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.702955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687771-ae81-4cff-ae96-492e8a1efceb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.775493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1b0f6-614e-443d-a8b7-776e1c5c4f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.776106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b0f6-614e-443d-a8b7-776e1c5c4f92 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.776390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b0f6-614e-443d-a8b7-776e1c5c4f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.776670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b0f6-614e-443d-a8b7-776e1c5c4f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.777311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1b0f6-614e-443d-a8b7-776e1c5c4f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.778975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1b0f6-614e-443d-a8b7-776e1c5c4f92 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:52.792459 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3719/7428] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:52.793934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.805043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f800db-f46c-45e5-8486-69e2541a16c6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.810586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.811290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.811576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.811852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] PATH_INFO: `/v3/projects/33dd5fd52de245c48d3834130aa2ba1e/users/ad0d8608893b40d9b166d8c25465930d/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.814596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dd5fd52de245c48d3834130aa2ba1e, user_id=ad0d8608893b40d9b166d8c25465930d, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.817920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:52.834548 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3710/7429] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:25:52 2022] PUT /identity/v3/projects/33dd5fd52de245c48d3834130aa2ba1e/users/ad0d8608893b40d9b166d8c25465930d/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:52.848711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.849118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.849474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.880952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] MFA Rules not processed for user `ad0d8608893b40d9b166d8c25465930d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:25:52.882469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:52.969732 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3720/7430] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:25:52.974911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:52.986901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ca00-6696-48ae-809f-beae9e94e76e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:52.991433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:52.992048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:52.992334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:52.992643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:52.993315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:52.994923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:53.062461 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3711/7431] 10.222.0.20 () {60 vars in 1150 bytes} [Tue Sep 6 11:25:52 2022] POST /identity/v3/domains => generated 274 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:53.066806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:53.079232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e2a71-6bfd-4d16-8456-566e67d54a5b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:53.134767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:53.160486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:53.161236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:53.161541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:53.162191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:53.163301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:53.165998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:53.240872 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3721/7432] 10.222.0.20 () {60 vars in 1150 bytes} [Tue Sep 6 11:25:53 2022] POST /identity/v3/domains => generated 276 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:25:53.245046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:53.255911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885450a-98f7-4f2f-b93c-b71adc5be05d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:53.315761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:53.316516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:53.316655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:53.316975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:53.317713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:53.319460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:53.389691 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3712/7433] 10.222.0.20 () {60 vars in 1150 bytes} [Tue Sep 6 11:25:53 2022] POST /identity/v3/domains => generated 276 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:25:53.395670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:53.408390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b229-197c-4a6b-9096-8c8918c06d38 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:53.478188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:53.478932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:53.479318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:53.479674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:53.480426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:53.482153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:53.566212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3722/7434] 10.222.0.20 () {60 vars in 1150 bytes} [Tue Sep 6 11:25:53 2022] POST /identity/v3/domains => generated 279 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:53.570661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:53.576247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:53.581807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525cc8a-a293-45ad-856f-2d4e7666e1e5 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:53.640896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:53.641684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:53.641973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:53.642254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/a4ec760ae01043e29a3625509c9cc6f8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:53.653902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a4ec760ae01043e29a3625509c9cc6f8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:53.655570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:53.683730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.689546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.801372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8', 'request_id': 'req-dd86677f-2887-44a7-a1c6-5c76b1ed9461'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.809186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8', 'request_id': 'req-dd86677f-2887-44a7-a1c6-5c76b1ed9461'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.818479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8', 'request_id': 'req-dd86677f-2887-44a7-a1c6-5c76b1ed9461'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.888745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project a4ec760ae01043e29a3625509c9cc6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:53.889041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.889715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.899637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8', 'request_id': 'req-dd86677f-2887-44a7-a1c6-5c76b1ed9461'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.900995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8', 'request_id': 'req-dd86677f-2887-44a7-a1c6-5c76b1ed9461'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.905071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a4ec760ae01043e29a3625509c9cc6f8', 'request_id': 'req-dd86677f-2887-44a7-a1c6-5c76b1ed9461'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:53.912470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3713/7435] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:53 2022] DELETE /identity/v3/domains/a4ec760ae01043e29a3625509c9cc6f8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:53.918293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:53.920156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:53.933781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e42e4-6b8b-4e11-b88d-c4b71d1e9886 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:53.992744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:53.993376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:53.993658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:53.993935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:53.994649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:53.996288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:54.114269 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3723/7436] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:25:53 2022] POST /identity/v3/domains => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:54.118364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:54.129817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86677f-2887-44a7-a1c6-5c76b1ed9461 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:54.174961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:54.196688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:54.197392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:54.197659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:54.198010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/2d28b91129f04edd9f4394634ddadcd1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:54.211343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2d28b91129f04edd9f4394634ddadcd1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:54.217622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:54.236664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.237411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.380060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.380723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.383314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3714/7437] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:54 2022] PATCH /identity/v3/domains/2d28b91129f04edd9f4394634ddadcd1 => generated 249 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:54.387551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:54.389203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:54.403363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf14d9-bf00-4750-a76e-e9033debeb89 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:54.466814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:54.467493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:54.467785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:54.468067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/2d28b91129f04edd9f4394634ddadcd1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:54.479378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2d28b91129f04edd9f4394634ddadcd1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:54.480996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:54.482405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:54.505022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.514792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.666144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1', 'request_id': 'req-f7078e1e-f3ab-42c7-8859-1c75edd0d967'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.674819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1', 'request_id': 'req-f7078e1e-f3ab-42c7-8859-1c75edd0d967'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.681888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1', 'request_id': 'req-f7078e1e-f3ab-42c7-8859-1c75edd0d967'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.814453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project 2d28b91129f04edd9f4394634ddadcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:54.815202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.816922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.825814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1', 'request_id': 'req-f7078e1e-f3ab-42c7-8859-1c75edd0d967'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.826516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1', 'request_id': 'req-f7078e1e-f3ab-42c7-8859-1c75edd0d967'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.829889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2d28b91129f04edd9f4394634ddadcd1', 'request_id': 'req-f7078e1e-f3ab-42c7-8859-1c75edd0d967'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:54.836286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3724/7438] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:54 2022] DELETE /identity/v3/domains/2d28b91129f04edd9f4394634ddadcd1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:25:54.841006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:54.852812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa9648-7f26-4e34-ac29-7e4ddfe04259 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:54.913670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:54.914366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:54.914651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:54.914929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:54.915626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:54.917246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:55.127841 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3715/7439] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:25:54 2022] POST /identity/v3/domains => generated 278 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:55.131086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:55.133010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:55.148485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7078e1e-f3ab-42c7-8859-1c75edd0d967 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:55.221554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:55.222305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:55.222602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:55.223513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/abd9083ce6134a3483a09773fb9652cf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:55.235354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=abd9083ce6134a3483a09773fb9652cf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:55.237019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:55.264360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.265192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.505372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.506109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.511429 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3725/7440] 10.222.0.20 () {60 vars in 1250 bytes} [Tue Sep 6 11:25:55 2022] PATCH /identity/v3/domains/abd9083ce6134a3483a09773fb9652cf => generated 279 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:25:55.512570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:55.514380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:55.527976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7d424-d5ac-4fca-9939-6730f404f476 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:55.591530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:55.592402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:55.592799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:55.593536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/abd9083ce6134a3483a09773fb9652cf` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:55.609855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=abd9083ce6134a3483a09773fb9652cf)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:55.611669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:55.616410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3716/7441] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:25:55 2022] GET /identity/v3/domains/abd9083ce6134a3483a09773fb9652cf => generated 279 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:25:55.617750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:55.626146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:55.632483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc5516-07ac-49b3-9508-f1c2542bb4d7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:55.637383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:55.638022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:55.638314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:55.638590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/abd9083ce6134a3483a09773fb9652cf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:55.639851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=abd9083ce6134a3483a09773fb9652cf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:55.641665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:55.669502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.681568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.819514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf', 'request_id': 'req-4f003512-e0cc-4bf8-bfc8-af0811f82d99'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.826920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf', 'request_id': 'req-4f003512-e0cc-4bf8-bfc8-af0811f82d99'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.832977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf', 'request_id': 'req-4f003512-e0cc-4bf8-bfc8-af0811f82d99'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.958939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project abd9083ce6134a3483a09773fb9652cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:55.959330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.960283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.976178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf', 'request_id': 'req-4f003512-e0cc-4bf8-bfc8-af0811f82d99'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.976178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf', 'request_id': 'req-4f003512-e0cc-4bf8-bfc8-af0811f82d99'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.976178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'abd9083ce6134a3483a09773fb9652cf', 'request_id': 'req-4f003512-e0cc-4bf8-bfc8-af0811f82d99'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:55.982876 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3726/7442] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:55 2022] DELETE /identity/v3/domains/abd9083ce6134a3483a09773fb9652cf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:55.988512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:55.991380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:56.005745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afbc12-40dc-4b25-9e0c-4313255cd847 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.038161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:56.096364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.097900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.097900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.097900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.098892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:56.101037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:56.124499 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3717/7443] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 11:25:55 2022] GET /identity/v3/domains => generated 1344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:56.125771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:56.137167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f003512-e0cc-4bf8-bfc8-af0811f82d99 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.142492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.143173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.143730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.144013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/abd9083ce6134a3483a09773fb9652cf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.153213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find domain: abd9083ce6134a3483a09773fb9652cf.: keystone.exception.DomainNotFound: Could not find domain: abd9083ce6134a3483a09773fb9652cf. Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: abd9083ce6134a3483a09773fb9652cf. Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:56.158736 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:56.167698 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: abd9083ce6134a3483a09773fb9652cf. Sep 06 11:25:56.168918 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:56.170133 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3727/7444] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:56 2022] PATCH /identity/v3/domains/abd9083ce6134a3483a09773fb9652cf => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:56.170213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:56.181340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4e56-83bd-4d39-b6d0-28882ee16c21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.186751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.187422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.187708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.187992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.188650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:56.190271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:56.275364 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3718/7445] 10.222.0.20 () {60 vars in 1149 bytes} [Tue Sep 6 11:25:56 2022] POST /identity/v3/domains => generated 273 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:56.280031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:56.293001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d713f-52be-4ce8-b134-d8cb37766509 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.359641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.360286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.360577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.360883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.361523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:56.363550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:56.470990 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3728/7446] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:25:56 2022] POST /identity/v3/users => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:56.472198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:56.484426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb429fe-1275-430b-901f-c57b7ce45f21 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.491386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.492185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.492478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.492819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/groups` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.493453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:56.495424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:56.580381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3719/7447] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 11:25:56 2022] POST /identity/v3/groups => generated 324 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:25:56.584888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:56.595280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59645bcf-9522-4bea-91a0-c7ef5460eeb7 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.601006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.601614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.601904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.602182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/8783409dc05b4a3faa787697674d272a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.603491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8783409dc05b4a3faa787697674d272a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:56.605162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:56.627758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8783409dc05b4a3faa787697674d272a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:56.628479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8783409dc05b4a3faa787697674d272a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:56.763534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8783409dc05b4a3faa787697674d272a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:56.764223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8783409dc05b4a3faa787697674d272a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:56.766762 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3729/7448] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:56 2022] PATCH /identity/v3/domains/8783409dc05b4a3faa787697674d272a => generated 274 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:56.771070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:56.772805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:56.786073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d0a6-73ca-4b15-a917-cbd71cb2694d tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:56.848872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:56.849852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:56.850140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:56.850416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/8783409dc05b4a3faa787697674d272a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:56.863165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8783409dc05b4a3faa787697674d272a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:56.867814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:56.888228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8783409dc05b4a3faa787697674d272a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:56.891700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8783409dc05b4a3faa787697674d272a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:56.997809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:57.010707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:57.132729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c547152f6a8a4f57837ef6ca21f8e2b4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.142250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c547152f6a8a4f57837ef6ca21f8e2b4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.142979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c547152f6a8a4f57837ef6ca21f8e2b4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.143894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c547152f6a8a4f57837ef6ca21f8e2b4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.161421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c547152f6a8a4f57837ef6ca21f8e2b4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.373063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8783409dc05b4a3faa787697674d272a', 'request_id': 'req-7eb29934-2674-40ba-9dbc-3fbf873d97c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.379272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8783409dc05b4a3faa787697674d272a', 'request_id': 'req-7eb29934-2674-40ba-9dbc-3fbf873d97c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.386017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8783409dc05b4a3faa787697674d272a', 'request_id': 'req-7eb29934-2674-40ba-9dbc-3fbf873d97c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.465151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project 8783409dc05b4a3faa787697674d272a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:57.465781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.466556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.475899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8783409dc05b4a3faa787697674d272a', 'request_id': 'req-7eb29934-2674-40ba-9dbc-3fbf873d97c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.476792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8783409dc05b4a3faa787697674d272a', 'request_id': 'req-7eb29934-2674-40ba-9dbc-3fbf873d97c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.480979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8783409dc05b4a3faa787697674d272a', 'request_id': 'req-7eb29934-2674-40ba-9dbc-3fbf873d97c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:57.486832 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3720/7449] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:56 2022] DELETE /identity/v3/domains/8783409dc05b4a3faa787697674d272a => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:57.491332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.502725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841875-4b52-4181-b328-08a1ca56e8ee tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.564104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.564754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.565044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.565327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/8783409dc05b4a3faa787697674d272a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.572707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=8783409dc05b4a3faa787697674d272a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.574600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find domain: 8783409dc05b4a3faa787697674d272a.: keystone.exception.DomainNotFound: Could not find domain: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:57.587748 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:57.589103 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:57.590395 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3730/7450] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:25:57 2022] GET /identity/v3/domains/8783409dc05b4a3faa787697674d272a => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:57.593592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.595270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:57.609028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb29934-2674-40ba-9dbc-3fbf873d97c1 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.614205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.614995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.615460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.615842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/users/c547152f6a8a4f57837ef6ca21f8e2b4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.629338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:get_user(user_id=c547152f6a8a4f57837ef6ca21f8e2b4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.631469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find user: c547152f6a8a4f57837ef6ca21f8e2b4.: keystone.exception.UserNotFound: Could not find user: c547152f6a8a4f57837ef6ca21f8e2b4. Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 11:25:57.643814 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:57.645731 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c547152f6a8a4f57837ef6ca21f8e2b4. Sep 06 11:25:57.646882 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:57.650423 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3721/7451] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 11:25:57 2022] GET /identity/v3/users/c547152f6a8a4f57837ef6ca21f8e2b4 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:57.651305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.662362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b22e5a-01cf-43a2-a3b4-bbf814f41a40 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.668554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.669194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.669481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.669937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/groups/39cd92d80cee4c05a095f4a5b728ac42` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.675003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:get_group(group_id=39cd92d80cee4c05a095f4a5b728ac42)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.676171 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:25:57.676171 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:25:57.676171 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:25:57.677387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find group: 39cd92d80cee4c05a095f4a5b728ac42.: keystone.exception.GroupNotFound: Could not find group: 39cd92d80cee4c05a095f4a5b728ac42. Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_group(group_id) Sep 06 11:25:57.702480 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:57.703854 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 39cd92d80cee4c05a095f4a5b728ac42. Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:57.704898 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3731/7452] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:57 2022] GET /identity/v3/groups/39cd92d80cee4c05a095f4a5b728ac42 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:57.708637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.718913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5dc9-5830-4b69-a624-a07e0307ee19 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.725356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.731097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.731097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.731097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/groups/39cd92d80cee4c05a095f4a5b728ac42` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.731986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find group: 39cd92d80cee4c05a095f4a5b728ac42.: keystone.exception.GroupNotFound: Could not find group: 39cd92d80cee4c05a095f4a5b728ac42. Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Sep 06 11:25:57.738179 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:57.739448 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 39cd92d80cee4c05a095f4a5b728ac42. Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:57.744036 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3722/7453] 10.222.0.20 () {58 vars in 1227 bytes} [Tue Sep 6 11:25:57 2022] DELETE /identity/v3/groups/39cd92d80cee4c05a095f4a5b728ac42 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:57.746016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.754810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd338-172d-4c4e-99fb-6734101773d6 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.759524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.760148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.760432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.760707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/users/c547152f6a8a4f57837ef6ca21f8e2b4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.769335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c547152f6a8a4f57837ef6ca21f8e2b4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.772023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find user: c547152f6a8a4f57837ef6ca21f8e2b4.: keystone.exception.UserNotFound: Could not find user: c547152f6a8a4f57837ef6ca21f8e2b4. Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Sep 06 11:25:57.784798 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:57.786572 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c547152f6a8a4f57837ef6ca21f8e2b4. Sep 06 11:25:57.788053 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:25:57.791317 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3732/7454] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:57 2022] DELETE /identity/v3/users/c547152f6a8a4f57837ef6ca21f8e2b4 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:57.792772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.804455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d78f4-9eb6-4002-ac6b-cffe84bfe921 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.809282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.809906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.810192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.810469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/8783409dc05b4a3faa787697674d272a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.818289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find domain: 8783409dc05b4a3faa787697674d272a.: keystone.exception.DomainNotFound: Could not find domain: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:57.824080 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:57.825337 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:57.826953 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:57.830116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3723/7455] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:57 2022] PATCH /identity/v3/domains/8783409dc05b4a3faa787697674d272a => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 06 11:25:57.831243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.843451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48977-5334-41ad-9941-15817d4a3f7c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.848220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.848834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.849121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.849542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.850166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.851815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.867169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3733/7456] 10.222.0.20 () {58 vars in 1128 bytes} [Tue Sep 6 11:25:57 2022] GET /identity/v3/domains => generated 1344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:57.870728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.887163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29338a9e-f4b2-45b2-8413-79ad9c24b592 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.892057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.892688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.892978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.893256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.894251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:25:57.894561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.896960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.917116 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3724/7457] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:25:57 2022] GET /identity/v3/domains?enabled=True => generated 1092 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:25:57.922097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.933447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492238-d19a-44d9-abf9-413140150471 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.939521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.940120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.940386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.940665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.942248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-60125974) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:25:57.942561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:57.944333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:57.957107 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3734/7458] 10.222.0.20 () {58 vars in 1195 bytes} [Tue Sep 6 11:25:57 2022] GET /identity/v3/domains?name=tempest-test_domain-60125974 => generated 404 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:57.962978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:57.970109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:57.973946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8ad98-51ed-4b4c-b68e-a9f16b21f885 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:57.979209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:57.979861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:57.980149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:57.980428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/8783409dc05b4a3faa787697674d272a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:57.992126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Could not find domain: 8783409dc05b4a3faa787697674d272a.: keystone.exception.DomainNotFound: Could not find domain: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:25:58.005465 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:25:58.011866 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application with Lock( Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8783409dc05b4a3faa787697674d272a. Sep 06 11:25:58.013074 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:25:58.014335 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3725/7459] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:57 2022] PATCH /identity/v3/domains/8783409dc05b4a3faa787697674d272a => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:25:58.014437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:58.023318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf6b32-14cf-4c4f-b873-ac3ed34d642a tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:58.028266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:58.028813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:58.029310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:58.029521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/dd1c7890aca041069c457d3d6d9dbd94` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:58.043723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dd1c7890aca041069c457d3d6d9dbd94)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:58.045571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:58.092857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3735/7460] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:58 2022] PATCH /identity/v3/domains/dd1c7890aca041069c457d3d6d9dbd94 => generated 276 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:58.097591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:58.109476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2c0cb-0738-4c96-9555-304868c5984c tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:58.115391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:58.116016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:58.116302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:58.116576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/dd1c7890aca041069c457d3d6d9dbd94` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:58.128640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dd1c7890aca041069c457d3d6d9dbd94)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:58.130842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:58.154467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.158128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.257855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94', 'request_id': 'req-807cb1d4-8efc-451a-9378-27306efd115e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.263809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94', 'request_id': 'req-807cb1d4-8efc-451a-9378-27306efd115e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.271428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94', 'request_id': 'req-807cb1d4-8efc-451a-9378-27306efd115e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.362856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project dd1c7890aca041069c457d3d6d9dbd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:58.364035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.364966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.376255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94', 'request_id': 'req-807cb1d4-8efc-451a-9378-27306efd115e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.380764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94', 'request_id': 'req-807cb1d4-8efc-451a-9378-27306efd115e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.404426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dd1c7890aca041069c457d3d6d9dbd94', 'request_id': 'req-807cb1d4-8efc-451a-9378-27306efd115e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.412953 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3726/7461] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:58 2022] DELETE /identity/v3/domains/dd1c7890aca041069c457d3d6d9dbd94 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:58.416969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:58.418691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:58.433774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191622e-d3f7-4075-8c11-e663dc9c6116 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:58.489466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:58.552153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:58.553485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:58.553932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:58.554402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/e126a14892d74421ba74fbb6b51918b1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:58.569873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e126a14892d74421ba74fbb6b51918b1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:58.571778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:58.613444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.615064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.718854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.719463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.722469 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3736/7462] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:58 2022] PATCH /identity/v3/domains/e126a14892d74421ba74fbb6b51918b1 => generated 277 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:58.727042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:58.741518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cb1d4-8efc-451a-9378-27306efd115e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:58.818848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:58.819443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:58.819725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:58.820000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/e126a14892d74421ba74fbb6b51918b1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:58.836532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e126a14892d74421ba74fbb6b51918b1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:58.838688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:58.866975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:58.871607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:58.876518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.021107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1', 'request_id': 'req-ea856743-565f-431a-94f6-7c508f58369e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.026855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1', 'request_id': 'req-ea856743-565f-431a-94f6-7c508f58369e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.035967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1', 'request_id': 'req-ea856743-565f-431a-94f6-7c508f58369e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.118096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project e126a14892d74421ba74fbb6b51918b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:59.118735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.119649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.128767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1', 'request_id': 'req-ea856743-565f-431a-94f6-7c508f58369e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.130049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1', 'request_id': 'req-ea856743-565f-431a-94f6-7c508f58369e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.133734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e126a14892d74421ba74fbb6b51918b1', 'request_id': 'req-ea856743-565f-431a-94f6-7c508f58369e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.140040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3727/7463] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:58 2022] DELETE /identity/v3/domains/e126a14892d74421ba74fbb6b51918b1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:25:59.144570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:59.146920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:59.162314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723532d-9098-47d5-a99a-10710cb549c4 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:59.237379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:59.238184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:59.239161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:59.240428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/cc4a33f0f9834a2b8b02ea5bfe478321` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:59.255303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cc4a33f0f9834a2b8b02ea5bfe478321)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:59.257046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:59.286879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.287857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.453294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.454333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.457494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3737/7464] 10.222.0.20 () {60 vars in 1249 bytes} [Tue Sep 6 11:25:59 2022] PATCH /identity/v3/domains/cc4a33f0f9834a2b8b02ea5bfe478321 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:25:59.461914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:59.464344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:59.479551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856743-565f-431a-94f6-7c508f58369e tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:59.552349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0d8608893b40d9b166d8c25465930d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33dd5fd52de245c48d3834130aa2ba1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:59.553011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:59.553296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:59.553572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] PATH_INFO: `/v3/domains/cc4a33f0f9834a2b8b02ea5bfe478321` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:59.565626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cc4a33f0f9834a2b8b02ea5bfe478321)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:59.567359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:59.595507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.597458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:25:59.599856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:25:59.610862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.658185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:59.685827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d80ce-a4a9-4d3a-87ab-df40324794c0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:25:59.693577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:25:59.693577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:25:59.693577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:25:59.693577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] PATH_INFO: `/v3/users/bef4a21849d7469187177b3fd2425f90` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:25:59.694046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef4a21849d7469187177b3fd2425f90)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:25:59.695668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:25:59.752193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:25:59.770138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321', 'request_id': 'req-3febb1dc-0d03-415c-a23b-1255926f63a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.777572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321', 'request_id': 'req-3febb1dc-0d03-415c-a23b-1255926f63a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.784867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321', 'request_id': 'req-3febb1dc-0d03-415c-a23b-1255926f63a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.961431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] The token cache is being invalidate because project cc4a33f0f9834a2b8b02ea5bfe478321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:25:59.961817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.962428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:25:59.972023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321', 'request_id': 'req-3febb1dc-0d03-415c-a23b-1255926f63a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.031720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321', 'request_id': 'req-3febb1dc-0d03-415c-a23b-1255926f63a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.031720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cc4a33f0f9834a2b8b02ea5bfe478321', 'request_id': 'req-3febb1dc-0d03-415c-a23b-1255926f63a0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.031720 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3728/7465] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:25:59 2022] DELETE /identity/v3/domains/cc4a33f0f9834a2b8b02ea5bfe478321 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:00.031720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:00.032218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.070989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febb1dc-0d03-415c-a23b-1255926f63a0 tempest-DomainsTestJSON-1799029615 tempest-DomainsTestJSON-1799029615-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:00.076412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:00.077082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:00.077372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:00.077643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] PATH_INFO: `/v3/users/f9cfcbadc17b42178214ffea2c20dda9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:00.078808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cfcbadc17b42178214ffea2c20dda9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:00.080795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:00.122124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef4a21849d7469187177b3fd2425f90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.130872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef4a21849d7469187177b3fd2425f90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.131689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef4a21849d7469187177b3fd2425f90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.145533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef4a21849d7469187177b3fd2425f90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.146432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-92a3ae36-edb3-458d-a9ab-9e8cb0a165a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef4a21849d7469187177b3fd2425f90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.238330 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3738/7466] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:59 2022] DELETE /identity/v3/users/bef4a21849d7469187177b3fd2425f90 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:00.243919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:00.244555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:00.245019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:00.271266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:00.272522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.337305 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3739/7467] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:00.342620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cfcbadc17b42178214ffea2c20dda9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.348435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:00.350400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.352401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cfcbadc17b42178214ffea2c20dda9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.353159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cfcbadc17b42178214ffea2c20dda9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.354047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cfcbadc17b42178214ffea2c20dda9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.368604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cfcbadc17b42178214ffea2c20dda9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:00.423882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79581611-b0a2-4f3d-9787-a7ccb0d3c714 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:00.429480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:00.430317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:00.430706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:00.430997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:00.433316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.454517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:00.454517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e37f-b20f-407d-819f-b5828e8d58b3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:00.464204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:00.473699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3740/7468] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:00.484782 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3729/7469] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:25:59 2022] DELETE /identity/v3/users/f9cfcbadc17b42178214ffea2c20dda9 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:00.489746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:00.490086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:00.490459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:00.513414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:00.514753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.584337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3741/7470] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:00.599648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:00.599859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.634614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:00.679184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505d9a8-593b-4981-abd8-c166cc9abbef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:00.682971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:00.683611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:00.683930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:00.684277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:00.694283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:00.695821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:00.705815 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3730/7471] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:00.839354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:00.841220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:00.854880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea68a71-fa1f-4fd8-a85c-7f2916a99f36 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:00.860519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:00.861872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:00.861872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:00.861872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] PATH_INFO: `/v3/projects/1cb5703c3d154f74b1fe7a36f101bd95` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:00.863371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb5703c3d154f74b1fe7a36f101bd95)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:00.866409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:01.026730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb5703c3d154f74b1fe7a36f101bd95', 'request_id': 'req-639aca64-2823-45e9-933f-9960c604c05b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.048473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb5703c3d154f74b1fe7a36f101bd95', 'request_id': 'req-639aca64-2823-45e9-933f-9960c604c05b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.063134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb5703c3d154f74b1fe7a36f101bd95', 'request_id': 'req-639aca64-2823-45e9-933f-9960c604c05b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.154156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] The token cache is being invalidate because project 1cb5703c3d154f74b1fe7a36f101bd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:01.154550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.155287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.156861 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3742/7472] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:00 2022] DELETE /identity/v3/projects/1cb5703c3d154f74b1fe7a36f101bd95 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:01.160859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:01.171881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de61a-ab2b-44bd-b12d-40e332b68cdc service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:01.237589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:01.244741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:01.249580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:01.250459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:01.250754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:01.251121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] PATH_INFO: `/v3/users/5629fae8487c44388a8fbcaa04140095` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:01.252362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5629fae8487c44388a8fbcaa04140095)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:01.255445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:01.273920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aca64-2823-45e9-933f-9960c604c05b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:01.284150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:01.287672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:01.287672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:01.287672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] PATH_INFO: `/v3/projects/c6c0afd04d98432e8108be7bec9d50ad` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:01.288094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c0afd04d98432e8108be7bec9d50ad)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:01.290799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:01.476592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5629fae8487c44388a8fbcaa04140095'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.479449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c0afd04d98432e8108be7bec9d50ad', 'request_id': 'req-f206bae1-ddcc-408a-a718-0d425bb37e2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.484114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5629fae8487c44388a8fbcaa04140095'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.484860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5629fae8487c44388a8fbcaa04140095'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.485472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5629fae8487c44388a8fbcaa04140095'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.485853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c0afd04d98432e8108be7bec9d50ad', 'request_id': 'req-f206bae1-ddcc-408a-a718-0d425bb37e2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.492206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c0afd04d98432e8108be7bec9d50ad', 'request_id': 'req-f206bae1-ddcc-408a-a718-0d425bb37e2b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.498382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5629fae8487c44388a8fbcaa04140095'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.637749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] The token cache is being invalidate because project c6c0afd04d98432e8108be7bec9d50ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:01.638208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.638957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:01.640543 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3743/7473] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:01 2022] DELETE /identity/v3/projects/c6c0afd04d98432e8108be7bec9d50ad => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:01.644757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:01.646182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:01.656614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:01.715262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206bae1-ddcc-408a-a718-0d425bb37e2b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:01.719988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:01.720619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:01.720904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:01.721243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] PATH_INFO: `/v3/users/ad0d8608893b40d9b166d8c25465930d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:01.722433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0d8608893b40d9b166d8c25465930d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:01.724954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:01.822342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3731/7474] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:01 2022] DELETE /identity/v3/users/5629fae8487c44388a8fbcaa04140095 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:02.056813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0d8608893b40d9b166d8c25465930d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.063899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0d8608893b40d9b166d8c25465930d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.064673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0d8608893b40d9b166d8c25465930d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.076759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0d8608893b40d9b166d8c25465930d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.078371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6363e7b6-f57c-4433-a80f-d2dd47027fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0d8608893b40d9b166d8c25465930d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.155804 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3744/7475] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:01 2022] DELETE /identity/v3/users/ad0d8608893b40d9b166d8c25465930d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:02.155987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:02.156895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:02.227153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:02.251650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461063f8-df47-42c1-a721-87a11e14a224 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:02.315537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:02.316171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.316998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.317275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] PATH_INFO: `/v3/projects/0af345cd62774ccaa6b5c8570f7989b6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.318391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af345cd62774ccaa6b5c8570f7989b6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:02.320321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:02.461838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af345cd62774ccaa6b5c8570f7989b6', 'request_id': 'req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.467309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af345cd62774ccaa6b5c8570f7989b6', 'request_id': 'req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.474537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af345cd62774ccaa6b5c8570f7989b6', 'request_id': 'req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.563299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] The token cache is being invalidate because project 0af345cd62774ccaa6b5c8570f7989b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:02.563611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.564284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.565881 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3732/7476] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:02 2022] DELETE /identity/v3/projects/0af345cd62774ccaa6b5c8570f7989b6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:02.571578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3290a-ed5f-42a6-b3e7-efcf8a47fc47 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.571878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3290a-ed5f-42a6-b3e7-efcf8a47fc47 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.572184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3290a-ed5f-42a6-b3e7-efcf8a47fc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.598540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-50e3290a-ed5f-42a6-b3e7-efcf8a47fc47 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:02.599333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:02.600129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-50e3290a-ed5f-42a6-b3e7-efcf8a47fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:02.601289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:02.677538 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3745/7477] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:02.681615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.681904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.682824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.686189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa342a6-22ba-41b7-9fa2-da07c6f10d8c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:02.691356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:02.692058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.695272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.695272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] PATH_INFO: `/v3/projects/33dd5fd52de245c48d3834130aa2ba1e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.695272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dd5fd52de245c48d3834130aa2ba1e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:02.696079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:02.703791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:02.704996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:02.715407 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3746/7478] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:02.719994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:02.730424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9e418-25c7-4e62-9db7-b001c1e5b477 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:02.735152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:02.735748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.736028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.736309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.736967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:02.737274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:02.738969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:02.751427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3747/7479] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:02.756211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:02.766181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3683bf-a013-4108-aed1-dbca16293ebe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:02.772131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:02.772843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.773124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.773403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.774025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:02.776096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:02.781659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:02.839511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dd5fd52de245c48d3834130aa2ba1e', 'request_id': 'req-9afd543b-5d97-4456-a879-de3cd8446d53'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.845058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dd5fd52de245c48d3834130aa2ba1e', 'request_id': 'req-9afd543b-5d97-4456-a879-de3cd8446d53'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.852868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dd5fd52de245c48d3834130aa2ba1e', 'request_id': 'req-9afd543b-5d97-4456-a879-de3cd8446d53'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.896840 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3748/7480] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:02 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:02.901305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:02.917910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:02.964493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] The token cache is being invalidate because project 33dd5fd52de245c48d3834130aa2ba1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:02.964904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.965499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948a77-bc2f-4248-8009-05bdbc371b84 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:02.965937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9afd543b-5d97-4456-a879-de3cd8446d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:02.971268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3733/7481] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:02 2022] DELETE /identity/v3/projects/33dd5fd52de245c48d3834130aa2ba1e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:02.971414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:02.971414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.971414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.971735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.972156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:02.974037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56542e96-9288-424c-976a-7183fa887f56 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:02.974613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56542e96-9288-424c-976a-7183fa887f56 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:02.974842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:02.975035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56542e96-9288-424c-976a-7183fa887f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:02.998649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-56542e96-9288-424c-976a-7183fa887f56 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:02.999922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-56542e96-9288-424c-976a-7183fa887f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:03.009763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3734/7482] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:03.021936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.022223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.022500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.043536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:03.047155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:03.055363 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3735/7483] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:03.059712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.070425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbfb20-04df-43ab-a08d-92e58c66afe0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.075151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.075780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.076060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.076336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.076991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:03.077299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.078921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.091120 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3736/7484] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:26:03.095324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.106141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00790a88-feea-4c8b-8327-7d360697b43d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.111054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.111666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.111946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.112219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.112834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.115455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.206544 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3749/7485] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:02 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:03.207762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.210097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:03.224601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c09ab-54cf-464e-a488-dcf62fe0d465 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.233833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.234302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.234583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.234865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.235559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.237196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.240337 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3737/7486] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:03 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:03.241367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.249960 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3750/7487] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:03.254319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.267375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5763fa4-e16e-48f8-a7de-e25259314c08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.322373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fa113-516c-47ea-95e4-e73c21a77ab5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.328717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.329427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.329737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.330021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.330789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.332845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.336433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.337293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.337742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.338186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.339021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.340868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.353184 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3751/7488] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:03.357742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.374370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa72d-a6db-4390-b17d-1208a6cf4096 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.376723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588320de-b910-4f2c-aa46-09fa59f3cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.377388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588320de-b910-4f2c-aa46-09fa59f3cfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.377689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588320de-b910-4f2c-aa46-09fa59f3cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.377990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588320de-b910-4f2c-aa46-09fa59f3cfd2 admin admin] PATH_INFO: `/v3/projects/6626671896c94e2b9d2bd4b095044dca/users/d9b5e99ee98847ee9b34d381d24dd6bc/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.397633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588320de-b910-4f2c-aa46-09fa59f3cfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6626671896c94e2b9d2bd4b095044dca, user_id=d9b5e99ee98847ee9b34d381d24dd6bc, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.400502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588320de-b910-4f2c-aa46-09fa59f3cfd2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.479273 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3738/7489] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:03 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:03.483867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.494380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62a861-cb8b-4409-b9b1-bd46ef6aa8c9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.499337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.500125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.500406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.500705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.501343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.503547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.518283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3739/7490] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:03.521512 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3752/7491] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:03 2022] PUT /identity/v3/projects/6626671896c94e2b9d2bd4b095044dca/users/d9b5e99ee98847ee9b34d381d24dd6bc/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:03.524589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.531982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.532279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.532562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.536411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076b946-f218-4f28-9298-1e33979855db admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.562603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] MFA Rules not processed for user `d9b5e99ee98847ee9b34d381d24dd6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:03.563877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:03.596006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.600805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.600805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.600805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.600805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.600805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.610922 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3740/7492] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:03.615269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.625372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b00d2b-ff1f-4259-b8f2-47582ea9d29b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.631704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872722e-e5ab-4c86-ac0f-bdecaba51113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.632504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872722e-e5ab-4c86-ac0f-bdecaba51113 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.632787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872722e-e5ab-4c86-ac0f-bdecaba51113 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.633096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872722e-e5ab-4c86-ac0f-bdecaba51113 admin admin] PATH_INFO: `/v3/projects/d27b7177182842a9b696ca62b427329b/users/f212c9050aec4cf9b7041551397b1854/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.638264 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3753/7493] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:03.650055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.651159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872722e-e5ab-4c86-ac0f-bdecaba51113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27b7177182842a9b696ca62b427329b, user_id=f212c9050aec4cf9b7041551397b1854, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.653512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:03.653889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872722e-e5ab-4c86-ac0f-bdecaba51113 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.672535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:03.715645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9baa31-6b3b-4679-a47d-7ced0ad99f49 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.719610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.720262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.720551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.720829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.731799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.733039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3741/7494] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:03 2022] PUT /identity/v3/projects/d27b7177182842a9b696ca62b427329b/users/f212c9050aec4cf9b7041551397b1854/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:03.733190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:03.743054 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3754/7495] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:03.744470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.750734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.750734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.775259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] MFA Rules not processed for user `f212c9050aec4cf9b7041551397b1854`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:03.776492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:03.792070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:03.844123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3742/7496] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:03.848667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:03.859748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8320e9-abfb-45a2-a85f-5a0aeed5ce5d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:03.921464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:03.922128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:03.922421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:03.922699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:03.923396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:03.925414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.059405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3755/7497] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:03 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:04.060912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.074044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7833c6-d9f2-4a89-850a-bb95b3db6f6d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.137250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.137882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.138157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.138716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.139100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.141450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.249801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3743/7498] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:04 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:04.253669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.265145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c3cc8-e9fc-4c77-a710-1991d63c3857 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.270099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.270701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.270986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.271293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.271926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.273521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.288413 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3756/7499] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:04.289436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.300388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784fd41-0cb3-431f-9eb2-c6170c778c72 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.305822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.306494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.306782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.307091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] PATH_INFO: `/v3/projects/493192d12b4d4a6ba25657a8dc6e7e43/users/6494181519b94f29a8c901770c2ad769/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.324381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=493192d12b4d4a6ba25657a8dc6e7e43, user_id=6494181519b94f29a8c901770c2ad769, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.327221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.421371 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3744/7500] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:04 2022] PUT /identity/v3/projects/493192d12b4d4a6ba25657a8dc6e7e43/users/6494181519b94f29a8c901770c2ad769/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:04.425423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.437762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d8cbc-d181-4ed7-833a-667cdcefacd8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.498961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:04.522466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4197b06-3a9c-4aca-9e3f-e95b33235390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.523192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4197b06-3a9c-4aca-9e3f-e95b33235390 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.523545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4197b06-3a9c-4aca-9e3f-e95b33235390 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.524028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4197b06-3a9c-4aca-9e3f-e95b33235390 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.524751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4197b06-3a9c-4aca-9e3f-e95b33235390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.526336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4197b06-3a9c-4aca-9e3f-e95b33235390 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.537085 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3757/7501] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:04.541155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.552960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70ec21-fac8-4466-9378-1af85625ef8b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.558160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.558818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.559138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.559420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] PATH_INFO: `/v3/projects/493192d12b4d4a6ba25657a8dc6e7e43/users/6494181519b94f29a8c901770c2ad769/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.561434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] RBAC: Authorizing `identity:create_grant(project_id=493192d12b4d4a6ba25657a8dc6e7e43, user_id=6494181519b94f29a8c901770c2ad769, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.564081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.567269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:04.575925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3745/7502] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:04 2022] PUT /identity/v3/projects/493192d12b4d4a6ba25657a8dc6e7e43/users/6494181519b94f29a8c901770c2ad769/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:04.587534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.587934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.588219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.617676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] MFA Rules not processed for user `6494181519b94f29a8c901770c2ad769`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:04.618981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:04.697104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3758/7503] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:04.705447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.717157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a739dee-e2ec-437a-8985-76c8b93d117b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.724309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.724977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.725331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.725550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.726523 ncdv-master-1 devstack@keystone.service[92878]: WARNING oslo_log.versionutils [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:04.727032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.730752 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:04.730752 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:26:04.730752 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:26:04.730752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.809089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3746/7504] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:26:04 2022] POST /identity/v3/policies => generated 229 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:04.813048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.825576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d31c-17b5-48af-94ae-41e8b0decdcb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.831677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.834158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.834454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.834732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies/ffda9fdb990f4784bd92be67ee080bae` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.835762 ncdv-master-1 devstack@keystone.service[92879]: WARNING oslo_log.versionutils [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:04.836266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=ffda9fdb990f4784bd92be67ee080bae)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.837624 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:04.837624 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:26:04.837624 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:26:04.838515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:04.956556 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3759/7505] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Sep 6 11:26:04 2022] PATCH /identity/v3/policies/ffda9fdb990f4784bd92be67ee080bae => generated 236 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:04.962507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:04.974855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd432-7974-43a8-b6b5-d21acbef8d35 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:04.986808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:04.987609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:04.987883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:04.988161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies/ffda9fdb990f4784bd92be67ee080bae` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:04.989768 ncdv-master-1 devstack@keystone.service[92878]: WARNING oslo_log.versionutils [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:04.990436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=ffda9fdb990f4784bd92be67ee080bae)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:04.991783 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:04.991783 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:26:04.991783 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:26:04.993366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.003068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3747/7506] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:26:04 2022] GET /identity/v3/policies/ffda9fdb990f4784bd92be67ee080bae => generated 236 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:05.008172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.022713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222641d-4ba5-4164-a7df-71daca90b40c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.026763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.027445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.027735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.028015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies/ffda9fdb990f4784bd92be67ee080bae` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.028795 ncdv-master-1 devstack@keystone.service[92879]: WARNING oslo_log.versionutils [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:05.029356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ffda9fdb990f4784bd92be67ee080bae)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.030603 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:05.030603 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:26:05.030603 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:26:05.031517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.141598 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3760/7507] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:05 2022] DELETE /identity/v3/policies/ffda9fdb990f4784bd92be67ee080bae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:05.148573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.159681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc74d-1640-4a78-9aec-c6dd0582c41a tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.165197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.165808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.166115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.166394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.167591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.169463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.262278 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3748/7508] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:26:05 2022] POST /identity/v3/policies => generated 229 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:05.278471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.298632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c16fb-6257-40fe-b6a0-8c752b51d40e tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.304426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.305201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.305545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.305825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.306881 ncdv-master-1 devstack@keystone.service[92879]: WARNING oslo_log.versionutils [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:05.307440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.308677 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:05.308677 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:26:05.308677 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:26:05.309595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.439510 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3761/7509] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:26:05 2022] POST /identity/v3/policies => generated 230 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:05.444103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.457870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042646a-cf4f-4b81-a1fb-c90ff9568705 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.463740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.464689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.464820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.465153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.466647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.468613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.557050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3749/7510] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:26:05 2022] POST /identity/v3/policies => generated 228 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:05.561741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.579868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4b43e-6a59-4110-ae13-ae8529b05d2c tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.585467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.586156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.586456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.586775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.587679 ncdv-master-1 devstack@keystone.service[92879]: WARNING oslo_log.versionutils [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:05.588293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.589605 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:05.589605 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:26:05.589605 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:26:05.590631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.605583 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3762/7511] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:26:05 2022] GET /identity/v3/policies => generated 763 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:05.609811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.621982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7abbf7-2a06-464c-8be1-de8486461200 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.628619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.629825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.630224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.630518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies/ff094051e3574ed6b1351eb795341db1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.631353 ncdv-master-1 devstack@keystone.service[92878]: WARNING oslo_log.versionutils [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Sep 06 11:26:05.632146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ff094051e3574ed6b1351eb795341db1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.633584 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:05.633584 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:26:05.633584 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:26:05.634488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.760974 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3750/7512] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:05 2022] DELETE /identity/v3/policies/ff094051e3574ed6b1351eb795341db1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:05.767198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.784123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f5e34-0b64-4770-b75c-416d51647662 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.789981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.790674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.791505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.791505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies/576f3e8c0cc54aebafa9e3df10cbc1d5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.792525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=576f3e8c0cc54aebafa9e3df10cbc1d5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.794724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:05.926039 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3763/7513] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:05 2022] DELETE /identity/v3/policies/576f3e8c0cc54aebafa9e3df10cbc1d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:05.931180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:05.944339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d0194-4742-4678-8fda-2566f702a704 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:05.949406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e3404-c62f-47cd-ac84-0b4a3d89ac31 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6494181519b94f29a8c901770c2ad769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '493192d12b4d4a6ba25657a8dc6e7e43', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:05.950512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e3404-c62f-47cd-ac84-0b4a3d89ac31 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:05.950748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e3404-c62f-47cd-ac84-0b4a3d89ac31 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:05.951048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e3404-c62f-47cd-ac84-0b4a3d89ac31 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] PATH_INFO: `/v3/policies/829d998c64d64cc89350573bd13017bb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:05.952372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e3404-c62f-47cd-ac84-0b4a3d89ac31 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=829d998c64d64cc89350573bd13017bb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:05.955960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e3404-c62f-47cd-ac84-0b4a3d89ac31 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:06.086390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3751/7514] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:05 2022] DELETE /identity/v3/policies/829d998c64d64cc89350573bd13017bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:06.093404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:06.178073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:06.187030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7255c7-8e69-44f7-89fe-811ad9fad989 tempest-PoliciesTestJSON-886426725 tempest-PoliciesTestJSON-886426725-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:06.194091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:06.194812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:06.195137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:06.195424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] PATH_INFO: `/v3/users/f212c9050aec4cf9b7041551397b1854` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:06.196792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f212c9050aec4cf9b7041551397b1854)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:06.198990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:06.552023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f212c9050aec4cf9b7041551397b1854'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:06.564970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f212c9050aec4cf9b7041551397b1854'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:06.566219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f212c9050aec4cf9b7041551397b1854'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:06.583407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f212c9050aec4cf9b7041551397b1854'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:06.584350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f212c9050aec4cf9b7041551397b1854'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:06.690063 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3764/7515] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:06 2022] DELETE /identity/v3/users/f212c9050aec4cf9b7041551397b1854 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:06.696852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:06.699789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:06.700547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:06.754830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:06.759217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:06.826679 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3752/7516] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:06.836633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:06.838686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:06.934535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe70e-91d2-4fe1-b38f-ab92c983cbd5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:06.943811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:06.944702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:06.945620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:06.946056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:06.970001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:06.972213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:06.991774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3765/7517] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:07.722373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:07.725206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:07.752905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c974e-1c48-40ed-bce8-b82b03dae4a9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:07.760537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:07.761462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:07.762573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:07.763122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] PATH_INFO: `/v3/projects/d27b7177182842a9b696ca62b427329b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:07.765343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27b7177182842a9b696ca62b427329b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:07.768887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:07.955047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27b7177182842a9b696ca62b427329b', 'request_id': 'req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:07.972554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27b7177182842a9b696ca62b427329b', 'request_id': 'req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:07.997384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27b7177182842a9b696ca62b427329b', 'request_id': 'req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.090170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=5,keystone:SELECT=86,keystone:DELETE=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:08.097496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] The token cache is being invalidate because project d27b7177182842a9b696ca62b427329b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:08.098267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.100370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.106408 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3753/7518] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:07 2022] DELETE /identity/v3/projects/d27b7177182842a9b696ca62b427329b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:08.106635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:08.127453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce0280-673b-43b5-a5fc-bfa4b829acc5 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:08.262697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:08.267497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:08.267497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:08.267497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] PATH_INFO: `/v3/users/6494181519b94f29a8c901770c2ad769` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:08.267497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6494181519b94f29a8c901770c2ad769)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:08.268462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:08.334565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:08.667266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6494181519b94f29a8c901770c2ad769'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.676353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6494181519b94f29a8c901770c2ad769'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.677197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6494181519b94f29a8c901770c2ad769'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.693942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6494181519b94f29a8c901770c2ad769'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.695255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d0795647-e211-4abd-90c5-36fab2313d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6494181519b94f29a8c901770c2ad769'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:08.798191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3766/7519] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:08 2022] DELETE /identity/v3/users/6494181519b94f29a8c901770c2ad769 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:09.621627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:09.623956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:09.661551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b9ab5-b92c-49f2-9e8c-8b6256626f77 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:09.730783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:09.731464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:09.731750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:09.732031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] PATH_INFO: `/v3/projects/493192d12b4d4a6ba25657a8dc6e7e43` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:09.733157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493192d12b4d4a6ba25657a8dc6e7e43)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:09.735155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:09.928419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493192d12b4d4a6ba25657a8dc6e7e43', 'request_id': 'req-e1777d18-b989-4f61-a909-4377522c8669'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:09.936452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493192d12b4d4a6ba25657a8dc6e7e43', 'request_id': 'req-e1777d18-b989-4f61-a909-4377522c8669'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:09.947683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493192d12b4d4a6ba25657a8dc6e7e43', 'request_id': 'req-e1777d18-b989-4f61-a909-4377522c8669'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:10.030707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] The token cache is being invalidate because project 493192d12b4d4a6ba25657a8dc6e7e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:10.031234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:10.031977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e1777d18-b989-4f61-a909-4377522c8669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:10.035562 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3754/7520] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:09 2022] DELETE /identity/v3/projects/493192d12b4d4a6ba25657a8dc6e7e43 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:10.043299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.043299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.043299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.068001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:10.069228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:10.133936 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3767/7521] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:10.141811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.142190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.142554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.164306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:10.165540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:10.174229 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3755/7522] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:10.178659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:10.189833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b115071-64ce-4433-ad7c-aabfafd46469 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:10.196133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:10.196833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.197148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.197436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.198117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:10.198587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:10.200647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:10.220978 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3768/7523] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:10.226712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:10.242485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe8f6-4b40-414c-a74f-efd7db6f9570 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:10.250786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:10.251574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.251866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.252143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.253146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:10.255404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:10.400028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3756/7524] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:10 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:10.401217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:10.414297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88da4-7679-43e1-8ad6-39557b2ad3b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:10.497069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:10.498437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.500575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.501856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.501856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:10.505009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:10.635620 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3769/7525] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:10 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:10.639756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:10.652437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba218e17-6a99-4857-995f-f4b4bd2f1e70 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:10.658463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:10.659179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.661161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.661161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.661161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:10.662730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:10.675418 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3757/7526] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:10.680220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:10.694120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e497-e6a7-4f52-ad7c-3fe7274014ff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:10.698077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07ba2-ac7a-41da-8343-87a8b16ba57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:10.698892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07ba2-ac7a-41da-8343-87a8b16ba57d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.699212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07ba2-ac7a-41da-8343-87a8b16ba57d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.699498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07ba2-ac7a-41da-8343-87a8b16ba57d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.701249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c07ba2-ac7a-41da-8343-87a8b16ba57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:10.703181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c07ba2-ac7a-41da-8343-87a8b16ba57d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:10.720466 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3770/7527] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:10.725221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:10.737270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bdb1c-a29d-4fed-947e-102b0007d8c7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:10.744979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:10.746441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.746731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.747092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] PATH_INFO: `/v3/projects/3740cb6f07a84c3e9e2ec10679568e0e/users/2fead2e01f2d4a42a39592d2dcf9104a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.772252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3740cb6f07a84c3e9e2ec10679568e0e, user_id=2fead2e01f2d4a42a39592d2dcf9104a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:10.775200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:10.906893 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3758/7528] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:10 2022] PUT /identity/v3/projects/3740cb6f07a84c3e9e2ec10679568e0e/users/2fead2e01f2d4a42a39592d2dcf9104a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:10.920296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:10.920593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:10.920881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:10.928493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:10.953223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] MFA Rules not processed for user `2fead2e01f2d4a42a39592d2dcf9104a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:10.955707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:11.035474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3771/7529] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:11.040089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.069751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:11.103842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ead61-c478-4051-a99b-dd91b8295a88 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.108751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.109390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.109674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.109975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.110699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.112664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:11.278183 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3759/7530] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:11 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:11.279600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.292487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b2c45-11f0-43c4-abf7-8ff2360a9b2b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.373453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.373453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.373685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.373950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.374733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.376842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:11.515994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3772/7531] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:11 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:11.518368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.531043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db867b2-7cc1-4f3f-9026-087bb56234ca admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.538007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.539040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.539198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.539563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.540118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.541903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:11.555733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3760/7532] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:11.560111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.573842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b53b5-a2e4-45f1-b0ec-cc6b8a24b98f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.576871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.577572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.577857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.578164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] PATH_INFO: `/v3/projects/9525766c5eea4d68a1472c557c2cb534/users/7318aeb08e6d45f5baaa7cb6d6b978ab/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.594535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9525766c5eea4d68a1472c557c2cb534, user_id=7318aeb08e6d45f5baaa7cb6d6b978ab, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.599973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:11.674672 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3773/7533] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:11 2022] PUT /identity/v3/projects/9525766c5eea4d68a1472c557c2cb534/users/7318aeb08e6d45f5baaa7cb6d6b978ab/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:11.679034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.689585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0500-87fc-4e04-a95b-e400a1544b76 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.755424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be08b1e-b741-47ff-b7c1-8aa5b23aaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.755922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08b1e-b741-47ff-b7c1-8aa5b23aaea5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.756209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08b1e-b741-47ff-b7c1-8aa5b23aaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.756595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08b1e-b741-47ff-b7c1-8aa5b23aaea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.757690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be08b1e-b741-47ff-b7c1-8aa5b23aaea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.758751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be08b1e-b741-47ff-b7c1-8aa5b23aaea5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:11.770166 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3761/7534] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:11.774054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.784883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ffe19-2c54-42ec-a6e6-12dda7a69492 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.790302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.791001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.791412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.791753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] PATH_INFO: `/v3/projects/9525766c5eea4d68a1472c557c2cb534/users/7318aeb08e6d45f5baaa7cb6d6b978ab/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.793732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9525766c5eea4d68a1472c557c2cb534, user_id=7318aeb08e6d45f5baaa7cb6d6b978ab, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.796708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:11.807870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3774/7535] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:11 2022] PUT /identity/v3/projects/9525766c5eea4d68a1472c557c2cb534/users/7318aeb08e6d45f5baaa7cb6d6b978ab/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:11.818208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.818847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.819281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.850807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] MFA Rules not processed for user `7318aeb08e6d45f5baaa7cb6d6b978ab`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:11.852820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:11.940362 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3762/7536] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:11.946486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:11.964476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcef1a-915d-4d2c-94ea-fd80aa6443dd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:11.970616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:11.971276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:11.971561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:11.971988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:11.973575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:11.975207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.048013 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3775/7537] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Sep 6 11:26:11 2022] POST /identity/v3/services => generated 241 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:12.049058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.060237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76fa8-73d5-4927-9dc5-0fdfc07a56a7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.080930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.081737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.082745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.083280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/85560dc03f3a4fc0b6a15cd05e3836a7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.084137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:delete_service(service_id=85560dc03f3a4fc0b6a15cd05e3836a7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.085810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.093566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:12.233825 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3763/7538] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:12 2022] DELETE /identity/v3/services/85560dc03f3a4fc0b6a15cd05e3836a7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:12.244744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.256173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b750e-eda4-4cf7-926a-b764d0643684 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.285385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.286115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.286624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.287316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.304017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.304017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.444588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3776/7539] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:12 2022] POST /identity/v3/services => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:12.450173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.462164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71970140-4795-4a0f-a343-71780808578c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.478238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.478898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `PATCH` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.479210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.479513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/6c421ce9a34c49ea986e59c7b648fe28` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.480157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:update_service(service_id=6c421ce9a34c49ea986e59c7b648fe28)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.481224 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:12.481224 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:26:12.481224 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:26:12.482102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.605862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3764/7540] 10.222.0.20 () {60 vars in 1252 bytes} [Tue Sep 6 11:26:12 2022] PATCH /identity/v3/services/6c421ce9a34c49ea986e59c7b648fe28 => generated 284 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:12.611578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.622739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091d616-dc9d-40d2-b371-9d03a51ba5f7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.629991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:12.640314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.641053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.641414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.641700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/6c421ce9a34c49ea986e59c7b648fe28` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.642287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:get_service(service_id=6c421ce9a34c49ea986e59c7b648fe28)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.643345 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:12.643345 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:26:12.643345 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:26:12.644543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.650835 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3777/7541] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:26:12 2022] GET /identity/v3/services/6c421ce9a34c49ea986e59c7b648fe28 => generated 284 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:12.654869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.666077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fd221-bdd1-4316-9132-37434d012c9d tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.670997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.671768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.674614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.674614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/6c421ce9a34c49ea986e59c7b648fe28` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.674614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6c421ce9a34c49ea986e59c7b648fe28)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.675070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.764586 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3765/7542] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:12 2022] DELETE /identity/v3/services/6c421ce9a34c49ea986e59c7b648fe28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:12.769543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.782505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc29e6-c6d6-4ee1-8a45-67cbb03232c5 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.796997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.797766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.805807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.805807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/6c421ce9a34c49ea986e59c7b648fe28` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.805807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:get_service(service_id=6c421ce9a34c49ea986e59c7b648fe28)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.805807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Could not find service: 6c421ce9a34c49ea986e59c7b648fe28.: keystone.exception.ServiceNotFound: Could not find service: 6c421ce9a34c49ea986e59c7b648fe28. Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6c421ce9a34c49ea986e59c7b648fe28. Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:26:12.827689 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 11:26:12.831526 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application with Lock( Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self._enter() Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application return self.creator() Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application created_value = creator( Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6c421ce9a34c49ea986e59c7b648fe28. Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: ERROR keystone.server.flask.application Sep 06 11:26:12.832861 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3778/7543] 10.222.0.20 () {58 vars in 1230 bytes} [Tue Sep 6 11:26:12 2022] GET /identity/v3/services/6c421ce9a34c49ea986e59c7b648fe28 => generated 113 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Sep 06 11:26:12.836344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:12.847062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50892-df05-46fa-bcc3-a52b4bf8fe3e tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:12.852742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:12.868745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:12.868745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:12.868745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:12.868745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:12.868745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.052633 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3766/7544] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:12 2022] POST /identity/v3/services => generated 273 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:13.053808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.069714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8675ee-fede-49d9-be7d-b1f3cddf54c7 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.092528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.093115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.093452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.094401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.095139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.096999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.194873 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3779/7545] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:13 2022] POST /identity/v3/services => generated 274 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:13.198735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.223636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f77b8-42cf-48a3-8aff-55582b6baabd tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.244995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.245613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.246042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.246331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.247145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.248830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.368898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3767/7546] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:13 2022] POST /identity/v3/services => generated 273 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:13.373380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.385967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f737ca-e067-4157-9202-ea7dba71a131 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.409062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.409632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.409927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.410209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.410821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.411902 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:13.411902 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(msg) Sep 06 11:26:13.411902 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:26:13.412866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.421158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3780/7547] 10.222.0.20 () {58 vars in 1131 bytes} [Tue Sep 6 11:26:13 2022] GET /identity/v3/services => generated 2975 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:13.426307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.445943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8632b-e356-4d3d-a075-7dfeab4bca18 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.450995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.451704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.451997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.452278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.452977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-747112661) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:13.453282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.454311 ncdv-master-1 devstack@keystone.service[92878]: WARNING py.warnings [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 11:26:13.454311 ncdv-master-1 devstack@keystone.service[92878]: warnings.warn(msg) Sep 06 11:26:13.454311 ncdv-master-1 devstack@keystone.service[92878]: Sep 06 11:26:13.455237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.461349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3768/7548] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Sep 6 11:26:13 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-747112661 => generated 415 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:13.465702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.478674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4ca81-95d9-4bce-a28a-7e23032096bc tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.484073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.484827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.484991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.485233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.485894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-893961240) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:13.486488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.489001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.500036 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3781/7549] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Sep 6 11:26:13 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-893961240 => generated 416 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:13.500554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.515049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e84b8e-871a-4ad7-a7c7-0b612360356a tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.525477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.526513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.527130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.528105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.529072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-489073303) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:13.529883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.533112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.543089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3769/7550] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Sep 6 11:26:13 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-489073303 => generated 415 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:13.545950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.558266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d7ee-9003-4eea-876e-4d0555a1b767 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.563541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.564215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.564698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.565048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/e49813d3ed2c466f9990582e9655cbca` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.565701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e49813d3ed2c466f9990582e9655cbca)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.568500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.741794 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3782/7551] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:13 2022] DELETE /identity/v3/services/e49813d3ed2c466f9990582e9655cbca => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:13.745938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.756278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f84e-ff53-4ef0-8369-c67a60076e38 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.772010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.772672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.773108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.773416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/ba3ca29eeec24f438a41c53b28f99fb5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.773994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ba3ca29eeec24f438a41c53b28f99fb5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.776954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:13.949683 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3770/7552] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:13 2022] DELETE /identity/v3/services/ba3ca29eeec24f438a41c53b28f99fb5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:13.953814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:13.966662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859871-3f6d-4a07-a38c-3831c1afd878 tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:13.991250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f79ff-d31f-4c48-81b5-80da41b3ce3f tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7318aeb08e6d45f5baaa7cb6d6b978ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9525766c5eea4d68a1472c557c2cb534', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:13.992086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f79ff-d31f-4c48-81b5-80da41b3ce3f tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:13.992382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f79ff-d31f-4c48-81b5-80da41b3ce3f tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:13.992661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f79ff-d31f-4c48-81b5-80da41b3ce3f tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] PATH_INFO: `/v3/services/86912845d88c417eb6840757660665a0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:13.993255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f79ff-d31f-4c48-81b5-80da41b3ce3f tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorizing `identity:delete_service(service_id=86912845d88c417eb6840757660665a0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:13.995236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f79ff-d31f-4c48-81b5-80da41b3ce3f tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:14.122179 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3783/7553] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:13 2022] DELETE /identity/v3/services/86912845d88c417eb6840757660665a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:14.127702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:14.215822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26b23-71db-419f-be41-5d9496bb267c tempest-ServicesTestJSON-70891646 tempest-ServicesTestJSON-70891646-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:14.228146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:14.234067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:14.234836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:14.235705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:14.235705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] PATH_INFO: `/v3/users/2fead2e01f2d4a42a39592d2dcf9104a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:14.237348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fead2e01f2d4a42a39592d2dcf9104a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:14.239031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:14.406846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279a1a-e942-4e6b-85d4-1578339713a3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:14.407392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279a1a-e942-4e6b-85d4-1578339713a3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:14.407496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279a1a-e942-4e6b-85d4-1578339713a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:14.427824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c1279a1a-e942-4e6b-85d4-1578339713a3 None None] MFA Rules not processed for user `5458eb197e36456fb7785c8625ed3140`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:14.429012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1279a1a-e942-4e6b-85d4-1578339713a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:14.500278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fead2e01f2d4a42a39592d2dcf9104a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:14.511094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fead2e01f2d4a42a39592d2dcf9104a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:14.514923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fead2e01f2d4a42a39592d2dcf9104a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:14.514923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fead2e01f2d4a42a39592d2dcf9104a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:14.517408 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3784/7554] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:14.556800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fead2e01f2d4a42a39592d2dcf9104a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:14.668102 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3771/7555] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:14 2022] DELETE /identity/v3/users/2fead2e01f2d4a42a39592d2dcf9104a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:14.672682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:14.672976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:14.673286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:14.700443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:14.701986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:14.734609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:14.792697 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3785/7556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:14.803227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:14.804726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:14.884594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc527-f63c-423c-9b9c-ea388a462917 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:14.888616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:14.889350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:14.889641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:14.889972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:14.901900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:14.904232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:14.916439 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3772/7557] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:15.344117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:15.348093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:15.450965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53f50-c125-4d7d-8a26-e1262cb9e4aa None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:15.458489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:15.459171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:15.459452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:15.459726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:15.461715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:15.480903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:15.482668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:15.498613 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3786/7558] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:15.654855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:15.656687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:15.708105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcad6d-7ea2-4d94-bcef-b2b0dbd1daae service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:15.716867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:15.717669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:15.718106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:15.718698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] PATH_INFO: `/v3/projects/3740cb6f07a84c3e9e2ec10679568e0e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:15.720464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3740cb6f07a84c3e9e2ec10679568e0e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:15.723629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:15.931784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3740cb6f07a84c3e9e2ec10679568e0e', 'request_id': 'req-10289bf2-7d43-4115-8b59-77e690887b94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:15.937523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3740cb6f07a84c3e9e2ec10679568e0e', 'request_id': 'req-10289bf2-7d43-4115-8b59-77e690887b94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:15.944874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3740cb6f07a84c3e9e2ec10679568e0e', 'request_id': 'req-10289bf2-7d43-4115-8b59-77e690887b94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:15.947653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:16.051263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] The token cache is being invalidate because project 3740cb6f07a84c3e9e2ec10679568e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:16.055663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.055663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.055663 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3773/7559] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:15 2022] DELETE /identity/v3/projects/3740cb6f07a84c3e9e2ec10679568e0e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:16.058753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:16.077355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d61b5-885f-490c-beb9-7226bf5178ae service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:16.145093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:16.147032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:16.147407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:16.147812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] PATH_INFO: `/v3/users/7318aeb08e6d45f5baaa7cb6d6b978ab` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:16.148961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7318aeb08e6d45f5baaa7cb6d6b978ab)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:16.151938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:16.338830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7318aeb08e6d45f5baaa7cb6d6b978ab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.340375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:16.349272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7318aeb08e6d45f5baaa7cb6d6b978ab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.353207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7318aeb08e6d45f5baaa7cb6d6b978ab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.363302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7318aeb08e6d45f5baaa7cb6d6b978ab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.364042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0e357bf2-580d-4fb3-a1bc-9bdff3650eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7318aeb08e6d45f5baaa7cb6d6b978ab'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:16.489877 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3787/7560] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:16 2022] DELETE /identity/v3/users/7318aeb08e6d45f5baaa7cb6d6b978ab => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:17.033638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:17.035462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:17.056226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10289bf2-7d43-4115-8b59-77e690887b94 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:17.125752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:17.126391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:17.126677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:17.126955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] PATH_INFO: `/v3/projects/9525766c5eea4d68a1472c557c2cb534` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:17.128115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9525766c5eea4d68a1472c557c2cb534)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:17.130082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:17.269182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9525766c5eea4d68a1472c557c2cb534', 'request_id': 'req-d2151db4-12ce-4589-9032-5d46ab8f3fd0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:17.275876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9525766c5eea4d68a1472c557c2cb534', 'request_id': 'req-d2151db4-12ce-4589-9032-5d46ab8f3fd0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:17.282851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9525766c5eea4d68a1472c557c2cb534', 'request_id': 'req-d2151db4-12ce-4589-9032-5d46ab8f3fd0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:17.386000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] The token cache is being invalidate because project 9525766c5eea4d68a1472c557c2cb534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:17.386301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:17.386961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2151db4-12ce-4589-9032-5d46ab8f3fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:17.392636 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3774/7561] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:17 2022] DELETE /identity/v3/projects/9525766c5eea4d68a1472c557c2cb534 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:17.395499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:17.395835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:17.396114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:17.417878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:17.419329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:17.503524 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3788/7562] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:17.512911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:17.513269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:17.513550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:17.540160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:17.541405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:17.550037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3775/7563] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:17.555499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:17.566812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09520f7-d536-44b4-a9dd-73b99a08eb74 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:17.572101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:17.572755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:17.573427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:17.573717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:17.574488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:17.574786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:17.576444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:17.606248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3789/7564] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:17.606936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:17.617814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928cb06-0601-4835-a0bc-77e260e9a4a8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:17.622866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:17.623529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:17.624069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:17.624346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:17.624980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:17.627066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:17.786946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:17.787397 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3776/7565] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:17 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:17.798389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512844d-8fc0-4373-a02e-0fe01e93b42b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:17.858205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:17.858832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:17.859171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:17.859463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:17.860114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:17.862046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:18.011449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3790/7566] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:17 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:18.015492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:18.034289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b793b-99ad-4dd2-91e4-7e0b10fd8d73 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:18.041498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:18.042404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.042855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.043319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:18.051910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:18.059354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:18.071907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:18.072756 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3777/7567] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:18.084416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b63d02-3c7f-4ab6-81c9-f5d9d65a8b03 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:18.090633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e710b-b111-4ecd-8d33-ef5bce2f946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:18.091723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e710b-b111-4ecd-8d33-ef5bce2f946a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.092219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e710b-b111-4ecd-8d33-ef5bce2f946a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.092885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e710b-b111-4ecd-8d33-ef5bce2f946a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:18.094007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e710b-b111-4ecd-8d33-ef5bce2f946a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:18.096404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e710b-b111-4ecd-8d33-ef5bce2f946a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:18.114874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:18.126280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3791/7568] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:18.127613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616c83-431c-4dbe-be4b-ea31b932973b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:18.133629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:18.137286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.137286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.137286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] PATH_INFO: `/v3/projects/c37ea4f510c94f449fa1460437c98558/users/7081f36cdb3d4962b45603b3551ed982/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:18.154624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37ea4f510c94f449fa1460437c98558, user_id=7081f36cdb3d4962b45603b3551ed982, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:18.159266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:18.262065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3778/7569] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:18 2022] PUT /identity/v3/projects/c37ea4f510c94f449fa1460437c98558/users/7081f36cdb3d4962b45603b3551ed982/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:18.275340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.275650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.275908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:18.310391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] MFA Rules not processed for user `7081f36cdb3d4962b45603b3551ed982`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:18.312058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:18.338157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:18.404139 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3792/7570] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:18.409196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:18.426492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158f2c-1329-497c-ad49-20c52726ebb9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:18.430087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94c5c-8ebf-4f64-94f8-722456c12802 tempest-IdentityCatalogTest-1206243416 tempest-IdentityCatalogTest-1206243416-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7081f36cdb3d4962b45603b3551ed982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c37ea4f510c94f449fa1460437c98558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:18.430737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94c5c-8ebf-4f64-94f8-722456c12802 tempest-IdentityCatalogTest-1206243416 tempest-IdentityCatalogTest-1206243416-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.431083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94c5c-8ebf-4f64-94f8-722456c12802 tempest-IdentityCatalogTest-1206243416 tempest-IdentityCatalogTest-1206243416-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.431583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94c5c-8ebf-4f64-94f8-722456c12802 tempest-IdentityCatalogTest-1206243416 tempest-IdentityCatalogTest-1206243416-project] PATH_INFO: `/v3/auth/catalog` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:18.431958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94c5c-8ebf-4f64-94f8-722456c12802 tempest-IdentityCatalogTest-1206243416 tempest-IdentityCatalogTest-1206243416-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:18.433081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94c5c-8ebf-4f64-94f8-722456c12802 tempest-IdentityCatalogTest-1206243416 tempest-IdentityCatalogTest-1206243416-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:18.439784 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3779/7571] 10.222.0.20 () {58 vars in 1143 bytes} [Tue Sep 6 11:26:18 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:18.440657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:18.516152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4e5b-043b-4585-bdc6-ea28481061bf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:18.521934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:18.522616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.522904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.523217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] PATH_INFO: `/v3/users/7081f36cdb3d4962b45603b3551ed982` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:18.524466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7081f36cdb3d4962b45603b3551ed982)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:18.526430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:18.792387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7081f36cdb3d4962b45603b3551ed982'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:18.801685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7081f36cdb3d4962b45603b3551ed982'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:18.802517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7081f36cdb3d4962b45603b3551ed982'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:18.825760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7081f36cdb3d4962b45603b3551ed982'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:18.826544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7081f36cdb3d4962b45603b3551ed982'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:18.985537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3793/7572] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:18 2022] DELETE /identity/v3/users/7081f36cdb3d4962b45603b3551ed982 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:18.986642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:18.987030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:18.987403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:19.021099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:19.028086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:19.032828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:19.097276 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3780/7573] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:19.108205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:19.109710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:19.178933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd89ee-4b4a-45dc-b681-f5ce9e1d0cd9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:19.183388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8c93-050e-49cf-93c2-8bd3b5d69589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:19.185371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8c93-050e-49cf-93c2-8bd3b5d69589 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:19.185371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8c93-050e-49cf-93c2-8bd3b5d69589 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:19.185371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8c93-050e-49cf-93c2-8bd3b5d69589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:19.202688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b8c93-050e-49cf-93c2-8bd3b5d69589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:19.205624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b8c93-050e-49cf-93c2-8bd3b5d69589 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:19.227977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3794/7574] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:19.375445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:19.879094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:19.881118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:19.895669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0d1a-dff4-404a-8273-106a9024cea5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:19.900718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:19.901363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:19.901653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:19.901935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] PATH_INFO: `/v3/projects/c37ea4f510c94f449fa1460437c98558` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:19.903114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37ea4f510c94f449fa1460437c98558)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:19.905116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:20.123418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37ea4f510c94f449fa1460437c98558', 'request_id': 'req-d98c7669-4d81-4770-8faf-641423755f8b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:20.143385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37ea4f510c94f449fa1460437c98558', 'request_id': 'req-d98c7669-4d81-4770-8faf-641423755f8b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:20.153477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37ea4f510c94f449fa1460437c98558', 'request_id': 'req-d98c7669-4d81-4770-8faf-641423755f8b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:20.307584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] The token cache is being invalidate because project c37ea4f510c94f449fa1460437c98558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:20.308028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:20.308699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d98c7669-4d81-4770-8faf-641423755f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:20.313678 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3781/7575] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:19 2022] DELETE /identity/v3/projects/c37ea4f510c94f449fa1460437c98558 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:20.315403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.315898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.315991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.340386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:20.341560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:20.415769 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3795/7576] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:20.423640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.423956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.424242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.447314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:20.448575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:20.459168 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3782/7577] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:20.463429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:20.474880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd00b5-a216-4636-b934-8b8be0041748 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:20.485567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:20.493415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.493415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.493415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.493415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:20.493415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:20.493415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:20.506756 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3796/7578] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:20.509490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:20.522899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330699a9-9960-4b1a-8c64-0cef752fe82f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:20.530268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:20.531051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.531939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.531939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.532292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:20.534286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:20.617003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3783/7579] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:20 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:20.621896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:20.649346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2f32c-ddf7-405d-977e-bf0b313b9e8b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:20.767042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:20.769827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.769827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.769827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.770115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:20.772451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:20.897440 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3797/7580] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:20 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:20.898647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:20.910484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf176-1ac4-4636-9dcb-6f3dc279587b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:20.916301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:20.916913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.917293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.918046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.918761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:20.920614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:20.932078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3784/7581] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:20.937846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:20.952716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a611a0-8452-402f-b1d8-3bd96afa4567 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:20.959638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdebe9f-6fe9-46b7-9b92-d9c94d36fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:20.960294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdebe9f-6fe9-46b7-9b92-d9c94d36fce6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.960582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdebe9f-6fe9-46b7-9b92-d9c94d36fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.960862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdebe9f-6fe9-46b7-9b92-d9c94d36fce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:20.961537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdebe9f-6fe9-46b7-9b92-d9c94d36fce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:20.963240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdebe9f-6fe9-46b7-9b92-d9c94d36fce6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:20.977461 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3798/7582] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:20.981765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:20.992885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a6d1a-b4eb-4cf6-b6ee-4a93fe17a0c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:20.997810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:20.998489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:20.998766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:20.999060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] PATH_INFO: `/v3/projects/77c720f6586e42deb16c40908a8c8257/users/ae9f4983bf05476abd26ce64f89d7598/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.026343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c720f6586e42deb16c40908a8c8257, user_id=ae9f4983bf05476abd26ce64f89d7598, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.027567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.090956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3785/7583] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:20 2022] PUT /identity/v3/projects/77c720f6586e42deb16c40908a8c8257/users/ae9f4983bf05476abd26ce64f89d7598/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:21.102814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.103458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.103830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.134995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] MFA Rules not processed for user `ae9f4983bf05476abd26ce64f89d7598`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:21.136259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:21.206681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:21.250667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3799/7584] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:21.252042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:21.319350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:21.358285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03585-3bca-4d72-9903-36d5da418c3e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:21.371969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:21.372871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.373637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.373914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.374633 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.376602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.456523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:21.458976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:21.479654 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3786/7585] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:21 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:21.484104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a7a16-ed86-4cb6-b37d-f609d53b29f1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:21.490700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:21.557674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:21.558329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.558612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.558890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] PATH_INFO: `/v3/users/d9b5e99ee98847ee9b34d381d24dd6bc` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.560224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b5e99ee98847ee9b34d381d24dd6bc)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.562175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.592309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544b1d0-f748-4b57-ac78-0709e6f133fb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:21.597485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:21.598192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.598470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.598745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.599408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.602013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.693814 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3787/7586] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:21 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:21.698245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:21.711133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5da55-8a2d-42ef-bf0c-2db4064c121a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:21.716890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:21.717515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.717797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.718099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.723205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.723205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.732390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3788/7587] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:21.737436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:21.750920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bd74c-56e3-4529-bd80-c496edd610f1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:21.751487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b5e99ee98847ee9b34d381d24dd6bc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:21.756804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:21.757429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.757725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.758109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.758657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.760470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.765113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b5e99ee98847ee9b34d381d24dd6bc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:21.765896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b5e99ee98847ee9b34d381d24dd6bc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:21.773014 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3789/7588] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:21.777622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:21.781072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:21.786073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b5e99ee98847ee9b34d381d24dd6bc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:21.788002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-abac902a-3ea0-40ad-a813-e612c8297d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b5e99ee98847ee9b34d381d24dd6bc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:21.795335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739d03a-41e9-42f5-ab2c-e5aee495aa26 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:21.801761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2586e-6d23-4c91-aac5-0a858062ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:21.802455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2586e-6d23-4c91-aac5-0a858062ee3e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.802736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2586e-6d23-4c91-aac5-0a858062ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.803076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2586e-6d23-4c91-aac5-0a858062ee3e admin admin] PATH_INFO: `/v3/projects/1410a7c778d84836a0be38ca6269d1b3/users/e6103358a40d4db49edbd6b696bd4dfe/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.819770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2586e-6d23-4c91-aac5-0a858062ee3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1410a7c778d84836a0be38ca6269d1b3, user_id=e6103358a40d4db49edbd6b696bd4dfe, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:21.822460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2586e-6d23-4c91-aac5-0a858062ee3e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:21.890717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3800/7589] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:21 2022] DELETE /identity/v3/users/d9b5e99ee98847ee9b34d381d24dd6bc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:21.895737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.896055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.896345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.917578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:21.918838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:21.948527 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3790/7590] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:21 2022] PUT /identity/v3/projects/1410a7c778d84836a0be38ca6269d1b3/users/e6103358a40d4db49edbd6b696bd4dfe/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:21.960863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:21.961336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:21.967516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:21.990813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:22.001105 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3801/7591] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:22.003893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] MFA Rules not processed for user `e6103358a40d4db49edbd6b696bd4dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:22.005773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.012984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:22.014662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.079470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d630f-b3cd-44ff-a19d-8112bd8d4e29 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:22.109902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3791/7592] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:22.118285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:22.119867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.124663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:22.132718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975712f-6700-40f1-bb3f-2eb8b813ab3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:22.133343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975712f-6700-40f1-bb3f-2eb8b813ab3d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.133664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975712f-6700-40f1-bb3f-2eb8b813ab3d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.133943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975712f-6700-40f1-bb3f-2eb8b813ab3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.187147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811d833-66fb-48bb-bae5-562eb15b61fa None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:22.192075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33b9f7-9dee-4255-93dd-4ccffbd2341a tempest-IdentityV3ProjectsTest-723423752 tempest-IdentityV3ProjectsTest-723423752-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae9f4983bf05476abd26ce64f89d7598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77c720f6586e42deb16c40908a8c8257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:22.192727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b9f7-9dee-4255-93dd-4ccffbd2341a tempest-IdentityV3ProjectsTest-723423752 tempest-IdentityV3ProjectsTest-723423752-project] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.193018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b9f7-9dee-4255-93dd-4ccffbd2341a tempest-IdentityV3ProjectsTest-723423752 tempest-IdentityV3ProjectsTest-723423752-project] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.193415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b9f7-9dee-4255-93dd-4ccffbd2341a tempest-IdentityV3ProjectsTest-723423752 tempest-IdentityV3ProjectsTest-723423752-project] PATH_INFO: `/v3/users/ae9f4983bf05476abd26ce64f89d7598/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.195168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33b9f7-9dee-4255-93dd-4ccffbd2341a tempest-IdentityV3ProjectsTest-723423752 tempest-IdentityV3ProjectsTest-723423752-project] RBAC: Authorizing `identity:list_user_projects(user_id=ae9f4983bf05476abd26ce64f89d7598)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:22.198494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33b9f7-9dee-4255-93dd-4ccffbd2341a tempest-IdentityV3ProjectsTest-723423752 tempest-IdentityV3ProjectsTest-723423752-project] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:22.204440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975712f-6700-40f1-bb3f-2eb8b813ab3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:22.205902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975712f-6700-40f1-bb3f-2eb8b813ab3d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:22.216704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3802/7593] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:22.255087 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3792/7594] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:26:22 2022] GET /identity/v3/users/ae9f4983bf05476abd26ce64f89d7598/projects => generated 515 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:26:22.257538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.257897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.258247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.293877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] MFA Rules not processed for user `ae9f4983bf05476abd26ce64f89d7598`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:22.295173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.303101 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3803/7595] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:22.307581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.307999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.308350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.329430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] MFA Rules not processed for user `ae9f4983bf05476abd26ce64f89d7598`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:22.333313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.380949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.models.token_model [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] User ae9f4983bf05476abd26ce64f89d7598 has no access to project 1410a7c778d84836a0be38ca6269d1b3 {{(pid=92878) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Sep 06 11:26:22.385818 ncdv-master-1 devstack@keystone.service[92878]: WARNING keystone.server.flask.application [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.20: keystone.exception.Unauthorized: The request you have made requires authentication. Sep 06 11:26:22.387300 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3793/7596] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:22 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 81 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Sep 06 11:26:22.392633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:22.404813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da334-6d02-45ad-a335-c6cffc9e0d7b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:22.410415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:22.411103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.411398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.411686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] PATH_INFO: `/v3/users/ae9f4983bf05476abd26ce64f89d7598` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.412941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9f4983bf05476abd26ce64f89d7598)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:22.414886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:22.503940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:22.506196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.524730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fb7f0-007b-4648-a2d9-076d930cfe0f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:22.530414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:22.530679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.531076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.531357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] PATH_INFO: `/v3/projects/6626671896c94e2b9d2bd4b095044dca` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.532625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6626671896c94e2b9d2bd4b095044dca)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:22.534625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:22.645823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:22.650238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9f4983bf05476abd26ce64f89d7598'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.664329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9f4983bf05476abd26ce64f89d7598'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.665530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9f4983bf05476abd26ce64f89d7598'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.692315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6626671896c94e2b9d2bd4b095044dca', 'request_id': 'req-4058f906-06ba-44ae-9f06-8d987d24332f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.698328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9f4983bf05476abd26ce64f89d7598'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.700051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2f9678be-323b-4f51-90cf-5ba4afd4909f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9f4983bf05476abd26ce64f89d7598'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.706734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6626671896c94e2b9d2bd4b095044dca', 'request_id': 'req-4058f906-06ba-44ae-9f06-8d987d24332f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.723263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6626671896c94e2b9d2bd4b095044dca', 'request_id': 'req-4058f906-06ba-44ae-9f06-8d987d24332f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.792617 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3804/7597] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:22 2022] DELETE /identity/v3/users/ae9f4983bf05476abd26ce64f89d7598 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:22.799692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.799984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.800263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.820517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:22.821726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.839642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:22.846055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] The token cache is being invalidate because project 6626671896c94e2b9d2bd4b095044dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:22.847940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.847940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4058f906-06ba-44ae-9f06-8d987d24332f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:22.848832 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3794/7598] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:22 2022] DELETE /identity/v3/projects/6626671896c94e2b9d2bd4b095044dca => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:22.853576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4439-4710-436a-8f96-1330320e92d1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.853875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4439-4710-436a-8f96-1330320e92d1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.854126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4439-4710-436a-8f96-1330320e92d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.874190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f68e4439-4710-436a-8f96-1330320e92d1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:22.876770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f68e4439-4710-436a-8f96-1330320e92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.904999 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3805/7599] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:22.904999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:22.906962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.961851 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3795/7600] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:22.974891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.975442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.975856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.982256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2c7b-e44e-4f77-a662-8f07d35f7b69 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:22.987124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:22.987755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:22.988566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:22.988845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:22.997529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:22.998741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:22.999322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.000762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.007526 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3796/7601] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:23.011939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.014314 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3806/7602] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:23.023180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182e867-991a-4a21-961a-4a86bf627dcd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.030013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.030643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.030920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.031230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.031880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:23.032184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.033789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.051046 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3797/7603] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:26:23.052251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.062654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f2de-7f8e-4be5-8b89-773df58d4d98 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.068636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.069527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.069527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.069822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.070438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.072403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.169688 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3807/7604] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:23 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:23.171052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.183802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d326-095f-47c8-8edc-b56242951483 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.252292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.252913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.253365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.254577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.255728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.257987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.373211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3798/7605] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:23 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:23.374836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.393004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260622da-a28d-4f78-bd0d-5136438280c9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.400186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.401245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.401676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.402758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.402913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.405416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.417469 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3808/7606] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:23.421607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.431953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ec397-726e-421e-8d6f-133288bd753f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.436859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.437451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.437734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.438008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.438640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.440297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.453072 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3799/7607] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:23.457503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.468708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550c12e-060d-4f6b-a958-9cfa6f9a26b7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.474691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1d162-c854-4878-a0a3-f77b0f92d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.474975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1d162-c854-4878-a0a3-f77b0f92d05a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.475279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1d162-c854-4878-a0a3-f77b0f92d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.475563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1d162-c854-4878-a0a3-f77b0f92d05a admin admin] PATH_INFO: `/v3/projects/1e5f81ad7ec74f519876897eba53aa0a/users/27ddf69029004866b345139e1f4261c7/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.501131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1d162-c854-4878-a0a3-f77b0f92d05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5f81ad7ec74f519876897eba53aa0a, user_id=27ddf69029004866b345139e1f4261c7, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.504665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1d162-c854-4878-a0a3-f77b0f92d05a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.508965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.510923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:23.532800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb1ad4-f319-4a9a-b8a6-78b0f0a7fb38 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.533800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.534453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.535682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.536167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] PATH_INFO: `/v3/projects/77c720f6586e42deb16c40908a8c8257` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.539195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c720f6586e42deb16c40908a8c8257)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.541764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.616206 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3809/7608] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:23 2022] PUT /identity/v3/projects/1e5f81ad7ec74f519876897eba53aa0a/users/27ddf69029004866b345139e1f4261c7/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:23.718087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c720f6586e42deb16c40908a8c8257', 'request_id': 'req-711d16a9-f5f3-4ca9-ac12-6616b0c72498'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:23.724006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:23.727775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.728309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.728550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.736017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c720f6586e42deb16c40908a8c8257', 'request_id': 'req-711d16a9-f5f3-4ca9-ac12-6616b0c72498'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:23.743875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c720f6586e42deb16c40908a8c8257', 'request_id': 'req-711d16a9-f5f3-4ca9-ac12-6616b0c72498'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:23.751091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:23.761004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] MFA Rules not processed for user `27ddf69029004866b345139e1f4261c7`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:23.762565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:23.819333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] The token cache is being invalidate because project 77c720f6586e42deb16c40908a8c8257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:23.820566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:23.821934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:23.827899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3800/7609] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:23 2022] DELETE /identity/v3/projects/77c720f6586e42deb16c40908a8c8257 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:23.829426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.834132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:23.840221 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3810/7610] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:23.850306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:23.851896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:23.905276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d16a9-f5f3-4ca9-ac12-6616b0c72498 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.911242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.912180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.912517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.912911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] PATH_INFO: `/v3/users/e6103358a40d4db49edbd6b696bd4dfe` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.914156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6103358a40d4db49edbd6b696bd4dfe)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.916204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.937489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05da88-5d62-485c-842c-cfc9b51fb3a9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:23.942088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:23.942725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:23.943060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:23.943329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:23.957372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:23.957372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:23.966797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3811/7611] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:24.094163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6103358a40d4db49edbd6b696bd4dfe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:24.101415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6103358a40d4db49edbd6b696bd4dfe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:24.102142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6103358a40d4db49edbd6b696bd4dfe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:24.102823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6103358a40d4db49edbd6b696bd4dfe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:24.116229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3587a26c-d7fa-4666-9e75-3559f0e018da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6103358a40d4db49edbd6b696bd4dfe'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:24.198113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3801/7612] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:23 2022] DELETE /identity/v3/users/e6103358a40d4db49edbd6b696bd4dfe => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:24.955416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:24.967024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47610a-e7e2-4cc0-bf64-d487d3b956f3 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:25.047380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:25.048463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.048754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.051543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] PATH_INFO: `/v3/projects/1410a7c778d84836a0be38ca6269d1b3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.051543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1410a7c778d84836a0be38ca6269d1b3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:25.052803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:25.230603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:25.233971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1410a7c778d84836a0be38ca6269d1b3', 'request_id': 'req-60f51e4d-2267-4077-8aea-21c53294e4fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:25.243087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1410a7c778d84836a0be38ca6269d1b3', 'request_id': 'req-60f51e4d-2267-4077-8aea-21c53294e4fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:25.249808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1410a7c778d84836a0be38ca6269d1b3', 'request_id': 'req-60f51e4d-2267-4077-8aea-21c53294e4fc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:25.359882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] The token cache is being invalidate because project 1410a7c778d84836a0be38ca6269d1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:25.361666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:25.361666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:25.368909 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3812/7613] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:24 2022] DELETE /identity/v3/projects/1410a7c778d84836a0be38ca6269d1b3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:25.370675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c480-da06-4b32-af1b-56cdf1ef6b16 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.371269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c480-da06-4b32-af1b-56cdf1ef6b16 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.371269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c480-da06-4b32-af1b-56cdf1ef6b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.395390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:25.397246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:25.409101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dac0c480-da06-4b32-af1b-56cdf1ef6b16 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:25.415911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dac0c480-da06-4b32-af1b-56cdf1ef6b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:25.492973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:25.502721 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3802/7614] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:25.510871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.511219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.511505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.531683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51e4d-2267-4077-8aea-21c53294e4fc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:25.539141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:25.540501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:25.540983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:25.541614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.541961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.542237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.544707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:25.548790 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3803/7615] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:25.553302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:25.564091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd675b-b3b3-4265-94eb-3d11cad0d348 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:25.564394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:25.567716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:25.570432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:25.571136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.571585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.571869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.574915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:25.574915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:25.574915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:25.587943 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3804/7617] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:26:25.594229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:25.595055 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3813/7616] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:25.606616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025fdb-afd5-4e9e-98d1-a2d62b383f4e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:25.617511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:25.617880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.617880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.618225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.620049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:25.625505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:25.773735 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3805/7618] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:25 2022] POST /identity/v3/projects => generated 397 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:25.777810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:25.790464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9f95e-8acb-407c-b5b5-1987600732dd service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:25.864777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:25.865725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:25.866236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:25.866566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:25.867290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:25.869258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:26.044460 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3814/7619] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:25 2022] POST /identity/v3/users => generated 305 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:26.048745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:26.059253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c279-8dca-4d81-bd60-e2335002f349 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:26.064029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:26.064637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.064923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.065198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.065870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:26.067513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:26.077836 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3806/7620] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:26.082567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:26.094712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdef5e-945a-47a4-8c70-7b7bc6cf88eb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:26.099738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:26.100399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.100679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.100967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] PATH_INFO: `/v3/projects/ee331a454da6496aa16a3e6e28992d8b/users/d406188b2985420ca0ad4c6eceb9c90f/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.116601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee331a454da6496aa16a3e6e28992d8b, user_id=d406188b2985420ca0ad4c6eceb9c90f, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:26.119439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:26.254764 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3815/7621] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:26 2022] PUT /identity/v3/projects/ee331a454da6496aa16a3e6e28992d8b/users/d406188b2985420ca0ad4c6eceb9c90f/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:26.259759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:26.274791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826528-4d15-4d2f-ab05-cb36b4ec71b3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:26.379390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc6fe-5b71-42f0-bb31-1116aab575ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:26.380095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc6fe-5b71-42f0-bb31-1116aab575ef admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.380584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc6fe-5b71-42f0-bb31-1116aab575ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.380584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc6fe-5b71-42f0-bb31-1116aab575ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.382687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc6fe-5b71-42f0-bb31-1116aab575ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:26.384440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc6fe-5b71-42f0-bb31-1116aab575ef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:26.396493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3807/7622] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:26.401050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:26.424207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354004-0e9e-4ac1-b6f1-8bd620972fbe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:26.430491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:26.431252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.431542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.431825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] PATH_INFO: `/v3/projects/ee331a454da6496aa16a3e6e28992d8b/users/d406188b2985420ca0ad4c6eceb9c90f/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.434423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee331a454da6496aa16a3e6e28992d8b, user_id=d406188b2985420ca0ad4c6eceb9c90f, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:26.437236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:26.455827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:26.461170 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3816/7623] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:26 2022] PUT /identity/v3/projects/ee331a454da6496aa16a3e6e28992d8b/users/d406188b2985420ca0ad4c6eceb9c90f/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:26.472790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.473107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.473396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.507713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] MFA Rules not processed for user `d406188b2985420ca0ad4c6eceb9c90f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:26.508964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:26.586562 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3808/7624] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:26.591291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:26.663734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8f83-a9d3-4447-a727-44cc2a9813d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:26.669261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:26.670022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.670379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.670722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.671498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:26.673474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:26.811922 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3817/7625] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:26 2022] POST /identity/v3/projects => generated 395 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:26.816743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:26.832390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a41e-1ce6-43f3-8cee-bb9ec1a8ce64 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:26.924305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:26.967831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:26.968457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:26.968920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:26.969216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:26.978107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:26.978107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:27.070270 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3809/7626] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:26 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:27.071508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:27.082107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0be6-6443-4e7e-82bb-68f57f204fe8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:27.086842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:27.087614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:27.087899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:27.088174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:27.088809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:27.090405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:27.113453 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3818/7627] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:27.113657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:27.120420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b0c39-b94d-4226-8146-f4179b58d7ad admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:27.127554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44344615-2e05-4011-a069-352295cfbe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:27.128121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344615-2e05-4011-a069-352295cfbe1e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:27.128443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344615-2e05-4011-a069-352295cfbe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:27.128772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44344615-2e05-4011-a069-352295cfbe1e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:27.129372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44344615-2e05-4011-a069-352295cfbe1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:27.131044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44344615-2e05-4011-a069-352295cfbe1e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:27.145390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3810/7628] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:27.146632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:27.157050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4417fb2-bc32-4e84-8c16-e5370b3f9124 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:27.162598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:27.163283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:27.163567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:27.163840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] PATH_INFO: `/v3/projects/300fcd1de72e480fbf8e680e8c9161b9/users/aa3219d46a264398b75a5480af91dbd4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:27.181184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=300fcd1de72e480fbf8e680e8c9161b9, user_id=aa3219d46a264398b75a5480af91dbd4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:27.184100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:27.323613 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3819/7629] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:27 2022] PUT /identity/v3/projects/300fcd1de72e480fbf8e680e8c9161b9/users/aa3219d46a264398b75a5480af91dbd4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:27.334866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a916c5-c200-4add-a784-77072d72f6db None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:27.335203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a916c5-c200-4add-a784-77072d72f6db None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:27.335488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a916c5-c200-4add-a784-77072d72f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:27.372857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-89a916c5-c200-4add-a784-77072d72f6db None None] MFA Rules not processed for user `aa3219d46a264398b75a5480af91dbd4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:27.374438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-89a916c5-c200-4add-a784-77072d72f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:27.447759 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3811/7630] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:27.465880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:27.467699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:27.579690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ac386-92b5-408f-8110-387a33f38a2d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:27.585390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:27.586203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:27.587111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:27.587664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:27.683697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:27.685539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:27.704941 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3820/7631] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:28.180950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:29.067310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a916c5-c200-4add-a784-77072d72f6db None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:29.211932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a916c5-c200-4add-a784-77072d72f6db None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:29.217961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:29.218703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:29.219215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:29.219713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] PATH_INFO: `/v3/users/d406188b2985420ca0ad4c6eceb9c90f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:29.222255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d406188b2985420ca0ad4c6eceb9c90f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:29.224372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:29.391304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:29.431482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:29.444520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd406188b2985420ca0ad4c6eceb9c90f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:29.457366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd406188b2985420ca0ad4c6eceb9c90f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:29.458748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd406188b2985420ca0ad4c6eceb9c90f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:29.459728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd406188b2985420ca0ad4c6eceb9c90f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:29.488884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd406188b2985420ca0ad4c6eceb9c90f'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:29.537603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6162-f80f-4e41-8523-580db8090bfa service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:29.546276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:29.548192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:29.548489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:29.548845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:29.551487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:29.567112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:29.568756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee28ea-0bb2-4796-bfcb-b1680fe29ad1 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:29.583186 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3821/7632] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:29.647060 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3812/7633] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:29 2022] DELETE /identity/v3/users/d406188b2985420ca0ad4c6eceb9c90f => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:29.650549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:29.651087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:29.651562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:29.682038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:29.683710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:29.685813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:29.688116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:29.757521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3822/7634] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:29.765330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208d838-e5b0-45af-8115-31801661a2bb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:29.770081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:29.771201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:29.775630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:29.775630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:29.775630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:29.775976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:29.790244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:29.796509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:29.796664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8cfc9-7856-4ccb-8320-08fd248a9f6c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:29.799406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:29.800830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:29.801669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:29.802277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:29.805656 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3813/7635] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:29.818192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:29.819873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:29.832166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3823/7636] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:30.970200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:30.974321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:31.006035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4dab-b290-448e-a9c2-b775f7977fbb service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:31.010944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:31.011650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:31.011933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:31.012209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] PATH_INFO: `/v3/projects/ee331a454da6496aa16a3e6e28992d8b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:31.013462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee331a454da6496aa16a3e6e28992d8b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:31.015506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:31.188640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee331a454da6496aa16a3e6e28992d8b', 'request_id': 'req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.195054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee331a454da6496aa16a3e6e28992d8b', 'request_id': 'req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.201561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee331a454da6496aa16a3e6e28992d8b', 'request_id': 'req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.317925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] The token cache is being invalidate because project ee331a454da6496aa16a3e6e28992d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:31.318229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.318891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.320661 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3814/7637] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:30 2022] DELETE /identity/v3/projects/ee331a454da6496aa16a3e6e28992d8b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:31.324305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:31.335648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d89d48-d1bd-4898-88ce-afe42d750b5a service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:31.388725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:31.402721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:31.403857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:31.404375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:31.404886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] PATH_INFO: `/v3/users/aa3219d46a264398b75a5480af91dbd4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:31.406837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3219d46a264398b75a5480af91dbd4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:31.410852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:31.586209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3219d46a264398b75a5480af91dbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.598349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3219d46a264398b75a5480af91dbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.600664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3219d46a264398b75a5480af91dbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.615092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3219d46a264398b75a5480af91dbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.615929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c67f7c7c-83c9-4ceb-b56e-b619bd00599c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3219d46a264398b75a5480af91dbd4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:31.730647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3824/7638] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:31 2022] DELETE /identity/v3/users/aa3219d46a264398b75a5480af91dbd4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:32.495718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:32.497172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:32.511144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4273-4c0f-4b22-ade6-dc5f4da6e8b1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:32.562730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:32.583267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:32.583935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:32.584224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:32.584503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] PATH_INFO: `/v3/projects/300fcd1de72e480fbf8e680e8c9161b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:32.585869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300fcd1de72e480fbf8e680e8c9161b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:32.588187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:32.687312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300fcd1de72e480fbf8e680e8c9161b9', 'request_id': 'req-f22d5cbd-1e67-49f6-874b-2a387f765208'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:32.692734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300fcd1de72e480fbf8e680e8c9161b9', 'request_id': 'req-f22d5cbd-1e67-49f6-874b-2a387f765208'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:32.699244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300fcd1de72e480fbf8e680e8c9161b9', 'request_id': 'req-f22d5cbd-1e67-49f6-874b-2a387f765208'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:32.752543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] The token cache is being invalidate because project 300fcd1de72e480fbf8e680e8c9161b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:32.752846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:32.753595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f22d5cbd-1e67-49f6-874b-2a387f765208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:32.755611 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3815/7639] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:32 2022] DELETE /identity/v3/projects/300fcd1de72e480fbf8e680e8c9161b9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:32.760420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:32.760927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:32.761043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:32.783100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:32.784335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:32.854422 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3825/7640] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:32.863184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:32.863576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:32.863942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:32.887145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:32.888483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:32.899493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3816/7641] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:32.903156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:32.915838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da427f5-16d0-42ee-9b2b-383fc3d4dbfd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:32.920712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:32.921329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:32.921622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:32.921972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:32.922649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:32.922905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:32.924565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:32.937158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3826/7642] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:32.941517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:32.951352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215527c-4a21-41b6-bbc4-30ea3c4a408a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:32.956191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:32.957497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:32.957792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:32.958074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:32.958702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:32.960701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:33.072254 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3817/7643] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:32 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:33.073438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:33.087970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708babb-df35-46a6-96cd-55abbf58dccb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:33.167426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:33.167426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:33.167426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:33.167426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:33.167977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:33.167977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:33.175251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:33.249530 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3827/7644] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:33 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:33.254442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:33.265608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd1f8b-e9ba-406b-b492-d4030b071915 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:33.271318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:33.271966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:33.272254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:33.272531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:33.273176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:33.274797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:33.289393 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3818/7645] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:33.290683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:33.301990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ee814-5fbf-4d8c-abbb-23c967f13685 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:33.308319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ed9d8-8ea1-4d90-b892-b2c4db1a9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:33.309231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ed9d8-8ea1-4d90-b892-b2c4db1a9401 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:33.309656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ed9d8-8ea1-4d90-b892-b2c4db1a9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:33.309952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ed9d8-8ea1-4d90-b892-b2c4db1a9401 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:33.310604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ed9d8-8ea1-4d90-b892-b2c4db1a9401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:33.312247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ed9d8-8ea1-4d90-b892-b2c4db1a9401 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:33.325164 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3828/7646] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:33.328718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:33.340166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8539b-fca8-4619-81be-a561d2052f09 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:33.345009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:33.348108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:33.348108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:33.348108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] PATH_INFO: `/v3/projects/c1f3ecacd86e4331845d4828f5a8a292/users/e4cb6a4830884e4bbe201622662d8e3e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:33.363356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f3ecacd86e4331845d4828f5a8a292, user_id=e4cb6a4830884e4bbe201622662d8e3e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:33.366082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:33.466387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3819/7647] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:33 2022] PUT /identity/v3/projects/c1f3ecacd86e4331845d4828f5a8a292/users/e4cb6a4830884e4bbe201622662d8e3e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:33.476845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a01455-fb17-4b0f-b1d9-bd00d2fbb894 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:33.477160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a01455-fb17-4b0f-b1d9-bd00d2fbb894 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:33.477570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a01455-fb17-4b0f-b1d9-bd00d2fbb894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:33.509362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b8a01455-fb17-4b0f-b1d9-bd00d2fbb894 None None] MFA Rules not processed for user `e4cb6a4830884e4bbe201622662d8e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:33.510647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b8a01455-fb17-4b0f-b1d9-bd00d2fbb894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:33.584535 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3829/7648] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:33.595223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:33.597029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:33.670895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7065a01-4a87-4047-9c83-daa87566bc63 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:33.674552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:33.675773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:33.676090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:33.676460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:33.686245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:33.687934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:33.698100 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3820/7649] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:34.006118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502002bf-92ef-4a07-96c6-beaa9cfd5b94 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:34.006738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502002bf-92ef-4a07-96c6-beaa9cfd5b94 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:34.006962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502002bf-92ef-4a07-96c6-beaa9cfd5b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:34.041943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-502002bf-92ef-4a07-96c6-beaa9cfd5b94 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:34.045666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-502002bf-92ef-4a07-96c6-beaa9cfd5b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:34.114788 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3830/7650] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:34.247791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:34.248884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:34.263846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:34.339058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243e026-6986-4d03-b18f-4e6471563243 service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:34.344305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:34.344916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:34.345197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:34.345471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:34.355141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:34.356864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:34.365420 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3821/7651] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:35.087824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc8e6-6b5d-43f2-8661-2369aaf23920 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:35.088321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc8e6-6b5d-43f2-8661-2369aaf23920 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:35.088431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc8e6-6b5d-43f2-8661-2369aaf23920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:35.110512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-90fdc8e6-6b5d-43f2-8661-2369aaf23920 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:35.113162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-90fdc8e6-6b5d-43f2-8661-2369aaf23920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:35.119495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3831/7652] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:26:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:35.131504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:35.145670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858cb76-eaad-4d06-b329-9f9c928bda8f service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:35.151119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:35.151682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:35.151966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:35.152232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:35.162122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:35.163795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:35.174304 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3822/7653] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:26:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:36.068414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58080d62-3dc9-476a-87db-52d25e8fafa0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:36.068707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58080d62-3dc9-476a-87db-52d25e8fafa0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:36.068989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58080d62-3dc9-476a-87db-52d25e8fafa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:36.089857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-58080d62-3dc9-476a-87db-52d25e8fafa0 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:36.091267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-58080d62-3dc9-476a-87db-52d25e8fafa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:36.099396 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3832/7654] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:36.111629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:36.126213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cccba5-e31c-46aa-a8bb-f3eab1130df6 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:36.131877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:36.132839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:36.133134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:36.133413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:36.142593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:36.144798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:36.153611 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3823/7655] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:36.656290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494cb2-9934-4696-bdc2-431fdcbc8c78 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:36.656582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494cb2-9934-4696-bdc2-431fdcbc8c78 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:36.656864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494cb2-9934-4696-bdc2-431fdcbc8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:36.678457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-00494cb2-9934-4696-bdc2-431fdcbc8c78 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:36.679724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00494cb2-9934-4696-bdc2-431fdcbc8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:36.687351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3833/7656] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:36.704423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:36.744787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b586be-81f6-4044-a7a2-7ef2c179f8f9 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:36.751811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:36.752701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:36.753395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:36.754093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:36.780187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:36.783748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:36.796457 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3824/7657] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:37.539985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc3ada-3d41-433e-902d-0778ada146b7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:37.540793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc3ada-3d41-433e-902d-0778ada146b7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:37.540793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc3ada-3d41-433e-902d-0778ada146b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:37.563534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cecc3ada-3d41-433e-902d-0778ada146b7 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:37.564754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cecc3ada-3d41-433e-902d-0778ada146b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:37.576159 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3834/7658] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:26:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:37.588979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:37.605304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172249bb-3c02-4820-a0e3-2583c0ea7ed6 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:37.610538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:37.611191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:37.611478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:37.615139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:37.621250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:37.622920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:37.631698 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3825/7659] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 11:26:38.281422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:38.281707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:38.281983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:38.303858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:38.309976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:38.313602 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3835/7660] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:38.327389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:38.341697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb93d9-c226-4e36-bd16-156c3535f7d9 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:38.351337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:38.351337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:38.351337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:38.351337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:38.358310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:38.359940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:38.368756 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3826/7661] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:26:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:26:38.765783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:38.767288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:38.797545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:38.838215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83cd1-0bc9-4aa1-bce8-c61fcbec59cd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:38.842956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:38.843627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:38.843915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:38.844225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] PATH_INFO: `/v3/users/27ddf69029004866b345139e1f4261c7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:38.845460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ddf69029004866b345139e1f4261c7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:38.848029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:38.917124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:38.928537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f3466-4cc9-40c8-9b0f-3ed6d079740c service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:38.933379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:38.934041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:38.934329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:38.934601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] PATH_INFO: `/v3/users/e4cb6a4830884e4bbe201622662d8e3e` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:38.935735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cb6a4830884e4bbe201622662d8e3e)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:38.937685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:39.051479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ddf69029004866b345139e1f4261c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.060695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ddf69029004866b345139e1f4261c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.061451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ddf69029004866b345139e1f4261c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.074754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ddf69029004866b345139e1f4261c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.075569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-98ed3076-628f-4e09-9f95-22452e0f4a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ddf69029004866b345139e1f4261c7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.116564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cb6a4830884e4bbe201622662d8e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.123993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cb6a4830884e4bbe201622662d8e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.124713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cb6a4830884e4bbe201622662d8e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.125341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cb6a4830884e4bbe201622662d8e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.138197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-68dfff4a-83fe-4934-bcac-9c1c3ac883e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cb6a4830884e4bbe201622662d8e3e'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.147104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3836/7662] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:38 2022] DELETE /identity/v3/users/27ddf69029004866b345139e1f4261c7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:39.151665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:39.151966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:39.152254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:39.171972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:39.175004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:39.201106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:39.211441 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3827/7663] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:38 2022] DELETE /identity/v3/users/e4cb6a4830884e4bbe201622662d8e3e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:39.214819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:39.215133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:39.215405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:39.235035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:39.236245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:39.238490 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3837/7664] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:39.248858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:39.250313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:39.300932 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3828/7665] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:39.302326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:39.310961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:39.319821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4deac93-ed80-4007-a511-fd9de2f5601a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:39.375918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebc0ac-ff9e-476f-a2bb-d70c542e5872 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:39.377620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:39.378869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:39.379288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:39.379572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:39.381799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:39.382430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:39.382743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:39.383777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:39.391150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:39.392599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:39.394782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:39.396269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:39.404232 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3838/7666] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:39.410765 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3829/7667] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:39.744168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:39.745635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:39.760388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5af9b5-fddd-4d89-9d7c-f00361dfd7da service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:39.765538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:39.766342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:39.766946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:39.766946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] PATH_INFO: `/v3/projects/1e5f81ad7ec74f519876897eba53aa0a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:39.770940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5f81ad7ec74f519876897eba53aa0a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:39.772715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:39.920241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5f81ad7ec74f519876897eba53aa0a', 'request_id': 'req-647a8862-24f8-44cc-bc35-4f94d547a935'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.928080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5f81ad7ec74f519876897eba53aa0a', 'request_id': 'req-647a8862-24f8-44cc-bc35-4f94d547a935'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.932646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:39.934232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:39.940013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5f81ad7ec74f519876897eba53aa0a', 'request_id': 'req-647a8862-24f8-44cc-bc35-4f94d547a935'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:39.949953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd67f72-d40f-4e09-bff0-ea4ad84987bc service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.014058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.014700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.014986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.015296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] PATH_INFO: `/v3/projects/c1f3ecacd86e4331845d4828f5a8a292` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.016432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f3ecacd86e4331845d4828f5a8a292)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.018351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.043385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] The token cache is being invalidate because project 1e5f81ad7ec74f519876897eba53aa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:40.043695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.044387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-647a8862-24f8-44cc-bc35-4f94d547a935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.045977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3839/7668] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:39 2022] DELETE /identity/v3/projects/1e5f81ad7ec74f519876897eba53aa0a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:40.051616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48040f-de44-4d5a-ba96-677bb32b0241 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.053295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48040f-de44-4d5a-ba96-677bb32b0241 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.053295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48040f-de44-4d5a-ba96-677bb32b0241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.073398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7d48040f-de44-4d5a-ba96-677bb32b0241 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:40.074965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7d48040f-de44-4d5a-ba96-677bb32b0241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.085744 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3840/7669] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:40.094403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.094719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.095004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.116421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:40.117697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.125866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3841/7670] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:40.130173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.139701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d538229-cb0c-44ea-8098-02a1f23a2fcb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.153495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:40.157531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f3ecacd86e4331845d4828f5a8a292', 'request_id': 'req-16fa2e23-74f5-4efd-8aea-2fea77e46771'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.163812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f3ecacd86e4331845d4828f5a8a292', 'request_id': 'req-16fa2e23-74f5-4efd-8aea-2fea77e46771'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.170365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f3ecacd86e4331845d4828f5a8a292', 'request_id': 'req-16fa2e23-74f5-4efd-8aea-2fea77e46771'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.203944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.204565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.204858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.205157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.205775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:40.206084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.208418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.220596 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3842/7671] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:26:40.225093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.234137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:40.248511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3d669-41b3-425e-83ad-f1b65c24bc79 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.248511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.248511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.248511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.248961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.248961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.248961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.266651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] The token cache is being invalidate because project c1f3ecacd86e4331845d4828f5a8a292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:40.266955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.273751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-16fa2e23-74f5-4efd-8aea-2fea77e46771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:40.273751 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3830/7672] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:39 2022] DELETE /identity/v3/projects/c1f3ecacd86e4331845d4828f5a8a292 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:40.276069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b328b7-3941-4d6d-9288-d7c0dd132cbc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.276390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b328b7-3941-4d6d-9288-d7c0dd132cbc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.276673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b328b7-3941-4d6d-9288-d7c0dd132cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.297259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c6b328b7-3941-4d6d-9288-d7c0dd132cbc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:40.298485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c6b328b7-3941-4d6d-9288-d7c0dd132cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.307427 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3831/7673] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:40.314855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.318462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.318462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.336482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:40.337849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.342067 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3843/7674] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:40.346484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.346662 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3832/7675] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:40.348691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.350679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.361052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83e06-7e1b-4730-92b7-3524d4617962 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.420395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.420919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.421206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.421375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b6c9-2cc8-44dc-b6d3-51494f8caffc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.421489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.422119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:40.422421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.424095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.428295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.428914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.429242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.429472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.430116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.432066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.440344 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3833/7676] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:40.441943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.452386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10556ad2-7fdd-464c-afc3-60c47cf87035 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.457179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.457799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.458083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.458358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.459157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.461032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.546519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3844/7677] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:40.551168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.561339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff07fba-79cb-4a15-b8ab-f660b481e005 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.566906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.567586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.567870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.568148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.568855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.570441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.584572 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3834/7678] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:40.585233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3845/7679] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:40.586529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.586910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.597477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc61fc-1deb-4a9b-b59d-7c9e701113a0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.658282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a40c-1c42-4ce4-9d50-cc381733034a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.663968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.664201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.664590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.664791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.664915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.665087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.665246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.665509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.665765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.666165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.667431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.668193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.682077 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3835/7680] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:40.690311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.700703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2713f0-e029-4415-be13-eb793a21f0e7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.706674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a618314-77fd-4207-8a2a-f996fbfcb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.707383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a618314-77fd-4207-8a2a-f996fbfcb2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.707667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a618314-77fd-4207-8a2a-f996fbfcb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.707942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a618314-77fd-4207-8a2a-f996fbfcb2bf admin admin] PATH_INFO: `/v3/projects/f101fb66cdc84bc6803a50363ee6c0bb/users/ff77f9a1e80e47a685f8ddd11b7013fe/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.725814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a618314-77fd-4207-8a2a-f996fbfcb2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f101fb66cdc84bc6803a50363ee6c0bb, user_id=ff77f9a1e80e47a685f8ddd11b7013fe, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.728627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a618314-77fd-4207-8a2a-f996fbfcb2bf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.743056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3846/7681] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:40.746294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.756645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f8284-536d-423b-9729-8838bcf01f4a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.762555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.763298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.763574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.763843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.764488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.766092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.780209 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3847/7682] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:40.782492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.792322 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3836/7683] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:40 2022] PUT /identity/v3/projects/f101fb66cdc84bc6803a50363ee6c0bb/users/ff77f9a1e80e47a685f8ddd11b7013fe/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:40.793101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01febb-85ba-4bdb-8295-b329165cbb19 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.803596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.803960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.804295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.812797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:40.838874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] MFA Rules not processed for user `ff77f9a1e80e47a685f8ddd11b7013fe`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:40.840015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:40.840216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.860263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.860876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.861162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.861435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.862074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.864365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.877567 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3848/7684] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:40.883516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.894020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a102aec-350a-437e-83e6-0dc2f2f5937f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.899076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.899746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.900031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.900305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] PATH_INFO: `/v3/projects/3550cbb79a7043ff9f5d322b6ad1ca97/users/89ffeeb4d4db4061919d9e8c60c8e246/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.912310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3837/7685] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:26:40.917396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3550cbb79a7043ff9f5d322b6ad1ca97, user_id=89ffeeb4d4db4061919d9e8c60c8e246, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:40.920350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:40.920778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:40.922291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:40.986115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffad23-9394-4127-b43a-257261a1bc61 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:40.989835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99227d44-fd57-4710-b4ae-c2e64e150bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:40.990459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227d44-fd57-4710-b4ae-c2e64e150bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:40.990743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227d44-fd57-4710-b4ae-c2e64e150bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:40.991039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99227d44-fd57-4710-b4ae-c2e64e150bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:40.999966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99227d44-fd57-4710-b4ae-c2e64e150bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.001417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99227d44-fd57-4710-b4ae-c2e64e150bf2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.010886 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3838/7686] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:26:41.016258 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3849/7687] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:40 2022] PUT /identity/v3/projects/3550cbb79a7043ff9f5d322b6ad1ca97/users/89ffeeb4d4db4061919d9e8c60c8e246/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:41.027330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.027636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.027912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.058286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] MFA Rules not processed for user `89ffeeb4d4db4061919d9e8c60c8e246`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:41.059781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:41.135984 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3839/7688] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:41.137437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.208429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9886b5-0529-4b23-993c-19e44138ac5f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:41.213412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:41.214035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.214360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.214632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.215306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.217277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.349023 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3850/7689] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:41 2022] POST /identity/v3/projects => generated 369 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:41.350058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.361431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1acff-a5da-4c61-8020-c1e65390c7eb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:41.397702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:41.438225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:41.438840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.439185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.439468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.440087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.442519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.560178 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3840/7690] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:41 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:41.564271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.575640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45c0c7-445f-47c4-a0b3-ab65a0131cf2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:41.580044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:41.580655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.580937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.581265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.581933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.583748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.599650 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3851/7691] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:41.600925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.611841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489ea0-e579-4e01-8213-0c1adbade383 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:41.619470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:41.621851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.621851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.621851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] PATH_INFO: `/v3/projects/3acf13b6cf794e8e8573d1d7e2062de0/users/062ac9588ffc4148b0ab15a242a5c4be/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.644048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acf13b6cf794e8e8573d1d7e2062de0, user_id=062ac9588ffc4148b0ab15a242a5c4be, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.647056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.719531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3841/7692] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:41 2022] PUT /identity/v3/projects/3acf13b6cf794e8e8573d1d7e2062de0/users/062ac9588ffc4148b0ab15a242a5c4be/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:41.724081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.734614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2489-6c83-4e83-8b13-d1e48c092352 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:41.796940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59b927-b287-43a0-968d-94ffb5c75654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:41.797673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59b927-b287-43a0-968d-94ffb5c75654 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.797857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59b927-b287-43a0-968d-94ffb5c75654 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.798105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59b927-b287-43a0-968d-94ffb5c75654 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.798741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59b927-b287-43a0-968d-94ffb5c75654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.800441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59b927-b287-43a0-968d-94ffb5c75654 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.815057 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3852/7693] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:41.816300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.827706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67d887-79d5-468e-8eb3-2671b5ca16b2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:41.833061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:41.833920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.834265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.834490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] PATH_INFO: `/v3/projects/3acf13b6cf794e8e8573d1d7e2062de0/users/062ac9588ffc4148b0ab15a242a5c4be/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.836590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acf13b6cf794e8e8573d1d7e2062de0, user_id=062ac9588ffc4148b0ab15a242a5c4be, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:41.839368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:41.851791 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3842/7694] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:41 2022] PUT /identity/v3/projects/3acf13b6cf794e8e8573d1d7e2062de0/users/062ac9588ffc4148b0ab15a242a5c4be/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:41.864314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:41.864607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:41.864892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:41.895407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] MFA Rules not processed for user `062ac9588ffc4148b0ab15a242a5c4be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:41.896634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:41.907412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:41.974611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3853/7695] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:41.985119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:41.987998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:42.071143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f31d4-8352-43b0-aec9-86d8c3c10e62 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:42.075362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653b4d-cfe1-4d35-af7f-5e35309a9f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:42.076002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653b4d-cfe1-4d35-af7f-5e35309a9f47 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:42.076281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653b4d-cfe1-4d35-af7f-5e35309a9f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:42.076553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653b4d-cfe1-4d35-af7f-5e35309a9f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:42.087117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653b4d-cfe1-4d35-af7f-5e35309a9f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:42.088564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653b4d-cfe1-4d35-af7f-5e35309a9f47 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:42.098875 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3843/7696] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:44.363548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:44.438942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4c338-487a-432f-9e2a-dbf2eba4acf8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:44.443709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:44.444360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:44.444644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:44.444952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] PATH_INFO: `/v3/users/89ffeeb4d4db4061919d9e8c60c8e246` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:44.446065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ffeeb4d4db4061919d9e8c60c8e246)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:44.448095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:44.634558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ffeeb4d4db4061919d9e8c60c8e246'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:44.642098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ffeeb4d4db4061919d9e8c60c8e246'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:44.642851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ffeeb4d4db4061919d9e8c60c8e246'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:44.657880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ffeeb4d4db4061919d9e8c60c8e246'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:44.658662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ffeeb4d4db4061919d9e8c60c8e246'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:44.725480 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3854/7697] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:44 2022] DELETE /identity/v3/users/89ffeeb4d4db4061919d9e8c60c8e246 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:44.730360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:44.730865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:44.730993 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:44.751857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:44.753707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:44.816707 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3844/7698] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:44.828502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:44.830123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:44.868080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:44.904127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f74d11-26cd-4f08-9ec8-dcd7b673d1ec admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:44.907868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:44.908493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:44.908777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:44.909056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:44.919772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:44.921265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:44.931628 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3855/7699] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:45.719469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:45.723477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:45.751439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2518d-7521-4a4d-a132-127b4fff24b1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:45.757623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:45.758321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:45.758603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:45.758877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] PATH_INFO: `/v3/projects/3550cbb79a7043ff9f5d322b6ad1ca97` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:45.760099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3550cbb79a7043ff9f5d322b6ad1ca97)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:45.762058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:45.784725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:45.875206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3550cbb79a7043ff9f5d322b6ad1ca97', 'request_id': 'req-95b74a36-8777-4d6f-b719-f19065f2e9e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:45.889783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3550cbb79a7043ff9f5d322b6ad1ca97', 'request_id': 'req-95b74a36-8777-4d6f-b719-f19065f2e9e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:45.898752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3550cbb79a7043ff9f5d322b6ad1ca97', 'request_id': 'req-95b74a36-8777-4d6f-b719-f19065f2e9e7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.010508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] The token cache is being invalidate because project 3550cbb79a7043ff9f5d322b6ad1ca97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:46.010508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.010508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.010508 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3845/7700] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:45 2022] DELETE /identity/v3/projects/3550cbb79a7043ff9f5d322b6ad1ca97 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:46.012773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:46.024417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d022-c29f-4d32-9400-bbbf8dc1e573 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:46.088585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:46.089003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:46.089280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:46.089556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] PATH_INFO: `/v3/users/062ac9588ffc4148b0ab15a242a5c4be` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:46.090747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] RBAC: Authorizing `identity:delete_user(user_id=062ac9588ffc4148b0ab15a242a5c4be)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:46.092750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:46.307189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062ac9588ffc4148b0ab15a242a5c4be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.314687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062ac9588ffc4148b0ab15a242a5c4be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.316030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062ac9588ffc4148b0ab15a242a5c4be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.340512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062ac9588ffc4148b0ab15a242a5c4be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.342012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-664a7fdf-b52a-4e50-882a-9430c83d159e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062ac9588ffc4148b0ab15a242a5c4be'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:46.470633 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3856/7701] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:26:46 2022] DELETE /identity/v3/users/062ac9588ffc4148b0ab15a242a5c4be => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:26:47.060019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:47.062323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:47.084568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b74a36-8777-4d6f-b719-f19065f2e9e7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:47.169671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:47.170241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:47.170555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:47.170809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] PATH_INFO: `/v3/projects/3acf13b6cf794e8e8573d1d7e2062de0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:47.172162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acf13b6cf794e8e8573d1d7e2062de0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:47.174107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:47.322914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acf13b6cf794e8e8573d1d7e2062de0', 'request_id': 'req-0bf9df30-b3da-492a-98fd-94c5d03ede36'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:47.329789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acf13b6cf794e8e8573d1d7e2062de0', 'request_id': 'req-0bf9df30-b3da-492a-98fd-94c5d03ede36'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:47.339856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acf13b6cf794e8e8573d1d7e2062de0', 'request_id': 'req-0bf9df30-b3da-492a-98fd-94c5d03ede36'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:47.467295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] The token cache is being invalidate because project 3acf13b6cf794e8e8573d1d7e2062de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:26:47.467982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:47.469132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf9df30-b3da-492a-98fd-94c5d03ede36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:26:47.471550 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3846/7702] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:47 2022] DELETE /identity/v3/projects/3acf13b6cf794e8e8573d1d7e2062de0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:47.476971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:47.477535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:47.477664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:47.500860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:47.502258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:47.586569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:47.601537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3857/7703] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:47.700502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:47.700791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:47.701074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:47.733629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:47.734919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:47.745592 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3847/7704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:47.750985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:47.763415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe4467-a527-49e0-a35a-9ae8bc9a5ae8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:47.770896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:47.771277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:47.771570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:47.772225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:47.773443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:47.773832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:47.775821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:47.796137 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3858/7705] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:47.797806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:47.810658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3d439-a54f-4a0d-94be-a0d299122c23 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:47.823906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:47.826406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:47.826406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:47.826406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:47.826406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:47.828395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:47.944633 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3848/7706] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:47 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:26:47.948722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:47.960582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf7c6-6fe4-4936-8451-161be5002c06 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.040124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.040766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.041352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.041836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.042461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.047511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.182945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3859/7707] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:47 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:48.184946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:48.196208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:48.201101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8ad67-05cb-48bc-bfe3-161136b5ea4f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.207551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.208617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.209074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.209636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.210501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.213438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.231892 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3849/7708] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:48.232107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:48.248998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b4de8-3845-4fbd-b4f7-5807f3ee3207 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.258453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7d495-f27b-4063-9f35-d58631983d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.259362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d495-f27b-4063-9f35-d58631983d07 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.259649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d495-f27b-4063-9f35-d58631983d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.261087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7d495-f27b-4063-9f35-d58631983d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.261087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7d495-f27b-4063-9f35-d58631983d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.263167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7d495-f27b-4063-9f35-d58631983d07 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.281409 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3860/7709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:48.284204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:48.296193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d913a9b-63b0-447d-88ea-8e4a93025902 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.305940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.306843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.307275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.307691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] PATH_INFO: `/v3/projects/6f71a53b641843a3adc06a4b2d7de2b0/users/7a755d5f716e4ddb85ffa0fdc389b5c0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.329372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f71a53b641843a3adc06a4b2d7de2b0, user_id=7a755d5f716e4ddb85ffa0fdc389b5c0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.332955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.412400 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3850/7710] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:48 2022] PUT /identity/v3/projects/6f71a53b641843a3adc06a4b2d7de2b0/users/7a755d5f716e4ddb85ffa0fdc389b5c0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:48.424688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.430606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.430606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.464799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] MFA Rules not processed for user `7a755d5f716e4ddb85ffa0fdc389b5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:48.466279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:48.570918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3861/7711] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:48.575625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:48.646777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e5aab-c60e-4a13-a7dc-50366afd83d1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.653985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.655232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.655725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.656344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.657020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.659023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.758301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3851/7712] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:48 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:48.763103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:48.777828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8762-ff51-4cff-9b79-7029c21c81c1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.839055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:48.858117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.858776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.859138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.859569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.860399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.863045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.943961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3862/7713] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:26:48 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:48.948172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:48.960345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab78c9-2dfe-4eb2-b3d5-28ce21aa7ff8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:48.965566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:48.966416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:48.966705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:48.967180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:48.967905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:48.969746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:48.995050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3852/7714] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:26:49.000030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:49.012230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6d5af-284e-4151-a104-f5b06f47dff4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:49.018563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:49.019422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:49.020190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:49.020646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] PATH_INFO: `/v3/projects/d744ccdcae984be6b6bd1e3d482fbb00/users/6dcde399561d4f52b4a22f0b018103a1/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:49.045411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d744ccdcae984be6b6bd1e3d482fbb00, user_id=6dcde399561d4f52b4a22f0b018103a1, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:49.048300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:49.160969 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3863/7715] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:48 2022] PUT /identity/v3/projects/d744ccdcae984be6b6bd1e3d482fbb00/users/6dcde399561d4f52b4a22f0b018103a1/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:49.165476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:49.179129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ebb71-98f1-43d6-929d-f09da15b120e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:49.250088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfdc0e-6f30-4acf-a428-deaf55d10481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:49.251137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfdc0e-6f30-4acf-a428-deaf55d10481 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:49.251137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfdc0e-6f30-4acf-a428-deaf55d10481 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:49.251492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfdc0e-6f30-4acf-a428-deaf55d10481 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:49.251930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfdc0e-6f30-4acf-a428-deaf55d10481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:49.254219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfdc0e-6f30-4acf-a428-deaf55d10481 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:49.265034 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3853/7716] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:26:49.269360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:49.281403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dee1c-a6bd-4c6d-8cd3-fd45ad981087 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:49.286355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:49.287036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:49.287340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:49.292223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] PATH_INFO: `/v3/projects/d744ccdcae984be6b6bd1e3d482fbb00/users/6dcde399561d4f52b4a22f0b018103a1/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:49.292223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d744ccdcae984be6b6bd1e3d482fbb00, user_id=6dcde399561d4f52b4a22f0b018103a1, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:49.292453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:49.304782 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3864/7717] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:26:49 2022] PUT /identity/v3/projects/d744ccdcae984be6b6bd1e3d482fbb00/users/6dcde399561d4f52b4a22f0b018103a1/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:26:49.318698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:49.319098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:49.319341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:49.359305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] MFA Rules not processed for user `6dcde399561d4f52b4a22f0b018103a1`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:26:49.360547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:49.406923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:26:49.448933 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3854/7718] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:26:49.464090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:49.468996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:49.554378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6430d-3234-4616-ac4c-3de6d86cf39c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:49.558909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:49.559792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:49.560304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:49.560803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:49.573387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:49.575819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:49.586838 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3865/7719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:51.422475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:51.442415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8b3c6-7980-4f7d-a365-eab2f9f0db34 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:51.449201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:51.450197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:51.450807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:51.451331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:51.453827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:26:51.470187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:51.473610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:51.504166 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3855/7720] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:26:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:26:58.600077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:58.611907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c665f-45ed-4d1f-965a-47d398cb49ca service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:58.617566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcde399561d4f52b4a22f0b018103a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd744ccdcae984be6b6bd1e3d482fbb00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:58.618885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:58.622620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:58.622620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:58.622620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:58.622620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:58.623441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:58.638545 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3866/7721] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:58.642948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:58.669582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b26a7-8c15-45bc-9c91-8a58d84cdf1d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:58.677731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcde399561d4f52b4a22f0b018103a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd744ccdcae984be6b6bd1e3d482fbb00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:58.678867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:58.679478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:58.680003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:58.680988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:58.683523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:58.857343 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3856/7722] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:26:58 2022] POST /identity/v3/projects => generated 348 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:26:58.861239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:58.877084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810bbb-910d-4ddb-bd65-1499f01065a1 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:58.962683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcde399561d4f52b4a22f0b018103a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd744ccdcae984be6b6bd1e3d482fbb00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:58.964209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:58.964758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:58.965294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:58.966180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:26:58.966717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:58.968602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:26:59.010097 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3867/7723] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:26:59.878130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:26:59.893096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f0df5-30f0-492d-aa23-ce673958fa27 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:26:59.898547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dcde399561d4f52b4a22f0b018103a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd744ccdcae984be6b6bd1e3d482fbb00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:26:59.899331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:26:59.899619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:26:59.899894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] PATH_INFO: `/v3/projects/758e0a6c0ab7420dacd47cdfdbefb929` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:26:59.901049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorizing `identity:delete_project(project_id=758e0a6c0ab7420dacd47cdfdbefb929)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:26:59.903089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:00.016669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758e0a6c0ab7420dacd47cdfdbefb929', 'request_id': 'req-72639e63-5eea-44b8-adb0-a6171685e9ba'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:00.023216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758e0a6c0ab7420dacd47cdfdbefb929', 'request_id': 'req-72639e63-5eea-44b8-adb0-a6171685e9ba'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:00.029828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758e0a6c0ab7420dacd47cdfdbefb929', 'request_id': 'req-72639e63-5eea-44b8-adb0-a6171685e9ba'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:00.111110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] The token cache is being invalidate because project 758e0a6c0ab7420dacd47cdfdbefb929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:00.111385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:00.112056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:00.113603 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3857/7724] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:26:59 2022] DELETE /identity/v3/projects/758e0a6c0ab7420dacd47cdfdbefb929 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:27:00.124553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:00.126324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:00.151372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:00.198799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640817c-158a-4aab-b435-02e22a6320f5 tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:00.253655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:00.259105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:00.259105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:00.259105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:00.259105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:00.336037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:00.337411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:00.349897 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3868/7725] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:10.107766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:10.342972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=59 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:11.363640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:11.366055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:11.639946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639e63-5eea-44b8-adb0-a6171685e9ba tempest-RoutersIpV6AdminTest-15229630 tempest-RoutersIpV6AdminTest-15229630-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:11.657309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654957-cd53-4964-ab37-142563199b87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:11.657309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654957-cd53-4964-ab37-142563199b87 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:11.657309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654957-cd53-4964-ab37-142563199b87 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:11.657309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654957-cd53-4964-ab37-142563199b87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:11.658430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-76654957-cd53-4964-ab37-142563199b87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:11.708916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654957-cd53-4964-ab37-142563199b87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:11.710803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654957-cd53-4964-ab37-142563199b87 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:11.742163 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3858/7726] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:17.289201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:17.295154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:17.532680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e32d5-4333-45a9-8023-1962957b3888 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:17.539586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:17.546903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:17.546903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:17.546903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:17.546903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:17.572173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:17.573844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:17.621351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3869/7727] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:21.723802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=32 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:24.538053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf420-fe09-450c-8a69-227ba3c8c15e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:24.539609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf420-fe09-450c-8a69-227ba3c8c15e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:24.540307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf420-fe09-450c-8a69-227ba3c8c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:24.568062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8bddf420-fe09-450c-8a69-227ba3c8c15e None None] MFA Rules not processed for user `5458eb197e36456fb7785c8625ed3140`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:24.569431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8bddf420-fe09-450c-8a69-227ba3c8c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:24.653652 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3859/7728] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:25.237498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:25.239127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:25.338351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be5c73-ba19-4fa9-8568-3d3494ed36fc service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:25.346388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:25.347539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:25.347902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:25.348672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] PATH_INFO: `/v3/users/ff77f9a1e80e47a685f8ddd11b7013fe` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:25.349615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff77f9a1e80e47a685f8ddd11b7013fe)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:25.352876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:25.581957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff77f9a1e80e47a685f8ddd11b7013fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:25.591760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff77f9a1e80e47a685f8ddd11b7013fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:25.595856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff77f9a1e80e47a685f8ddd11b7013fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:25.623044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff77f9a1e80e47a685f8ddd11b7013fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:25.623044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff77f9a1e80e47a685f8ddd11b7013fe'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:25.714879 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3870/7729] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:25 2022] DELETE /identity/v3/users/ff77f9a1e80e47a685f8ddd11b7013fe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:25.720617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:25.721131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:25.721240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:25.741148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:25.742553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:25.805222 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3860/7730] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:27:25.815766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:25.817216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:25.824198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:25.894490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52b1a-fd45-4c94-983d-1492e5436db7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:25.898762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f08a9-253e-4908-98e9-b7388cac23e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:25.899626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f08a9-253e-4908-98e9-b7388cac23e1 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:25.899922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f08a9-253e-4908-98e9-b7388cac23e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:25.900202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f08a9-253e-4908-98e9-b7388cac23e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:25.912022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f08a9-253e-4908-98e9-b7388cac23e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:25.913503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f08a9-253e-4908-98e9-b7388cac23e1 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:25.925202 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3871/7731] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:26.204514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:26.206039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:26.218830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125df75-2a99-4e9b-9de8-bd7feb539c64 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:26.223881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:26.224842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:26.225317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:26.225950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] PATH_INFO: `/v3/projects/f101fb66cdc84bc6803a50363ee6c0bb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:26.227415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f101fb66cdc84bc6803a50363ee6c0bb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:26.229581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:26.358847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f101fb66cdc84bc6803a50363ee6c0bb', 'request_id': 'req-67f29647-1eba-4266-b3f1-0786190ee391'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:26.365328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f101fb66cdc84bc6803a50363ee6c0bb', 'request_id': 'req-67f29647-1eba-4266-b3f1-0786190ee391'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:26.371822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f101fb66cdc84bc6803a50363ee6c0bb', 'request_id': 'req-67f29647-1eba-4266-b3f1-0786190ee391'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:26.466409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] The token cache is being invalidate because project f101fb66cdc84bc6803a50363ee6c0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:26.466735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:26.467427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-67f29647-1eba-4266-b3f1-0786190ee391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:26.468956 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3861/7732] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:26 2022] DELETE /identity/v3/projects/f101fb66cdc84bc6803a50363ee6c0bb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:26.474860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:26.475419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:26.475515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:26.498872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:26.500241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:26.573375 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3872/7733] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:26.582207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:26.582504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:26.582784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:26.606080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:26.607388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:26.616202 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3862/7734] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:26.621506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:26.634366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cc56c-6e99-45e0-b600-05a87e6df5af None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:26.640447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:26.640971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:26.641649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:26.642205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:26.643406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:27:26.643895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:26.645569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:26.661001 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3873/7735] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:27:26.665314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:26.676312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e130a8-8e77-4a63-8c9d-e1df44bb73bf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:26.683995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:26.684692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:26.684982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:26.685258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:26.686000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:26.688122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:26.834403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:26.841387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3863/7736] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:26 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:26.845818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:26.860126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b2139-a688-4f9a-b2d5-c0036780d053 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:26.943853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:26.944484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:26.945405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:26.945405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:26.945793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:26.948423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.039424 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3874/7737] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:26 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:27:27.043390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.053864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14b62b-5f8e-4720-a468-bb05ce675fff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.058694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.059353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.059638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.059918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.060637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.062255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.078520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.079222 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3864/7738] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:27:27.090414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c9805-7e07-4a0f-937a-861de6c279d1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.095688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf24b5-1696-4287-81c5-1670ff2fc47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.096292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf24b5-1696-4287-81c5-1670ff2fc47a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.096578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf24b5-1696-4287-81c5-1670ff2fc47a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.097274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf24b5-1696-4287-81c5-1670ff2fc47a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.097650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf24b5-1696-4287-81c5-1670ff2fc47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.099485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf24b5-1696-4287-81c5-1670ff2fc47a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.114235 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3875/7739] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:27:27.115571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.126464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e33805-601d-4f30-bd01-b8140e9d4a13 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.132828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.133498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.134015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.134312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] PATH_INFO: `/v3/projects/aa4b0608c2ae462b99ba637ba16b35c1/users/c4c16c874ad6484dbb48f9f8b373bcbd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.152164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4b0608c2ae462b99ba637ba16b35c1, user_id=c4c16c874ad6484dbb48f9f8b373bcbd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.155271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.212055 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3865/7740] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:27 2022] PUT /identity/v3/projects/aa4b0608c2ae462b99ba637ba16b35c1/users/c4c16c874ad6484dbb48f9f8b373bcbd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:27:27.221963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.222367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.222947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.254705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:27.260535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] MFA Rules not processed for user `c4c16c874ad6484dbb48f9f8b373bcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:27.261736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:27.332761 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3876/7741] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:27.337401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.409884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722213b-9471-4c41-85b6-75eacc78d5ff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.414923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.415652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.416014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.416362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.417022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.419047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.523352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3866/7742] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:27 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:27.527703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.552511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ad78f-af7c-425c-a939-71962ca0ae81 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.628719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.629499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.629793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.630403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.631112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.633056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.787355 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3877/7743] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:27 2022] POST /identity/v3/users => generated 308 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:27.790311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.805564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01171-350a-4aa1-a6b7-2ff520f99d8f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.812389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.813126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.813482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.813831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.815145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.816866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.828408 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3867/7744] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:27.832701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.843951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad2a5-c97e-4f35-a8ca-a551ef4ef121 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:27.849592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:27.850487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:27.859290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:27.859290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] PATH_INFO: `/v3/projects/6289a4eae17d460186105cc2e6e4824a/users/9067651842f347bd99e9aeff72206fed/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:27.868750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6289a4eae17d460186105cc2e6e4824a, user_id=9067651842f347bd99e9aeff72206fed, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:27.871958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:27.982381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3878/7745] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:27 2022] PUT /identity/v3/projects/6289a4eae17d460186105cc2e6e4824a/users/9067651842f347bd99e9aeff72206fed/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:27.986262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:27.997500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c82183-90eb-4287-971b-f23e4cfb216c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:28.083839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77262823-3fc9-4350-9dbf-4a5e0f3fbcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:28.084102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262823-3fc9-4350-9dbf-4a5e0f3fbcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:28.084258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262823-3fc9-4350-9dbf-4a5e0f3fbcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:28.084535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262823-3fc9-4350-9dbf-4a5e0f3fbcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:28.085647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77262823-3fc9-4350-9dbf-4a5e0f3fbcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:28.087989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77262823-3fc9-4350-9dbf-4a5e0f3fbcb0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:28.103606 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3868/7746] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:28.105605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:28.118933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638a5f1-2e34-410b-aa62-688eeb04cc3c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:28.127097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:28.129146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:28.129146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:28.129146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] PATH_INFO: `/v3/projects/6289a4eae17d460186105cc2e6e4824a/users/9067651842f347bd99e9aeff72206fed/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:28.131203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6289a4eae17d460186105cc2e6e4824a, user_id=9067651842f347bd99e9aeff72206fed, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:28.134305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:28.153778 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3879/7747] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:28 2022] PUT /identity/v3/projects/6289a4eae17d460186105cc2e6e4824a/users/9067651842f347bd99e9aeff72206fed/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:28.164511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:28.164800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:28.165078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:28.200691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] MFA Rules not processed for user `9067651842f347bd99e9aeff72206fed`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:28.202429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:28.231864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:28.295456 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3869/7748] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:28 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:28.304467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:28.307094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:28.389055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:28.393775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e813-eaf6-46d3-8b70-e6b33f652f47 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:28.398279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400ed90-97fd-4747-996c-94b1086403b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:28.398934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ed90-97fd-4747-996c-94b1086403b7 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:28.399251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ed90-97fd-4747-996c-94b1086403b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:28.399533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ed90-97fd-4747-996c-94b1086403b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:28.409916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400ed90-97fd-4747-996c-94b1086403b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:28.417469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400ed90-97fd-4747-996c-94b1086403b7 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:28.422166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3880/7749] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:28 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:28.584510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:28.662899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe5040-c8c5-46bb-8d13-7466670c1981 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:28.667724 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:28.668485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:28.668861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:28.669214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] PATH_INFO: `/v3/users/c4c16c874ad6484dbb48f9f8b373bcbd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:28.670620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c16c874ad6484dbb48f9f8b373bcbd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:28.672856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:28.893167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c16c874ad6484dbb48f9f8b373bcbd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:28.901164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c16c874ad6484dbb48f9f8b373bcbd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:28.901913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c16c874ad6484dbb48f9f8b373bcbd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:28.902560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c16c874ad6484dbb48f9f8b373bcbd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:28.921138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c16c874ad6484dbb48f9f8b373bcbd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:29.027293 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3870/7750] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:28 2022] DELETE /identity/v3/users/c4c16c874ad6484dbb48f9f8b373bcbd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:29.031947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:29.032384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:29.032686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:29.054501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:29.055787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:29.124391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3881/7751] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:29.159983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:29.162483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:29.230397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:29.246976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8166b-cbd3-42de-bca0-858ebebe385a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:29.251593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:29.252403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:29.252954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:29.253102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:29.263688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:29.265151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:29.276472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3871/7752] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:29.806607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:29.808347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:29.824618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1f0c1-4421-4009-8bb4-d2196e7d54a1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:29.829421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:29.830132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:29.830417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:29.830702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] PATH_INFO: `/v3/projects/aa4b0608c2ae462b99ba637ba16b35c1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:29.832356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4b0608c2ae462b99ba637ba16b35c1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:29.834507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:29.953227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4b0608c2ae462b99ba637ba16b35c1', 'request_id': 'req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:29.963536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4b0608c2ae462b99ba637ba16b35c1', 'request_id': 'req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:29.973051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4b0608c2ae462b99ba637ba16b35c1', 'request_id': 'req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.074248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] The token cache is being invalidate because project aa4b0608c2ae462b99ba637ba16b35c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:30.074988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.075530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.077462 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3882/7753] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:29 2022] DELETE /identity/v3/projects/aa4b0608c2ae462b99ba637ba16b35c1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:30.081304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:30.092637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45c28c-7c1f-4bde-be81-2ff65a90d210 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:30.162115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:30.162753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:30.163058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:30.163341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] PATH_INFO: `/v3/users/9067651842f347bd99e9aeff72206fed` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:30.164484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9067651842f347bd99e9aeff72206fed)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:30.168149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:30.384005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9067651842f347bd99e9aeff72206fed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.396606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9067651842f347bd99e9aeff72206fed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.397698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9067651842f347bd99e9aeff72206fed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.398406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9067651842f347bd99e9aeff72206fed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.413184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cecf8224-bf5c-4393-9a4d-4f6429adfbc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9067651842f347bd99e9aeff72206fed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:30.503361 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3872/7754] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:30 2022] DELETE /identity/v3/users/9067651842f347bd99e9aeff72206fed => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:31.236046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:31.237981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:31.266732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bbe06-23b2-4da0-a90f-7f38704dbbc9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:31.344355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:31.347377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:31.347377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:31.347377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] PATH_INFO: `/v3/projects/6289a4eae17d460186105cc2e6e4824a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:31.348667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6289a4eae17d460186105cc2e6e4824a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:31.352501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:31.380911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:31.508233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6289a4eae17d460186105cc2e6e4824a', 'request_id': 'req-8fa06048-0452-44ee-a812-0a4944b27bd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:31.515027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6289a4eae17d460186105cc2e6e4824a', 'request_id': 'req-8fa06048-0452-44ee-a812-0a4944b27bd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:31.521945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6289a4eae17d460186105cc2e6e4824a', 'request_id': 'req-8fa06048-0452-44ee-a812-0a4944b27bd6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:31.581660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] The token cache is being invalidate because project 6289a4eae17d460186105cc2e6e4824a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:31.581959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:31.582632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8fa06048-0452-44ee-a812-0a4944b27bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:31.584603 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3883/7755] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:31 2022] DELETE /identity/v3/projects/6289a4eae17d460186105cc2e6e4824a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:27:31.590033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:31.590551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:31.590848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:31.612722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:31.614000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:31.680936 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3873/7756] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:31.689755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:31.690057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:31.690298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:31.711177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:31.716391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:31.721504 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3884/7757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:31.725668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:31.730930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:31.736641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93d899-010f-4cb0-ab52-492b9aaea9e2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:31.742241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:31.742864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:31.743185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:31.743462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:31.744227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:27:31.744665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:31.746288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:31.763359 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3874/7758] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:27:31.764439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:31.774638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b957c41-588f-4514-a2d5-a636679303cf None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:31.780753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:31.781382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:31.785139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:31.785139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:31.785139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:31.785139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:31.946796 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3885/7759] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:27:31.951077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:31.962538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5593ea-05cf-4dce-bc3b-f052a434ed29 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.025268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.025893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.026181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.026462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.027183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.029177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.135663 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3875/7760] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:31 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:32.141124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.155156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543f1f1-669f-41de-97fa-1a54073d76b6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.162222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.162940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.163265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.166707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.166707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.166707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.176661 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3886/7761] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:32.180535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.191718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167afda-146b-413e-9819-48e4bd47c12a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.196721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035fa6-71f1-4597-aba4-5641d2fa24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.197393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035fa6-71f1-4597-aba4-5641d2fa24b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.197734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035fa6-71f1-4597-aba4-5641d2fa24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.198070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035fa6-71f1-4597-aba4-5641d2fa24b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.199106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035fa6-71f1-4597-aba4-5641d2fa24b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.200811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035fa6-71f1-4597-aba4-5641d2fa24b0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.213333 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3876/7762] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:32.217233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.229701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7479c40-bbfe-467c-880d-2e602ebeecdd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.234917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.235608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.235929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.236214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] PATH_INFO: `/v3/projects/57a54585a3c64c59a4a54488fa051d27/users/0ec431fb2f40416f9c6c5fa2775634ef/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.252053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a54585a3c64c59a4a54488fa051d27, user_id=0ec431fb2f40416f9c6c5fa2775634ef, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.254878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.325838 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3887/7763] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:32 2022] PUT /identity/v3/projects/57a54585a3c64c59a4a54488fa051d27/users/0ec431fb2f40416f9c6c5fa2775634ef/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:27:32.335698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.336005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.336284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.370067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] MFA Rules not processed for user `0ec431fb2f40416f9c6c5fa2775634ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:32.371450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:32.439384 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3877/7764] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:32.444000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.510675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751671-d930-4096-bd31-3d6ab4c48089 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.515678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.516303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.516589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.516866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.517508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.522274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.604667 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3888/7765] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:32 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:32.608984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.625152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d310a-9061-4fbb-8e4e-7dbbeb3b9e5c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.682714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:32.688997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.689653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.689938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.690210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.690862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.692834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.826767 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3878/7766] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:32 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:27:32.826982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.837311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0527f-32f4-4def-9631-d45393fa5314 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.842378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.843038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.843340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.843737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.844386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.845995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:32.862307 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3889/7767] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:32.863602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:32.874280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b321f1-fd13-40e3-841b-6d1902692df7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:32.879793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:32.880466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:32.881373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:32.881373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] PATH_INFO: `/v3/projects/791ca01c5e4b46f7ba9a192200ec4649/users/cd5a3e4abfce41b7b7493aa7c61e39ef/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:32.898828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791ca01c5e4b46f7ba9a192200ec4649, user_id=cd5a3e4abfce41b7b7493aa7c61e39ef, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:32.901530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:33.009917 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3879/7768] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:32 2022] PUT /identity/v3/projects/791ca01c5e4b46f7ba9a192200ec4649/users/cd5a3e4abfce41b7b7493aa7c61e39ef/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:33.014145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:33.027161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4413-5f14-4566-b6c1-23fc2b981fe5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:33.039858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:33.101417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc84f-dce3-4af8-bcfc-fe416ec39b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:33.102129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc84f-dce3-4af8-bcfc-fe416ec39b30 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:33.102426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc84f-dce3-4af8-bcfc-fe416ec39b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:33.102734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc84f-dce3-4af8-bcfc-fe416ec39b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:33.103417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc84f-dce3-4af8-bcfc-fe416ec39b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:33.105094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc84f-dce3-4af8-bcfc-fe416ec39b30 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:33.117044 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3890/7769] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:33.120981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:33.133270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926c45-267f-4477-8af0-ef466174b2a2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:33.138042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:33.138862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:33.139219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:33.139505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] PATH_INFO: `/v3/projects/791ca01c5e4b46f7ba9a192200ec4649/users/cd5a3e4abfce41b7b7493aa7c61e39ef/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:33.141510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791ca01c5e4b46f7ba9a192200ec4649, user_id=cd5a3e4abfce41b7b7493aa7c61e39ef, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:33.144293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:33.156085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3880/7770] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:33 2022] PUT /identity/v3/projects/791ca01c5e4b46f7ba9a192200ec4649/users/cd5a3e4abfce41b7b7493aa7c61e39ef/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:33.167554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:33.167897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:33.168131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:33.200168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] MFA Rules not processed for user `cd5a3e4abfce41b7b7493aa7c61e39ef`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:33.201420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:33.290611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3891/7771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:33.307694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:33.311112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:33.379890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8e7e-0fc6-485b-8443-ae4a7be07bb3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:33.384072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:33.384704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:33.385655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:33.385963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:33.397253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:33.398742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:33.410206 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3881/7772] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:33.655231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:33.670038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170c75b-bd95-43de-9bb7-14c0ebf153ec None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:33.674040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158683-ce69-43dd-b796-542513928dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:33.674681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158683-ce69-43dd-b796-542513928dea service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:33.674964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158683-ce69-43dd-b796-542513928dea service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:33.675279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158683-ce69-43dd-b796-542513928dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:33.742738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158683-ce69-43dd-b796-542513928dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:33.744219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158683-ce69-43dd-b796-542513928dea service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:33.753255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3892/7773] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:39.078883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:39.082902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:39.162550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183357b-a336-4047-9f7f-59d97f985518 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:39.170530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:39.171889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:39.176645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:39.176645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] PATH_INFO: `/v3/users/7a755d5f716e4ddb85ffa0fdc389b5c0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:39.176645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a755d5f716e4ddb85ffa0fdc389b5c0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:39.177012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:39.399435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a755d5f716e4ddb85ffa0fdc389b5c0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:39.406399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:39.408864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a755d5f716e4ddb85ffa0fdc389b5c0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:39.409886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a755d5f716e4ddb85ffa0fdc389b5c0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:39.410499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a755d5f716e4ddb85ffa0fdc389b5c0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:39.428249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a755d5f716e4ddb85ffa0fdc389b5c0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:39.684498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3882/7774] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:39 2022] DELETE /identity/v3/users/7a755d5f716e4ddb85ffa0fdc389b5c0 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:39.688909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:39.689533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:39.690061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:39.715847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:39.717386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:39.758678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:39.816250 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3893/7775] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:39.816844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:39.816844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:39.900339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d05fe-8c94-4075-aa7b-601bfd9d55c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:39.902286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:39.909875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:39.909875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:39.909875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:39.917514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:39.918991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:39.939190 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3883/7776] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:40.490767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:40.492728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:40.506899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f34d-f067-407b-b126-5ec23e217ac0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:40.513699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:40.514422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:40.515425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:40.515741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] PATH_INFO: `/v3/projects/6f71a53b641843a3adc06a4b2d7de2b0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:40.523343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f71a53b641843a3adc06a4b2d7de2b0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:40.525262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:40.657135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f71a53b641843a3adc06a4b2d7de2b0', 'request_id': 'req-6cb92a84-b98e-41b6-b559-4e88067feb04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:40.663772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f71a53b641843a3adc06a4b2d7de2b0', 'request_id': 'req-6cb92a84-b98e-41b6-b559-4e88067feb04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:40.669880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f71a53b641843a3adc06a4b2d7de2b0', 'request_id': 'req-6cb92a84-b98e-41b6-b559-4e88067feb04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:40.747244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] The token cache is being invalidate because project 6f71a53b641843a3adc06a4b2d7de2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:40.748399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:40.749615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:40.751390 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3894/7777] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:40 2022] DELETE /identity/v3/projects/6f71a53b641843a3adc06a4b2d7de2b0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:40.756332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:40.767386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e913f8-d4a3-48a7-8e64-ef84e47ccfdf service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:40.833518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:40.834162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:40.834449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:40.834729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] PATH_INFO: `/v3/users/6dcde399561d4f52b4a22f0b018103a1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:40.835978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcde399561d4f52b4a22f0b018103a1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:40.838128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:41.058384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcde399561d4f52b4a22f0b018103a1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.065718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcde399561d4f52b4a22f0b018103a1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.066435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcde399561d4f52b4a22f0b018103a1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.067091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcde399561d4f52b4a22f0b018103a1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.079727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-678d8200-888b-4f43-bd11-d6a158284622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcde399561d4f52b4a22f0b018103a1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.082868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:41.164313 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3884/7778] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:40 2022] DELETE /identity/v3/users/6dcde399561d4f52b4a22f0b018103a1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:27:41.465584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:41.467027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:41.482856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb92a84-b98e-41b6-b559-4e88067feb04 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:41.548687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:41.549322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:41.549609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:41.550433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] PATH_INFO: `/v3/projects/d744ccdcae984be6b6bd1e3d482fbb00` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:41.551655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d744ccdcae984be6b6bd1e3d482fbb00)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:41.553656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:41.713106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd744ccdcae984be6b6bd1e3d482fbb00', 'request_id': 'req-505dd8ce-f990-4185-a318-65bb9ae2a9d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.719438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd744ccdcae984be6b6bd1e3d482fbb00', 'request_id': 'req-505dd8ce-f990-4185-a318-65bb9ae2a9d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.724316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:41.726605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd744ccdcae984be6b6bd1e3d482fbb00', 'request_id': 'req-505dd8ce-f990-4185-a318-65bb9ae2a9d1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.818643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] The token cache is being invalidate because project d744ccdcae984be6b6bd1e3d482fbb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:41.819384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.819688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-505dd8ce-f990-4185-a318-65bb9ae2a9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:41.821238 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3895/7779] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:41 2022] DELETE /identity/v3/projects/d744ccdcae984be6b6bd1e3d482fbb00 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:41.826551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:41.828866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:41.828866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:41.848395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:41.851876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:41.911625 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3885/7780] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:41.919243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:41.920698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:41.920698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:41.947512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:41.948770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:41.960822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3896/7781] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:41.962039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:41.972679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a99b-b5ea-4c35-b0bd-63b60c18af1f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:41.978283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:41.978914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:41.979211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:41.979484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:41.980122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:27:41.980420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:41.982010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:41.994801 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3886/7782] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:27:41.999315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.008960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebfe9d-4c7c-4e06-b57b-fd403153c7e8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.013736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.014347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.014633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.014919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.015600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.017551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.096349 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3897/7783] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:41 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:42.100793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.110912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac7b50-99d2-4f03-a1d8-a394458a0b75 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.168381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.168969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.169261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.169536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.170158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.172164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.282622 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3887/7784] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:42 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:42.286985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.297722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5327c-ed94-4728-b0a2-6ae7f107dcdd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.302433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.303118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.303363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.303645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.304291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.305900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.317968 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3898/7785] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:42.322091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.333184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fc77-c816-4b90-abf7-001067d9cb07 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.337761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e778-5c7a-4511-ba9e-881044d5ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.338354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e778-5c7a-4511-ba9e-881044d5ed75 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.338636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e778-5c7a-4511-ba9e-881044d5ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.338909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e778-5c7a-4511-ba9e-881044d5ed75 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.339574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e778-5c7a-4511-ba9e-881044d5ed75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.341165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e778-5c7a-4511-ba9e-881044d5ed75 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.352222 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3888/7786] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:42.356469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.366983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb639a84-45cb-4c6d-a361-45e0be13f068 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.371881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.372539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.372823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.373217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] PATH_INFO: `/v3/projects/2256e80e473a4090a3e757e3d41ba09d/users/0dad6cdbf4c64d04a169ac71cb07ff08/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.389770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2256e80e473a4090a3e757e3d41ba09d, user_id=0dad6cdbf4c64d04a169ac71cb07ff08, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.392596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.490556 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3899/7787] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:42 2022] PUT /identity/v3/projects/2256e80e473a4090a3e757e3d41ba09d/users/0dad6cdbf4c64d04a169ac71cb07ff08/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:42.500972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.501264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.501547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.535354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] MFA Rules not processed for user `0dad6cdbf4c64d04a169ac71cb07ff08`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:42.536589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:42.589068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:42.607612 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3889/7788] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:42.612119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.678886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc172-00dc-4d95-9d81-0890dbaff1a1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.683636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.684249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.684531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.684807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.685480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.687425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.794117 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3900/7789] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:42 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:42.798360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.809923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc3b0-fc2b-4af1-901d-f43643afa8ef None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:42.876280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:42.877019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:42.877330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:42.877606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:42.878778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:42.880770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:42.981175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3890/7790] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:42 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:42.985294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:42.996445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f35d8-ed01-490d-afaa-141c00f965c3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:43.001310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:43.001906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:43.002188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:43.002496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:43.003684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:43.005265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:43.016614 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3901/7791] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:43.021813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:43.032528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111696-0fcf-4853-8134-d74d3fcfbc2d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:43.037919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:43.039375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:43.039375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:43.039375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] PATH_INFO: `/v3/projects/e163fe1e404d4df0a651561bd34c4ed5/users/8bc6391e08524511a0a2a4a97b679695/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:43.055822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e163fe1e404d4df0a651561bd34c4ed5, user_id=8bc6391e08524511a0a2a4a97b679695, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:43.058409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:43.140030 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3891/7792] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:43 2022] PUT /identity/v3/projects/e163fe1e404d4df0a651561bd34c4ed5/users/8bc6391e08524511a0a2a4a97b679695/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:27:43.143964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:43.154842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7849f-f172-4185-90a2-b350d7af1e4c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:43.208093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:43.214203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf734-b967-4448-b068-78c8ca275dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:43.214821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf734-b967-4448-b068-78c8ca275dec admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:43.215145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf734-b967-4448-b068-78c8ca275dec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:43.215426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf734-b967-4448-b068-78c8ca275dec admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:43.216064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf734-b967-4448-b068-78c8ca275dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:43.217682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf734-b967-4448-b068-78c8ca275dec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:43.229660 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3902/7793] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:43.233642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:43.244444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d300b-59ba-4e03-af6d-f3a83f86d625 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:43.249396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:43.250062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:43.253437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:43.253437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] PATH_INFO: `/v3/projects/e163fe1e404d4df0a651561bd34c4ed5/users/8bc6391e08524511a0a2a4a97b679695/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:43.253437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e163fe1e404d4df0a651561bd34c4ed5, user_id=8bc6391e08524511a0a2a4a97b679695, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:43.255406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:43.266799 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3892/7794] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:43 2022] PUT /identity/v3/projects/e163fe1e404d4df0a651561bd34c4ed5/users/8bc6391e08524511a0a2a4a97b679695/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:43.279861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1550801-a337-48f2-9287-6659ca294848 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:43.280127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1550801-a337-48f2-9287-6659ca294848 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:43.280421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1550801-a337-48f2-9287-6659ca294848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:43.311434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-a1550801-a337-48f2-9287-6659ca294848 None None] MFA Rules not processed for user `8bc6391e08524511a0a2a4a97b679695`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:43.312624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a1550801-a337-48f2-9287-6659ca294848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:43.386966 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3903/7795] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:43.398513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:43.400286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:43.463470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f43b3-9f7a-4aeb-8266-eff7b3b51cec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:43.467176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b48bc-eeee-4a4b-b40f-43af38db02a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:43.467790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b48bc-eeee-4a4b-b40f-43af38db02a3 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:43.468071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b48bc-eeee-4a4b-b40f-43af38db02a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:43.468343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b48bc-eeee-4a4b-b40f-43af38db02a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:43.478595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b48bc-eeee-4a4b-b40f-43af38db02a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:43.480056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b48bc-eeee-4a4b-b40f-43af38db02a3 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:43.489795 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3893/7796] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:43 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:46.216190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1550801-a337-48f2-9287-6659ca294848 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:46.284983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1550801-a337-48f2-9287-6659ca294848 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:46.289561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:46.290204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:46.290488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:46.290765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] PATH_INFO: `/v3/users/0dad6cdbf4c64d04a169ac71cb07ff08` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:46.291939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dad6cdbf4c64d04a169ac71cb07ff08)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:46.293920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:46.510999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dad6cdbf4c64d04a169ac71cb07ff08'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:46.518304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dad6cdbf4c64d04a169ac71cb07ff08'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:46.519057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dad6cdbf4c64d04a169ac71cb07ff08'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:46.532533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dad6cdbf4c64d04a169ac71cb07ff08'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:46.533270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dad6cdbf4c64d04a169ac71cb07ff08'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:46.604096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:46.609391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3904/7797] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:46 2022] DELETE /identity/v3/users/0dad6cdbf4c64d04a169ac71cb07ff08 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:46.615078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:46.615599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:46.615716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:46.634936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:46.640450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:46.683926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:46.704387 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3894/7798] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:27:46.714581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:46.716124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:46.781556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6853b-5777-44b7-80cf-4ed4e37ac0f3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:46.785812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:46.786564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:46.786857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:46.787185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:46.797270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:46.798748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:46.809410 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3905/7799] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:47.302055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:47.303548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:47.318131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07b30-158b-442d-a548-5fa37e714bb8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:47.322925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:47.323649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:47.323944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:47.324207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] PATH_INFO: `/v3/projects/2256e80e473a4090a3e757e3d41ba09d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:47.325351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2256e80e473a4090a3e757e3d41ba09d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:47.327923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:47.434199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2256e80e473a4090a3e757e3d41ba09d', 'request_id': 'req-81fafba8-28f1-42db-a478-7d3b9848c91a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.440954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2256e80e473a4090a3e757e3d41ba09d', 'request_id': 'req-81fafba8-28f1-42db-a478-7d3b9848c91a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.447659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2256e80e473a4090a3e757e3d41ba09d', 'request_id': 'req-81fafba8-28f1-42db-a478-7d3b9848c91a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.506445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] The token cache is being invalidate because project 2256e80e473a4090a3e757e3d41ba09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:47.506747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.507400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.508942 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3895/7800] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:47 2022] DELETE /identity/v3/projects/2256e80e473a4090a3e757e3d41ba09d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:47.513542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:47.530944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00df4c-e7f7-42ed-891a-2c572e7736ca service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:47.593610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:47.594166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:47.594448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:47.594724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] PATH_INFO: `/v3/users/8bc6391e08524511a0a2a4a97b679695` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:47.595907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc6391e08524511a0a2a4a97b679695)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:47.597824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:47.834585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc6391e08524511a0a2a4a97b679695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.842242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc6391e08524511a0a2a4a97b679695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.843084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc6391e08524511a0a2a4a97b679695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.873120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc6391e08524511a0a2a4a97b679695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:47.883418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cc7ff6f9-f356-4595-a4a2-eef0b959873f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc6391e08524511a0a2a4a97b679695'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:48.031375 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3906/7801] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:27:47 2022] DELETE /identity/v3/users/8bc6391e08524511a0a2a4a97b679695 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:48.372604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:48.375659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:48.398214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fafba8-28f1-42db-a478-7d3b9848c91a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:48.490923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:48.491708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:48.491991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:48.492266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] PATH_INFO: `/v3/projects/e163fe1e404d4df0a651561bd34c4ed5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:48.493552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e163fe1e404d4df0a651561bd34c4ed5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:48.495637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:48.637596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e163fe1e404d4df0a651561bd34c4ed5', 'request_id': 'req-7e6b859f-4fcb-4c11-8332-3559df3e0b40'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:48.642246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e163fe1e404d4df0a651561bd34c4ed5', 'request_id': 'req-7e6b859f-4fcb-4c11-8332-3559df3e0b40'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:48.649229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e163fe1e404d4df0a651561bd34c4ed5', 'request_id': 'req-7e6b859f-4fcb-4c11-8332-3559df3e0b40'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:48.713741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:48.720872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] The token cache is being invalidate because project e163fe1e404d4df0a651561bd34c4ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:27:48.721173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:48.722009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7e6b859f-4fcb-4c11-8332-3559df3e0b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:27:48.723854 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3896/7802] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:27:48 2022] DELETE /identity/v3/projects/e163fe1e404d4df0a651561bd34c4ed5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:48.728662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:48.729195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:48.729313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:48.751833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:48.753704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:48.769360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:48.821427 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3907/7803] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:27:48.829461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:48.830009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:48.830358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:48.851602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:48.852861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:48.860993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3897/7804] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:48.866000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:48.876442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d61dcb-4117-4213-aded-96ba75c121b6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:48.881523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:48.882130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:48.882417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:48.882694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:48.883393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:27:48.883707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:48.885356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:48.899242 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3908/7805] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:27:48.903751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:48.914285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63793bb-aad1-4d98-8a8e-fd207cdaa828 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:48.919189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:48.919798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:48.921856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:48.921856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:48.921856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:48.923027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:49.032760 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3898/7806] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:27:48 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:27:49.035065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:49.047211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223f6a2-363b-4868-8982-a9404d40856c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:49.117330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:49.117647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:49.118136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:49.118527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:49.119285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:49.121298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:49.262262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3909/7807] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:27:49 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:27:49.263468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:49.278104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd83e26-c303-4129-9c05-f2e90a8badef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:49.288183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:49.288916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:49.289298 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:49.289649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:49.290392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:49.292127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:49.306861 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3899/7808] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:49.310117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:49.325598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc33-4683-48f9-a651-87fe38f5a7e5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:49.332254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc08592-caf7-4c82-8639-2f9520bd90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:49.332869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08592-caf7-4c82-8639-2f9520bd90c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:49.333152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08592-caf7-4c82-8639-2f9520bd90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:49.333430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc08592-caf7-4c82-8639-2f9520bd90c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:49.334120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc08592-caf7-4c82-8639-2f9520bd90c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:49.336825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc08592-caf7-4c82-8639-2f9520bd90c2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:49.350172 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3910/7809] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:27:49.354119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:49.365276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3d850-583f-4df1-9239-81a02bd181bb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:49.370775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:49.372033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:49.372033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:49.372033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] PATH_INFO: `/v3/projects/68b3b8e8b9554f6482de411dc73bb5b6/users/90435f845a23475c8e960306766e2c85/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:49.396100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b3b8e8b9554f6482de411dc73bb5b6, user_id=90435f845a23475c8e960306766e2c85, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:49.399877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:49.489402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3900/7810] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:27:49 2022] PUT /identity/v3/projects/68b3b8e8b9554f6482de411dc73bb5b6/users/90435f845a23475c8e960306766e2c85/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:27:49.501448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:49.502009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:49.502340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:49.564305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] MFA Rules not processed for user `90435f845a23475c8e960306766e2c85`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:27:49.566257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:49.695274 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3911/7811] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:27:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:27:49.708464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:27:49.710775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:27:49.823260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00abb-7988-4155-803a-ebe7cc4dcda3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:27:49.827349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da135241-02ef-475b-8dd0-a6253d336574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:27:49.828363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da135241-02ef-475b-8dd0-a6253d336574 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:27:49.828363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da135241-02ef-475b-8dd0-a6253d336574 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:27:49.828595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da135241-02ef-475b-8dd0-a6253d336574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:27:49.841127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da135241-02ef-475b-8dd0-a6253d336574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:27:49.842662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da135241-02ef-475b-8dd0-a6253d336574 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:27:49.853737 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3901/7812] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:27:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:27:59.682803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:27:59.849104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:15.253074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:15.324285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76decbb6-e9cb-46d2-a37f-5b06595844b5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:15.328898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:15.329524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:15.329805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:15.330102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] PATH_INFO: `/v3/users/90435f845a23475c8e960306766e2c85` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:15.331791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90435f845a23475c8e960306766e2c85)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:15.333821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:15.543179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90435f845a23475c8e960306766e2c85'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:15.550672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90435f845a23475c8e960306766e2c85'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:15.551396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90435f845a23475c8e960306766e2c85'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:15.563328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90435f845a23475c8e960306766e2c85'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:15.563996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90435f845a23475c8e960306766e2c85'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:15.649312 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3912/7813] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:28:15 2022] DELETE /identity/v3/users/90435f845a23475c8e960306766e2c85 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:15.654024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:15.654576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:15.654576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:15.675250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:15.683375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:15.738463 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3902/7814] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:15.748527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:15.758543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:15.817797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad83b-e00d-4bd3-91a5-fe0a068a2df4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:15.822949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77684f0f-7744-4053-a82c-816dda29c750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:15.824164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684f0f-7744-4053-a82c-816dda29c750 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:15.824164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684f0f-7744-4053-a82c-816dda29c750 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:15.824475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77684f0f-7744-4053-a82c-816dda29c750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:15.835190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77684f0f-7744-4053-a82c-816dda29c750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:15.836784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77684f0f-7744-4053-a82c-816dda29c750 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:15.847979 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3913/7815] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:16.107407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.109206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:16.123324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea203a-47d5-4466-a2bc-29a279285e91 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.128277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.128923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.129209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.129485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] PATH_INFO: `/v3/projects/68b3b8e8b9554f6482de411dc73bb5b6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.130631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b3b8e8b9554f6482de411dc73bb5b6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.132814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:16.252971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b3b8e8b9554f6482de411dc73bb5b6', 'request_id': 'req-688985f7-7d86-4b49-9f90-717e0d0d1a4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:16.260858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b3b8e8b9554f6482de411dc73bb5b6', 'request_id': 'req-688985f7-7d86-4b49-9f90-717e0d0d1a4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:16.270288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b3b8e8b9554f6482de411dc73bb5b6', 'request_id': 'req-688985f7-7d86-4b49-9f90-717e0d0d1a4a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:16.375998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] The token cache is being invalidate because project 68b3b8e8b9554f6482de411dc73bb5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:28:16.376351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:16.377216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-688985f7-7d86-4b49-9f90-717e0d0d1a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:16.378809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3903/7816] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:28:16 2022] DELETE /identity/v3/projects/68b3b8e8b9554f6482de411dc73bb5b6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:16.383889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.384497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.384497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.406039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:16.408929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:16.425996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:16.469928 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3914/7817] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:16.478640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.478935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.479254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.500210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:16.501453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:16.509594 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3904/7818] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:16.513873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.525480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce7494-2a80-4227-bfc5-e492e9a35f32 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.534497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.534497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.534497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.534497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.535210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:28:16.535210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.535210 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:16.548259 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3915/7819] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:28:16.552549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.562531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124c0ff-d245-493e-9756-72cfce38d157 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.568290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.568427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.568687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.568963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.569598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.571547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:16.679779 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3905/7820] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:28:16 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:16.684410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.695427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2eaf3-d96a-4d50-b7c6-f782c0951302 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.754536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.755199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.755567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.755789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.756428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.758467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:16.866904 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3916/7821] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:28:16 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:16.870969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.882212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c808-3fb2-4ce5-a173-27f557cfba13 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.887355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.887508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.887758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.888027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.888658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.890278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:16.901282 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3906/7822] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:16.905196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.915475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e1527-bf59-43aa-83df-21ac5c11fb68 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.920173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c392ba-507e-4e62-9193-35631368e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.920769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c392ba-507e-4e62-9193-35631368e91b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.921051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c392ba-507e-4e62-9193-35631368e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.921328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c392ba-507e-4e62-9193-35631368e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.921956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c392ba-507e-4e62-9193-35631368e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.923584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c392ba-507e-4e62-9193-35631368e91b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:16.935111 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3917/7823] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:28:16.941057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:16.950367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27e13b-7c05-4aa2-bd66-3a14e07dbb0f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:16.955930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:16.956622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:16.956909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:16.957253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] PATH_INFO: `/v3/projects/5a56b857c26e40cda8808489eaaa8914/users/3c100d7d250b4862ab4f020a245b411c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:16.972959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a56b857c26e40cda8808489eaaa8914, user_id=3c100d7d250b4862ab4f020a245b411c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:16.975643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:17.043625 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3907/7824] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:28:16 2022] PUT /identity/v3/projects/5a56b857c26e40cda8808489eaaa8914/users/3c100d7d250b4862ab4f020a245b411c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:17.054184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:17.054650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:17.055161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:17.083620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] MFA Rules not processed for user `3c100d7d250b4862ab4f020a245b411c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:17.113190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:17.154476 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3918/7825] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:17.165056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:17.166868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:17.193236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:17.243815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8a86b-29cb-42c3-a695-5606c9cc6657 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:17.247655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f278d-2e52-4fe9-9628-9a76c6a12431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:17.248274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f278d-2e52-4fe9-9628-9a76c6a12431 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:17.248551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f278d-2e52-4fe9-9628-9a76c6a12431 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:17.248824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f278d-2e52-4fe9-9628-9a76c6a12431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:17.260728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f278d-2e52-4fe9-9628-9a76c6a12431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:17.262151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f278d-2e52-4fe9-9628-9a76c6a12431 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:17.271732 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3908/7826] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:17.287478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:17.309072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:17.364202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80695b1b-5372-4925-ae59-3dd04e44fd69 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:17.369453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:17.370150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:17.370440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:17.370818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] PATH_INFO: `/v3/users/3c100d7d250b4862ab4f020a245b411c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:17.374500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c100d7d250b4862ab4f020a245b411c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:17.376579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:17.538198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c100d7d250b4862ab4f020a245b411c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:17.545404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c100d7d250b4862ab4f020a245b411c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:17.546126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c100d7d250b4862ab4f020a245b411c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:17.565187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c100d7d250b4862ab4f020a245b411c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:17.566604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c100d7d250b4862ab4f020a245b411c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:17.675464 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3919/7827] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:28:17 2022] DELETE /identity/v3/users/3c100d7d250b4862ab4f020a245b411c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:17.680142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:17.680698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:17.680698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:17.701032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:17.702531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:17.773674 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3909/7828] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:17.794227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:17.795947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:17.869514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6939f-f9fe-448b-a266-0d244bdcc4e5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:17.873866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:17.874459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:17.874815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:17.875158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:17.895491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:17.897949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:17.918267 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3920/7829] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:18.417279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:18.419153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:18.448134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5cf29-cfc7-45b8-93fb-4e13e786b969 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:18.462162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:18.463693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:18.464037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:18.464327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] PATH_INFO: `/v3/projects/5a56b857c26e40cda8808489eaaa8914` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:18.466683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a56b857c26e40cda8808489eaaa8914)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:18.467528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:18.469228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:18.469850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:18.491425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3a72e-f966-4d58-a7bc-c9932adc4446 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:18.495481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:18.496111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:18.496399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:18.496684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:18.499940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:18.518572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:18.520072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7c0c7-da7d-435b-ac83-677fdd1eca8c service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:18.532381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3921/7830] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:28:18.684966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a56b857c26e40cda8808489eaaa8914', 'request_id': 'req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:18.691638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a56b857c26e40cda8808489eaaa8914', 'request_id': 'req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:18.698356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a56b857c26e40cda8808489eaaa8914', 'request_id': 'req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:18.771488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] The token cache is being invalidate because project 5a56b857c26e40cda8808489eaaa8914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:28:18.772324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:18.773192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3c22f1ac-e9f1-4d47-a405-3ccdd28f9faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:18.779203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3910/7831] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:28:18 2022] DELETE /identity/v3/projects/5a56b857c26e40cda8808489eaaa8914 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:18.780949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:18.781632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:18.782062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:18.808077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:18.809351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:18.842894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:18.885271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3922/7832] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:18.892522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:18.892822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:18.893103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:18.915311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:18.916535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:18.925305 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3911/7833] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:18.929572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:18.940961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df244c-58c3-4ba7-8b33-36564d0247d2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:18.946287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:18.946907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:18.947230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:18.947504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:18.948164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:28:18.948466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:18.950122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:18.964611 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3923/7834] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:28:18.968481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:18.978203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e806e-6a23-4d8e-9c45-b2ab81e7b56f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:18.982831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:18.983475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:18.983759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:18.984028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:18.984813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:18.986834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:19.116803 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3912/7835] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:28:18 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:19.118071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:19.129234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a78e-99bd-4e47-8294-e33e3dffc4c0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:19.193645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:19.194314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:19.194602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:19.194883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:19.195639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:19.197753 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:19.292282 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3924/7836] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:28:19 2022] POST /identity/v3/users => generated 279 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:19.292425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:19.308083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6995-c07c-43ae-aea8-9634c88ca975 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:19.316407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:19.317417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:19.320852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:19.320852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:19.320852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:19.322213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:19.334191 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3913/7837] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:19.337191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:19.347969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33e4c-4c63-49b7-93b5-0c69a43516fa admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:19.353212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812daca9-cbc9-429f-bb77-7259cc4a394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:19.353945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812daca9-cbc9-429f-bb77-7259cc4a394c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:19.354378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812daca9-cbc9-429f-bb77-7259cc4a394c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:19.354727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812daca9-cbc9-429f-bb77-7259cc4a394c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:19.355453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812daca9-cbc9-429f-bb77-7259cc4a394c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:19.357364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812daca9-cbc9-429f-bb77-7259cc4a394c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:19.370913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3925/7838] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:19.375132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:19.387090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff959-1914-4d94-a3eb-eef16d3de51b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:19.391971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:19.392667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:19.392952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:19.393236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] PATH_INFO: `/v3/projects/a870697457f04f8c874906e9a6523c81/users/0bf12cad06c04587a4ae09740f350838/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:19.398774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:19.417369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a870697457f04f8c874906e9a6523c81, user_id=0bf12cad06c04587a4ae09740f350838, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:19.417369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:19.522196 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3914/7839] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:28:19 2022] PUT /identity/v3/projects/a870697457f04f8c874906e9a6523c81/users/0bf12cad06c04587a4ae09740f350838/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:28:19.532966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:19.533811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:19.534037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:19.566561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] MFA Rules not processed for user `0bf12cad06c04587a4ae09740f350838`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:19.567907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:19.653716 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3926/7840] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:19.694592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:19.699594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:19.766526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be30a-9c05-4ce0-bafe-f3c1cc278a5e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:19.779871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:19.780647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:19.781035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:19.781445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:19.792868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:19.794526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:19.806093 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3915/7841] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:28.694362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:28.696710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:28.727549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:28.786683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee0424-f78b-428b-81d5-0794b75b6d4b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:28.793684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:28.794477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:28.795475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:28.796135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] PATH_INFO: `/v3/users/d1ac283e33a040a5ae2b6c85610c16db` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:28.797693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ac283e33a040a5ae2b6c85610c16db)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:28.801182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:29.046760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ac283e33a040a5ae2b6c85610c16db'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.056116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ac283e33a040a5ae2b6c85610c16db'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.056958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ac283e33a040a5ae2b6c85610c16db'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.073126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ac283e33a040a5ae2b6c85610c16db'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.074054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ac283e33a040a5ae2b6c85610c16db'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.134200 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3927/7842] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:28:28 2022] DELETE /identity/v3/users/d1ac283e33a040a5ae2b6c85610c16db => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:29.522603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:29.538899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c1cd-c414-4e03-9ec3-25df018a57a8 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:29.602492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:29.603035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:29.603336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:29.603610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] PATH_INFO: `/v3/projects/9d6767d15bea403e985c76bf6f2f0905` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:29.604712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6767d15bea403e985c76bf6f2f0905)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:29.606611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:29.741262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6767d15bea403e985c76bf6f2f0905', 'request_id': 'req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.746823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6767d15bea403e985c76bf6f2f0905', 'request_id': 'req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.753177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6767d15bea403e985c76bf6f2f0905', 'request_id': 'req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.876885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] The token cache is being invalidate because project 9d6767d15bea403e985c76bf6f2f0905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:28:29.877217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.878330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:29.880236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3916/7843] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:28:29 2022] DELETE /identity/v3/projects/9d6767d15bea403e985c76bf6f2f0905 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:28:29.886448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:29.888065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:29.902863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db0ee-9205-4a2c-9753-c5547ea654a0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:29.965340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:29.966036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:29.966321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:29.966633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] PATH_INFO: `/v3/users/dc31d3ef125048b2b22ff5bc4a7b170e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:29.967932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc31d3ef125048b2b22ff5bc4a7b170e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:29.969948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:30.277565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:30.280094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc31d3ef125048b2b22ff5bc4a7b170e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.287686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc31d3ef125048b2b22ff5bc4a7b170e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.288478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc31d3ef125048b2b22ff5bc4a7b170e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.301694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc31d3ef125048b2b22ff5bc4a7b170e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.302382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc31d3ef125048b2b22ff5bc4a7b170e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.407557 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3928/7844] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:28:29 2022] DELETE /identity/v3/users/dc31d3ef125048b2b22ff5bc4a7b170e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:30.696741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:30.698663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:30.715963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4bac7-ac6d-4472-bf5d-9d52154f5cea admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:30.730261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:30.782663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:30.782663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:30.782663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:30.782663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] PATH_INFO: `/v3/projects/245c6a95d2c448e4b0df37db1a2dd2ee` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:30.783700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=245c6a95d2c448e4b0df37db1a2dd2ee)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:30.785009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:30.950303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245c6a95d2c448e4b0df37db1a2dd2ee', 'request_id': 'req-4fd3df6a-90fa-44c4-b180-9594be962849'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.956337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245c6a95d2c448e4b0df37db1a2dd2ee', 'request_id': 'req-4fd3df6a-90fa-44c4-b180-9594be962849'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:30.964496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245c6a95d2c448e4b0df37db1a2dd2ee', 'request_id': 'req-4fd3df6a-90fa-44c4-b180-9594be962849'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:31.121613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] The token cache is being invalidate because project 245c6a95d2c448e4b0df37db1a2dd2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:28:31.121910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:31.122682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3df6a-90fa-44c4-b180-9594be962849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:31.124243 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3917/7845] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:28:30 2022] DELETE /identity/v3/projects/245c6a95d2c448e4b0df37db1a2dd2ee => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:37.045892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:37.047526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:37.066198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343240-e591-4d4a-9e4e-cee6dcb52920 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:37.130892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:37.131573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:37.131859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:37.132139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] PATH_INFO: `/v3/users/0bf12cad06c04587a4ae09740f350838` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:37.133322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf12cad06c04587a4ae09740f350838)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:37.135355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:37.366918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf12cad06c04587a4ae09740f350838'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:37.374469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf12cad06c04587a4ae09740f350838'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:37.375235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf12cad06c04587a4ae09740f350838'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:37.389430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf12cad06c04587a4ae09740f350838'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:37.390340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf12cad06c04587a4ae09740f350838'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:37.482809 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3929/7846] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:28:37 2022] DELETE /identity/v3/users/0bf12cad06c04587a4ae09740f350838 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:28:37.487529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:37.488060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:37.488060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:37.506745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:37.507992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:37.569113 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3918/7847] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:37.579309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:37.581478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:37.633070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:37.651648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fe24-14eb-436d-a15b-25acccbe78f0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:37.656051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:37.656668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:37.656953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:37.657231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:37.667421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:37.668878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:37.679807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3930/7848] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:37.699384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:37.701027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:37.760060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:37.793320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fefb3-554a-4c1b-aa75-e337955a82b5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:37.798879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:37.799535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:37.799821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:37.800097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:37.801949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:37.817989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:37.819729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b235e72-33a3-4c62-9f1f-450939bce059 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:37.835348 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3919/7849] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:37.987993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:37.989501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:38.005262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b42c50-b78d-4c49-849d-785480fc1b70 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.010083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.010716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.010998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.011306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] PATH_INFO: `/v3/projects/a870697457f04f8c874906e9a6523c81` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.012423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a870697457f04f8c874906e9a6523c81)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.014403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:38.193234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a870697457f04f8c874906e9a6523c81', 'request_id': 'req-f49c32eb-b509-4f84-8e27-cf26f780740b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:38.199640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a870697457f04f8c874906e9a6523c81', 'request_id': 'req-f49c32eb-b509-4f84-8e27-cf26f780740b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:38.205769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a870697457f04f8c874906e9a6523c81', 'request_id': 'req-f49c32eb-b509-4f84-8e27-cf26f780740b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:38.294929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] The token cache is being invalidate because project a870697457f04f8c874906e9a6523c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:28:38.295263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:38.298993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f49c32eb-b509-4f84-8e27-cf26f780740b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:38.298993 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3931/7850] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:28:37 2022] DELETE /identity/v3/projects/a870697457f04f8c874906e9a6523c81 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:38.303270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.303591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.303867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.324043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:38.325272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:38.386589 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3920/7851] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:38.394761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.395109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.395390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.420467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:38.421610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:38.431278 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3932/7852] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:28:38.435570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:38.445678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b39256-9442-4fcc-a030-00c5d6abfcd0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.450523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.451140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.451433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.457399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.457399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:28:38.457399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.457399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:38.466472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3921/7853] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:28:38.471457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:38.481364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575405-7bd2-44eb-b813-a4f9069e0de8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.486728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.487370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.487651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.487926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.488569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.490477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:38.662381 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3933/7854] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:28:38 2022] POST /identity/v3/projects => generated 355 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:38.666642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:38.677907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd8f5-6e2c-4591-9750-a4b1a39ada83 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.735529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.736171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.736456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.736733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.737355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.739297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:38.803512 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3922/7855] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:28:38 2022] POST /identity/v3/users => generated 278 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:38.807814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:38.818745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13e67-41ae-47fb-852f-c7569e02b9a9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.823582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.824197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.824481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.826505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.826505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.827106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:38.838038 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3934/7856] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:38.842144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:38.853022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e54b0-2e29-42aa-8bba-893108916f7d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.857608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ff3c-7417-4908-8a2a-13bca01a9b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.858200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ff3c-7417-4908-8a2a-13bca01a9b9d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.858480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ff3c-7417-4908-8a2a-13bca01a9b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.858752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ff3c-7417-4908-8a2a-13bca01a9b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.859490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80ff3c-7417-4908-8a2a-13bca01a9b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.861134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80ff3c-7417-4908-8a2a-13bca01a9b9d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:38.872302 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3923/7857] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:38.876825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:38.887478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dbbb4-2837-482f-a973-1325e118920e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:38.892821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:38.893484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:38.893766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:38.894055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] PATH_INFO: `/v3/projects/e17c292a841d411a99a7a95db6140f41/users/99d03b2c36c543ae8ded351fac0f8c04/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:38.910947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17c292a841d411a99a7a95db6140f41, user_id=99d03b2c36c543ae8ded351fac0f8c04, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:38.913683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.008241 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3935/7858] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:28:38 2022] PUT /identity/v3/projects/e17c292a841d411a99a7a95db6140f41/users/99d03b2c36c543ae8ded351fac0f8c04/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:39.018642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.018932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.019242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.049791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] MFA Rules not processed for user `99d03b2c36c543ae8ded351fac0f8c04`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:39.051202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:39.070630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:39.120064 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3924/7859] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:39.124656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.187277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d40d5-31cb-4203-855f-dd2b9c4def66 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.192868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.194812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.194812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.194812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.194812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.196705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.202421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:39.274079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3936/7860] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:28:39 2022] POST /identity/v3/projects => generated 355 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:39.278537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.289840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a2e9-d033-41a0-8213-b33e987bcf77 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.351779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.352425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.352715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.352988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.353681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.355663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.469174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3925/7861] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:28:39 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:39.470169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.480901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f66af3-1837-4d06-b482-f38de418a3e2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.486462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.487137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.487440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.488042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.488402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.490025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.504915 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3937/7862] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:39.508506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.518679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431171ad-ea30-4a9a-b405-fb00a6bc20c9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.524279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.525008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.525321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.525690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] PATH_INFO: `/v3/projects/b8e28e41663240a4ae2e8eb4e579a44a/users/db72094ee0f648e7b501dd08c6a1911c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.541668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e28e41663240a4ae2e8eb4e579a44a, user_id=db72094ee0f648e7b501dd08c6a1911c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.544568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.633212 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3926/7863] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:28:39 2022] PUT /identity/v3/projects/b8e28e41663240a4ae2e8eb4e579a44a/users/db72094ee0f648e7b501dd08c6a1911c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:28:39.637490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.648492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b2f3f-d3da-44d6-9899-85ba0234b532 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.709336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b601d0-d77f-452a-8121-aa1f66880454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.709949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b601d0-d77f-452a-8121-aa1f66880454 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.710232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b601d0-d77f-452a-8121-aa1f66880454 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.710504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b601d0-d77f-452a-8121-aa1f66880454 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.711169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b601d0-d77f-452a-8121-aa1f66880454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.712766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b601d0-d77f-452a-8121-aa1f66880454 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.722642 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3938/7864] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:28:39.726904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.738287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b43c47-9ed7-41da-9c3a-d85cf935fbd1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.743189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.743848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.744130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.744405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] PATH_INFO: `/v3/projects/b8e28e41663240a4ae2e8eb4e579a44a/users/db72094ee0f648e7b501dd08c6a1911c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.746350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e28e41663240a4ae2e8eb4e579a44a, user_id=db72094ee0f648e7b501dd08c6a1911c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.749033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.759853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3927/7865] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:28:39 2022] PUT /identity/v3/projects/b8e28e41663240a4ae2e8eb4e579a44a/users/db72094ee0f648e7b501dd08c6a1911c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:39.770783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.771108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.771372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.800673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] MFA Rules not processed for user `db72094ee0f648e7b501dd08c6a1911c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:39.802894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:39.871584 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3939/7866] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:39.882824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:39.884648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:39.947342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97debb52-4fe4-443b-ad42-bd8e0613dd1c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:39.951054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:39.951659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:39.951939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:39.952211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:39.961172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:39.962654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:39.972692 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3928/7867] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:40.170978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:40.183798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ededff-29fb-4013-a628-05bd548811e1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:40.190182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:40.190182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:40.190182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:40.190182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:40.244555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:40.246907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:40.248304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:40.258002 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3940/7868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:48.715352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:48.716861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:48.736014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:48.791661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99a477-fba7-4f15-ac5c-34b30256ef88 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:48.796729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:48.797330 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:48.797606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:48.797874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:48.800184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:48.814934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:48.816558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:48.829349 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3929/7869] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:50.328790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:50.561660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:50.563196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:50.625922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18685a-2e81-42c7-8006-1c15ecee4a4d service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:50.630294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:50.630918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:50.631235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:50.631574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:50.633481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:50.701359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:50.702810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:50.713554 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3941/7870] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:28:54.815562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:54.817071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:54.832455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a551-3c9c-4a3b-b0fb-b7a86536a9ee service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:54.837070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:54.837703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:54.842035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:54.842035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] PATH_INFO: `/v3/users/5458eb197e36456fb7785c8625ed3140` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:54.842035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5458eb197e36456fb7785c8625ed3140)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:54.842035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:55.045916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5458eb197e36456fb7785c8625ed3140'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.053772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5458eb197e36456fb7785c8625ed3140'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.054584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5458eb197e36456fb7785c8625ed3140'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.055227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5458eb197e36456fb7785c8625ed3140'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.067391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5580db12-c69f-45d8-a47e-ccbcc9232080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5458eb197e36456fb7785c8625ed3140'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.151516 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3930/7871] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:28:54 2022] DELETE /identity/v3/users/5458eb197e36456fb7785c8625ed3140 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:55.411330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:55.430670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832dd8e-77c6-4ca5-be51-7c0bd2f5d71f service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:55.498782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:55.499498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:55.502678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:55.502678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] PATH_INFO: `/v3/projects/2f6a64ebac2146b9a92c0ed0ac76a5fb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:55.502678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6a64ebac2146b9a92c0ed0ac76a5fb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:55.504091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:55.661561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'request_id': 'req-286315c3-dcac-46da-8de9-92e1726a40b9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.664304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:55.669095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'request_id': 'req-286315c3-dcac-46da-8de9-92e1726a40b9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.675487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6a64ebac2146b9a92c0ed0ac76a5fb', 'request_id': 'req-286315c3-dcac-46da-8de9-92e1726a40b9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.775596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] The token cache is being invalidate because project 2f6a64ebac2146b9a92c0ed0ac76a5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:28:55.775895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.776574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286315c3-dcac-46da-8de9-92e1726a40b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:28:55.778160 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3942/7872] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:28:55 2022] DELETE /identity/v3/projects/2f6a64ebac2146b9a92c0ed0ac76a5fb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:55.783653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:55.784024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:55.784380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:55.806529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:55.807960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:55.876736 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3931/7873] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:55.885285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:55.885662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:55.885940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:55.909345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:55.910808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:55.919378 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3943/7874] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:28:55.924513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:55.935782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d08c8-a2bd-4c99-8f1f-7aa74f7bde19 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:55.941569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:55.942235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:55.942520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:55.942958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:55.943641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:28:55.943951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:55.945694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:55.959833 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3932/7875] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:28:55.966793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:55.976642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625c2c-ec82-4844-8712-8b36a3218c1c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:55.983518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:55.984225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:55.984511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:55.984788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:55.985461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:55.987957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:56.101699 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3944/7876] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:28:55 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:28:56.106402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:56.114348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:28:56.118296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5040d3-030f-49bb-b8c0-2a66d44126a7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:56.180425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:56.181020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:56.181307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:56.185156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:56.185156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:56.185156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:56.298278 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3933/7877] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:28:56 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:28:56.300795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:56.312856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4b40c-87e4-474d-a40d-5454c6d1791a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:56.317365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:56.317985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:56.318271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:56.318552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:56.319419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:56.321032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:56.331966 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3945/7878] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:28:56.336255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:56.347943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fa2a8-5e4f-4a87-aff3-9cf439a4be44 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:56.353559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610830e-7664-420d-b21e-ea792d282dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:56.357335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610830e-7664-420d-b21e-ea792d282dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:56.357335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610830e-7664-420d-b21e-ea792d282dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:56.357335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610830e-7664-420d-b21e-ea792d282dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:56.357335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610830e-7664-420d-b21e-ea792d282dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:56.357752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610830e-7664-420d-b21e-ea792d282dc6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:56.369010 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3934/7879] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:28:56.373209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:56.384344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ab868-9ee8-4dbb-9893-2d6175ba8e0e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:56.389112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:56.389827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:56.390105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:56.390380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] PATH_INFO: `/v3/projects/54e35bc5bedd4f1b95313973f8118470/users/c3ea9be43d92471584942594b3febc06/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:56.406238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e35bc5bedd4f1b95313973f8118470, user_id=c3ea9be43d92471584942594b3febc06, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:56.409610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:56.546916 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3946/7880] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:28:56 2022] PUT /identity/v3/projects/54e35bc5bedd4f1b95313973f8118470/users/c3ea9be43d92471584942594b3febc06/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:28:56.558477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:56.558775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:56.559584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:56.590108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] MFA Rules not processed for user `c3ea9be43d92471584942594b3febc06`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:28:56.591396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:56.660496 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3935/7881] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:28:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:28:56.672301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:28:56.674053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:28:56.776177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4e52d-3ada-4fda-aa5c-112b4b8174ea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:28:56.781871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54256121-1aea-46de-aeaf-b243e3a14a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:28:56.782476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256121-1aea-46de-aeaf-b243e3a14a91 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:28:56.782758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256121-1aea-46de-aeaf-b243e3a14a91 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:28:56.783083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256121-1aea-46de-aeaf-b243e3a14a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:28:56.791511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54256121-1aea-46de-aeaf-b243e3a14a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:28:56.793529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54256121-1aea-46de-aeaf-b243e3a14a91 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:28:56.804296 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3947/7882] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:28:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:06.656750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:06.799481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=66,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:17.153615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:17.218945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abeff3-bf9c-432c-96f8-02c8f6760a4e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:17.224306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:17.228480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:17.228480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:17.228480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] PATH_INFO: `/v3/users/c3ea9be43d92471584942594b3febc06` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:17.228480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ea9be43d92471584942594b3febc06)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:17.228975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:17.425670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ea9be43d92471584942594b3febc06'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:17.438304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ea9be43d92471584942594b3febc06'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:17.439556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ea9be43d92471584942594b3febc06'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:17.441180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ea9be43d92471584942594b3febc06'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:17.456618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ea9be43d92471584942594b3febc06'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:17.539118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3936/7883] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:17 2022] DELETE /identity/v3/users/c3ea9be43d92471584942594b3febc06 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:17.543875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:17.544450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:17.544450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:17.564348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:17.566331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:17.639961 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3948/7884] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:17.646933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:17.648726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:17.718573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26b7a7-a093-4ce3-813e-1da6ceec7ada admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:17.722309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab914-0e56-4235-bd04-f8445e755543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:17.722928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab914-0e56-4235-bd04-f8445e755543 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:17.723246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab914-0e56-4235-bd04-f8445e755543 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:17.723557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab914-0e56-4235-bd04-f8445e755543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:17.733288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abab914-0e56-4235-bd04-f8445e755543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:17.734750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abab914-0e56-4235-bd04-f8445e755543 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:17.745558 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3937/7885] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:18.289022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:18.290558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:18.304845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48273a70-f6e4-4d3d-a454-a5a36de5a836 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:18.309495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:18.315215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:18.315215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:18.315215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] PATH_INFO: `/v3/projects/54e35bc5bedd4f1b95313973f8118470` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:18.315215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e35bc5bedd4f1b95313973f8118470)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:18.315215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:18.507883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e35bc5bedd4f1b95313973f8118470', 'request_id': 'req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:18.514267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e35bc5bedd4f1b95313973f8118470', 'request_id': 'req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:18.520543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e35bc5bedd4f1b95313973f8118470', 'request_id': 'req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:18.600787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] The token cache is being invalidate because project 54e35bc5bedd4f1b95313973f8118470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:18.601494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:18.601845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-8c47b28e-5be8-40c2-89bf-9b1ea8e89425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:18.603433 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3949/7886] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:18 2022] DELETE /identity/v3/projects/54e35bc5bedd4f1b95313973f8118470 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:18.610417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:18.610916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:18.611091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:18.633159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:18.634369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:18.654454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:18.699485 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3938/7887] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:18.709294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:18.709821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:18.710132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:18.732781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:18.738410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:18.744060 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3950/7888] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:18.748306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:18.760043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c82e-4257-4b25-adfb-bf5a1af4b45d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:18.765388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:18.766035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:18.766459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:18.766742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:18.767431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:18.767736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:18.769903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:18.786802 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3939/7889] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:29:18.790976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:18.804913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308c995-3cea-4ead-81bb-3775b728e3ed None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:18.809636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:18.810275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:18.810556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:18.810829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:18.811512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:18.813416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:18.888329 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3951/7890] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:18 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:18.892439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:18.903903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518f11e-a652-47ef-b219-e495acbde825 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:18.967295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:18.968160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:18.968492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:18.968768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:18.969577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:18.971701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.073038 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3940/7891] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:18 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:19.077292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.092711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00d67-c0ae-4dce-a9cc-68022f83cfc3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.097984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.098632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.098909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.099201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.099903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.101464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.113110 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3952/7892] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:19.117227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.128539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cea4e-a7dd-4fc0-99fd-8b272a5e43eb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.133234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c77b82-12ce-41a6-bd46-2e250ba153c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.133862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c77b82-12ce-41a6-bd46-2e250ba153c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.134151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c77b82-12ce-41a6-bd46-2e250ba153c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.134431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c77b82-12ce-41a6-bd46-2e250ba153c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.135305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c77b82-12ce-41a6-bd46-2e250ba153c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.137037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c77b82-12ce-41a6-bd46-2e250ba153c8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.152195 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3941/7893] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:19.153425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.163983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02896d-5a1d-4eab-8fd3-a36a8630dcd8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.168707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.170627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.170627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.170627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] PATH_INFO: `/v3/projects/c15ab4aa6ced43d78858465410875cdd/users/0dffda3f841a4261bc541138f6630f83/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.187209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15ab4aa6ced43d78858465410875cdd, user_id=0dffda3f841a4261bc541138f6630f83, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.189949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.310442 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3953/7894] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:19 2022] PUT /identity/v3/projects/c15ab4aa6ced43d78858465410875cdd/users/0dffda3f841a4261bc541138f6630f83/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:19.321518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.325830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.325830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.350197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] MFA Rules not processed for user `0dffda3f841a4261bc541138f6630f83`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:19.351439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:19.428266 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3942/7895] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:19.433114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.461933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:19.505323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718f3aa-6174-4210-90a2-a7a1e362f235 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.518812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.519469 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.519748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.520017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.520657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.522592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.668286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3954/7896] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:19 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:19.672289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.683933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790f62-875e-4e7f-a452-2ad410888fe6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.697291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:19.743830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.744476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.744770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.745041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.745679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.747663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.883902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3943/7897] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:19 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:19.889046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.902565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9f41-73b7-41e3-9309-333d8dccba22 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.907977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.908596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.908882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.910052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.912220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.912950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:19.927502 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3955/7898] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:19.931545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:19.940837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5575a7-bad7-41d2-b71b-455f5dffedda admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:19.946187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:19.946981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:19.947372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:19.947665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] PATH_INFO: `/v3/projects/b124fc7c92ba4539aa5066897a3cc212/users/b9eeba525e98451887ffdeb800b2a6ea/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:19.967834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b124fc7c92ba4539aa5066897a3cc212, user_id=b9eeba525e98451887ffdeb800b2a6ea, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:19.970714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.072299 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3944/7899] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:19 2022] PUT /identity/v3/projects/b124fc7c92ba4539aa5066897a3cc212/users/b9eeba525e98451887ffdeb800b2a6ea/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:20.076373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.087463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e98809-88f3-4411-bb1c-9e0b4693b512 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.147932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083611-dfeb-438c-8cab-dbce9238de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.148804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083611-dfeb-438c-8cab-dbce9238de52 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.149089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083611-dfeb-438c-8cab-dbce9238de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.149368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083611-dfeb-438c-8cab-dbce9238de52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.150057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083611-dfeb-438c-8cab-dbce9238de52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.151763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083611-dfeb-438c-8cab-dbce9238de52 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.166261 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3956/7900] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:20.170634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.181809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5d659-1c82-48ca-9a86-f7d90e1d3e9b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.187439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.188112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.188399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.188679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] PATH_INFO: `/v3/projects/b124fc7c92ba4539aa5066897a3cc212/users/b9eeba525e98451887ffdeb800b2a6ea/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.190707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b124fc7c92ba4539aa5066897a3cc212, user_id=b9eeba525e98451887ffdeb800b2a6ea, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.193500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.204809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3945/7901] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:20 2022] PUT /identity/v3/projects/b124fc7c92ba4539aa5066897a3cc212/users/b9eeba525e98451887ffdeb800b2a6ea/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:20.216784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.217743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.218029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.250584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] MFA Rules not processed for user `b9eeba525e98451887ffdeb800b2a6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:20.252640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:20.342237 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3957/7902] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:20.347545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.358559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c61f1-a5ef-4640-abd8-31dfbf8d43b0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.363534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.364141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.364421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.364694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.365335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.367245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.477422 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3946/7903] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:20 2022] POST /identity/v3/projects => generated 358 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:20.481576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.492297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca32b4-a09c-4d7a-8b71-d087e3115c24 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.505236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:20.553372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.554037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.554330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.554616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1014047803` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.555983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=151e0683e0e248a6a0fa6791c0c7bc9c, value=tempest-tag-1014047803)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.558399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.670823 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1014047803. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:29:20.670823 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:29:20.670823 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:29:20.677061 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3958/7904] 10.222.0.20 () {60 vars in 1333 bytes} [Tue Sep 6 11:29:20 2022] PUT /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1014047803 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Sep 06 11:29:20.681444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.692490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d9d4-266a-4b05-840a-bdbad2817bcc tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.701913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.701913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.701913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.702454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1014047803` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.713432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=151e0683e0e248a6a0fa6791c0c7bc9c, value=tempest-tag-1014047803)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.715774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.728724 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3947/7905] 10.222.0.20 () {58 vars in 1314 bytes} [Tue Sep 6 11:29:20 2022] GET /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1014047803 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:20.733022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.744164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a3c93-0008-44f3-b205-46b1a6674d51 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.749084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.749731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.750021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.750301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.751550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=151e0683e0e248a6a0fa6791c0c7bc9c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.754403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.934003 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3959/7906] 10.222.0.20 () {60 vars in 1265 bytes} [Tue Sep 6 11:29:20 2022] PUT /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags => generated 141 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:20.935172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.947043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03c6b-2655-4289-9ddd-e78a28e726ce tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:20.955711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:20.955711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:20.955711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:20.956301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:20.965350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=151e0683e0e248a6a0fa6791c0c7bc9c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:20.967668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:20.979542 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3948/7907] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:20 2022] GET /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags => generated 141 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:20.987739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:20.998227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11355b98-3d9e-4ff9-88fc-59aa855250a4 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:21.003132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:21.003961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:21.004369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:21.004756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1003274874` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:21.006025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=151e0683e0e248a6a0fa6791c0c7bc9c, value=tempest-tag-1003274874)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:21.008209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:21.197143 ncdv-master-1 devstack@keystone.service[92879]: WARNING py.warnings [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1003274874. To ensure interoperability, identifiers should be a valid uuid. Sep 06 11:29:21.197143 ncdv-master-1 devstack@keystone.service[92879]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Sep 06 11:29:21.197143 ncdv-master-1 devstack@keystone.service[92879]: Sep 06 11:29:21.203086 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3960/7908] 10.222.0.20 () {58 vars in 1317 bytes} [Tue Sep 6 11:29:20 2022] DELETE /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1003274874 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:21.207690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:21.217935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d55ab-d53c-42f9-b675-339fd9f727b9 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:21.223448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:21.234617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:21.234617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:21.234617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1003274874` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:21.237841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=151e0683e0e248a6a0fa6791c0c7bc9c, value=tempest-tag-1003274874)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:21.239958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Could not find project tag: tempest-tag-1003274874.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1003274874. Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Sep 06 11:29:21.256178 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Sep 06 11:29:21.257637 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 11:29:21.257637 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 11:29:21.257637 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Sep 06 11:29:21.257637 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Sep 06 11:29:21.257637 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1003274874. Sep 06 11:29:21.257637 ncdv-master-1 devstack@keystone.service[92878]: ERROR keystone.server.flask.application Sep 06 11:29:21.258237 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3949/7909] 10.222.0.20 () {58 vars in 1314 bytes} [Tue Sep 6 11:29:21 2022] GET /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags/tempest-tag-1003274874 => generated 107 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 06 11:29:21.261892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:21.272593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccef4e-e785-4b33-8034-af57a8b07b1a tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:21.277737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:21.278407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:21.278695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:21.278977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:21.280149 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=151e0683e0e248a6a0fa6791c0c7bc9c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:21.282277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:21.380950 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3961/7910] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 11:29:21 2022] DELETE /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:21.385145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:21.396151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b100f-2905-4ef5-b7c6-d71786fe37be tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:21.401636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:21.401809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:21.402015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:21.402294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:21.415102 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=151e0683e0e248a6a0fa6791c0c7bc9c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:21.417191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:21.428523 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3950/7911] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 11:29:21 2022] GET /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c/tags => generated 66 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Sep 06 11:29:21.432775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:21.443417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc7d4-0afc-4f6c-912c-e19817ef98dd tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:21.448155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9eeba525e98451887ffdeb800b2a6ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b124fc7c92ba4539aa5066897a3cc212', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:21.448798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:21.449091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:21.449370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] PATH_INFO: `/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:21.450516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=151e0683e0e248a6a0fa6791c0c7bc9c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:21.452487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:21.462628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:21.616447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151e0683e0e248a6a0fa6791c0c7bc9c', 'request_id': 'req-58502a8e-bcff-4a29-9680-8fc9500eaa15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:21.624881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151e0683e0e248a6a0fa6791c0c7bc9c', 'request_id': 'req-58502a8e-bcff-4a29-9680-8fc9500eaa15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:21.630381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151e0683e0e248a6a0fa6791c0c7bc9c', 'request_id': 'req-58502a8e-bcff-4a29-9680-8fc9500eaa15'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:21.809583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] The token cache is being invalidate because project 151e0683e0e248a6a0fa6791c0c7bc9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:21.810321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:21.810605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-58502a8e-bcff-4a29-9680-8fc9500eaa15 tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:21.812143 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3962/7912] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:21 2022] DELETE /identity/v3/projects/151e0683e0e248a6a0fa6791c0c7bc9c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:21.818286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:21.820514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:21.844455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:21.895322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1bc9a-b2a3-46aa-9b44-177ec1a859fe tempest-IdentityV3ProjectTagsTest-1076099619 tempest-IdentityV3ProjectTagsTest-1076099619-project-admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:21.957556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:21.958199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:21.958491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:21.958821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] PATH_INFO: `/v3/users/0dffda3f841a4261bc541138f6630f83` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:21.960034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dffda3f841a4261bc541138f6630f83)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:21.962315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:22.213544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dffda3f841a4261bc541138f6630f83'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:22.220838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dffda3f841a4261bc541138f6630f83'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:22.221638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dffda3f841a4261bc541138f6630f83'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:22.222418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dffda3f841a4261bc541138f6630f83'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:22.237641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dffda3f841a4261bc541138f6630f83'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:22.307501 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3951/7913] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:21 2022] DELETE /identity/v3/users/0dffda3f841a4261bc541138f6630f83 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:22.312233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:22.312524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:22.312803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:22.333068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:22.338767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:22.404851 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3963/7914] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:22.409994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:22.412696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:22.478518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:22.487967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbb83f-49d3-414a-9be8-44c5c54ddc02 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:22.493702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:22.494320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:22.494599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:22.494872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:22.505808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:22.507353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:22.517459 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3952/7915] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:22.977963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:22.980442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:22.995293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48f69e-9a78-4a01-822b-e8f1bcc155e0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:23.000432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:23.001114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:23.001740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:23.001740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] PATH_INFO: `/v3/projects/c15ab4aa6ced43d78858465410875cdd` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:23.002844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15ab4aa6ced43d78858465410875cdd)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:23.004847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:23.135551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15ab4aa6ced43d78858465410875cdd', 'request_id': 'req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.142431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15ab4aa6ced43d78858465410875cdd', 'request_id': 'req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.149306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15ab4aa6ced43d78858465410875cdd', 'request_id': 'req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.230984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] The token cache is being invalidate because project c15ab4aa6ced43d78858465410875cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:23.231227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.231855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.233357 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3964/7916] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:22 2022] DELETE /identity/v3/projects/c15ab4aa6ced43d78858465410875cdd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:23.238093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:23.248438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b6a50-a4f2-470e-b11f-a97473e67d65 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:23.325164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:23.325798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:23.326083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:23.326369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] PATH_INFO: `/v3/users/b9eeba525e98451887ffdeb800b2a6ea` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:23.327577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9eeba525e98451887ffdeb800b2a6ea)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:23.329509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:23.551254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9eeba525e98451887ffdeb800b2a6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.555657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9eeba525e98451887ffdeb800b2a6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.556361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9eeba525e98451887ffdeb800b2a6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.556971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9eeba525e98451887ffdeb800b2a6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.570954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1a82a781-5e1b-4021-8902-63322a21a7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9eeba525e98451887ffdeb800b2a6ea'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:23.643239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3953/7917] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:23 2022] DELETE /identity/v3/users/b9eeba525e98451887ffdeb800b2a6ea => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:24.196162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:24.196162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:24.218766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64cac4-3adc-493a-8ff1-5f7ce222bc90 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:24.241194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:24.282552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:24.283246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:24.283531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:24.283808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] PATH_INFO: `/v3/projects/b124fc7c92ba4539aa5066897a3cc212` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:24.285473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b124fc7c92ba4539aa5066897a3cc212)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:24.287650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:24.429539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b124fc7c92ba4539aa5066897a3cc212', 'request_id': 'req-f10bd194-7d14-4ac5-8757-db037fb494a8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:24.435871 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b124fc7c92ba4539aa5066897a3cc212', 'request_id': 'req-f10bd194-7d14-4ac5-8757-db037fb494a8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:24.441579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b124fc7c92ba4539aa5066897a3cc212', 'request_id': 'req-f10bd194-7d14-4ac5-8757-db037fb494a8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:24.614510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] The token cache is being invalidate because project b124fc7c92ba4539aa5066897a3cc212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:24.618811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:24.618811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f10bd194-7d14-4ac5-8757-db037fb494a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:24.618811 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3965/7918] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:24 2022] DELETE /identity/v3/projects/b124fc7c92ba4539aa5066897a3cc212 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:24.631497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:24.631497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:24.631497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:24.646373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:24.653286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:24.711830 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3954/7919] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:24.721059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:24.721396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:24.721674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:24.744059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:24.745287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:24.753765 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3966/7920] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:24.758686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:24.769527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add7438-a54a-41ed-a51e-b2b65c3dd368 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:24.774768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:24.776656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:24.776656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:24.776656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:24.776656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:24.777098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:24.778486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:24.781412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:24.791478 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3955/7921] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:24.796153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:24.806070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec28d1-1ed8-40b8-a22b-e776b07ae30a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:24.811126 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:24.811801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:24.812090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:24.812369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:24.813051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:24.814974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:24.976135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3967/7922] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:24 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:24.980686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:24.991433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e19442-09b4-475d-97a9-e7b20723e705 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.055278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.055905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.056190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.056468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.057106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.059105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:25.178205 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3956/7923] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:24 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:25.183193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:25.195511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d498-5384-48e8-b16f-7ae6108e4789 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.202341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.203486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.203993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.204965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.205544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.209006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:25.226440 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3968/7924] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:25.231525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:25.247611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2845-acb4-4900-bc5f-106b9699fcb8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.252600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.253276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.253558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.253837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] PATH_INFO: `/v3/projects/087b0bd35a904719b44dcd217888bbeb/users/a6d2c12def0d428682ce05290bed0036/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.272065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087b0bd35a904719b44dcd217888bbeb, user_id=a6d2c12def0d428682ce05290bed0036, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.276303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:25.346860 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3957/7925] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:25 2022] PUT /identity/v3/projects/087b0bd35a904719b44dcd217888bbeb/users/a6d2c12def0d428682ce05290bed0036/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:25.352022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:25.365526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db6f7-e777-4825-b8cd-2cef58b87b0d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.441103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e060-ec3b-4475-aa80-e215f2a3f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.442299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e060-ec3b-4475-aa80-e215f2a3f2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.442608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e060-ec3b-4475-aa80-e215f2a3f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.442883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e060-ec3b-4475-aa80-e215f2a3f2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.443583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e060-ec3b-4475-aa80-e215f2a3f2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.445237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e060-ec3b-4475-aa80-e215f2a3f2d3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:25.456189 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3969/7926] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:25.461357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:25.473230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7cd7-e379-4e65-8407-1476d3f16a53 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.478161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.478863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.479175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.479515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] PATH_INFO: `/v3/projects/087b0bd35a904719b44dcd217888bbeb/users/a6d2c12def0d428682ce05290bed0036/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.481572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087b0bd35a904719b44dcd217888bbeb, user_id=a6d2c12def0d428682ce05290bed0036, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.484310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:25.506996 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3958/7927] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:25 2022] PUT /identity/v3/projects/087b0bd35a904719b44dcd217888bbeb/users/a6d2c12def0d428682ce05290bed0036/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:25.524285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.524794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.525617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.541379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:25.558325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] MFA Rules not processed for user `a6d2c12def0d428682ce05290bed0036`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:25.560080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:25.636094 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3970/7928] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:25.640722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:25.719200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112323b-5dd9-49db-85b4-c2443de2d892 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.725599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.726587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.727063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.727504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.728528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.731830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:25.862415 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3959/7929] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:25 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:25.867457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:25.881541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d490a-7246-44a2-8745-050c2e69d41f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:25.968732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:25.969359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:25.969645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:25.969929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:25.971073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:25.972597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:26.084521 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3971/7930] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:25 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:26.088670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:26.099415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615240-4571-49fd-aa20-62529c6c44b5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:26.104383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:26.104996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:26.105299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:26.105569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:26.106260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:26.107928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:26.119343 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3960/7931] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:26.123552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:26.134798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66911dc1-b126-473f-b88b-e952f830cc6f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:26.139958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f68f-0ad1-4b5e-8f50-c48ccb9faf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:26.144856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f68f-0ad1-4b5e-8f50-c48ccb9faf7e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:26.144856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f68f-0ad1-4b5e-8f50-c48ccb9faf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:26.144856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f68f-0ad1-4b5e-8f50-c48ccb9faf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:26.144856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f68f-0ad1-4b5e-8f50-c48ccb9faf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:26.144856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f68f-0ad1-4b5e-8f50-c48ccb9faf7e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:26.154717 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3972/7932] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:26.159057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:26.169324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7fe9b-e933-44f1-842e-7edcc6c9cf01 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:26.173987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:26.174651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:26.174933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:26.175235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] PATH_INFO: `/v3/projects/c03adcf8339642668da5ea134ff96f7a/users/15d53bbf8e5a45f8ad576d02eeed7ba2/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:26.192270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03adcf8339642668da5ea134ff96f7a, user_id=15d53bbf8e5a45f8ad576d02eeed7ba2, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:26.194949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:26.289529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:26.295487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3961/7933] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:26 2022] PUT /identity/v3/projects/c03adcf8339642668da5ea134ff96f7a/users/15d53bbf8e5a45f8ad576d02eeed7ba2/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:26.307365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:26.307900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:26.308025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:26.342695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] MFA Rules not processed for user `15d53bbf8e5a45f8ad576d02eeed7ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:26.343962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:26.414348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:26.418167 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3973/7934] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:26.430784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:26.432571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:26.496566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfb35e-4137-4948-9398-cf9068720b53 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:26.500595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e66c-e4b5-487d-89cd-60dc500f3e97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:26.501289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e66c-e4b5-487d-89cd-60dc500f3e97 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:26.501573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e66c-e4b5-487d-89cd-60dc500f3e97 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:26.502064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e66c-e4b5-487d-89cd-60dc500f3e97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:26.594954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e66c-e4b5-487d-89cd-60dc500f3e97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:26.596498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e66c-e4b5-487d-89cd-60dc500f3e97 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:26.607570 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3962/7935] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:26.803304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:26.804858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:26.873287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeb047-79ce-4468-a6e2-897c16d9857d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:26.877878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:26.878520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:26.878831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:26.879311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] PATH_INFO: `/v3/users/99d03b2c36c543ae8ded351fac0f8c04` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:26.880487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d03b2c36c543ae8ded351fac0f8c04)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:26.882421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:27.119769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d03b2c36c543ae8ded351fac0f8c04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:27.134261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d03b2c36c543ae8ded351fac0f8c04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:27.135405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d03b2c36c543ae8ded351fac0f8c04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:27.149743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d03b2c36c543ae8ded351fac0f8c04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:27.152674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d03b2c36c543ae8ded351fac0f8c04'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:27.305549 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3974/7936] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:26 2022] DELETE /identity/v3/users/99d03b2c36c543ae8ded351fac0f8c04 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:27.310015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:27.310516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:27.310649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:27.331204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:27.333026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:27.410211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3963/7937] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:27.422199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:27.423779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:27.493707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5d1f1-741c-4768-8b90-dd6ccb3c640d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:27.497749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:27.498363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:27.498724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:27.499021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:27.509249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:27.510680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:27.525201 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3975/7938] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:28.068605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:28.071588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:28.101853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109fae4-8286-49e6-95af-7eeb12971b85 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:28.107150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:28.107795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:28.108522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:28.108866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] PATH_INFO: `/v3/projects/e17c292a841d411a99a7a95db6140f41` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:28.110104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17c292a841d411a99a7a95db6140f41)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:28.112055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:28.236955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:28.242382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17c292a841d411a99a7a95db6140f41', 'request_id': 'req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.247918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17c292a841d411a99a7a95db6140f41', 'request_id': 'req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.256478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17c292a841d411a99a7a95db6140f41', 'request_id': 'req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.342588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] The token cache is being invalidate because project e17c292a841d411a99a7a95db6140f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:28.343812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.344204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.346709 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3964/7939] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:28 2022] DELETE /identity/v3/projects/e17c292a841d411a99a7a95db6140f41 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:28.353283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:28.364229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82617635-a104-4b71-9f0f-ebfc315d0155 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:28.388024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:28.433277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:28.433979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:28.434193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:28.434474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] PATH_INFO: `/v3/users/db72094ee0f648e7b501dd08c6a1911c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:28.435727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db72094ee0f648e7b501dd08c6a1911c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:28.437842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:28.540351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:28.541795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:28.560292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cbe0-c8e5-4af1-9a09-d30fb2a590ed admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:28.565068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:28.565701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:28.565990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:28.566803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] PATH_INFO: `/v3/users/0ec431fb2f40416f9c6c5fa2775634ef` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:28.568022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec431fb2f40416f9c6c5fa2775634ef)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:28.569992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:28.657866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db72094ee0f648e7b501dd08c6a1911c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.665059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db72094ee0f648e7b501dd08c6a1911c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.665759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db72094ee0f648e7b501dd08c6a1911c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.677917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db72094ee0f648e7b501dd08c6a1911c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.678741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db72094ee0f648e7b501dd08c6a1911c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.802965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3976/7940] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:28 2022] DELETE /identity/v3/users/db72094ee0f648e7b501dd08c6a1911c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:28.803930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:28.805404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:28.835193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec431fb2f40416f9c6c5fa2775634ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.843406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec431fb2f40416f9c6c5fa2775634ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.846236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec431fb2f40416f9c6c5fa2775634ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.846236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec431fb2f40416f9c6c5fa2775634ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.859545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7caf1224-f8bd-4c54-a4aa-df34da7dfec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec431fb2f40416f9c6c5fa2775634ef'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:28.893428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c6d4a-3fd9-43ab-a045-11a4bae259e2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:28.899806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:28.900553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:28.900895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:28.901234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] PATH_INFO: `/v3/users/a6d2c12def0d428682ce05290bed0036` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:28.902466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d2c12def0d428682ce05290bed0036)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:28.904494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:28.956889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3965/7941] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:28 2022] DELETE /identity/v3/users/0ec431fb2f40416f9c6c5fa2775634ef => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:28.961372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078591a8-c852-49f6-82d1-70e36712554e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:28.961667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078591a8-c852-49f6-82d1-70e36712554e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:28.961942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078591a8-c852-49f6-82d1-70e36712554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:28.980825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-078591a8-c852-49f6-82d1-70e36712554e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:28.982042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-078591a8-c852-49f6-82d1-70e36712554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.045403 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3966/7942] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:29.065017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078591a8-c852-49f6-82d1-70e36712554e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.067572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-078591a8-c852-49f6-82d1-70e36712554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.123152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:29.137417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078591a8-c852-49f6-82d1-70e36712554e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:29.141230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:29.141851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.142173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.142433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.153088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:29.154709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:29.166989 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3967/7943] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:29.171431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:29.173630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d2c12def0d428682ce05290bed0036'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.182548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d2c12def0d428682ce05290bed0036'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.183459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d2c12def0d428682ce05290bed0036'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.196985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d2c12def0d428682ce05290bed0036'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.197854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f65c69bc-cfd0-47ba-9ae2-55cdaa9f501b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d2c12def0d428682ce05290bed0036'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.268282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.270016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.290668 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3977/7944] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:28 2022] DELETE /identity/v3/users/a6d2c12def0d428682ce05290bed0036 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:29.293299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b955aa-b1b1-42d3-928e-e31d68d1b682 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:29.295166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.295457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.295740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.321849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:29.324572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.370381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:29.371100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.371375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.371650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] PATH_INFO: `/v3/projects/b8e28e41663240a4ae2e8eb4e579a44a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.373429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e28e41663240a4ae2e8eb4e579a44a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:29.375428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:29.399776 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3978/7945] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:29.411356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.413042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.479944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacab18c-975f-4bcd-8437-be527826c1ba None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:29.483821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633e7d-4df2-479c-97b2-ed548eb6e0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:29.484439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633e7d-4df2-479c-97b2-ed548eb6e0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.484726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633e7d-4df2-479c-97b2-ed548eb6e0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.485005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633e7d-4df2-479c-97b2-ed548eb6e0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.495565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633e7d-4df2-479c-97b2-ed548eb6e0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:29.497034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633e7d-4df2-479c-97b2-ed548eb6e0a7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:29.510065 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3979/7946] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:29.515996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e28e41663240a4ae2e8eb4e579a44a', 'request_id': 'req-4dde5bf3-77ad-49d0-aa17-300dda81fba2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.521959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e28e41663240a4ae2e8eb4e579a44a', 'request_id': 'req-4dde5bf3-77ad-49d0-aa17-300dda81fba2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.528821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e28e41663240a4ae2e8eb4e579a44a', 'request_id': 'req-4dde5bf3-77ad-49d0-aa17-300dda81fba2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.619437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] The token cache is being invalidate because project b8e28e41663240a4ae2e8eb4e579a44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:29.619729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.620371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4dde5bf3-77ad-49d0-aa17-300dda81fba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.621887 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3968/7947] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:29 2022] DELETE /identity/v3/projects/b8e28e41663240a4ae2e8eb4e579a44a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:29.626972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.627299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.627582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.650867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:29.651935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.713837 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3980/7948] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:29.721382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.721664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.721940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.737417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.739167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.743689 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:29.744935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:29.753246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb255e1-6911-467c-a20c-a78a03cac8dc None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:29.755362 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3969/7949] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:29.761137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:29.762266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.767486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.767767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.768042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] PATH_INFO: `/v3/projects/57a54585a3c64c59a4a54488fa051d27` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.770645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a54585a3c64c59a4a54488fa051d27)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:29.772690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:29.782630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914e153-86da-49fa-bb7d-22ecf728340e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:29.788109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:29.788711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.788990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.789262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.789906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:29.790415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:29.792050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:29.807629 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3970/7950] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:29.808735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.819153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490c114-d03b-409f-9599-e5039421e3fa admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:29.823992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:29.824591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:29.824929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:29.825138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:29.825758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:29.827697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:29.899992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a54585a3c64c59a4a54488fa051d27', 'request_id': 'req-b840d91d-1aed-458f-b981-8cb3ee3490b7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.914052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a54585a3c64c59a4a54488fa051d27', 'request_id': 'req-b840d91d-1aed-458f-b981-8cb3ee3490b7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.920323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a54585a3c64c59a4a54488fa051d27', 'request_id': 'req-b840d91d-1aed-458f-b981-8cb3ee3490b7'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:29.970755 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3971/7951] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:29 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:29.975048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:29.994267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:30.000721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] The token cache is being invalidate because project 57a54585a3c64c59a4a54488fa051d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:30.001814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.002594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.005280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3981/7952] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:29 2022] DELETE /identity/v3/projects/57a54585a3c64c59a4a54488fa051d27 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:30.009982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.011800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.022941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:30.050407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb13d-e1d0-47e6-a2fd-b720b58ffda5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.056988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.057636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.057935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.058205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.058836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.060829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.089387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840d91d-1aed-458f-b981-8cb3ee3490b7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.094193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.094838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.095153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.095433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] PATH_INFO: `/v3/users/cd5a3e4abfce41b7b7493aa7c61e39ef` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.096595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5a3e4abfce41b7b7493aa7c61e39ef)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.098536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.145898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3972/7953] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:29 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:30.146767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.149310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.161798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956affee-7531-46fa-b2f5-db401322a0e0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.166548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.167212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.167497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.167773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] PATH_INFO: `/v3/projects/087b0bd35a904719b44dcd217888bbeb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.168964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=087b0bd35a904719b44dcd217888bbeb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.170873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.321671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5a3e4abfce41b7b7493aa7c61e39ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.321969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087b0bd35a904719b44dcd217888bbeb', 'request_id': 'req-98fa20df-3831-4a41-9143-8a4ef0101964'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.327784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087b0bd35a904719b44dcd217888bbeb', 'request_id': 'req-98fa20df-3831-4a41-9143-8a4ef0101964'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.328675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5a3e4abfce41b7b7493aa7c61e39ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.329381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5a3e4abfce41b7b7493aa7c61e39ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.335804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087b0bd35a904719b44dcd217888bbeb', 'request_id': 'req-98fa20df-3831-4a41-9143-8a4ef0101964'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.343520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5a3e4abfce41b7b7493aa7c61e39ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.343520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5a3e4abfce41b7b7493aa7c61e39ef'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.425084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] The token cache is being invalidate because project 087b0bd35a904719b44dcd217888bbeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:30.426246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.426707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.428460 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3973/7954] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:30 2022] DELETE /identity/v3/projects/087b0bd35a904719b44dcd217888bbeb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:30.429246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.430719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.483396 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3982/7955] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:30 2022] DELETE /identity/v3/users/cd5a3e4abfce41b7b7493aa7c61e39ef => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:30.489463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.489463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.506787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa20df-3831-4a41-9143-8a4ef0101964 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.567840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ff124-d287-4107-80a8-efa5c042299e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.573718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.575189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.575472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.575748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.576401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.578766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.579320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.579601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.579880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] PATH_INFO: `/v3/users/15d53bbf8e5a45f8ad576d02eeed7ba2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.580847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.582962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d53bbf8e5a45f8ad576d02eeed7ba2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.585290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.597497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3974/7956] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:30.598742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.610090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e2389-01d5-404a-8e65-c961c6116a67 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.610932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:30.615763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.617201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.617201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.617201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.617541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.619322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.630609 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3975/7957] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:30.635185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.645680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651e96-cac8-4f2e-91ae-468f0583238d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:30.650737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed2274-2483-4e2b-9ad2-9856f31b95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:30.651444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed2274-2483-4e2b-9ad2-9856f31b95aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.651731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed2274-2483-4e2b-9ad2-9856f31b95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.652011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed2274-2483-4e2b-9ad2-9856f31b95aa admin admin] PATH_INFO: `/v3/projects/ad72d6caf0f54af99a434bb8bb836f09/users/3424723f87db436badd94a53ec4a908e/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.667670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed2274-2483-4e2b-9ad2-9856f31b95aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad72d6caf0f54af99a434bb8bb836f09, user_id=3424723f87db436badd94a53ec4a908e, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:30.672568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed2274-2483-4e2b-9ad2-9856f31b95aa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:30.688977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:30.764555 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3976/7958] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:30 2022] PUT /identity/v3/projects/ad72d6caf0f54af99a434bb8bb836f09/users/3424723f87db436badd94a53ec4a908e/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:30.776250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:30.776569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:30.776798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:30.805071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d53bbf8e5a45f8ad576d02eeed7ba2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.810754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] MFA Rules not processed for user `3424723f87db436badd94a53ec4a908e`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:30.812168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.813784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d53bbf8e5a45f8ad576d02eeed7ba2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.814482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d53bbf8e5a45f8ad576d02eeed7ba2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.827643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d53bbf8e5a45f8ad576d02eeed7ba2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.828298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d53bbf8e5a45f8ad576d02eeed7ba2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:30.880786 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3977/7959] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:30.892534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.893937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.942938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3983/7960] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:30 2022] DELETE /identity/v3/users/15d53bbf8e5a45f8ad576d02eeed7ba2 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:30.954832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:30.966064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:30.974587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7e80e-2ef7-49df-a489-48d562b534f7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.046050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.046402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.046808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.047155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.047688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.049679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc44e9-bd5a-4757-b394-0860c79d9d05 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.049935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.056440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.057108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.057516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.057721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] PATH_INFO: `/v3/projects/791ca01c5e4b46f7ba9a192200ec4649` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.058926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791ca01c5e4b46f7ba9a192200ec4649)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.060905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.174844 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3978/7961] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:30 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:31.178667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.201173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791ca01c5e4b46f7ba9a192200ec4649', 'request_id': 'req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.210222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791ca01c5e4b46f7ba9a192200ec4649', 'request_id': 'req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.216780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791ca01c5e4b46f7ba9a192200ec4649', 'request_id': 'req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.264048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d632-66e2-4199-a51d-e1aad099f9e5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.269192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.270493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.270639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.270914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.271576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.273837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.340106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] The token cache is being invalidate because project 791ca01c5e4b46f7ba9a192200ec4649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:31.340555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.341411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7e6bb86b-8522-4e60-9200-5a4ec58cfb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.343162 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3984/7962] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:30 2022] DELETE /identity/v3/projects/791ca01c5e4b46f7ba9a192200ec4649 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:31.348667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89435b-f38e-4fc2-9637-339ae540347b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.348964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89435b-f38e-4fc2-9637-339ae540347b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.349251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89435b-f38e-4fc2-9637-339ae540347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.364816 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3979/7963] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:31.368585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.370300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.372543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ff89435b-f38e-4fc2-9637-339ae540347b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:31.373853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ff89435b-f38e-4fc2-9637-339ae540347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.382454 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3985/7964] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:31.383930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721cfef-3c37-4990-90db-90e3add99bbb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.389045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.389772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.390138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.390514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.391403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.391545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.391713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.392021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.393585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.407961 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3980/7965] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:31.412944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.415118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:31.416633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.427199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c992d9-9a33-4d87-bb16-00d629aea7ac admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.432127 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3986/7966] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:31.432127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.432440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.432440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.432440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.432701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.432801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] PATH_INFO: `/v3/projects/4d72f431766e49569b3f357f28b3d2a8/users/d57745404d0f4630bcd2d9da3f496236/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.451266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d72f431766e49569b3f357f28b3d2a8, user_id=d57745404d0f4630bcd2d9da3f496236, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.451602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94315-d455-485c-bd6d-ef887f2f67fa None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.457688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.459595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.460256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.460585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.460806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] PATH_INFO: `/v3/projects/c03adcf8339642668da5ea134ff96f7a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.462050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03adcf8339642668da5ea134ff96f7a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.464123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.590724 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3981/7967] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:31 2022] PUT /identity/v3/projects/4d72f431766e49569b3f357f28b3d2a8/users/d57745404d0f4630bcd2d9da3f496236/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:31.591940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.626102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03adcf8339642668da5ea134ff96f7a', 'request_id': 'req-d8f55393-1815-4001-9d5f-4bc355bde3fb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.633491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03adcf8339642668da5ea134ff96f7a', 'request_id': 'req-d8f55393-1815-4001-9d5f-4bc355bde3fb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.639703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03adcf8339642668da5ea134ff96f7a', 'request_id': 'req-d8f55393-1815-4001-9d5f-4bc355bde3fb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.662703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91361a28-f444-4e60-96e5-523296cfdde4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.683104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:31.719967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] The token cache is being invalidate because project c03adcf8339642668da5ea134ff96f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:31.720462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.721465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:31.727581 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3987/7968] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:31 2022] DELETE /identity/v3/projects/c03adcf8339642668da5ea134ff96f7a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:31.727581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.727581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.728007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.728723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.729176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.729630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.730732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:31.731274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.734200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c9cf-59bc-4f80-901c-5d3251163a2f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.739833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:31.746808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f55393-1815-4001-9d5f-4bc355bde3fb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.754669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.755694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.756139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.756582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.757626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.763681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3982/7969] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:31.763919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.766733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.766733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.766733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.777449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3988/7970] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:31.778583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.782150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.789037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:31.790281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.796620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b1610-c448-4107-9ea8-ca3328ddcb53 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.798957 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3983/7971] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:31.799908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.809207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6858989-6ac5-4f33-8503-9cb67ddb5820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.809839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858989-6ac5-4f33-8503-9cb67ddb5820 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.810124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858989-6ac5-4f33-8503-9cb67ddb5820 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.810406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6858989-6ac5-4f33-8503-9cb67ddb5820 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.811072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370a2d-6945-4b0a-9fc1-6a657daecc69 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.813851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6858989-6ac5-4f33-8503-9cb67ddb5820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.813851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6858989-6ac5-4f33-8503-9cb67ddb5820 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.816710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b442e-bf1c-4e77-ae05-3cb289d05acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:31.817370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b442e-bf1c-4e77-ae05-3cb289d05acd admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.817648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b442e-bf1c-4e77-ae05-3cb289d05acd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.817920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b442e-bf1c-4e77-ae05-3cb289d05acd admin admin] PATH_INFO: `/v3/projects/4d72f431766e49569b3f357f28b3d2a8/users/d57745404d0f4630bcd2d9da3f496236/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.819958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b442e-bf1c-4e77-ae05-3cb289d05acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d72f431766e49569b3f357f28b3d2a8, user_id=d57745404d0f4630bcd2d9da3f496236, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:31.822600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b442e-bf1c-4e77-ae05-3cb289d05acd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:31.834274 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3984/7972] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:31 2022] PUT /identity/v3/projects/4d72f431766e49569b3f357f28b3d2a8/users/d57745404d0f4630bcd2d9da3f496236/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:31.835698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3006-27e5-4357-99df-7b2833078550 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.836968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3006-27e5-4357-99df-7b2833078550 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.836968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3006-27e5-4357-99df-7b2833078550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.857508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-189f3006-27e5-4357-99df-7b2833078550 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:31.860047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:31.864007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-189f3006-27e5-4357-99df-7b2833078550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.917689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3989/7973] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:31.919434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:31.919911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:31.921336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:31.929433 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3985/7974] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:31.933001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3006-27e5-4357-99df-7b2833078550 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:31.943346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3006-27e5-4357-99df-7b2833078550 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:31.953474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] MFA Rules not processed for user `d57745404d0f4630bcd2d9da3f496236`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:31.956041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:31.999778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:32.018200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.018961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.019415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.019792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.020549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.022553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.030741 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3990/7975] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:32.031860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.043571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3094962-019e-48d6-ab28-9d7729d0dd17 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.048337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.048978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.049259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.049534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.050194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:32.050995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.052655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.069095 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3991/7976] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:32.069095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.069095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:32.085190 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3986/7977] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:31 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:32.086592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.103720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26dc43-e04e-4599-820f-133debc1cb69 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.108649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.109256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.109537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.110164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.111265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.112886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.161459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498431d7-d341-4771-9325-1da54ff3ac6f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.165330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.165895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.166178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.166457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.177091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.178542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.181988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3987/7978] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:32.182829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.198135 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3992/7979] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:32.198846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.211238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f0d41-296c-4469-b55b-66f5ac810f53 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.212140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:32.259811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8c76f-1dde-4b83-9acb-d520d4be86fc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.265120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.266346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.266640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.266920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.267846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.269482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.272320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.272945 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.273232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.273776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.274449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.276413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.283496 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3988/7980] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:32.289948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.300406 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077db65-a8c1-4103-8529-fb3b77bd0a1c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.305987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.306604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.306888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.307231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.307874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.309496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.320407 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3989/7981] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:32.325285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.341067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a801ad-3657-446a-9476-6820cad75c65 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.346610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.347312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.348132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.348403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] PATH_INFO: `/v3/projects/2e2258f4a93649f898bad7d90e5efb37/users/d17d79b38c4c48e7b253617177cf5000/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.364722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2258f4a93649f898bad7d90e5efb37, user_id=d17d79b38c4c48e7b253617177cf5000, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.367442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.395906 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3993/7982] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:32.400572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.411834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29495d-2313-4104-a142-59dfec5bd1aa admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.416608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.417170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.417577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.417872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.418486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.420114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.431374 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3994/7983] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:32.435562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.447220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8482d-9c2f-4c43-83c9-14ba26dd19a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.455565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.456296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.456648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.457035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.457755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.459565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.471895 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3995/7984] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:32.473084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.503811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:32.511124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3990/7985] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:32 2022] PUT /identity/v3/projects/2e2258f4a93649f898bad7d90e5efb37/users/d17d79b38c4c48e7b253617177cf5000/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:32.511970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.548670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39204365-b3ad-4e37-8ceb-3afa69b36695 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.590654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0d375-9592-49e8-9bf4-613a4c46c1c8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.596021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37842e-57b4-413c-8bd7-243e63cb636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.596812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37842e-57b4-413c-8bd7-243e63cb636d admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.597144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37842e-57b4-413c-8bd7-243e63cb636d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.598190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37842e-57b4-413c-8bd7-243e63cb636d admin admin] PATH_INFO: `/v3/projects/f6db781783b7492e95c7c09b5da761c3/users/bc8c2d751b4e4d08a4cd9dbbbcfc0992/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.609054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.613510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.613510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.613510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.613510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:32.613971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37842e-57b4-413c-8bd7-243e63cb636d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6db781783b7492e95c7c09b5da761c3, user_id=bc8c2d751b4e4d08a4cd9dbbbcfc0992, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.616625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37842e-57b4-413c-8bd7-243e63cb636d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.675113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.680240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edce799-e55b-4afa-8461-8f1cd56def47 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.686092 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3996/7986] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:32.687551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.687841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.688118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.720472 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3991/7987] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:32 2022] PUT /identity/v3/projects/f6db781783b7492e95c7c09b5da761c3/users/bc8c2d751b4e4d08a4cd9dbbbcfc0992/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:32.720891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] MFA Rules not processed for user `d17d79b38c4c48e7b253617177cf5000`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:32.722034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:32.731409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.731702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.731984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.764946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] MFA Rules not processed for user `bc8c2d751b4e4d08a4cd9dbbbcfc0992`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:32.766279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:32.800176 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3997/7988] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:32.805161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.832612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:32.837443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:32.842736 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3992/7989] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:32.847066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:32.878434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e123be-c66e-4289-940f-808fdedf2dc7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.884114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.884746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.885034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.885408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.886066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.888357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.921013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360778c-cfac-4ec0-b04e-480a98fe0edd None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:32.930828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:32.930828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:32.930828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:32.930828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:32.931547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:32.931547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:32.982163 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3998/7990] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:32.986473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.001821 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3993/7991] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:33.002852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.059989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe568-e76e-4d0c-9453-e8d7d64978d0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.077088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f14c-3c6a-486d-befc-e41848f81846 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.083113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.084097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.084852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.085376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.086440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.090911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.135152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.135816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.136107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.136387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.137029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.138968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.255186 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3994/7992] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:33 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:33.259480 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 3999/7993] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:32 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:33.259671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.260580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.270792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5963f0-9ed1-44f5-a796-a6a5352da0cd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.271333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff74bd4-a112-45b4-95c0-8c6fa2433373 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.276561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.281738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.281964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.282090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.282218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.282326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.282441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.282556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.282659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.282760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.282861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.282973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.291808 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3995/7994] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:33.295476 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4000/7995] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:33.296160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.299739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.308155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c28dc-c40f-4fe5-b84d-3d4c7f48a9c1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.310664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c35985-3d6b-4414-8670-71fad169b0d4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.313008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.313610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.313899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.314182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.314971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.315758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.316687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.316826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.316960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.317196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] PATH_INFO: `/v3/projects/fc83d0e981dc4ec29f0fc858361b0098/users/026aecd0b4d14fd8b882be9ad4eae814/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.327952 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3996/7996] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:33.333837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.335291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc83d0e981dc4ec29f0fc858361b0098, user_id=026aecd0b4d14fd8b882be9ad4eae814, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.339328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.345869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd2f6-3f64-45a1-b578-5d430e481929 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.351470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f1bec-9912-429d-9c7f-e99a46b7e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.352149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f1bec-9912-429d-9c7f-e99a46b7e3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.352434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f1bec-9912-429d-9c7f-e99a46b7e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.352711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f1bec-9912-429d-9c7f-e99a46b7e3e6 admin admin] PATH_INFO: `/v3/projects/2415b46e99df45b5aadd7c144dc4fee3/users/4e57e0151263483fb97d2d4c7de9dbb8/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.370589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f1bec-9912-429d-9c7f-e99a46b7e3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2415b46e99df45b5aadd7c144dc4fee3, user_id=4e57e0151263483fb97d2d4c7de9dbb8, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.373329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f1bec-9912-429d-9c7f-e99a46b7e3e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.416419 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4001/7997] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:33 2022] PUT /identity/v3/projects/fc83d0e981dc4ec29f0fc858361b0098/users/026aecd0b4d14fd8b882be9ad4eae814/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:33.421368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.436031 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:33.437283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3997/7998] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:33 2022] PUT /identity/v3/projects/2415b46e99df45b5aadd7c144dc4fee3/users/4e57e0151263483fb97d2d4c7de9dbb8/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:33.453093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.453391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.453678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.488157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] MFA Rules not processed for user `4e57e0151263483fb97d2d4c7de9dbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:33.488157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:33.493586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c28d-2f32-4db7-9f60-bb7d2d2e816e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.500634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:33.553827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.554451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.554736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.555029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.555721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.556324 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3998/7999] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:33.557305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.570125 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4002/8000] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:33.571770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.573234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:33.575091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.585668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82c579-e46d-4a7f-a10e-3e10a0cfaf04 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.590577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc4d7-339b-4c25-abc5-cd0442a552dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.591283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc4d7-339b-4c25-abc5-cd0442a552dc admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.591597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc4d7-339b-4c25-abc5-cd0442a552dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.591879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc4d7-339b-4c25-abc5-cd0442a552dc admin admin] PATH_INFO: `/v3/projects/fc83d0e981dc4ec29f0fc858361b0098/users/026aecd0b4d14fd8b882be9ad4eae814/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.594280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc4d7-339b-4c25-abc5-cd0442a552dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc83d0e981dc4ec29f0fc858361b0098, user_id=026aecd0b4d14fd8b882be9ad4eae814, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.597034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc4d7-339b-4c25-abc5-cd0442a552dc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.616400 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4003/8001] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:33 2022] PUT /identity/v3/projects/fc83d0e981dc4ec29f0fc858361b0098/users/026aecd0b4d14fd8b882be9ad4eae814/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:33.629266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.635994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.635994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.643278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519685-4599-4298-b366-2b602bb42f23 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.670681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] MFA Rules not processed for user `026aecd0b4d14fd8b882be9ad4eae814`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:33.672170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:33.706516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.707889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.708172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.708447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.759166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4004/8002] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:33.772907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:33.773821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.775310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.785760 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 3999/8003] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:33.804885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:33.841107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb2e5-3e97-43e0-84b0-9b33b05289e2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:33.849595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7580a0-8be0-43be-9033-68929192eae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:33.850219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7580a0-8be0-43be-9033-68929192eae8 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:33.850507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7580a0-8be0-43be-9033-68929192eae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:33.850829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7580a0-8be0-43be-9033-68929192eae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:33.860541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7580a0-8be0-43be-9033-68929192eae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:33.861977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7580a0-8be0-43be-9033-68929192eae8 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:33.871814 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4005/8004] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:33.997603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:34.013786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2bf9-d132-4543-a9b4-9adf6ac1ab96 service glance] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:34.017971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:34.018601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:34.018888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:34.019253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:34.043142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:34.079577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:34.081032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:34.091303 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4000/8005] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:34.137836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:34.138137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:34.138434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:34.160270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:34.161492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:34.239211 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4006/8006] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:34.412050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:34.413529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:34.498469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc2bf-5f8c-4675-ba32-70345e2eb708 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:34.503717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44c439-6ac9-41f5-a9bb-aa7927bc4eeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:34.504339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44c439-6ac9-41f5-a9bb-aa7927bc4eeb service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:34.504620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44c439-6ac9-41f5-a9bb-aa7927bc4eeb service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:34.504892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44c439-6ac9-41f5-a9bb-aa7927bc4eeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:34.514506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44c439-6ac9-41f5-a9bb-aa7927bc4eeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:34.516248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44c439-6ac9-41f5-a9bb-aa7927bc4eeb service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:34.525686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4001/8007] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:29:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:29:35.039980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:35.039980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:35.055436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5cae6-f6dd-473c-954f-fdb953cb3636 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:35.060150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:35.060625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:35.060942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:35.061163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:35.124114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:35.125566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:35.140892 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4007/8008] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:35.222919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:35.223468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:35.223590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:35.243631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:35.247737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:35.252487 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4002/8009] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:29:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:35.265670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:35.288792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56a136-945f-41c5-9494-e05894d13584 service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:35.294219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3ec86-17bd-435c-b8eb-53e52d99e8a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:35.295073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3ec86-17bd-435c-b8eb-53e52d99e8a8 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:35.295187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3ec86-17bd-435c-b8eb-53e52d99e8a8 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:35.295410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3ec86-17bd-435c-b8eb-53e52d99e8a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:35.305297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3ec86-17bd-435c-b8eb-53e52d99e8a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:35.307820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3ec86-17bd-435c-b8eb-53e52d99e8a8 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:35.318107 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4008/8010] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:29:35.743033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:35.811537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4ff66-876d-4710-9a3f-c829f913d725 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:35.816800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:35.817448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:35.817731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:35.818025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] PATH_INFO: `/v3/users/bc8c2d751b4e4d08a4cd9dbbbcfc0992` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:35.819199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8c2d751b4e4d08a4cd9dbbbcfc0992)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:35.821230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:36.011421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8c2d751b4e4d08a4cd9dbbbcfc0992'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.012668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:36.019040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8c2d751b4e4d08a4cd9dbbbcfc0992'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.019740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8c2d751b4e4d08a4cd9dbbbcfc0992'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.020347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8c2d751b4e4d08a4cd9dbbbcfc0992'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.033398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8c2d751b4e4d08a4cd9dbbbcfc0992'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.127227 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4003/8011] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:35 2022] DELETE /identity/v3/users/bc8c2d751b4e4d08a4cd9dbbbcfc0992 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:36.132063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:36.132870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:36.133104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:36.154631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:36.159251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:36.208776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:36.223055 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4009/8012] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:36.232698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:36.234171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:36.299160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab00d5-aae9-42e3-8d3b-3d24861ad1f0 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:36.310676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d481b-cc0e-462a-aaa0-8e656a00793a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:36.311354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d481b-cc0e-462a-aaa0-8e656a00793a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:36.311641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d481b-cc0e-462a-aaa0-8e656a00793a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:36.311916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d481b-cc0e-462a-aaa0-8e656a00793a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:36.322206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d481b-cc0e-462a-aaa0-8e656a00793a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:36.323849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d481b-cc0e-462a-aaa0-8e656a00793a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:36.324451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:36.325856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:36.334672 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4004/8013] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:36.338549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab386-0ee6-482b-9dd7-bd333033bf7e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:36.343567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:36.344216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:36.344516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:36.344776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] PATH_INFO: `/v3/users/3424723f87db436badd94a53ec4a908e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:36.346104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3424723f87db436badd94a53ec4a908e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:36.348872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:36.591449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3424723f87db436badd94a53ec4a908e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.599974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3424723f87db436badd94a53ec4a908e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.601243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3424723f87db436badd94a53ec4a908e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.614586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3424723f87db436badd94a53ec4a908e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.615321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3424723f87db436badd94a53ec4a908e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:36.734744 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4010/8014] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:36 2022] DELETE /identity/v3/users/3424723f87db436badd94a53ec4a908e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:36.739595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:36.739908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:36.740182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:36.759952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:36.761225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:36.798386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:36.798386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:36.843201 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4005/8015] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:36.854261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:36.855720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:36.880226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bf879-5278-4d4a-89a4-82c6ae4699dd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:36.885960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:36.886863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:36.887197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:36.887473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] PATH_INFO: `/v3/projects/f6db781783b7492e95c7c09b5da761c3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:36.888603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6db781783b7492e95c7c09b5da761c3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:36.890499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:36.926552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943951b-d637-4b41-a1ad-629532e5faee None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:36.930296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:36.930903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:36.931215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:36.931487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:36.942577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:36.944172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:36.954376 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4006/8016] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:37.064315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6db781783b7492e95c7c09b5da761c3', 'request_id': 'req-de88bbc1-208b-4f60-89f2-78b16b827556'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.075518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6db781783b7492e95c7c09b5da761c3', 'request_id': 'req-de88bbc1-208b-4f60-89f2-78b16b827556'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.079045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6db781783b7492e95c7c09b5da761c3', 'request_id': 'req-de88bbc1-208b-4f60-89f2-78b16b827556'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.083500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:37.163879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] The token cache is being invalidate because project f6db781783b7492e95c7c09b5da761c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:37.165060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.165402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.166967 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4011/8017] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:36 2022] DELETE /identity/v3/projects/f6db781783b7492e95c7c09b5da761c3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:37.172184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:37.183939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a46f-c18f-4d2d-a1f9-ff2fc2ee1ef9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:37.194832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:37.251845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:37.252579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:37.252579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:37.252792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] PATH_INFO: `/v3/users/4e57e0151263483fb97d2d4c7de9dbb8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:37.254501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e57e0151263483fb97d2d4c7de9dbb8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:37.256498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:37.423654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:37.423654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:37.451103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bbc1-208b-4f60-89f2-78b16b827556 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:37.460117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:37.461193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:37.461480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:37.461915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] PATH_INFO: `/v3/projects/ad72d6caf0f54af99a434bb8bb836f09` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:37.466421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad72d6caf0f54af99a434bb8bb836f09)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:37.467099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:37.510582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e57e0151263483fb97d2d4c7de9dbb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.517999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e57e0151263483fb97d2d4c7de9dbb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.521454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e57e0151263483fb97d2d4c7de9dbb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.521454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e57e0151263483fb97d2d4c7de9dbb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.533023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e57e0151263483fb97d2d4c7de9dbb8'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.610667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad72d6caf0f54af99a434bb8bb836f09', 'request_id': 'req-cee7404c-3c7e-4b2f-9109-2f5a68baf923'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.617930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad72d6caf0f54af99a434bb8bb836f09', 'request_id': 'req-cee7404c-3c7e-4b2f-9109-2f5a68baf923'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.623900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad72d6caf0f54af99a434bb8bb836f09', 'request_id': 'req-cee7404c-3c7e-4b2f-9109-2f5a68baf923'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.626453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4007/8018] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:37 2022] DELETE /identity/v3/users/4e57e0151263483fb97d2d4c7de9dbb8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:37.726893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] The token cache is being invalidate because project ad72d6caf0f54af99a434bb8bb836f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:37.727221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.727877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:37.729548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4012/8019] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:37 2022] DELETE /identity/v3/projects/ad72d6caf0f54af99a434bb8bb836f09 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:37.733921 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:37.735544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:37.807989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee3eb-62e6-47b5-a78f-90ba1696e4d7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:37.813117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:37.813767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:37.814051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:37.814482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] PATH_INFO: `/v3/users/d57745404d0f4630bcd2d9da3f496236` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:37.815793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57745404d0f4630bcd2d9da3f496236)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:37.818400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:38.085068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:38.090965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:38.092613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:38.103114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57745404d0f4630bcd2d9da3f496236'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.112740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57745404d0f4630bcd2d9da3f496236'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.116027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57745404d0f4630bcd2d9da3f496236'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.116753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57745404d0f4630bcd2d9da3f496236'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.135840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2ccc940f-ff1d-4cc4-bc00-a6e08dc57ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57745404d0f4630bcd2d9da3f496236'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.177718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7404c-3c7e-4b2f-9109-2f5a68baf923 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:38.184396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:38.185261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.185545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.185828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] PATH_INFO: `/v3/projects/2415b46e99df45b5aadd7c144dc4fee3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.187076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2415b46e99df45b5aadd7c144dc4fee3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:38.189049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:38.192123 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4008/8020] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:37 2022] DELETE /identity/v3/users/d57745404d0f4630bcd2d9da3f496236 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:38.292917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2415b46e99df45b5aadd7c144dc4fee3', 'request_id': 'req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.300193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2415b46e99df45b5aadd7c144dc4fee3', 'request_id': 'req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.306384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2415b46e99df45b5aadd7c144dc4fee3', 'request_id': 'req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.421245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] The token cache is being invalidate because project 2415b46e99df45b5aadd7c144dc4fee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:38.421723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.422404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f0d1e3ad-e710-4cfa-a57d-6e5d1bad27d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.423980 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4013/8021] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:38 2022] DELETE /identity/v3/projects/2415b46e99df45b5aadd7c144dc4fee3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:38.431377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.431962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.432991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.458899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:38.460606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:38.541898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4009/8022] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:38.550467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.550742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.551171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.573142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:38.574356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:38.586020 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4014/8023] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:38.590486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:38.601617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6786d-6237-463a-8109-f6ac3764ac8a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:38.607617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:38.608243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.608529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.608810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.609464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:38.609774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:38.611490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:38.624528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4010/8024] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:38.628710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:38.633731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:38.639966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e6f4-9e8d-4a7d-b61b-70f26182f6eb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:38.644713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:38.645957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.646239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.646509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.647199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:38.649374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:38.709567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:38.711335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:38.726143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57605-c2f8-4d30-987c-02be5f877fa7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:38.736997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:38.736997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.736997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.736997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] PATH_INFO: `/v3/projects/4d72f431766e49569b3f357f28b3d2a8` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.737494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d72f431766e49569b3f357f28b3d2a8)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:38.738074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:38.746104 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4015/8025] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:38 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:38.750019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:38.831887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e4df-bcb3-4c49-abc1-64098eb9e6ca admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:38.837365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:38.837977 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:38.838257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:38.838533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:38.839209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:38.841150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:38.891295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d72f431766e49569b3f357f28b3d2a8', 'request_id': 'req-1bcdbd95-ecf8-4138-8758-7c4109c200e2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.897992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d72f431766e49569b3f357f28b3d2a8', 'request_id': 'req-1bcdbd95-ecf8-4138-8758-7c4109c200e2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.905370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d72f431766e49569b3f357f28b3d2a8', 'request_id': 'req-1bcdbd95-ecf8-4138-8758-7c4109c200e2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:38.975344 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4016/8026] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:38 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:38.979344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:38.990383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709fcc1-864b-4a26-a23b-5e2d973ed609 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.018803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] The token cache is being invalidate because project 4d72f431766e49569b3f357f28b3d2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:39.019138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:39.019835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1bcdbd95-ecf8-4138-8758-7c4109c200e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:39.021386 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4011/8027] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:38 2022] DELETE /identity/v3/projects/4d72f431766e49569b3f357f28b3d2a8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:39.026580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706766b-378e-4adc-8176-3aaed8ceef79 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.026874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706766b-378e-4adc-8176-3aaed8ceef79 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.027188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706766b-378e-4adc-8176-3aaed8ceef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.047804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9706766b-378e-4adc-8176-3aaed8ceef79 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:39.049035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9706766b-378e-4adc-8176-3aaed8ceef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:39.057563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.058186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.058470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.058785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.065648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.065648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.066042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:39.074275 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4017/8028] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:39.078758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.084632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:39.097423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523de82-0dd2-48fa-9ef4-2c04d1f36fd1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.102914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.103637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.103986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.104218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.104860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.106494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.118532 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4018/8029] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:39.129534 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4012/8030] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:39.130277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.131701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.131994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.132272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.134354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515212c-0177-427b-a7d1-e1ee5f0bef08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.139514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fd13-6a01-4ed7-992d-fe861a150800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.140190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fd13-6a01-4ed7-992d-fe861a150800 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.140479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fd13-6a01-4ed7-992d-fe861a150800 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.140762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fd13-6a01-4ed7-992d-fe861a150800 admin admin] PATH_INFO: `/v3/projects/308af4460b5d422b8b763eb1b1dc4f9c/users/24a20163eacb4620859569110693ecf5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.157745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fd13-6a01-4ed7-992d-fe861a150800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308af4460b5d422b8b763eb1b1dc4f9c, user_id=24a20163eacb4620859569110693ecf5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.161292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fd13-6a01-4ed7-992d-fe861a150800 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.161762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:39.162989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:39.171352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4013/8031] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:39.175514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.185345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae98d4b-2636-4f6b-b141-cf083e0f507a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.190071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.190657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.190945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.191256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.191938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:39.192798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.194396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.206236 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4014/8032] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:39.210511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.220197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5648db-3bdb-44a9-8235-e9b8733d9e3e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.224939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.229794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.229794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.229794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.229794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.229794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.254373 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4019/8033] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:39 2022] PUT /identity/v3/projects/308af4460b5d422b8b763eb1b1dc4f9c/users/24a20163eacb4620859569110693ecf5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:39.266693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.266985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.267308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.297447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] MFA Rules not processed for user `24a20163eacb4620859569110693ecf5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:39.298669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:39.319724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:39.333902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4015/8034] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:39.335250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.379517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4020/8035] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:39.384348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.410290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d626279-ddad-4a8f-873a-89eb45ab75cb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.421972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.422623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.422910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.423227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.423978 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.426057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.453752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824fad-80bd-4e69-817d-b26377ef2e09 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.467425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.468348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.468843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.469355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.470159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.474017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.589124 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4016/8036] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:39.592850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.605011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd095d6-801e-43e5-8d48-bc0c0b87aac1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.609877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.610501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.610903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.611220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.612094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.613773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.621978 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4021/8037] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:39.623176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.625966 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4017/8038] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:39.632034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.643229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15956dd2-2ed0-4546-900b-68d9ed52cbc5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.697489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ef02e-c5f0-4ab2-b00d-34744f201a34 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.702908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.703690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.704019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.704523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.705176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.707170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.708629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:39.717424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.718175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.718533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.718878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.719543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.721260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.732474 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4018/8039] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:39.736673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.746981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca46d5-07fa-460f-9907-0418f6fcb2bc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.751746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac401e6-d127-4a85-9fc6-943ed17b2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.752446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac401e6-d127-4a85-9fc6-943ed17b2697 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.752730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac401e6-d127-4a85-9fc6-943ed17b2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.753028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac401e6-d127-4a85-9fc6-943ed17b2697 admin admin] PATH_INFO: `/v3/projects/a17919cdeb79404090e5fc5701e51fa8/users/7ab1b28b2abf4581a4d92f501cf71545/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.769097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac401e6-d127-4a85-9fc6-943ed17b2697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17919cdeb79404090e5fc5701e51fa8, user_id=7ab1b28b2abf4581a4d92f501cf71545, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.772455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac401e6-d127-4a85-9fc6-943ed17b2697 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.833502 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4022/8040] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:39.837541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.848311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804d294-235a-4ce6-803d-f54f83c934a3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.854093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.854720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.858117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.858117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.858117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.858117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.870672 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4023/8041] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:39.874777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:39.886493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a942ed2-f070-4933-9bb9-0d6d3352137f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:39.898371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:39.898371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.898371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.898371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] PATH_INFO: `/v3/projects/2c79242eb9254d6ead71d3a333cfd2ab/users/6f2b162d7f494c4eac0e3bbc90f20f30/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.914832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c79242eb9254d6ead71d3a333cfd2ab, user_id=6f2b162d7f494c4eac0e3bbc90f20f30, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:39.917729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:39.925135 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4019/8042] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:39 2022] PUT /identity/v3/projects/a17919cdeb79404090e5fc5701e51fa8/users/7ab1b28b2abf4581a4d92f501cf71545/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:39.935214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:39.935508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:39.935788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:39.965954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] MFA Rules not processed for user `7ab1b28b2abf4581a4d92f501cf71545`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:39.967458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:39.998665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:40.004220 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4024/8043] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:39 2022] PUT /identity/v3/projects/2c79242eb9254d6ead71d3a333cfd2ab/users/6f2b162d7f494c4eac0e3bbc90f20f30/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:40.007903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.037862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4020/8044] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:40.041302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.083345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c352d8-58c2-42dd-aa27-6c82705e567e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.090409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.090960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.091281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.091560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.092221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.093845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.107279 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4025/8045] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:40.108651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.112826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f07bb-f201-4d48-9471-6a4d401c567c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.117855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e36487-9643-4dab-97e0-301093b077d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.121616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36487-9643-4dab-97e0-301093b077d8 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.121616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36487-9643-4dab-97e0-301093b077d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.121616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36487-9643-4dab-97e0-301093b077d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.121616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e36487-9643-4dab-97e0-301093b077d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.122041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d679845-03ac-4faa-b6f8-c594df137405 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.122163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e36487-9643-4dab-97e0-301093b077d8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.128670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.129342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.130142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.130424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] PATH_INFO: `/v3/projects/2c79242eb9254d6ead71d3a333cfd2ab/users/6f2b162d7f494c4eac0e3bbc90f20f30/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.133366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c79242eb9254d6ead71d3a333cfd2ab, user_id=6f2b162d7f494c4eac0e3bbc90f20f30, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.136175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.149118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4026/8046] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:40 2022] PUT /identity/v3/projects/2c79242eb9254d6ead71d3a333cfd2ab/users/6f2b162d7f494c4eac0e3bbc90f20f30/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:40.234391 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4021/8047] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:40 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:40.235965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.242351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.242640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.242914 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.272503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] MFA Rules not processed for user `6f2b162d7f494c4eac0e3bbc90f20f30`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:40.273995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:40.304036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a69e3-2c47-476f-836f-7f628556b5f7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.312830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:40.355733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4022/8048] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:40.366749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.368319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:40.369559 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.370176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.370498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.370780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.371442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.373462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.429780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf71a-77d1-4ca8-ac88-4f333f4f96bb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.433603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.434217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.434501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.434812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.494023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.495522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.505713 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4023/8049] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:40.510486 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4027/8050] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:40 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:40.514337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.525713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d251-64ac-4cbf-b02c-49f13f89dc58 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.530895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.531625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.538254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.538254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.538254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.538254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.545364 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4024/8051] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:40.549443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.562071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf993-3af5-4f03-973c-409b7f0dbb76 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.567802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59236ab-3cb6-494f-bbce-8a545eed3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.568447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59236ab-3cb6-494f-bbce-8a545eed3b9e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.568730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59236ab-3cb6-494f-bbce-8a545eed3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.569004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59236ab-3cb6-494f-bbce-8a545eed3b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.569639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59236ab-3cb6-494f-bbce-8a545eed3b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.571537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59236ab-3cb6-494f-bbce-8a545eed3b9e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.585083 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4028/8052] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:40.586683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.597886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299beddb-65ab-46b9-8fed-e15defbaf079 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.607227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.607227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.607227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.607227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] PATH_INFO: `/v3/projects/df6feeb37f024544badd54684c8e5ab1/users/8a2490b038c34555a1986ee3a5267acd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.623932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6feeb37f024544badd54684c8e5ab1, user_id=8a2490b038c34555a1986ee3a5267acd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.628815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:40.718866 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4025/8053] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:40 2022] PUT /identity/v3/projects/df6feeb37f024544badd54684c8e5ab1/users/8a2490b038c34555a1986ee3a5267acd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:40.728498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.728786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.729064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.751504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:40.761189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] MFA Rules not processed for user `8a2490b038c34555a1986ee3a5267acd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:40.762512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:40.832029 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4029/8054] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:40.836545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:40.892557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:40.909745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab744f-219c-4fa0-97fe-49e1b92167a6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:40.915811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:40.916672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:40.916964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:40.917244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:40.917881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:40.919835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.024902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4026/8055] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:40 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:41.026087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.037716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7956472-1d23-4128-902e-f67a3b4252e2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.099050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.099672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.101280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.101280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.101280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:41.103349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.216253 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4030/8056] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:41 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:41.217542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.228528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48ba2-5022-40a1-8ba1-48dae0bcbd8b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.233740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.234468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.234746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.235052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.235770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:41.237336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.248504 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4027/8057] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:41.252677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.263369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b4d1c-66f2-4818-9726-63db02e6a81e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.268056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.268784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.269062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.269338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] PATH_INFO: `/v3/projects/5857a09fffd149c99a2886d16d5db6b9/users/1f2bd27575b74b23876eceb151e92f5a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.284668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5857a09fffd149c99a2886d16d5db6b9, user_id=1f2bd27575b74b23876eceb151e92f5a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:41.287455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.466097 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4031/8058] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:41 2022] PUT /identity/v3/projects/5857a09fffd149c99a2886d16d5db6b9/users/1f2bd27575b74b23876eceb151e92f5a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:41.470146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.480346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f242f2-3f4f-4f7e-9c99-8690e1ee0467 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.539175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79502d3f-7e26-460d-98b7-cd52f1af534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.539780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79502d3f-7e26-460d-98b7-cd52f1af534b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.540061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79502d3f-7e26-460d-98b7-cd52f1af534b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.540335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79502d3f-7e26-460d-98b7-cd52f1af534b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.540959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79502d3f-7e26-460d-98b7-cd52f1af534b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:41.542544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79502d3f-7e26-460d-98b7-cd52f1af534b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.552730 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4028/8059] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:41.557175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.568338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a052c-6fea-473d-aa3f-1d388d96c16f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.573170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.573830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.574117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.574393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] PATH_INFO: `/v3/projects/5857a09fffd149c99a2886d16d5db6b9/users/1f2bd27575b74b23876eceb151e92f5a/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.576335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5857a09fffd149c99a2886d16d5db6b9, user_id=1f2bd27575b74b23876eceb151e92f5a, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:41.579081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.599266 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4032/8060] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:41 2022] PUT /identity/v3/projects/5857a09fffd149c99a2886d16d5db6b9/users/1f2bd27575b74b23876eceb151e92f5a/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:41.610116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.610701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.610939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.642185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] MFA Rules not processed for user `1f2bd27575b74b23876eceb151e92f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:41.643608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:41.725889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4029/8061] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:41.737868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.740529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:41.802081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e360054-430f-4e4e-84f0-f338293a32a5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.805756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.806363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.806646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.806946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:41.812859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:41.816639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:41.818079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:41.827851 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4033/8062] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:41.966967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:41.968459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:41.983429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58439a-aa3d-432a-8c4c-9f18e22724d0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:41.987031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98932f6b-e790-4e6d-abfd-f9ce899735b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:41.987651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98932f6b-e790-4e6d-abfd-f9ce899735b7 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:41.987933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98932f6b-e790-4e6d-abfd-f9ce899735b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:41.988204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98932f6b-e790-4e6d-abfd-f9ce899735b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:42.038991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:42.055920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98932f6b-e790-4e6d-abfd-f9ce899735b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:42.057483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98932f6b-e790-4e6d-abfd-f9ce899735b7 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:42.067946 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4030/8063] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:42.763844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:42.765406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:42.835824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642d549-e954-47df-862d-9826b383e1f0 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:42.840528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:42.841183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:42.841466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:42.841747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] PATH_INFO: `/v3/users/d17d79b38c4c48e7b253617177cf5000` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:42.843221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17d79b38c4c48e7b253617177cf5000)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:42.847985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:43.138726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17d79b38c4c48e7b253617177cf5000'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:43.155996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17d79b38c4c48e7b253617177cf5000'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:43.157212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17d79b38c4c48e7b253617177cf5000'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:43.176311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17d79b38c4c48e7b253617177cf5000'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:43.177178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17d79b38c4c48e7b253617177cf5000'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:43.276746 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4034/8064] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:42 2022] DELETE /identity/v3/users/d17d79b38c4c48e7b253617177cf5000 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:43.280740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:43.281561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:43.282008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:43.301780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:43.303240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:43.380686 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4031/8065] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:43.391996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:43.393605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:43.486051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62ff9b-4a24-4524-b89e-f76cea5167f6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:43.492089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:43.492712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:43.492993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:43.493269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:43.507693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:43.509435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:43.523910 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4035/8066] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:43.941232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:43.942769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:43.959715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e25f6-52f3-4ebb-861a-765355abd626 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:43.964284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:43.964973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:43.965326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:43.965672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:43.967813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:44.047623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:44.049580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:44.061720 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4032/8067] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:44.344007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:44.344510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:44.363152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad755-d4c9-48bf-9230-6851041d3137 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:44.388716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:44.390082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:44.393085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:44.393085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] PATH_INFO: `/v3/projects/2e2258f4a93649f898bad7d90e5efb37` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:44.397608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2258f4a93649f898bad7d90e5efb37)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:44.404410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:44.433985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:44.623690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2258f4a93649f898bad7d90e5efb37', 'request_id': 'req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:44.644859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2258f4a93649f898bad7d90e5efb37', 'request_id': 'req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:44.664775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2258f4a93649f898bad7d90e5efb37', 'request_id': 'req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:44.756908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] The token cache is being invalidate because project 2e2258f4a93649f898bad7d90e5efb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:44.760654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:44.760654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:44.763779 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4036/8068] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:44 2022] DELETE /identity/v3/projects/2e2258f4a93649f898bad7d90e5efb37 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:44.766649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:44.779373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6692b8-65ce-4b5e-88d0-541c322824c2 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:44.918762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:44.919559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:44.919942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:44.920290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] PATH_INFO: `/v3/users/026aecd0b4d14fd8b882be9ad4eae814` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:44.921992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=026aecd0b4d14fd8b882be9ad4eae814)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:44.924306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:44.949119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:45.219040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026aecd0b4d14fd8b882be9ad4eae814'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:45.228026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026aecd0b4d14fd8b882be9ad4eae814'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:45.228896 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026aecd0b4d14fd8b882be9ad4eae814'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:45.229626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026aecd0b4d14fd8b882be9ad4eae814'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:45.243410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4e02d665-1499-49fb-86e0-00834222c7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026aecd0b4d14fd8b882be9ad4eae814'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:45.331085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4033/8069] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:44 2022] DELETE /identity/v3/users/026aecd0b4d14fd8b882be9ad4eae814 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:45.892445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:45.900079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:45.920374 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d43c5-0cb0-4aec-b542-edad61bbcf2a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:45.999798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.000503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.001239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.001239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] PATH_INFO: `/v3/projects/fc83d0e981dc4ec29f0fc858361b0098` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.002433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc83d0e981dc4ec29f0fc858361b0098)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.005198 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:46.152970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc83d0e981dc4ec29f0fc858361b0098', 'request_id': 'req-12f56cbc-c3ac-4065-a791-cf019dc3161f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:46.161665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc83d0e981dc4ec29f0fc858361b0098', 'request_id': 'req-12f56cbc-c3ac-4065-a791-cf019dc3161f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:46.167254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc83d0e981dc4ec29f0fc858361b0098', 'request_id': 'req-12f56cbc-c3ac-4065-a791-cf019dc3161f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:46.262752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] The token cache is being invalidate because project fc83d0e981dc4ec29f0fc858361b0098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:46.262965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:46.263677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-12f56cbc-c3ac-4065-a791-cf019dc3161f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:46.265209 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4037/8070] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:45 2022] DELETE /identity/v3/projects/fc83d0e981dc4ec29f0fc858361b0098 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:46.270300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.270873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.270873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.294881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:46.296472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:46.375301 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4034/8071] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:46.383257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.383562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.383863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.408209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:46.408209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:46.418180 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4038/8072] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:46.431982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:46.444890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14929aed-45cc-4979-9f43-ccec66dac35d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:46.457266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.458636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.459200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.459721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.460660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:46.461041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.462912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:46.477321 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4035/8073] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:46.486593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:46.494687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e11cab-0c66-44c3-8154-e4e6f1881907 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:46.501495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.502590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.503122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.503636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.505088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.508718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:46.612338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:46.621103 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4039/8074] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:46 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:46.622335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:46.633680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26f3b-df32-4a2e-bc12-d83cd8187b7a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:46.696029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.696650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.696940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.697238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.697846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.699943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:46.864549 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4036/8075] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:46 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:46.865776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:46.876333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc623640-71fe-4366-bd61-2e6e9d74395d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:46.889301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.889947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.890230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.890642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.891398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.893645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:46.906196 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4040/8076] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:46.910143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:46.923058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027dc27-dbad-49db-8468-6ae7c4d9f429 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:46.929893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114685d6-6d3e-4e08-8551-51855018b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.930737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114685d6-6d3e-4e08-8551-51855018b88f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.931045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114685d6-6d3e-4e08-8551-51855018b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.931364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114685d6-6d3e-4e08-8551-51855018b88f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.932172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114685d6-6d3e-4e08-8551-51855018b88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.933773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114685d6-6d3e-4e08-8551-51855018b88f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:46.946209 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4037/8077] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:46.950246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:46.962256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b25e-f652-402f-b710-2316ee0923fa admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:46.968214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:46.971490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:46.971490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:46.971490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] PATH_INFO: `/v3/projects/7a6ad41a3efb4d8b8422001a9c3aceb0/users/4aa18374eb6b4d33bb9a4fef49d0661b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:46.990572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6ad41a3efb4d8b8422001a9c3aceb0, user_id=4aa18374eb6b4d33bb9a4fef49d0661b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:46.996421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.090361 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4041/8078] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:46 2022] PUT /identity/v3/projects/7a6ad41a3efb4d8b8422001a9c3aceb0/users/4aa18374eb6b4d33bb9a4fef49d0661b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:47.101234 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.101604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.101931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.112273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:47.137054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] MFA Rules not processed for user `4aa18374eb6b4d33bb9a4fef49d0661b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:47.138308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:47.224864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4038/8079] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:47.230129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.303048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de455df9-354b-4a9b-81f0-ba5e2c377719 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:47.308146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:47.308715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.308995 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.309274 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.309913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:47.312047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.465140 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4042/8080] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:47 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:47.468954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.485726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b6de1-30f8-4d2f-a016-559efb8c0aae None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:47.575129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:47.575716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.576006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.576287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.576966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:47.578922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.688151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.689934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:47.704023 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4039/8081] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:47 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:47.704186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34467a9-abcd-4e12-9e08-78184c935660 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:47.706553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.710500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:47.711285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.711628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.711993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] PATH_INFO: `/v3/users/24a20163eacb4620859569110693ecf5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.713557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a20163eacb4620859569110693ecf5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:47.715696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.718430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a558c-f6e8-4195-a038-b5b4f9943e74 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:47.723582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:47.724202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.724489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.724764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.725446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:47.727095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.737891 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4040/8082] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:47.744249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.757011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f3aa-d1ab-4fc7-8600-9d72828d94e4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:47.761782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:47.762454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.762741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.763032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] PATH_INFO: `/v3/projects/994b3ad5c13848d3b1b38722cc98d3fa/users/09a84fe13041457ca4d20db4c5c524b4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.782413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=994b3ad5c13848d3b1b38722cc98d3fa, user_id=09a84fe13041457ca4d20db4c5c524b4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:47.785144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.884739 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4041/8083] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:47 2022] PUT /identity/v3/projects/994b3ad5c13848d3b1b38722cc98d3fa/users/09a84fe13041457ca4d20db4c5c524b4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:47.888352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.955477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a20163eacb4620859569110693ecf5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:47.969388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a20163eacb4620859569110693ecf5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:47.972645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a20163eacb4620859569110693ecf5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:47.973160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf32c-506c-4f90-b0e0-c86cc7ad01cd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:47.978245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:47.978868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:47.979310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:47.979595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:47.980247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:47.981872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:47.984788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a20163eacb4620859569110693ecf5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:47.985577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-20b270ed-a175-49a6-bdb2-e46d8c2e3154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a20163eacb4620859569110693ecf5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:47.993184 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4042/8084] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:47.997447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:47.999339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:48.014535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d16203-e372-45be-b35c-2b24e886feef admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:48.019655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199aabb-d5e2-46b8-928d-cfb2b400faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:48.020390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199aabb-d5e2-46b8-928d-cfb2b400faff admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:48.020943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199aabb-d5e2-46b8-928d-cfb2b400faff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:48.020943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199aabb-d5e2-46b8-928d-cfb2b400faff admin admin] PATH_INFO: `/v3/projects/994b3ad5c13848d3b1b38722cc98d3fa/users/09a84fe13041457ca4d20db4c5c524b4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:48.022883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199aabb-d5e2-46b8-928d-cfb2b400faff admin admin] RBAC: Authorizing `identity:create_grant(project_id=994b3ad5c13848d3b1b38722cc98d3fa, user_id=09a84fe13041457ca4d20db4c5c524b4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:48.025847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199aabb-d5e2-46b8-928d-cfb2b400faff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:48.036539 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4043/8085] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:47 2022] PUT /identity/v3/projects/994b3ad5c13848d3b1b38722cc98d3fa/users/09a84fe13041457ca4d20db4c5c524b4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:48.047804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:48.048099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:48.048383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:48.079982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] MFA Rules not processed for user `09a84fe13041457ca4d20db4c5c524b4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:48.081271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:48.086386 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4043/8086] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:47 2022] DELETE /identity/v3/users/24a20163eacb4620859569110693ecf5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:48.091154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:48.091450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:48.091726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:48.111884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:48.113128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:48.151869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:48.167539 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4044/8087] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:48.178829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:48.180213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:48.183601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4044/8088] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:48.190273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:48.192726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:48.246401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe647c3-450d-4c82-b80b-0a007b0dd934 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:48.253453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334976d-233d-44a2-b1ca-adbccddb9d3a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:48.257883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:48.258537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:48.258834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:48.259143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:48.268813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:48.270348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:48.282487 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4045/8089] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:48.298963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:48.299622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:48.299904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:48.300180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:48.340529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:48.387238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:48.389947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:48.406108 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4045/8090] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:48.580204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:48.689278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:48.690813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:48.727476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716be08e-22e2-486d-bf96-56926ab47280 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:48.728646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:48.729292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:48.729803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:48.730090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] PATH_INFO: `/v3/projects/308af4460b5d422b8b763eb1b1dc4f9c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:48.731425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308af4460b5d422b8b763eb1b1dc4f9c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:48.733604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:48.870702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308af4460b5d422b8b763eb1b1dc4f9c', 'request_id': 'req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:48.877938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308af4460b5d422b8b763eb1b1dc4f9c', 'request_id': 'req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:48.884642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308af4460b5d422b8b763eb1b1dc4f9c', 'request_id': 'req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:48.961330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] The token cache is being invalidate because project 308af4460b5d422b8b763eb1b1dc4f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:48.962025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:48.962340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:48.963875 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4046/8091] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:48 2022] DELETE /identity/v3/projects/308af4460b5d422b8b763eb1b1dc4f9c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:48.967969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:48.978813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e272a0-68cd-4d75-ad91-328d1e84f7e7 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:49.017497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:49.018946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:49.045308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:49.048962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:49.048962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:49.048962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] PATH_INFO: `/v3/users/6f2b162d7f494c4eac0e3bbc90f20f30` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:49.048962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2b162d7f494c4eac0e3bbc90f20f30)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:49.049750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:49.078991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:49.095711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb0e1-1304-44d1-9e82-23a7b3f79d52 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:49.102809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:49.103503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:49.103825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:49.107867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] PATH_INFO: `/v3/users/4aa18374eb6b4d33bb9a4fef49d0661b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:49.107867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa18374eb6b4d33bb9a4fef49d0661b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:49.107867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:49.325397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2b162d7f494c4eac0e3bbc90f20f30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.332740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2b162d7f494c4eac0e3bbc90f20f30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.333482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2b162d7f494c4eac0e3bbc90f20f30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.334094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2b162d7f494c4eac0e3bbc90f20f30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.347257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d6deff81-1edf-4d20-916a-d4ab1400ea9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2b162d7f494c4eac0e3bbc90f20f30'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.358085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa18374eb6b4d33bb9a4fef49d0661b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.366207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa18374eb6b4d33bb9a4fef49d0661b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.367286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa18374eb6b4d33bb9a4fef49d0661b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.379902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa18374eb6b4d33bb9a4fef49d0661b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.380654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa18374eb6b4d33bb9a4fef49d0661b'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:49.471895 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4046/8092] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:48 2022] DELETE /identity/v3/users/6f2b162d7f494c4eac0e3bbc90f20f30 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:49.569255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4047/8093] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:49 2022] DELETE /identity/v3/users/4aa18374eb6b4d33bb9a4fef49d0661b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:49.574335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:49.574681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:49.574965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:49.597050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:49.598933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:49.636999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:49.666269 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4047/8094] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:49.676938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:49.678448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:49.763393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92361f-ee56-4e5a-b2cf-ca10002f4633 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:49.764134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:49.764962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:49.765591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:49.765591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:49.779722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:49.779722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:49.791041 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4048/8095] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:49.998982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.001186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:50.028893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b80e8-9f5b-4e1e-aaa4-4200b9f721ac None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.034998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.036249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.036531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.036848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] PATH_INFO: `/v3/projects/2c79242eb9254d6ead71d3a333cfd2ab` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.037995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c79242eb9254d6ead71d3a333cfd2ab)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.040025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.185227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c79242eb9254d6ead71d3a333cfd2ab', 'request_id': 'req-743ca2cf-7010-4f0a-93cb-785c811d6d16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.191347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c79242eb9254d6ead71d3a333cfd2ab', 'request_id': 'req-743ca2cf-7010-4f0a-93cb-785c811d6d16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.198512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c79242eb9254d6ead71d3a333cfd2ab', 'request_id': 'req-743ca2cf-7010-4f0a-93cb-785c811d6d16'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.261636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.263758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:50.287383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392de41b-161d-4582-aabb-c3df5440b33e service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.305531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] The token cache is being invalidate because project 2c79242eb9254d6ead71d3a333cfd2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:50.305884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.306462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-743ca2cf-7010-4f0a-93cb-785c811d6d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.308255 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4048/8096] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:49 2022] DELETE /identity/v3/projects/2c79242eb9254d6ead71d3a333cfd2ab => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:50.313538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca315-9f04-4614-8858-e3ea89c08594 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.313898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca315-9f04-4614-8858-e3ea89c08594 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.314262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca315-9f04-4614-8858-e3ea89c08594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.340254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-194ca315-9f04-4614-8858-e3ea89c08594 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:50.341478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-194ca315-9f04-4614-8858-e3ea89c08594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:50.358936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.359540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.359824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.360104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] PATH_INFO: `/v3/projects/7a6ad41a3efb4d8b8422001a9c3aceb0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.361292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6ad41a3efb4d8b8422001a9c3aceb0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.363254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.376103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:50.406689 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4049/8097] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:50.415081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.415383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.415661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.437150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:50.438388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:50.446945 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4050/8098] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:50.451236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.461603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce71ad-eb23-48f7-a6ed-b7e01d6a1d33 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.466351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.466997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.467315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.467645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.468235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:50.468540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.470144 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.482856 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4051/8099] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:29:50.487565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.504202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68cb83-0b69-48a2-abb2-1ba48c2f6898 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.522639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6ad41a3efb4d8b8422001a9c3aceb0', 'request_id': 'req-4969d055-9170-4435-8fe4-33f02d67c37a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.531808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6ad41a3efb4d8b8422001a9c3aceb0', 'request_id': 'req-4969d055-9170-4435-8fe4-33f02d67c37a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.542659 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6ad41a3efb4d8b8422001a9c3aceb0', 'request_id': 'req-4969d055-9170-4435-8fe4-33f02d67c37a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.554392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:50.570823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.571483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.571770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.572049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.572677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.574701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.660521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] The token cache is being invalidate because project 7a6ad41a3efb4d8b8422001a9c3aceb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:50.660847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.661554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.663114 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4049/8100] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:50 2022] DELETE /identity/v3/projects/7a6ad41a3efb4d8b8422001a9c3aceb0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:50.669821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.669821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:50.676180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4052/8101] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:50 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:50.679515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.681347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:50.683109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969d055-9170-4435-8fe4-33f02d67c37a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.761309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.761309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.761309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.761309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] PATH_INFO: `/v3/users/09a84fe13041457ca4d20db4c5c524b4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.764454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a84fe13041457ca4d20db4c5c524b4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.764454 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.764693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e768a6d-0b7c-4391-9aaf-44330f5fb891 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.769545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.770748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.771040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.771361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.771991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.774254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.877877 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4053/8102] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:50 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:50.880575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.895908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709a17-f667-4f66-8398-b3179e7a0d81 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.901124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.901741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.902028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.902316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.902958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.904616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.915272 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4054/8103] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:50.919434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.930455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a795e-bace-4e72-8e69-154d53f1920b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.935397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.936002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.936285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.936559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.937191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.938774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.950272 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4055/8104] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:50.954422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:50.963779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a168-729b-473c-84d3-aed10340884e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:50.969790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28871e3-283a-4aba-be6b-1edefa1846ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:50.970489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28871e3-283a-4aba-be6b-1edefa1846ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:50.970779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28871e3-283a-4aba-be6b-1edefa1846ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:50.971285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28871e3-283a-4aba-be6b-1edefa1846ab admin admin] PATH_INFO: `/v3/projects/6015740b124f4ab0891a70483f26249d/users/4ff3ceb2ed5d438ca8e8c303589a8a62/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:50.985954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a84fe13041457ca4d20db4c5c524b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.991333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28871e3-283a-4aba-be6b-1edefa1846ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6015740b124f4ab0891a70483f26249d, user_id=4ff3ceb2ed5d438ca8e8c303589a8a62, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:50.994699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a84fe13041457ca4d20db4c5c524b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:50.995911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28871e3-283a-4aba-be6b-1edefa1846ab admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:50.996886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a84fe13041457ca4d20db4c5c524b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.013756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a84fe13041457ca4d20db4c5c524b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.014549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a84fe13041457ca4d20db4c5c524b4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.088806 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4056/8105] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:50 2022] PUT /identity/v3/projects/6015740b124f4ab0891a70483f26249d/users/4ff3ceb2ed5d438ca8e8c303589a8a62/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:51.098865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.099261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.099479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.111604 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4050/8106] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:50 2022] DELETE /identity/v3/users/09a84fe13041457ca4d20db4c5c524b4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:51.133663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] MFA Rules not processed for user `4ff3ceb2ed5d438ca8e8c303589a8a62`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:51.134940 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:51.206493 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4057/8107] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:51.211174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.212594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:51.235430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:51.279541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f1c32-6777-45fd-a6e0-7002a551818a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.291645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.292293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.292579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.292894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.293503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.295540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.394575 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4051/8108] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:51 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:51.395912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.401974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:51.408337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30a257-9649-4d76-8842-4a68e1d9c380 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.474886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.475570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.475855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.476131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.476759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.478681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.570128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.570660 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4058/8109] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:51 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:51.574439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.582483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:51.590196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995661-e740-4a64-9684-7c5e1e8bb8b3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.592570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8b9e-6838-4d5e-aec0-747d47fa78da admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.602066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.602324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.602700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.603194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.603481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.603671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.604110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.604558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] PATH_INFO: `/v3/projects/994b3ad5c13848d3b1b38722cc98d3fa` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.604685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.606428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.607477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=994b3ad5c13848d3b1b38722cc98d3fa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.610384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.622310 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4059/8110] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:51.626967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.639865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341b8a-b062-4644-98d5-5639a467f630 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.645336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.651489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.651489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.651489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] PATH_INFO: `/v3/projects/952e07099daf484cab284287e69f4809/users/c86720d4d8a74c7f86c45425555b89b2/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.664459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952e07099daf484cab284287e69f4809, user_id=c86720d4d8a74c7f86c45425555b89b2, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.667506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.793437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4060/8111] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:51 2022] PUT /identity/v3/projects/952e07099daf484cab284287e69f4809/users/c86720d4d8a74c7f86c45425555b89b2/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:51.798058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.803965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994b3ad5c13848d3b1b38722cc98d3fa', 'request_id': 'req-7f6f5ed7-65be-4571-83c2-ac1366ed3732'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.813321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994b3ad5c13848d3b1b38722cc98d3fa', 'request_id': 'req-7f6f5ed7-65be-4571-83c2-ac1366ed3732'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.824072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994b3ad5c13848d3b1b38722cc98d3fa', 'request_id': 'req-7f6f5ed7-65be-4571-83c2-ac1366ed3732'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.870737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc58f68-5934-4b9e-89d9-a2ab70d0ac73 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.932667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbc318-13d2-46da-bfb8-28ee548a93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.933290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbc318-13d2-46da-bfb8-28ee548a93db admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.933573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbc318-13d2-46da-bfb8-28ee548a93db admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.933915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbc318-13d2-46da-bfb8-28ee548a93db admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.934211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] The token cache is being invalidate because project 994b3ad5c13848d3b1b38722cc98d3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:51.934515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.934661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbc318-13d2-46da-bfb8-28ee548a93db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.935268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:51.936516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbc318-13d2-46da-bfb8-28ee548a93db admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.936815 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4052/8112] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:51 2022] DELETE /identity/v3/projects/994b3ad5c13848d3b1b38722cc98d3fa => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:51.937760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.939790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:51.943925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:51.952571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4061/8113] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:51.952571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.952571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.952571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.957923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5ed7-65be-4571-83c2-ac1366ed3732 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:51.962928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:51.963596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:51.963880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:51.964164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] PATH_INFO: `/v3/users/7ab1b28b2abf4581a4d92f501cf71545` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:51.965503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab1b28b2abf4581a4d92f501cf71545)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:51.967598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:51.971498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:51.972790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:51.981519 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4062/8114] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:51.982124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:51.983485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:51.996863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dcc6d-09b0-4a34-be30-7a699b5ec6f8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.002573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79650cc1-7183-4062-a2af-8fc3a6133239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.003273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650cc1-7183-4062-a2af-8fc3a6133239 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.003555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650cc1-7183-4062-a2af-8fc3a6133239 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.003829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650cc1-7183-4062-a2af-8fc3a6133239 admin admin] PATH_INFO: `/v3/projects/952e07099daf484cab284287e69f4809/users/c86720d4d8a74c7f86c45425555b89b2/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.008509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650cc1-7183-4062-a2af-8fc3a6133239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952e07099daf484cab284287e69f4809, user_id=c86720d4d8a74c7f86c45425555b89b2, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.009046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650cc1-7183-4062-a2af-8fc3a6133239 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.019744 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4063/8115] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:51 2022] PUT /identity/v3/projects/952e07099daf484cab284287e69f4809/users/c86720d4d8a74c7f86c45425555b89b2/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:52.020988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2540d3-43f2-4d09-a03e-0f925a957486 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.021268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2540d3-43f2-4d09-a03e-0f925a957486 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.021538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2540d3-43f2-4d09-a03e-0f925a957486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.041788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-be2540d3-43f2-4d09-a03e-0f925a957486 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:52.043002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-be2540d3-43f2-4d09-a03e-0f925a957486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:52.104287 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4064/8116] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:52.105582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.105873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.106150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.136888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] MFA Rules not processed for user `c86720d4d8a74c7f86c45425555b89b2`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:52.138124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:52.171596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab1b28b2abf4581a4d92f501cf71545'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:52.180001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab1b28b2abf4581a4d92f501cf71545'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:52.183277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab1b28b2abf4581a4d92f501cf71545'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:52.193986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab1b28b2abf4581a4d92f501cf71545'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:52.194861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab1b28b2abf4581a4d92f501cf71545'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:52.228263 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4065/8117] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:52.229305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.230669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:52.244977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6ca38-a05a-4c22-a74f-c000d6e857c4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.249652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.250928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.250928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.250928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.251552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:52.251853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.253459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.265881 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4066/8118] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:52.266881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.268759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:52.272821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:52.277560 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4053/8119] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:51 2022] DELETE /identity/v3/users/7ab1b28b2abf4581a4d92f501cf71545 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:52.278585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.333273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4783c-dbee-45d5-80f1-d7ec12aaa78e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.338449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:52.345507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36012d0-c530-4742-999e-276fe408f6b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.350919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d37b9-c707-4c5e-a4d3-e34dd274ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.351733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d37b9-c707-4c5e-a4d3-e34dd274ee5f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.351873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d37b9-c707-4c5e-a4d3-e34dd274ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.352115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d37b9-c707-4c5e-a4d3-e34dd274ee5f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.352758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d37b9-c707-4c5e-a4d3-e34dd274ee5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.354692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d37b9-c707-4c5e-a4d3-e34dd274ee5f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.391112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.391732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.392017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.392324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.446896 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4054/8120] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:52 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:52.448256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.448550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.448829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.462435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.464000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.470509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:52.471868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:52.475252 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4067/8121] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:52.475855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.486471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eefff9-8343-4e68-8fe3-ebff0c37d9eb service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.552093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.552793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.553009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.553289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.553926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.556100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.556938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4055/8122] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:52.577791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.644259 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4068/8123] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:52 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:52.649567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.649991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f1330-fbb2-49e0-8f78-16177767ad91 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.653688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.654305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.654579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.654862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.664919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fab1e-aaba-4d96-9ea9-1b41af00951c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.670303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.670495 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.670935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.671345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.671582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.672317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.672635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.673836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.684671 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4056/8124] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:52.689528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4069/8125] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:52.690686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.700897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe862ad-4b05-4126-8c07-54172005dfa7 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.710320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad14f-bf61-41e3-b5bf-1318981f4774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.711389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad14f-bf61-41e3-b5bf-1318981f4774 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.711866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad14f-bf61-41e3-b5bf-1318981f4774 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.712360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad14f-bf61-41e3-b5bf-1318981f4774 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.713391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad14f-bf61-41e3-b5bf-1318981f4774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.717643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad14f-bf61-41e3-b5bf-1318981f4774 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.732618 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4057/8126] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:52.734055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:52.745288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f380-cd91-4bce-b634-7833ff5c69de admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:52.752500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:52.752500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.752500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.752500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] PATH_INFO: `/v3/projects/10efbb65a176403d93859c5bf2671e75/users/d0f76cd4cdaa45d3899981b9cc1c4f93/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.775083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10efbb65a176403d93859c5bf2671e75, user_id=d0f76cd4cdaa45d3899981b9cc1c4f93, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:52.777944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:52.849492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4070/8127] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:52 2022] PUT /identity/v3/projects/10efbb65a176403d93859c5bf2671e75/users/d0f76cd4cdaa45d3899981b9cc1c4f93/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:52.860003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:52.860381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:52.860696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:52.902029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] MFA Rules not processed for user `d0f76cd4cdaa45d3899981b9cc1c4f93`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:52.903824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:52.915924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:53.004674 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4058/8128] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:53.015726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:53.017496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:53.033436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:53.082758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39f407-36d4-4cae-bfbf-ca40e9230562 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:53.086826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:53.087752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:53.088150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:53.088510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:53.098157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:53.099690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:53.110318 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4071/8129] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:53.263642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:53.265535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:53.359589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3155dd0-5335-4ddb-8fe4-71f782216ffd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:53.366022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:53.366930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:53.367499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:53.367626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] PATH_INFO: `/v3/projects/a17919cdeb79404090e5fc5701e51fa8` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:53.368968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17919cdeb79404090e5fc5701e51fa8)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:53.371056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:53.474335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17919cdeb79404090e5fc5701e51fa8', 'request_id': 'req-b33e020c-956c-46d4-af90-64155e30efd3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.481459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17919cdeb79404090e5fc5701e51fa8', 'request_id': 'req-b33e020c-956c-46d4-af90-64155e30efd3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.487734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17919cdeb79404090e5fc5701e51fa8', 'request_id': 'req-b33e020c-956c-46d4-af90-64155e30efd3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.595384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] The token cache is being invalidate because project a17919cdeb79404090e5fc5701e51fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:53.595715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.596447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.598797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4059/8130] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:53 2022] DELETE /identity/v3/projects/a17919cdeb79404090e5fc5701e51fa8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:53.603024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:53.616839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2e5a-2341-42dd-9d3a-994535afd382 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:53.680837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:53.681453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:53.681729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:53.682002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] PATH_INFO: `/v3/users/8a2490b038c34555a1986ee3a5267acd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:53.683190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2490b038c34555a1986ee3a5267acd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:53.685133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:53.972092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2490b038c34555a1986ee3a5267acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.980178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2490b038c34555a1986ee3a5267acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.981024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2490b038c34555a1986ee3a5267acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.982192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2490b038c34555a1986ee3a5267acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:53.998544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2490b038c34555a1986ee3a5267acd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:54.077444 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4072/8131] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:53 2022] DELETE /identity/v3/users/8a2490b038c34555a1986ee3a5267acd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:54.559819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:54.561343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:54.576205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e020c-956c-46d4-af90-64155e30efd3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:54.627944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:54.657146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:54.657789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:54.658083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:54.658349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] PATH_INFO: `/v3/projects/df6feeb37f024544badd54684c8e5ab1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:54.660835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6feeb37f024544badd54684c8e5ab1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:54.663489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:54.862644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6feeb37f024544badd54684c8e5ab1', 'request_id': 'req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:54.869223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6feeb37f024544badd54684c8e5ab1', 'request_id': 'req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:54.874884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6feeb37f024544badd54684c8e5ab1', 'request_id': 'req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:54.986128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] The token cache is being invalidate because project df6feeb37f024544badd54684c8e5ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:54.986447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:54.987159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:54.989056 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4060/8132] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:54 2022] DELETE /identity/v3/projects/df6feeb37f024544badd54684c8e5ab1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:54.994422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:54.996463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:55.016965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203aee3-9782-48fd-a14c-35a790b7ab38 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:55.089044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:55.118793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:55.119500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:55.119782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:55.120053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] PATH_INFO: `/v3/users/1f2bd27575b74b23876eceb151e92f5a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:55.121218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2bd27575b74b23876eceb151e92f5a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:55.123229 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:55.314301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2bd27575b74b23876eceb151e92f5a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:55.322454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2bd27575b74b23876eceb151e92f5a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:55.323235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2bd27575b74b23876eceb151e92f5a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:55.323856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2bd27575b74b23876eceb151e92f5a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:55.337415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2bd27575b74b23876eceb151e92f5a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:55.420812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:55.422336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:55.440646 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4073/8133] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:54 2022] DELETE /identity/v3/users/1f2bd27575b74b23876eceb151e92f5a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:55.489648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ff55-f8df-4cea-b88b-57aad2c73c4f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:55.541767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:55.542558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:55.542848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:55.543161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:55.545070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:55.587429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:55.607449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:55.608824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d0dc-8fa7-414a-8123-3495fec51140 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:55.618362 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4061/8134] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:55.957236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:55.959549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:56.046915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5a4e2-b07d-4fec-a261-eef9b2a2dd6b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.053792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.055103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.055596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.056074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] PATH_INFO: `/v3/projects/5857a09fffd149c99a2886d16d5db6b9` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.058278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5857a09fffd149c99a2886d16d5db6b9)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.060881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.221082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5857a09fffd149c99a2886d16d5db6b9', 'request_id': 'req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:56.226440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:56.227875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5857a09fffd149c99a2886d16d5db6b9', 'request_id': 'req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:56.236620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5857a09fffd149c99a2886d16d5db6b9', 'request_id': 'req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:56.326067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] The token cache is being invalidate because project 5857a09fffd149c99a2886d16d5db6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:56.326370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:56.328826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c8bc3d4f-2f4a-4d06-b348-ad5dc5f088e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:56.330390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4074/8135] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:55 2022] DELETE /identity/v3/projects/5857a09fffd149c99a2886d16d5db6b9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:56.336946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.337239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.337515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.357996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:56.359224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:56.421849 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4062/8136] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:56.429846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.430198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.430483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.450636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:56.452045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:56.461134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4075/8137] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:56.465655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.477016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754305ac-b884-493a-bfc2-3c2b96b6fe16 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.481774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.482564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.482847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.483164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.483818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:56.484125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.485765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.499539 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4063/8138] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:56.505303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.514705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c781be7-7eaa-4ce3-9c89-cdbb7d5fbadb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.523259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.524190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.524468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.524741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.525371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.527283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.655753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4076/8139] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:56 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:56.656992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.667819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32745a0-dad9-484b-ad01-47a6316f6bb2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.742396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.743046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.743339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.743618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.744254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.746363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.853675 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4064/8140] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:56 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:56.862489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.871466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530962d-56cc-4999-af4f-23f6603a4055 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.877301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.878738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.878738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.878738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.879931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.881561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.892987 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4077/8141] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:56.897698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.909640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192c935-d77e-4d7a-8357-e484d5166bd8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.914980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.916098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.916098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.916405 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.916810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.918411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.932095 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4065/8142] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:29:56.936383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.947629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570295c9-7aec-4866-a079-a4e23eb3e842 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:56.952345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe03655-e085-4fc4-9b51-6eb4b308f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:56.953027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe03655-e085-4fc4-9b51-6eb4b308f078 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:56.953312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe03655-e085-4fc4-9b51-6eb4b308f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:56.953723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe03655-e085-4fc4-9b51-6eb4b308f078 admin admin] PATH_INFO: `/v3/projects/cbaaafdcb8b04083b2f59d94f5db13e4/users/234cb084eee9476088114dbf5809be0b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:56.975133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:56.977593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:56.980031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe03655-e085-4fc4-9b51-6eb4b308f078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbaaafdcb8b04083b2f59d94f5db13e4, user_id=234cb084eee9476088114dbf5809be0b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:56.982730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe03655-e085-4fc4-9b51-6eb4b308f078 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:56.997774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c68c2-2171-4eaa-9298-6049f9567a7d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:57.002902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:57.003735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.004696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.005136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] PATH_INFO: `/v3/users/4ff3ceb2ed5d438ca8e8c303589a8a62` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.006358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff3ceb2ed5d438ca8e8c303589a8a62)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:57.008344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:57.081541 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4078/8143] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:56 2022] PUT /identity/v3/projects/cbaaafdcb8b04083b2f59d94f5db13e4/users/234cb084eee9476088114dbf5809be0b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:57.094142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.094424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.094699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.127264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] MFA Rules not processed for user `234cb084eee9476088114dbf5809be0b`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:57.128591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.197979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:57.204627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff3ceb2ed5d438ca8e8c303589a8a62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.212333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff3ceb2ed5d438ca8e8c303589a8a62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.213076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff3ceb2ed5d438ca8e8c303589a8a62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.216938 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4079/8144] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:57.227584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:57.229071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff3ceb2ed5d438ca8e8c303589a8a62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.229585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.230593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-68a1ff7b-c6f9-4baf-a46c-00738708977a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff3ceb2ed5d438ca8e8c303589a8a62'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.296433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197829-899b-4c3b-b787-979bd4646a2c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:57.300172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:57.301308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.301647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.301920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.303676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.314976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:57.317160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:57.326768 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4080/8145] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:57.348672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:57.350097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.364762 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4066/8146] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:56 2022] DELETE /identity/v3/users/4ff3ceb2ed5d438ca8e8c303589a8a62 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:57.365627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:57.369338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.369705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.369928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.389766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:57.391003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.427479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa2c2-e9d2-4940-b5f5-b4b96fce1f8e service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:57.468684 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4067/8147] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:57.479919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:57.481390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.489456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:57.490106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.490396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.490684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] PATH_INFO: `/v3/users/234cb084eee9476088114dbf5809be0b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.491918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] RBAC: Authorizing `identity:delete_user(user_id=234cb084eee9476088114dbf5809be0b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:57.493894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:57.546997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628563-96d3-41a3-930a-e91d8109b1f2 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:57.551993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7ff2-1fdc-4f11-abb6-04b6ad1f7dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:57.552620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7ff2-1fdc-4f11-abb6-04b6ad1f7dea service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.553636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7ff2-1fdc-4f11-abb6-04b6ad1f7dea service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.553912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7ff2-1fdc-4f11-abb6-04b6ad1f7dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.564682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7ff2-1fdc-4f11-abb6-04b6ad1f7dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:57.566384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7ff2-1fdc-4f11-abb6-04b6ad1f7dea service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:57.577233 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4068/8148] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:29:57.709209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234cb084eee9476088114dbf5809be0b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.720472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234cb084eee9476088114dbf5809be0b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.721215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234cb084eee9476088114dbf5809be0b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.721836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234cb084eee9476088114dbf5809be0b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.735498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234cb084eee9476088114dbf5809be0b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:57.826818 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4081/8149] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:57 2022] DELETE /identity/v3/users/234cb084eee9476088114dbf5809be0b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:57.832106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:57.832633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:57.832996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:57.854012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:57.855611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:57.943652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:57.953679 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4069/8150] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:57.963393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:57.964806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:58.014792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:58.031996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4d7c9-5a5c-48fc-a393-784efb7596af admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:58.035671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:58.036191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:58.036474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:58.036748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:58.050323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:58.052355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:58.062629 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4082/8151] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:29:58.147787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:58.149835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:58.165083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24e59f-3bea-428e-827c-a8500a0d7957 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:58.171116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:58.172044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:58.172394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:58.172767 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] PATH_INFO: `/v3/projects/6015740b124f4ab0891a70483f26249d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:58.174120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6015740b124f4ab0891a70483f26249d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:58.177627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:58.347147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6015740b124f4ab0891a70483f26249d', 'request_id': 'req-26c1c7f4-6304-435e-9621-ea62262d1680'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.354288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6015740b124f4ab0891a70483f26249d', 'request_id': 'req-26c1c7f4-6304-435e-9621-ea62262d1680'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.360502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6015740b124f4ab0891a70483f26249d', 'request_id': 'req-26c1c7f4-6304-435e-9621-ea62262d1680'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.454314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] The token cache is being invalidate because project 6015740b124f4ab0891a70483f26249d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:58.454639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.455410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.457619 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4070/8152] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:58 2022] DELETE /identity/v3/projects/6015740b124f4ab0891a70483f26249d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:58.462028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:58.472351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8c62a-a0f0-4397-b92c-98d7a131f470 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:58.535203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:58.536368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:58.536677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:58.536953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] PATH_INFO: `/v3/users/c86720d4d8a74c7f86c45425555b89b2` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:58.538106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86720d4d8a74c7f86c45425555b89b2)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:58.540087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:58.605328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:58.606854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:58.621251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c7f4-6304-435e-9621-ea62262d1680 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:58.627522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:58.630971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:58.630971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:58.630971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] PATH_INFO: `/v3/projects/cbaaafdcb8b04083b2f59d94f5db13e4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:58.630971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbaaafdcb8b04083b2f59d94f5db13e4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:58.632632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:58.772322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86720d4d8a74c7f86c45425555b89b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.779830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86720d4d8a74c7f86c45425555b89b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.780797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86720d4d8a74c7f86c45425555b89b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.781427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86720d4d8a74c7f86c45425555b89b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.806800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9ab1e68c-b955-4960-b9be-68e99bb9b4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86720d4d8a74c7f86c45425555b89b2'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.817800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbaaafdcb8b04083b2f59d94f5db13e4', 'request_id': 'req-b003b0e4-0ce3-4e8f-a855-8d771283030f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.824489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbaaafdcb8b04083b2f59d94f5db13e4', 'request_id': 'req-b003b0e4-0ce3-4e8f-a855-8d771283030f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.830432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbaaafdcb8b04083b2f59d94f5db13e4', 'request_id': 'req-b003b0e4-0ce3-4e8f-a855-8d771283030f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.893900 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4083/8153] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:29:58 2022] DELETE /identity/v3/users/c86720d4d8a74c7f86c45425555b89b2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:29:58.962113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] The token cache is being invalidate because project cbaaafdcb8b04083b2f59d94f5db13e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:58.962736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.963136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b003b0e4-0ce3-4e8f-a855-8d771283030f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:58.964920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4071/8154] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:58 2022] DELETE /identity/v3/projects/cbaaafdcb8b04083b2f59d94f5db13e4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:58.969774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:58.970140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:58.970496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:58.992699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:58.993994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.056820 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4084/8155] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:59.065073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.065363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.065643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.088041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:59.089415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.101079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4072/8156] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:59.105948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.111177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:59.119272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c8cd5-7378-4b1f-87fb-834029b201c1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.135865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.135865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.135865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.135865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.136292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:59.136292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.136292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.149128 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4085/8157] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:29:59.153351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.163645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e9679-3c55-4446-91d6-ca09aae61aa4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.168521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.169142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.169427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.169705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.170348 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.172402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.261497 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4073/8158] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:59.265735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.276469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72acf3-2762-4e93-b2aa-430966f47373 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.335120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.335738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.336026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.336302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.337015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.338938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.382190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.384054 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.404808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a89b-a367-4ee7-b0e8-63880ec83353 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.404808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.405183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.405388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.405668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] PATH_INFO: `/v3/projects/952e07099daf484cab284287e69f4809` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.406852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952e07099daf484cab284287e69f4809)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.409644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.485580 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4086/8159] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:29:59.490364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.501039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd04f2-0af0-43a6-bd04-c8480dc628bd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.507903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.508519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.508795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.509067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.509710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.511355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.522561 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4087/8160] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:59.527230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.533937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:59.537741 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66a2e4-9bdc-4dc5-8287-b9e6e59874d2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.549589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952e07099daf484cab284287e69f4809', 'request_id': 'req-f97e3314-5a16-4409-8084-13d73e335cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:59.558648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952e07099daf484cab284287e69f4809', 'request_id': 'req-f97e3314-5a16-4409-8084-13d73e335cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:59.566263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952e07099daf484cab284287e69f4809', 'request_id': 'req-f97e3314-5a16-4409-8084-13d73e335cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:59.604871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.605486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.605767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.606042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.606686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.608338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.619981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4088/8161] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:29:59.623936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.634695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf395-c192-4d35-a2ea-6485126c7cd1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.639834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436d2cd-dadf-4669-ad48-7039f14fff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.640521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d2cd-dadf-4669-ad48-7039f14fff2e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.640803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d2cd-dadf-4669-ad48-7039f14fff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.641086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d2cd-dadf-4669-ad48-7039f14fff2e admin admin] PATH_INFO: `/v3/projects/3c75453d515a48488ee030bb0cadea02/users/f55dcf04dff74414bd3828c62a35da94/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.652093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] The token cache is being invalidate because project 952e07099daf484cab284287e69f4809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:29:59.652491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:59.653169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f97e3314-5a16-4409-8084-13d73e335cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:29:59.654903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4074/8162] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:29:59 2022] DELETE /identity/v3/projects/952e07099daf484cab284287e69f4809 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:59.657705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436d2cd-dadf-4669-ad48-7039f14fff2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c75453d515a48488ee030bb0cadea02, user_id=f55dcf04dff74414bd3828c62a35da94, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.659873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152e66-5711-4a5d-b68f-b1e0442ef452 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.660687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152e66-5711-4a5d-b68f-b1e0442ef452 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.660949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152e66-5711-4a5d-b68f-b1e0442ef452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.661083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436d2cd-dadf-4669-ad48-7039f14fff2e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.681899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-38152e66-5711-4a5d-b68f-b1e0442ef452 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:59.683159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-38152e66-5711-4a5d-b68f-b1e0442ef452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.691600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4075/8163] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:59.699199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.702791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.702791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.719918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:59.721167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.730009 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4076/8164] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:29:59.734207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.744279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f418-ae17-4d95-95fb-9da4f3f2ce52 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.749121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.749795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.750080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.750357 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.751004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:29:59.751341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.752932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.757910 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4089/8165] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:29:59 2022] PUT /identity/v3/projects/3c75453d515a48488ee030bb0cadea02/users/f55dcf04dff74414bd3828c62a35da94/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:29:59.769934 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4077/8166] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:29:59.771682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.771842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.772008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.772449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.784190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0dbd2-c186-465a-b833-79596bee7e86 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:29:59.805334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] MFA Rules not processed for user `f55dcf04dff74414bd3828c62a35da94`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:29:59.806580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.846981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:29:59.854754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:29:59.855412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:29:59.855698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:29:59.855973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:29:59.856609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:29:59.858527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:29:59.887872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4090/8167] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:29:59.901049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.902517 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:29:59.959486 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4078/8168] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:29:59.964067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:29:59.971243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095de4-c579-45a2-acaf-72dff226f749 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:00.027032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:00.027656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.027939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.028214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.036019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ef61-7ef9-469d-83ff-76302804be9c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:00.041349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:00.041970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.042266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.042546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.043305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:00.045268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:00.092226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:00.093715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:00.106257 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4091/8169] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:29:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:00.161866 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4079/8170] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:29:59 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:30:00.166350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:00.177309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2caf3a-3d9c-416b-841f-ef226731bdd2 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:00.188423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:00.189048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.189336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.189684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.190317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:00.192016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:00.202604 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4092/8171] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:30:00.206839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:00.219834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709350b6-0f4b-441b-85de-49fbeb7e1b61 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:00.232860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f7514-0f53-44cf-b48a-10766a7c05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:00.233502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f7514-0f53-44cf-b48a-10766a7c05b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.237447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f7514-0f53-44cf-b48a-10766a7c05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.237447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f7514-0f53-44cf-b48a-10766a7c05b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.237447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f7514-0f53-44cf-b48a-10766a7c05b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:00.237447 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f7514-0f53-44cf-b48a-10766a7c05b6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:00.239335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:00.249899 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4080/8172] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:30:00.254427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:00.265188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1562f-93a3-4311-997d-44d131b2f4c3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:00.272104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:00.272769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.273054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.273334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] PATH_INFO: `/v3/projects/68af720ce42b4500accb1c1c8fadf4d0/users/ddbf5d648d8a46559c11bd2a5fa5de9c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.291710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68af720ce42b4500accb1c1c8fadf4d0, user_id=ddbf5d648d8a46559c11bd2a5fa5de9c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:00.294349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:00.374613 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4093/8173] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:00 2022] PUT /identity/v3/projects/68af720ce42b4500accb1c1c8fadf4d0/users/ddbf5d648d8a46559c11bd2a5fa5de9c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:30:00.388822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.389110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.389387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.422030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] MFA Rules not processed for user `ddbf5d648d8a46559c11bd2a5fa5de9c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:00.423183 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:00.496120 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4081/8174] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:00.507032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:00.508794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:00.515472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:00.575455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701c3ac-fce6-47d1-98d9-290b7d41dd9b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:00.579458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bc4d-7a7d-434c-91a2-a397e541114c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:00.586007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bc4d-7a7d-434c-91a2-a397e541114c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:00.586007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bc4d-7a7d-434c-91a2-a397e541114c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:00.586007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bc4d-7a7d-434c-91a2-a397e541114c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:00.591335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bc4d-7a7d-434c-91a2-a397e541114c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:00.592911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bc4d-7a7d-434c-91a2-a397e541114c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:00.602470 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4094/8175] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:02.989140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:02.990632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:03.115592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77251678-a743-4953-9e9a-4762e009b5a1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:03.122326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:03.123329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:03.124175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:03.124704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] PATH_INFO: `/v3/users/d0f76cd4cdaa45d3899981b9cc1c4f93` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:03.131225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f76cd4cdaa45d3899981b9cc1c4f93)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:03.134912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:03.390769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f76cd4cdaa45d3899981b9cc1c4f93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:03.409944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f76cd4cdaa45d3899981b9cc1c4f93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:03.411331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f76cd4cdaa45d3899981b9cc1c4f93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:03.432346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f76cd4cdaa45d3899981b9cc1c4f93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:03.433169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f76cd4cdaa45d3899981b9cc1c4f93'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:03.513439 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4082/8176] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:02 2022] DELETE /identity/v3/users/d0f76cd4cdaa45d3899981b9cc1c4f93 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:03.518837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:03.520090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:03.520813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:03.545532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:03.546861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:03.615297 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4095/8177] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:30:03.622022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:03.623272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:03.655412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:03.725032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910224d-c0bd-43cc-913b-fa4826d39c15 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:03.728974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1589d9-c131-4fce-9b20-86b4e23c6967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:03.729596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1589d9-c131-4fce-9b20-86b4e23c6967 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:03.729880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1589d9-c131-4fce-9b20-86b4e23c6967 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:03.730159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1589d9-c131-4fce-9b20-86b4e23c6967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:03.747474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1589d9-c131-4fce-9b20-86b4e23c6967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:03.749282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1589d9-c131-4fce-9b20-86b4e23c6967 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:03.760936 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4083/8178] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:04.349595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:04.361720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:04.368050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882038-0830-4dee-9c10-ade7ac47b169 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:04.373365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:04.374015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:04.374305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:04.374574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] PATH_INFO: `/v3/projects/10efbb65a176403d93859c5bf2671e75` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:04.375801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=10efbb65a176403d93859c5bf2671e75)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:04.377730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:04.554920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10efbb65a176403d93859c5bf2671e75', 'request_id': 'req-d30046c8-08c5-4c68-9d49-693629178fdf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:04.563457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10efbb65a176403d93859c5bf2671e75', 'request_id': 'req-d30046c8-08c5-4c68-9d49-693629178fdf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:04.576542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10efbb65a176403d93859c5bf2671e75', 'request_id': 'req-d30046c8-08c5-4c68-9d49-693629178fdf'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:04.674983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] The token cache is being invalidate because project 10efbb65a176403d93859c5bf2671e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:04.675305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:04.679386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d30046c8-08c5-4c68-9d49-693629178fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:04.681152 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4096/8179] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:04 2022] DELETE /identity/v3/projects/10efbb65a176403d93859c5bf2671e75 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:04.686588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:04.686588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:04.687281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:04.710634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:04.711959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:04.802266 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4084/8180] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:04.811602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:04.812189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:04.812679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:04.837727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:04.839494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:04.850134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4097/8181] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:04.855430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:04.868939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda4468-4066-4d92-aced-d9a19b9d6469 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:04.874704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:04.875651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:04.875932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:04.876217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:04.876919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:30:04.883513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:04.883513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:04.901240 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4085/8182] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:30:04.909910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:04.918371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d0b10-6835-441b-85f2-b5478b778c1a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:04.926042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:04.927293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:04.927811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:04.928096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:04.928929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:04.931127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:05.039497 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4098/8183] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:04 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:05.045379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:05.065499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbebda-650a-48fa-87a2-64318090a651 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:05.154536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:05.155285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:05.155624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:05.155966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:05.156672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:05.159429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:05.323806 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4086/8184] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:05 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:05.328325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:05.334508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:05.340175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18aac4-654f-47bd-8189-b8b7d2f4086e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:05.345143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:05.345837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:05.346188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:05.346533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:05.347311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:05.349015 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:05.359506 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4099/8185] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:05.364162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:05.374104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45725096-5119-4dbb-988a-5a5477f0065f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:05.380282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a38c8-5aa7-4d91-90b5-138f2ce5b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:05.380985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a38c8-5aa7-4d91-90b5-138f2ce5b4cc admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:05.381270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a38c8-5aa7-4d91-90b5-138f2ce5b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:05.381548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a38c8-5aa7-4d91-90b5-138f2ce5b4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:05.382203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a38c8-5aa7-4d91-90b5-138f2ce5b4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:05.383930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a38c8-5aa7-4d91-90b5-138f2ce5b4cc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:05.395823 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4087/8186] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:05.400448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:05.411485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4e5bc-677d-4ac5-9c8b-9b26e77bf34c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:05.418690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:05.418690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:05.418690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:05.418690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] PATH_INFO: `/v3/projects/18b3f0c7137c468f8689c36e97e7d085/users/de0523a635564f69b31a24c07ed96779/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:05.449168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b3f0c7137c468f8689c36e97e7d085, user_id=de0523a635564f69b31a24c07ed96779, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:05.452167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:05.544050 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4100/8187] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:05 2022] PUT /identity/v3/projects/18b3f0c7137c468f8689c36e97e7d085/users/de0523a635564f69b31a24c07ed96779/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:05.554741 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:05.555066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:05.555346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:05.592472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] MFA Rules not processed for user `de0523a635564f69b31a24c07ed96779`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:05.593976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:05.601456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:05.690297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4088/8188] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:05.696147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:05.797765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a9cc5-eaf3-4b3f-9b7c-96a6a5bef66f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:05.804692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:05.805682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:05.806121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:05.806397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:05.807184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:05.809160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:05.920658 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4101/8189] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:05 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:05.927988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:05.939165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28602-cf35-4bb6-8be0-5946fac63906 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:06.000635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:06.001310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.001609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.001884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.002528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:06.004586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:06.136528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4089/8190] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:05 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:06.137887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:06.150151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff52c3-437a-4d9b-8a21-c071f53feca6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:06.154895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:06.155618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.155906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.156179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.156821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:06.158534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:06.174161 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4102/8191] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:06.178116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:06.187605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070b004-68f3-422e-b3ce-126c15f3c0f3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:06.193899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7c14-5544-41f4-87bf-b613c421dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:06.194521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7c14-5544-41f4-87bf-b613c421dd52 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.194800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7c14-5544-41f4-87bf-b613c421dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.195110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7c14-5544-41f4-87bf-b613c421dd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.195793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7c14-5544-41f4-87bf-b613c421dd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:06.197532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7c14-5544-41f4-87bf-b613c421dd52 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:06.212474 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4090/8192] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:06.216526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:06.228313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c8893-2764-4059-888f-4492ac472398 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:06.234795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:06.235591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.236143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.236949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] PATH_INFO: `/v3/projects/ec153d0340e3470dbe7b04f42fc1c186/users/57300267f7ae4a26a34f8922b67cf1e1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.254606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec153d0340e3470dbe7b04f42fc1c186, user_id=57300267f7ae4a26a34f8922b67cf1e1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:06.257457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:06.423235 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4103/8193] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:06 2022] PUT /identity/v3/projects/ec153d0340e3470dbe7b04f42fc1c186/users/57300267f7ae4a26a34f8922b67cf1e1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:06.429273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.429484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.429860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.471806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] MFA Rules not processed for user `57300267f7ae4a26a34f8922b67cf1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:06.471806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:06.557599 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4091/8194] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:06.562351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:06.653475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe50a4-151f-4a71-8035-606b3e4a1e4e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:06.660067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:06.660783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.661121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.661451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.662241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:06.664328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:06.823085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4104/8195] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:06 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:30:06.827432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:06.839603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053b82-f8fb-4588-acbd-72c0d59afae4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:06.850422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:06.915851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:06.916669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:06.917216 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:06.917737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:06.918516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:06.920704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:07.103338 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4092/8196] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:06 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:07.105951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:07.111813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:07.118469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115183-52a7-4b1b-bb66-6fcfb0db04c2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:07.123697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:07.124676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:07.124965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:07.125311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:07.125969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:07.127678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:07.160394 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4105/8197] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:07.171177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:07.185232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b1c6-46b4-42c3-b0c9-5c10b2a76c8f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:07.190704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:07.191877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:07.192162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:07.192441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] PATH_INFO: `/v3/projects/bc17714e282c4aa6868bb670feadf777/users/b28ed5b6aceb45f4a7d2aa83b2407c73/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:07.210415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc17714e282c4aa6868bb670feadf777, user_id=b28ed5b6aceb45f4a7d2aa83b2407c73, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:07.213226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:07.302024 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4093/8198] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:07 2022] PUT /identity/v3/projects/bc17714e282c4aa6868bb670feadf777/users/b28ed5b6aceb45f4a7d2aa83b2407c73/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:07.306400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:07.322897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77220308-bd5f-4dd9-9620-3855f507b9d5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:07.391133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495446c-c85e-4e98-96be-a8738311ed8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:07.391941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495446c-c85e-4e98-96be-a8738311ed8f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:07.392362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495446c-c85e-4e98-96be-a8738311ed8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:07.392640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495446c-c85e-4e98-96be-a8738311ed8f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:07.394048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495446c-c85e-4e98-96be-a8738311ed8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:07.396408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495446c-c85e-4e98-96be-a8738311ed8f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:07.412370 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4106/8199] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:07.416327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:07.428967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f0634-c2e5-47c2-9447-e87458723449 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:07.434128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:07.434806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:07.435132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:07.435419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] PATH_INFO: `/v3/projects/bc17714e282c4aa6868bb670feadf777/users/b28ed5b6aceb45f4a7d2aa83b2407c73/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:07.437530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc17714e282c4aa6868bb670feadf777, user_id=b28ed5b6aceb45f4a7d2aa83b2407c73, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:07.440218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:07.455051 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4094/8200] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:07 2022] PUT /identity/v3/projects/bc17714e282c4aa6868bb670feadf777/users/b28ed5b6aceb45f4a7d2aa83b2407c73/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:07.468434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:07.468728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:07.469007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:07.503287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] MFA Rules not processed for user `b28ed5b6aceb45f4a7d2aa83b2407c73`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:07.504654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:07.584164 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4107/8201] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:07.601778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:07.604632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:07.689260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc07a1-30ef-40bf-bdba-26cde35c74d9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:07.693997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:07.694638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:07.694930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:07.695264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:07.774506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:07.776136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:07.789193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4095/8202] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:11.099812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:11.114391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dfb23-5d5a-4267-abe7-76196e44e77b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:11.118445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:11.120313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:11.120313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:11.120313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:11.190346 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:11.192511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:11.202437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4108/8203] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:13.257493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:13.259108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:13.279325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7245-5881-4717-831e-23b283167503 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:13.280134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727375-d741-4af9-856d-74964af128cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:13.280965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727375-d741-4af9-856d-74964af128cd service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:13.281397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727375-d741-4af9-856d-74964af128cd service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:13.281818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727375-d741-4af9-856d-74964af128cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:13.293027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9727375-d741-4af9-856d-74964af128cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:13.294717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9727375-d741-4af9-856d-74964af128cd service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:13.322262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4096/8204] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:21.197884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:23.302899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:27.322265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:27.323949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:27.415343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc023-2072-407a-9c05-ce2b6eb42c76 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:27.420449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:27.421111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:27.421452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:27.421732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] PATH_INFO: `/v3/users/f55dcf04dff74414bd3828c62a35da94` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:27.422961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55dcf04dff74414bd3828c62a35da94)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:27.432131 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:27.676078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55dcf04dff74414bd3828c62a35da94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:27.684208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55dcf04dff74414bd3828c62a35da94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:27.685082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55dcf04dff74414bd3828c62a35da94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:27.685716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55dcf04dff74414bd3828c62a35da94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:27.700008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55dcf04dff74414bd3828c62a35da94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:27.808847 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4109/8205] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:27 2022] DELETE /identity/v3/users/f55dcf04dff74414bd3828c62a35da94 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:27.814325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:27.814846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:27.815403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:27.840531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:27.841781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:27.922249 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4097/8206] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:27.932504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:27.934100 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:28.021752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e74a6-e752-4293-a8b3-949f8425f671 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:28.027569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a483a-f174-4697-9e6d-55d321875be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:28.029429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a483a-f174-4697-9e6d-55d321875be8 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:28.029429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a483a-f174-4697-9e6d-55d321875be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:28.029429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a483a-f174-4697-9e6d-55d321875be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:28.041239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a483a-f174-4697-9e6d-55d321875be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:28.042858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a483a-f174-4697-9e6d-55d321875be8 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:28.054948 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4110/8207] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:29.141950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:29.144232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:29.167847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db195afa-c0a6-44f3-b34f-b04fb9687ac1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:29.175436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:29.176989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:29.177281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:29.177568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] PATH_INFO: `/v3/projects/3c75453d515a48488ee030bb0cadea02` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:29.179041 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c75453d515a48488ee030bb0cadea02)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:29.181000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:29.297798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c75453d515a48488ee030bb0cadea02', 'request_id': 'req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:29.306650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c75453d515a48488ee030bb0cadea02', 'request_id': 'req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:29.315410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c75453d515a48488ee030bb0cadea02', 'request_id': 'req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:29.466849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] The token cache is being invalidate because project 3c75453d515a48488ee030bb0cadea02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:29.467583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:29.469353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6e108f8f-b833-40e7-b9a6-8e9afd7a30dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:29.475198 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4098/8208] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:29 2022] DELETE /identity/v3/projects/3c75453d515a48488ee030bb0cadea02 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:29.480814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:29.481324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:29.481462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:29.505194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:29.506479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:29.527908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:29.591935 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4111/8209] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:29.594891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:29.595528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:29.595986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:29.624583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:29.626023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:29.635834 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4099/8210] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:29.640408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:29.652729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb407bb-abca-45b7-bb1a-5b6bd6b53234 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:29.658070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:29.658827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:29.659253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:29.659612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:29.660553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:30:29.661152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:29.663154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:29.678354 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4112/8211] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:30:29.682709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:29.695300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4bebb-361e-4293-98ce-2c93cb4264d9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:29.708728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:29.709540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:29.710690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:29.710690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:29.711439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:29.713958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:29.887438 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4100/8212] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:29 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:29.891831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:29.903243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89020c46-13d6-4d96-85d0-acb5239b6545 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:30.042431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:30.043379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.043992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.044498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.045725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:30.049522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:30.188250 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4113/8213] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:29 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:30.194982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:30.212839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276356d-72d7-4a97-ba12-5482474e4ecf admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:30.232109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:30.234241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.234567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.234877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.235580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:30.240333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:30.257256 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4101/8214] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:30.261223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:30.273809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be813ef9-e3ed-4bef-b82d-e2cb9e568ec3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:30.284016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4579cb8-d9b9-42e7-a887-d49fd754edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:30.284697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579cb8-d9b9-42e7-a887-d49fd754edb1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.284983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579cb8-d9b9-42e7-a887-d49fd754edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.285257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4579cb8-d9b9-42e7-a887-d49fd754edb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.285980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4579cb8-d9b9-42e7-a887-d49fd754edb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:30.288272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4579cb8-d9b9-42e7-a887-d49fd754edb1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:30.313176 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4114/8215] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:30.313423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:30.327682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4911-c75a-4aac-b785-63a1a9c2a3b8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:30.334881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:30.335774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.336044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.336540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] PATH_INFO: `/v3/projects/78a6a32c73364afb8ec72aca84139e9f/users/23bf78cf79b84662bb88e7988944785f/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.356293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a6a32c73364afb8ec72aca84139e9f, user_id=23bf78cf79b84662bb88e7988944785f, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:30.359457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:30.437510 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4102/8216] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:30 2022] PUT /identity/v3/projects/78a6a32c73364afb8ec72aca84139e9f/users/23bf78cf79b84662bb88e7988944785f/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:30:30.448182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.448476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.448758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.479956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] MFA Rules not processed for user `23bf78cf79b84662bb88e7988944785f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:30.481284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:30.591808 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4115/8217] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:30.593328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:30.630134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:30.691825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961829da-4520-4cb5-9fa0-c13c7a17e8ff admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:30.698312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:30.699101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.699494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.699882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.700642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:30.702804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:30.833600 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4103/8218] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:30 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:30.837521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:30.859077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dfe60-da45-49c5-8a86-cb9750d3a2b0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:30.873684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:30.923201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:30.923825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:30.924109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:30.924384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:30.925052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:30.926967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.050031 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4116/8219] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:30 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:31.053986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.066990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72662506-f135-41ec-a101-6f33d9bf8336 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.077589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.078368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.078905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.079282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.080006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.086920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.101617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.103992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:31.115001 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4104/8220] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:31.116186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.117718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5dbb-7e23-44a1-aa34-83a42408d91b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.123440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.124226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.124610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.125137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] PATH_INFO: `/v3/users/de0523a635564f69b31a24c07ed96779` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.126558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0523a635564f69b31a24c07ed96779)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.129436 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.142402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa4096-7211-4501-bd77-c6f0c9d76aab admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.151876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.153631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.153936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.154218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.154924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.157458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.177003 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4105/8221] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:31.179611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.191999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5b3d9-8d5d-47da-8a7c-5823db1b4da4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.198481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a920df-508b-424c-aabd-7d98763d16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.199347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a920df-508b-424c-aabd-7d98763d16f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.199632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a920df-508b-424c-aabd-7d98763d16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.199914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a920df-508b-424c-aabd-7d98763d16f4 admin admin] PATH_INFO: `/v3/projects/d04eaa5a44164645bb8d2962cb0a0542/users/8fdc77b5efab479a818c0878daf933cf/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.228606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a920df-508b-424c-aabd-7d98763d16f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04eaa5a44164645bb8d2962cb0a0542, user_id=8fdc77b5efab479a818c0878daf933cf, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.231422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a920df-508b-424c-aabd-7d98763d16f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.328805 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4106/8222] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:31 2022] PUT /identity/v3/projects/d04eaa5a44164645bb8d2962cb0a0542/users/8fdc77b5efab479a818c0878daf933cf/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:31.341305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.341852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.342249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.345913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0523a635564f69b31a24c07ed96779'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:31.363112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0523a635564f69b31a24c07ed96779'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:31.364537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0523a635564f69b31a24c07ed96779'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:31.365807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0523a635564f69b31a24c07ed96779'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:31.401087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-01d36afe-d1de-45cd-82ed-5092931b1a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0523a635564f69b31a24c07ed96779'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:31.405499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] MFA Rules not processed for user `8fdc77b5efab479a818c0878daf933cf`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:31.407751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:31.522242 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4107/8223] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:31.527641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.532683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:31.536590 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4117/8224] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:31 2022] DELETE /identity/v3/users/de0523a635564f69b31a24c07ed96779 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:31.543168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.543666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.544134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.570035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:31.571860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:31.600246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:31.625884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77fb3b-c581-40ce-8145-2cb6caac061d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.661297 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4118/8225] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:31.671852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.677555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:31.705745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:31.735432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.736281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.737037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.737875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.738537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.741687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.769467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39eba-1e06-4535-84cf-dcf7d16cf927 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.777348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.777348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.777348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.777348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.785619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.787036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:31.805809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4119/8226] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:30:31.860118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4108/8227] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:31 2022] POST /identity/v3/projects => generated 383 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:31.861264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:31.872528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22999-6f7e-4e2e-a7dd-0f3ed0056347 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:31.948820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:31.949382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:31.949681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:31.949942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:31.950589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:31.952618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.074751 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4120/8228] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:31 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:30:32.080400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.099401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001928e-c3d6-4c35-9f4a-b9f84f9cb654 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.107264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.107900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.108203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.108621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.109433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.111754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.125862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4109/8229] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:32.130465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.141625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ada42-0c68-4af0-9d3c-820b1e0b1c93 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.149570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.150375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.150666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.150946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] PATH_INFO: `/v3/projects/619319491a8a4122beec80dd2686929d/users/f9a9a9b04d364d07a80dbcad4e9fc6f4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.173022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619319491a8a4122beec80dd2686929d, user_id=f9a9a9b04d364d07a80dbcad4e9fc6f4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.176435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.264397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.267233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:32.287129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4121/8230] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:32 2022] PUT /identity/v3/projects/619319491a8a4122beec80dd2686929d/users/f9a9a9b04d364d07a80dbcad4e9fc6f4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:32.289705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e7fbd-0edf-47ff-93ad-80b89ada0364 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.290872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.375311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.375969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.376307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.376604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] PATH_INFO: `/v3/projects/18b3f0c7137c468f8689c36e97e7d085` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.377801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b3f0c7137c468f8689c36e97e7d085)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.379755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.390350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19de592-8d06-4bf6-8120-c9cfb7d61161 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.396154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.396957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.397331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.397619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.398165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.400162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.415068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4122/8231] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:30:32.417337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.428288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876554-1955-43bc-b884-ea3c50ff92cd admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.433069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf2f51-b2f1-4e48-8c38-d44c8d4493a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.433922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2f51-b2f1-4e48-8c38-d44c8d4493a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.434205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2f51-b2f1-4e48-8c38-d44c8d4493a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.434474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2f51-b2f1-4e48-8c38-d44c8d4493a7 admin admin] PATH_INFO: `/v3/projects/619319491a8a4122beec80dd2686929d/users/f9a9a9b04d364d07a80dbcad4e9fc6f4/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.436494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf2f51-b2f1-4e48-8c38-d44c8d4493a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619319491a8a4122beec80dd2686929d, user_id=f9a9a9b04d364d07a80dbcad4e9fc6f4, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.439523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf2f51-b2f1-4e48-8c38-d44c8d4493a7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.456782 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4123/8232] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:32 2022] PUT /identity/v3/projects/619319491a8a4122beec80dd2686929d/users/f9a9a9b04d364d07a80dbcad4e9fc6f4/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:30:32.467740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.468034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.468307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.495225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:32.505267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] MFA Rules not processed for user `f9a9a9b04d364d07a80dbcad4e9fc6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:32.506744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:32.512439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b3f0c7137c468f8689c36e97e7d085', 'request_id': 'req-70f74a27-683d-48e9-8b90-466c0d141013'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.522061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b3f0c7137c468f8689c36e97e7d085', 'request_id': 'req-70f74a27-683d-48e9-8b90-466c0d141013'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.529844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b3f0c7137c468f8689c36e97e7d085', 'request_id': 'req-70f74a27-683d-48e9-8b90-466c0d141013'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.586433 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4124/8233] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:32.598094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.604168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:32.634771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:32.637325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] The token cache is being invalidate because project 18b3f0c7137c468f8689c36e97e7d085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:32.637769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.638778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.644985 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4110/8234] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:32 2022] DELETE /identity/v3/projects/18b3f0c7137c468f8689c36e97e7d085 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:32.646162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:32.647787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:32.695193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1038e-18e0-4b9b-9c7c-08e04eba8682 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.700246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.701264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.701728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.702163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.704506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:32.725227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f74a27-683d-48e9-8b90-466c0d141013 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:32.736410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:32.736410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:32.736410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:32.736410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] PATH_INFO: `/v3/users/57300267f7ae4a26a34f8922b67cf1e1` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:32.736928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57300267f7ae4a26a34f8922b67cf1e1)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.738605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.790919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:32.792625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:32.804914 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4125/8235] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:30:32.983271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57300267f7ae4a26a34f8922b67cf1e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.995455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57300267f7ae4a26a34f8922b67cf1e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:32.996482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57300267f7ae4a26a34f8922b67cf1e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:33.014544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57300267f7ae4a26a34f8922b67cf1e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:33.015888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57300267f7ae4a26a34f8922b67cf1e1'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:33.148696 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4111/8236] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:32 2022] DELETE /identity/v3/users/57300267f7ae4a26a34f8922b67cf1e1 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:33.711660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:33.741779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bac7-b798-4d33-bc6b-8e21c5093d55 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:33.814262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:33.826591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:33.827263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:33.827647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:33.827922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] PATH_INFO: `/v3/projects/ec153d0340e3470dbe7b04f42fc1c186` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:33.829128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec153d0340e3470dbe7b04f42fc1c186)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:33.831097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:33.962169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec153d0340e3470dbe7b04f42fc1c186', 'request_id': 'req-d2e788a3-5b38-4af6-828b-76e4e9336b4c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:33.968426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec153d0340e3470dbe7b04f42fc1c186', 'request_id': 'req-d2e788a3-5b38-4af6-828b-76e4e9336b4c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:33.980250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec153d0340e3470dbe7b04f42fc1c186', 'request_id': 'req-d2e788a3-5b38-4af6-828b-76e4e9336b4c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.094589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] The token cache is being invalidate because project ec153d0340e3470dbe7b04f42fc1c186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:34.094890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.095593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.097753 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4126/8237] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:33 2022] DELETE /identity/v3/projects/ec153d0340e3470dbe7b04f42fc1c186 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:34.102402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:34.103554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:34.123699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890c6f-270d-485a-b8ff-678c8bb5b622 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:34.212456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:34.213131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:34.213416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:34.213694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] PATH_INFO: `/v3/users/b28ed5b6aceb45f4a7d2aa83b2407c73` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:34.214987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28ed5b6aceb45f4a7d2aa83b2407c73)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:34.216931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:34.245136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:34.496215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28ed5b6aceb45f4a7d2aa83b2407c73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.509182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28ed5b6aceb45f4a7d2aa83b2407c73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.509986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28ed5b6aceb45f4a7d2aa83b2407c73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.538206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28ed5b6aceb45f4a7d2aa83b2407c73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.543546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-61475d7d-36eb-4b24-bd9d-997aeb2b4f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28ed5b6aceb45f4a7d2aa83b2407c73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:34.653423 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4112/8238] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:34 2022] DELETE /identity/v3/users/b28ed5b6aceb45f4a7d2aa83b2407c73 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:35.227721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:35.229231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:35.248656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e788a3-5b38-4af6-828b-76e4e9336b4c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:35.328905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:35.329830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:35.330306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:35.330591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] PATH_INFO: `/v3/projects/bc17714e282c4aa6868bb670feadf777` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:35.332854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc17714e282c4aa6868bb670feadf777)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:35.336290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:35.502214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc17714e282c4aa6868bb670feadf777', 'request_id': 'req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:35.512791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc17714e282c4aa6868bb670feadf777', 'request_id': 'req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:35.519671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc17714e282c4aa6868bb670feadf777', 'request_id': 'req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:35.646291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] The token cache is being invalidate because project bc17714e282c4aa6868bb670feadf777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:35.646591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:35.647376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9e6bf89f-dbdd-47f7-a84d-e284f97b045d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:35.649182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4127/8239] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:35 2022] DELETE /identity/v3/projects/bc17714e282c4aa6868bb670feadf777 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:35.654464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:35.654978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:35.655090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:35.677881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:35.679213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:35.753858 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4113/8240] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:35.762834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:35.763241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:35.763593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:35.786292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:35.788101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:35.796942 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4128/8241] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:35.801668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:35.812042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af21c2-beb3-4ee9-927b-e6842c987669 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:35.825354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:35.826005 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:35.826298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:35.826582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:35.827324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:30:35.827708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:35.830025 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:35.845114 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4114/8242] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:30:35.850195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:35.857737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:35.863981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ccb8a-adce-40e4-ab54-7f994fb8abcc None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:35.878239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:35.878239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:35.878239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:35.878239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:35.878556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:35.879771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:35.988957 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4129/8243] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:35 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:35.990650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:36.013812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57fa5b-0765-4e11-8839-1ec68990120d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:36.091677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:36.092440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.092778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.093055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.093720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:36.095960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:36.213517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4115/8244] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:35 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:30:36.214534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:36.230424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a955e-8fa3-4a8c-bf8a-1a34a27b6ae7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:36.236574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:36.237257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.241200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.241200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.241200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:36.241200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:36.252052 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4130/8245] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:36.256685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:36.267690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbecd0-e65d-43e7-9f4e-9ae97385889d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:36.278717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:36.279532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.279823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.283912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.283912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:36.283912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:36.291961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:36.294220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:36.321158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4116/8246] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:36.322358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:36.342012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:36.350045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb374e-ff80-4c45-bceb-6dc9482f6c3f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:36.368460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147a7b-e941-44cd-9b31-cc554916797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:36.369691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147a7b-e941-44cd-9b31-cc554916797b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.370114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147a7b-e941-44cd-9b31-cc554916797b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.370437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147a7b-e941-44cd-9b31-cc554916797b admin admin] PATH_INFO: `/v3/projects/0b461b8622c143ce8f77d8b48970cade/users/0f883ece2e5e49698d2bd382ab3a40dd/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.405305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147a7b-e941-44cd-9b31-cc554916797b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b461b8622c143ce8f77d8b48970cade, user_id=0f883ece2e5e49698d2bd382ab3a40dd, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:36.413213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147a7b-e941-44cd-9b31-cc554916797b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:36.447137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301ed9-433c-4cd2-8507-71011064cfad admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:36.454837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:36.455529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.456392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.456853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.460074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:36.496456 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4117/8247] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:36 2022] PUT /identity/v3/projects/0b461b8622c143ce8f77d8b48970cade/users/0f883ece2e5e49698d2bd382ab3a40dd/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:36.508973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.509458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.509898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.566737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:36.568358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:36.576258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] MFA Rules not processed for user `0f883ece2e5e49698d2bd382ab3a40dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:36.577551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:36.578888 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4131/8248] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:36.691179 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4118/8249] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:36.705474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:36.708190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:36.726501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa197c-94bc-449c-990d-e6a73f5ac885 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:36.827876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714271f-ba1b-4adb-84d3-23b68dfe893f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:36.828534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714271f-ba1b-4adb-84d3-23b68dfe893f service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:36.828824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714271f-ba1b-4adb-84d3-23b68dfe893f service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:36.829137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714271f-ba1b-4adb-84d3-23b68dfe893f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:36.842375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714271f-ba1b-4adb-84d3-23b68dfe893f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:36.844073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714271f-ba1b-4adb-84d3-23b68dfe893f service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:36.866458 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4132/8250] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:38.534674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:38.547336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2645c-53e4-4baa-95e4-92ffcf036c4d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:38.551707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:38.552347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:38.552636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:38.552914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:38.554685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:38.622233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:38.623723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:38.634687 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4119/8251] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:39.886032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:39.886872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:39.887500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:39.919290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] MFA Rules not processed for user `0f883ece2e5e49698d2bd382ab3a40dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:39.921641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:39.930290 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4133/8252] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:39.973145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:39.975929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:40.084504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400232-bd9a-4493-bc76-46616eabb304 service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:40.088939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:40.089589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:40.089878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:40.090162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:40.092127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:40.133194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:40.237918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:40.239601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:40.254193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4120/8253] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:41.042849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:41.044309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:41.088831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:41.163700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a3518-0845-4f5b-8f25-b4e51126d197 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:41.174949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:41.176018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:41.176460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:41.178446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:41.180449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:41.200847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:41.202795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891b1e9-3a39-414b-80b1-3b8c02a64446 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:41.218363 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4134/8254] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:50.430392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=30 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:51.807058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=16 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:53.390339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:53.392311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:53.484347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b9539-27e3-461f-9267-a0d05547da9d service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:53.489473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:53.490159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:53.490450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:53.490733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] PATH_INFO: `/v3/users/23bf78cf79b84662bb88e7988944785f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:53.491987 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23bf78cf79b84662bb88e7988944785f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:53.497937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:53.783662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23bf78cf79b84662bb88e7988944785f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:53.799368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23bf78cf79b84662bb88e7988944785f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:53.802371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23bf78cf79b84662bb88e7988944785f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:53.842325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23bf78cf79b84662bb88e7988944785f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:53.848921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23bf78cf79b84662bb88e7988944785f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:53.936405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4121/8255] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:53 2022] DELETE /identity/v3/users/23bf78cf79b84662bb88e7988944785f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:53.941122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:53.941680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:53.941769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:53.967509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:53.969497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:54.042192 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4135/8256] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:54.052695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:54.054403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:54.137980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b4f2-71d6-4e2b-a5d2-57e565186e98 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:54.142079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:54.144289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:54.144289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:54.144289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:54.156621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:54.158353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:54.169755 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4122/8257] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:30:54.936713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:54.937643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:54.954370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c408f-9f84-4a66-99bc-bf02bd298302 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:54.979817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:54.981270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:54.982410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:54.982912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] PATH_INFO: `/v3/projects/78a6a32c73364afb8ec72aca84139e9f` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:54.984868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a6a32c73364afb8ec72aca84139e9f)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:54.987492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:55.145486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a6a32c73364afb8ec72aca84139e9f', 'request_id': 'req-d160c03c-49d9-4541-abe7-e955eee557ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.158200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a6a32c73364afb8ec72aca84139e9f', 'request_id': 'req-d160c03c-49d9-4541-abe7-e955eee557ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.165630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a6a32c73364afb8ec72aca84139e9f', 'request_id': 'req-d160c03c-49d9-4541-abe7-e955eee557ec'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.278097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] The token cache is being invalidate because project 78a6a32c73364afb8ec72aca84139e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:55.278398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.279613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.281689 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4136/8258] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:54 2022] DELETE /identity/v3/projects/78a6a32c73364afb8ec72aca84139e9f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:55.285543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:55.297757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e30ac-9889-410f-83d0-c101f0caf46a service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:55.334742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:55.392203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:55.394065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:55.394766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:55.395273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] PATH_INFO: `/v3/users/8fdc77b5efab479a818c0878daf933cf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:55.397702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdc77b5efab479a818c0878daf933cf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:55.400380 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:55.703406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdc77b5efab479a818c0878daf933cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.718379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdc77b5efab479a818c0878daf933cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.719975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdc77b5efab479a818c0878daf933cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.744616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdc77b5efab479a818c0878daf933cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.746395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdc77b5efab479a818c0878daf933cf'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:55.942219 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4123/8259] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:55 2022] DELETE /identity/v3/users/8fdc77b5efab479a818c0878daf933cf => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:56.513369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:56.516138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:56.558485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160c03c-49d9-4541-abe7-e955eee557ec admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:56.641945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:56.644002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:56.644002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:56.644002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] PATH_INFO: `/v3/projects/d04eaa5a44164645bb8d2962cb0a0542` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:56.645344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04eaa5a44164645bb8d2962cb0a0542)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:56.648074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:56.792241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:56.809681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04eaa5a44164645bb8d2962cb0a0542', 'request_id': 'req-ab793152-ef6f-4ed4-a636-208a32c993b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:56.818755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04eaa5a44164645bb8d2962cb0a0542', 'request_id': 'req-ab793152-ef6f-4ed4-a636-208a32c993b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:56.825376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04eaa5a44164645bb8d2962cb0a0542', 'request_id': 'req-ab793152-ef6f-4ed4-a636-208a32c993b9'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:56.926614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] The token cache is being invalidate because project d04eaa5a44164645bb8d2962cb0a0542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:56.926916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:56.927656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:56.929224 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4137/8260] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:56 2022] DELETE /identity/v3/projects/d04eaa5a44164645bb8d2962cb0a0542 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:56.933364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:56.934978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:56.949643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2681dc-20f6-4871-b026-c3f392c13823 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:57.043748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:57.044525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:57.044976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:57.045265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] PATH_INFO: `/v3/users/f9a9a9b04d364d07a80dbcad4e9fc6f4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:57.046601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a9a9b04d364d07a80dbcad4e9fc6f4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:57.049651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:57.286308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:57.290537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a9a9b04d364d07a80dbcad4e9fc6f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:57.300135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a9a9b04d364d07a80dbcad4e9fc6f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:57.300528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a9a9b04d364d07a80dbcad4e9fc6f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:57.315736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a9a9b04d364d07a80dbcad4e9fc6f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:57.316588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-60f5d674-96a5-41c2-b491-c3c0bbe6d417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a9a9b04d364d07a80dbcad4e9fc6f4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:57.407648 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4124/8261] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:30:56 2022] DELETE /identity/v3/users/f9a9a9b04d364d07a80dbcad4e9fc6f4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:58.084994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:58.090672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:58.116816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793152-ef6f-4ed4-a636-208a32c993b9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:58.195062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:58.195893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:58.196251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:58.196528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] PATH_INFO: `/v3/projects/619319491a8a4122beec80dd2686929d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:58.198110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=619319491a8a4122beec80dd2686929d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:58.200378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:58.343187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619319491a8a4122beec80dd2686929d', 'request_id': 'req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:58.354499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619319491a8a4122beec80dd2686929d', 'request_id': 'req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:58.365167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619319491a8a4122beec80dd2686929d', 'request_id': 'req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:58.482959 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] The token cache is being invalidate because project 619319491a8a4122beec80dd2686929d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:30:58.485374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:58.485374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1dfe8ebd-ae4b-4cb5-b607-2841773d2a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:30:58.486080 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4138/8262] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:30:58 2022] DELETE /identity/v3/projects/619319491a8a4122beec80dd2686929d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:58.491583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:58.492172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:58.492172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:58.515471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:58.516911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:58.600317 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4125/8263] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:58.600963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:58.601246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:58.601569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:58.629124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:58.630583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:58.641117 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4139/8264] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:58.646815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:58.657286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611483-9dab-401e-94cf-fd4879fa2311 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:58.662557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:58.663223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:58.663828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:58.664009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:58.664885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:30:58.665203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:58.669245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:58.680010 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4126/8265] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:30:58.684493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:58.695195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ece4c-fa7a-4fa9-aefd-122ca1e56942 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:58.700452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:58.701328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:58.701615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:58.702775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:58.703847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:58.705969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:58.844451 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4140/8266] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:30:58 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:58.849131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:58.866319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc020d7-1b5d-4467-8dd6-56fc7d0acae9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:58.966594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:58.967341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:58.967739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:58.968115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:58.968768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:58.975737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:59.097722 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4127/8267] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:30:58 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:30:59.102009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:59.114452 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468c63-6e4f-4438-9939-51305ca37d00 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:59.129596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:59.129596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:59.129596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:59.129596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:59.130062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:59.130062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:59.134486 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4141/8268] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:59.138520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:59.152410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d6f8-105c-4b01-9680-f4207c902c5e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:59.157928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32011cd-f8af-42c0-a8e0-27cabc1cec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:59.159903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32011cd-f8af-42c0-a8e0-27cabc1cec07 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:59.160201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32011cd-f8af-42c0-a8e0-27cabc1cec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:59.160484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32011cd-f8af-42c0-a8e0-27cabc1cec07 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:59.161179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32011cd-f8af-42c0-a8e0-27cabc1cec07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:59.162810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32011cd-f8af-42c0-a8e0-27cabc1cec07 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:59.178903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4128/8269] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:30:59.183289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:59.191784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:59.195889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b83d49-59a6-459f-b7d5-3eafa590d1f8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:59.200742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:59.201443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:59.201712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:59.202019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] PATH_INFO: `/v3/projects/eb7c997d05c141afb82389298ecb372c/users/4a1fe9d40733413a9c56393762549c7d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:59.218618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7c997d05c141afb82389298ecb372c, user_id=4a1fe9d40733413a9c56393762549c7d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:59.222627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:59.298739 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4142/8270] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:30:59 2022] PUT /identity/v3/projects/eb7c997d05c141afb82389298ecb372c/users/4a1fe9d40733413a9c56393762549c7d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:30:59.304167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b2b5-8059-4680-8543-1e00721a78b2 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:59.304484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b2b5-8059-4680-8543-1e00721a78b2 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:59.304763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b2b5-8059-4680-8543-1e00721a78b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:59.324437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8ab0b2b5-8059-4680-8543-1e00721a78b2 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:30:59.325750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8ab0b2b5-8059-4680-8543-1e00721a78b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:59.348157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:30:59.389197 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4129/8271] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:30:59.400132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:30:59.402453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:30:59.492936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df45eb-bfd5-4047-ad67-865b6ab57904 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:30:59.506386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:30:59.507099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:30:59.507453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:30:59.507734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:30:59.519430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:30:59.521067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:30:59.544853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4143/8272] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:31:01.273769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:01.277604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:01.277604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:01.308496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] MFA Rules not processed for user `4a1fe9d40733413a9c56393762549c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:01.309813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:01.385862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4130/8273] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:01.398607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:01.400559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:01.471884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f06ed-25a9-4386-ac6d-f7c2e1c426c8 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:01.475855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:01.476477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:01.476763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:01.477042 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:01.487514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:01.489475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:01.500172 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4144/8274] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:31:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:31:11.382705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=47 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:11.505567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:42.727322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:42.731385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:42.824876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642147e4-7c1f-4324-b827-4aebab9774e6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:42.830617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:42.831407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:42.831695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:42.831974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:42.834141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:42.859364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:42.861786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b41c5-e5e3-4039-8f46-4a866de14ad9 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:42.881447 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4131/8275] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:31:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:31:42.902057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:42.903626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:42.918942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943d43f-5f1d-4e14-b77a-4bf71d40cb20 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:42.928260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:42.930677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:42.931145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:42.931414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] PATH_INFO: `/v3/users/ddbf5d648d8a46559c11bd2a5fa5de9c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:42.932950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddbf5d648d8a46559c11bd2a5fa5de9c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:42.936282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:43.288888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddbf5d648d8a46559c11bd2a5fa5de9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:43.300380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddbf5d648d8a46559c11bd2a5fa5de9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:43.300380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddbf5d648d8a46559c11bd2a5fa5de9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:43.300380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddbf5d648d8a46559c11bd2a5fa5de9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:43.319363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddbf5d648d8a46559c11bd2a5fa5de9c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:43.451607 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4145/8276] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:31:42 2022] DELETE /identity/v3/users/ddbf5d648d8a46559c11bd2a5fa5de9c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:31:43.457261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:43.457599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:43.457920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:43.480651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:43.481874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:43.548262 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4132/8277] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:43.560860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:43.562339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:43.639637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c6f0-4883-4bdf-ae4e-57499510ba8e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:43.644735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c382ef-37a9-4ec6-8120-d2fc5431a25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:43.645347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c382ef-37a9-4ec6-8120-d2fc5431a25d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:43.645628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c382ef-37a9-4ec6-8120-d2fc5431a25d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:43.645902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c382ef-37a9-4ec6-8120-d2fc5431a25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:43.656476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c382ef-37a9-4ec6-8120-d2fc5431a25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:43.658539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c382ef-37a9-4ec6-8120-d2fc5431a25d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:43.669305 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4146/8278] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:31:43.970553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:43.972700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:43.987841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c21fd-efcc-4412-b6c7-9197a905d70e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:43.992912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:43.995689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:43.995689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:43.995689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] PATH_INFO: `/v3/projects/68af720ce42b4500accb1c1c8fadf4d0` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:43.995689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68af720ce42b4500accb1c1c8fadf4d0)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:43.997415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:44.134365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68af720ce42b4500accb1c1c8fadf4d0', 'request_id': 'req-393fa458-87df-4da2-a9c5-e488645d0ac5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:44.141508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68af720ce42b4500accb1c1c8fadf4d0', 'request_id': 'req-393fa458-87df-4da2-a9c5-e488645d0ac5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:44.147614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68af720ce42b4500accb1c1c8fadf4d0', 'request_id': 'req-393fa458-87df-4da2-a9c5-e488645d0ac5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:44.225094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] The token cache is being invalidate because project 68af720ce42b4500accb1c1c8fadf4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:31:44.225392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:44.226063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-393fa458-87df-4da2-a9c5-e488645d0ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:44.227636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4133/8279] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:31:43 2022] DELETE /identity/v3/projects/68af720ce42b4500accb1c1c8fadf4d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:31:44.232522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.240409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.240409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.253675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:44.254894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:44.317556 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4147/8280] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:44.325362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.325657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.325944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.348794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:44.351546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:44.358630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4134/8281] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:44.363078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:44.373278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4abcee-6409-401a-b2cb-1f4d686766ad None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:44.378265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:44.379053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.379351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.379627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.380339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:31:44.380641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:44.382266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:44.397346 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4148/8282] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:31:44.401009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:44.411517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa87ce-9460-4969-8402-36c79af73519 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:44.416328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:44.416963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.417241 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.417517 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.418151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:44.420111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:44.425024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:44.541902 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4135/8283] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:31:44 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:31:44.546061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:44.551484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:44.557054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2296d-d08c-4f30-a06b-a740424b47fe admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:44.622701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:44.623363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.623649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.623933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.624626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:44.627399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:44.757398 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4149/8284] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:31:44 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:31:44.761381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:44.777920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f301a-a466-4691-9423-3a24d918c254 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:44.785638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:44.786312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.786595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.786932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.788360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:44.789983 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:44.808405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4136/8285] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:31:44.812536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:44.830636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e0a4-6375-4e4e-bafe-8887e678c278 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:44.842919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b77d-5205-437c-95e7-1334f3d04662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:44.842919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b77d-5205-437c-95e7-1334f3d04662 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.842919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b77d-5205-437c-95e7-1334f3d04662 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.842919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b77d-5205-437c-95e7-1334f3d04662 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.845429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b77d-5205-437c-95e7-1334f3d04662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:44.847829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b77d-5205-437c-95e7-1334f3d04662 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:44.868522 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4150/8286] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:31:44.872414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:44.884346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42097b1-d765-4485-a4e1-5f70cea2f85e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:44.889835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:44.892150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:44.892150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:44.892150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] PATH_INFO: `/v3/projects/060b9abebc414eaa9fbc99c1ce89107e/users/f7a0bfde685b4cbcbad339af545f87d7/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:44.920286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060b9abebc414eaa9fbc99c1ce89107e, user_id=f7a0bfde685b4cbcbad339af545f87d7, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:44.924295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:45.008101 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4137/8287] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:31:44 2022] PUT /identity/v3/projects/060b9abebc414eaa9fbc99c1ce89107e/users/f7a0bfde685b4cbcbad339af545f87d7/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:31:45.019687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:45.020083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:45.020434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:45.052347 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] MFA Rules not processed for user `f7a0bfde685b4cbcbad339af545f87d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:45.053606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:45.138111 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4151/8288] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:45.156379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:45.158191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:45.230880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e61c-67de-419b-b228-b04e7090ae00 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:45.235432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dc004-3533-4719-8b7c-5b1d548ed1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:45.236024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dc004-3533-4719-8b7c-5b1d548ed1ed service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:45.236306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dc004-3533-4719-8b7c-5b1d548ed1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:45.236590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dc004-3533-4719-8b7c-5b1d548ed1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:45.245950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dc004-3533-4719-8b7c-5b1d548ed1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:45.247453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dc004-3533-4719-8b7c-5b1d548ed1ed service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:45.258289 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4138/8289] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:31:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:31:52.175939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:52.251521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08ed9-08b8-45ec-9a0b-cae40a1d468d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:52.256213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:52.257021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:52.257705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:52.257705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] PATH_INFO: `/v3/users/f7a0bfde685b4cbcbad339af545f87d7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:52.258793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a0bfde685b4cbcbad339af545f87d7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:52.260781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:52.284128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:52.429680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a0bfde685b4cbcbad339af545f87d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:52.436785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a0bfde685b4cbcbad339af545f87d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:52.437515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a0bfde685b4cbcbad339af545f87d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:52.438915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a0bfde685b4cbcbad339af545f87d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:52.453114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a0bfde685b4cbcbad339af545f87d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:52.528340 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4152/8290] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:31:52 2022] DELETE /identity/v3/users/f7a0bfde685b4cbcbad339af545f87d7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:31:52.533779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:52.534345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:52.534471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:52.554974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:52.558496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:52.632498 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4139/8291] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:52.643156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:52.644605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:52.707987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a891a-e5a1-468b-85d4-a10356426134 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:52.713905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa0a6-4f32-4582-bdec-55486cbc47d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:52.714521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa0a6-4f32-4582-bdec-55486cbc47d4 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:52.714800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa0a6-4f32-4582-bdec-55486cbc47d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:52.715104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa0a6-4f32-4582-bdec-55486cbc47d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:52.725906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa0a6-4f32-4582-bdec-55486cbc47d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:52.727423 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa0a6-4f32-4582-bdec-55486cbc47d4 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:52.741078 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4153/8292] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:31:53.061156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.063180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:53.076293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d1337-a162-443f-8cfa-4db777cd0278 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.082065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.082733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.083052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.083332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] PATH_INFO: `/v3/projects/060b9abebc414eaa9fbc99c1ce89107e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.084510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=060b9abebc414eaa9fbc99c1ce89107e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.086783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:53.191526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:53.193073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060b9abebc414eaa9fbc99c1ce89107e', 'request_id': 'req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:53.199931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060b9abebc414eaa9fbc99c1ce89107e', 'request_id': 'req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:53.205838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060b9abebc414eaa9fbc99c1ce89107e', 'request_id': 'req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:53.307664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] The token cache is being invalidate because project 060b9abebc414eaa9fbc99c1ce89107e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:31:53.307890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:53.308558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ea01a525-eaf3-4ade-bbbb-ae207b67b48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:31:53.310096 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4140/8293] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:31:53 2022] DELETE /identity/v3/projects/060b9abebc414eaa9fbc99c1ce89107e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:31:53.315777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.319676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.319676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.336490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:53.337880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:53.404277 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4154/8294] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:53.412463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.412755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.413034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.434268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:53.435587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:53.444669 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4141/8295] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:31:53.449122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.460635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d48b80-60bb-4c5f-ba26-26e6c90dbe7c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.465478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.466099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.466383 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.466659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.467376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:31:53.467681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.469864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:53.482390 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4155/8296] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:31:53.487102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.497429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d58293-7d8e-4e83-9adb-4607e1f7c2f1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.504758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.505412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.505700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.505978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.506736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.508839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:53.603187 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4142/8297] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:31:53 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:31:53.607385 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.623729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28c51-2559-4821-b138-6306ca795c13 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.639519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:31:53.687265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.688513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.688794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.689068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.689746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.692561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:53.815489 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4156/8298] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:31:53 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:31:53.819368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.831039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16154bb-6fd5-4c64-9b3a-419a5b49d227 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.835776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.836388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.836675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.837290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.837750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.839407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:53.852644 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4143/8299] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:31:53.856039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.866923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972101de-945e-4e75-a4e8-8be29f228519 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.871852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60585985-aa8a-4dec-9a7e-2df858c6d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.872463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60585985-aa8a-4dec-9a7e-2df858c6d126 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.872746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60585985-aa8a-4dec-9a7e-2df858c6d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.873079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60585985-aa8a-4dec-9a7e-2df858c6d126 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.875693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60585985-aa8a-4dec-9a7e-2df858c6d126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.875693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60585985-aa8a-4dec-9a7e-2df858c6d126 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:53.887319 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4157/8300] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:31:53.891719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:53.902700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d36bd-4dae-4b3b-b41f-0a94e5803be5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:53.909406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:53.910159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:53.910444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:53.910722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] PATH_INFO: `/v3/projects/752af1adc731426bbe9443232a9fc357/users/a19e343124194f45aa8c8119847aeb45/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:53.932965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752af1adc731426bbe9443232a9fc357, user_id=a19e343124194f45aa8c8119847aeb45, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:53.936154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:54.058485 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4144/8301] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:31:53 2022] PUT /identity/v3/projects/752af1adc731426bbe9443232a9fc357/users/a19e343124194f45aa8c8119847aeb45/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:31:54.069172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:54.069538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:54.069735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:54.100608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] MFA Rules not processed for user `a19e343124194f45aa8c8119847aeb45`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:31:54.101927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:54.176402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4158/8302] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:31:54.188511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:31:54.190611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:31:54.254417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02724d-3e5b-444d-8d7c-e48897a79c30 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:31:54.258120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8f34e-b69d-47b0-9ffa-21c1963892bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:31:54.258870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8f34e-b69d-47b0-9ffa-21c1963892bf service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:31:54.259186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8f34e-b69d-47b0-9ffa-21c1963892bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:31:54.259460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8f34e-b69d-47b0-9ffa-21c1963892bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:31:54.268993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8f34e-b69d-47b0-9ffa-21c1963892bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:31:54.270314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8f34e-b69d-47b0-9ffa-21c1963892bf service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:31:54.279836 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4145/8303] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:31:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:04.172917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:04.275381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=60,keystone:DELETE=3,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:09.324153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:09.412107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e947-7dac-4437-93a0-0c56f9084092 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:09.416831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:09.417471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:09.417752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:09.418027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] PATH_INFO: `/v3/users/a19e343124194f45aa8c8119847aeb45` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:09.419178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19e343124194f45aa8c8119847aeb45)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:09.422357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:09.677664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19e343124194f45aa8c8119847aeb45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:09.685399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19e343124194f45aa8c8119847aeb45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:09.686407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19e343124194f45aa8c8119847aeb45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:09.687299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19e343124194f45aa8c8119847aeb45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:09.700124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19e343124194f45aa8c8119847aeb45'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:09.766321 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4159/8304] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:32:09 2022] DELETE /identity/v3/users/a19e343124194f45aa8c8119847aeb45 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:09.771191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:09.771729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:09.771867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:09.793414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:09.794640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:09.866560 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4146/8305] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:09.876708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:09.878253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:09.945056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d46dd-3d7b-4be3-9b15-ffdaac2a9836 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:09.948693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fb939-627f-47ad-a3f4-49934d2803b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:09.949485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb939-627f-47ad-a3f4-49934d2803b0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:09.949767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb939-627f-47ad-a3f4-49934d2803b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:09.950040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb939-627f-47ad-a3f4-49934d2803b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:09.962051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb939-627f-47ad-a3f4-49934d2803b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:09.963548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb939-627f-47ad-a3f4-49934d2803b0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:09.974399 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4160/8306] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:10.241607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:10.243485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:10.258899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf120d-3e92-4c12-aa3e-e4358db50720 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:10.264142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:10.265831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:10.265831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:10.266179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] PATH_INFO: `/v3/projects/752af1adc731426bbe9443232a9fc357` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:10.267227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=752af1adc731426bbe9443232a9fc357)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:10.269131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:10.463191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752af1adc731426bbe9443232a9fc357', 'request_id': 'req-7b444d42-cc47-414a-8659-650a44f17c39'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:10.470808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752af1adc731426bbe9443232a9fc357', 'request_id': 'req-7b444d42-cc47-414a-8659-650a44f17c39'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:10.490961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752af1adc731426bbe9443232a9fc357', 'request_id': 'req-7b444d42-cc47-414a-8659-650a44f17c39'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:10.586985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] The token cache is being invalidate because project 752af1adc731426bbe9443232a9fc357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:32:10.591449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:10.591449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-7b444d42-cc47-414a-8659-650a44f17c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:10.591449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4147/8307] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:32:10 2022] DELETE /identity/v3/projects/752af1adc731426bbe9443232a9fc357 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:32:10.595341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:10.595825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:10.595912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:10.620450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:10.621706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:10.646908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:10.686733 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4161/8308] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:10.695280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:10.695562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:10.695835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:10.716856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:10.718076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:10.726506 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4148/8309] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:10.731207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:10.743448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ecc2f-56cf-4a69-a2a8-e4c17ba3afe5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:10.748380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:10.750715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:10.751023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:10.751345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:10.752049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:32:10.752356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:10.754033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:10.766464 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4162/8310] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:32:10.771044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:10.781314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0c7ea-1ba5-4114-a692-6b4ff2902715 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:10.786072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:10.786686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:10.786967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:10.787286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:10.787931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:10.789844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:10.938857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4149/8311] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:10 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:32:10.942674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:10.954637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474661f5-3aa1-4197-a872-c5162776db43 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:11.024595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:11.025218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:11.025504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:11.026035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:11.026740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:11.028737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:11.135170 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4163/8312] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:10 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:32:11.139735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:11.151104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f12a-315d-4974-a9a8-3de9285cdbbe admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:11.157343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:11.157993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:11.158275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:11.158551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:11.159247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:11.160863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:11.172578 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4150/8313] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:11.177145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:11.189019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdae6b-b08f-4705-820f-61100b480dd6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:11.193915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541392b-e472-4610-8127-f7f482c46c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:11.194584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541392b-e472-4610-8127-f7f482c46c85 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:11.194866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541392b-e472-4610-8127-f7f482c46c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:11.195187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541392b-e472-4610-8127-f7f482c46c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:11.195843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541392b-e472-4610-8127-f7f482c46c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:11.197543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541392b-e472-4610-8127-f7f482c46c85 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:11.209774 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4164/8314] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:11.214203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:11.227422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b66af9-3989-4f54-9d8e-03b9d38f1293 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:11.233162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:11.233882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:11.234726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:11.234726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] PATH_INFO: `/v3/projects/6e1f191cf5c04da1abbdc5a629aac3f0/users/edd347c656f845f4946544194e2b9157/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:11.255538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1f191cf5c04da1abbdc5a629aac3f0, user_id=edd347c656f845f4946544194e2b9157, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:11.258214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:11.362382 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4151/8315] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:11 2022] PUT /identity/v3/projects/6e1f191cf5c04da1abbdc5a629aac3f0/users/edd347c656f845f4946544194e2b9157/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:32:11.372956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:11.373255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:11.373537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:11.406585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] MFA Rules not processed for user `edd347c656f845f4946544194e2b9157`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:11.407889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:11.485550 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4165/8316] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:11.500226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:11.502418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:11.526913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:11.573066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef6ccf-d93c-48bd-8645-8f56ecc366a7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:11.579004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:11.579663 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:11.579971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:11.580248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:11.589647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:11.591148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:11.600774 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4152/8317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:13.396626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:13.400228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:13.420596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:13.477563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237acd1e-a241-4ec7-829a-e187e452d192 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:13.482794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:13.483492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:13.483794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:13.484067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:13.485819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:13.501280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:13.503450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14c396-e4e9-4ba9-87ec-e543b8380f66 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:13.517073 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4166/8318] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:21.653664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=17 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:23.512578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:23.567619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=24 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:23.584726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b933dd-8fde-4cfb-a213-187ea2be8ce4 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:23.589509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:23.593617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:23.593617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:23.593617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] PATH_INFO: `/v3/users/edd347c656f845f4946544194e2b9157` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:23.593617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd347c656f845f4946544194e2b9157)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:23.594155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:23.798968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd347c656f845f4946544194e2b9157'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:23.806523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd347c656f845f4946544194e2b9157'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:23.807285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd347c656f845f4946544194e2b9157'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:23.820449 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd347c656f845f4946544194e2b9157'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:23.821114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd347c656f845f4946544194e2b9157'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:23.882167 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4153/8319] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:32:23 2022] DELETE /identity/v3/users/edd347c656f845f4946544194e2b9157 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:23.886805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:23.887140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:23.887422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:23.910601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:23.911872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:23.975976 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4167/8320] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:23.991359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:23.993101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:24.063598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b84b3-2d07-4e36-a774-cb938c40e7c8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:24.067272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41349556-a132-45fd-8401-8da661dc5dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:24.068013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349556-a132-45fd-8401-8da661dc5dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:24.068304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349556-a132-45fd-8401-8da661dc5dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:24.068585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41349556-a132-45fd-8401-8da661dc5dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:24.078257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41349556-a132-45fd-8401-8da661dc5dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:24.079765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41349556-a132-45fd-8401-8da661dc5dd6 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:24.089711 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4154/8321] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:24.367335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:24.368916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:24.381025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ce87-5c2a-4d3c-bfc7-534a9de904ea None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:24.385715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:24.386357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:24.386702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:24.386988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] PATH_INFO: `/v3/projects/6e1f191cf5c04da1abbdc5a629aac3f0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:24.388169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1f191cf5c04da1abbdc5a629aac3f0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:24.393096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:24.532143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1f191cf5c04da1abbdc5a629aac3f0', 'request_id': 'req-12c10c0e-eb26-44d1-a532-46c43d3d4c05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:24.538002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1f191cf5c04da1abbdc5a629aac3f0', 'request_id': 'req-12c10c0e-eb26-44d1-a532-46c43d3d4c05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:24.544319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1f191cf5c04da1abbdc5a629aac3f0', 'request_id': 'req-12c10c0e-eb26-44d1-a532-46c43d3d4c05'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:24.696056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] The token cache is being invalidate because project 6e1f191cf5c04da1abbdc5a629aac3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:32:24.696653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:24.697117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-12c10c0e-eb26-44d1-a532-46c43d3d4c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:24.698603 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4168/8322] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:32:24 2022] DELETE /identity/v3/projects/6e1f191cf5c04da1abbdc5a629aac3f0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:24.704107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:24.704536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:24.704666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:24.729206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:24.730458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:24.747970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:24.792342 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4155/8323] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:24.800608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:24.800899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:24.801170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:24.820880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:24.822088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:24.831063 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4169/8324] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:24.835488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:24.846050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c35c-c0f8-45b6-aeb2-bf8c65cfc0fb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:24.850590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:24.851269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:24.851566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:24.859189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:24.859189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:32:24.859189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:24.859189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:24.867591 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4156/8325] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:32:24.871963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:24.881505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997557b-97dc-46d4-a989-6857d0c3c14b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:24.886317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:24.886923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:24.887248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:24.887524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:24.888163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:24.890067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:25.021864 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4170/8326] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:24 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:25.026290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:25.038156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb348-6ed7-487a-8ec0-a7023b95ad1c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:25.097644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:25.098263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:25.098549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:25.098842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:25.099515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:25.101717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:25.262523 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4157/8327] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:25 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:25.264180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:25.275682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545eee-5f7f-443b-b550-4dd83a00f22b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:25.280580 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:25.281158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:25.281442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:25.281720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:25.282388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:25.284027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:25.294265 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4171/8328] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:25.298312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:25.308708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b9f63-580c-4906-a8b4-afaf36484da7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:25.314422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c39262-586b-4cf3-8e73-ac52ba624967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:25.315033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c39262-586b-4cf3-8e73-ac52ba624967 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:25.315322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c39262-586b-4cf3-8e73-ac52ba624967 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:25.315596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c39262-586b-4cf3-8e73-ac52ba624967 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:25.316495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c39262-586b-4cf3-8e73-ac52ba624967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:25.318082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c39262-586b-4cf3-8e73-ac52ba624967 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:25.329528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4158/8329] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:25.333678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:25.349559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7ca1-b742-487f-ac9d-6593d3a4f0ba admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:25.357507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:25.358667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:25.359221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:25.359720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] PATH_INFO: `/v3/projects/0d7b8355a91a46b0a1a1e2b1641b8a32/users/1e9aae621f2e4cf7ad7cc2d711a29add/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:25.386657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b8355a91a46b0a1a1e2b1641b8a32, user_id=1e9aae621f2e4cf7ad7cc2d711a29add, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:25.393692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:25.493248 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4172/8330] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:25 2022] PUT /identity/v3/projects/0d7b8355a91a46b0a1a1e2b1641b8a32/users/1e9aae621f2e4cf7ad7cc2d711a29add/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:32:25.504836 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:25.505157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:25.505434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:25.536952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] MFA Rules not processed for user `1e9aae621f2e4cf7ad7cc2d711a29add`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:25.538201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:25.618854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4159/8331] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:25.630564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:25.632986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:25.657317 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:25.696264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2b68f-bfff-4e08-aa4b-4639e1352ed4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:25.699967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f69a23-365c-448c-b92d-a072b530492a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:25.700579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69a23-365c-448c-b92d-a072b530492a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:25.700860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69a23-365c-448c-b92d-a072b530492a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:25.701132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69a23-365c-448c-b92d-a072b530492a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:25.709853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69a23-365c-448c-b92d-a072b530492a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:25.711381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69a23-365c-448c-b92d-a072b530492a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:25.721291 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4173/8332] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:26.021164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:26.041727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:26.090044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc92f-757a-40d1-8d27-fada3aadffdd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:26.095292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:26.095925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:26.096209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:26.096487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] PATH_INFO: `/v3/users/1e9aae621f2e4cf7ad7cc2d711a29add` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:26.097617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9aae621f2e4cf7ad7cc2d711a29add)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:26.099574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:26.307579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9aae621f2e4cf7ad7cc2d711a29add'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:26.315345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9aae621f2e4cf7ad7cc2d711a29add'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:26.316024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9aae621f2e4cf7ad7cc2d711a29add'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:26.328385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9aae621f2e4cf7ad7cc2d711a29add'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:26.329057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9aae621f2e4cf7ad7cc2d711a29add'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:26.403752 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4160/8333] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:32:26 2022] DELETE /identity/v3/users/1e9aae621f2e4cf7ad7cc2d711a29add => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:26.409534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:26.409839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:26.410114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:26.432551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:26.433811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:26.495173 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4174/8334] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:26.505089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:26.506529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:26.568531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256259c8-7c40-46cf-8348-9ee643049238 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:26.572160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d15782-8713-4a6e-a554-50fc9d885efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:26.572778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d15782-8713-4a6e-a554-50fc9d885efc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:26.573062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d15782-8713-4a6e-a554-50fc9d885efc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:26.573338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d15782-8713-4a6e-a554-50fc9d885efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:26.583315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d15782-8713-4a6e-a554-50fc9d885efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:26.584749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d15782-8713-4a6e-a554-50fc9d885efc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:26.594391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4161/8335] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:27.120575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.122150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:27.140996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9a3d1-7bb3-4ef3-998e-1daed0ef4caf None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.146159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.146961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.147268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.147545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] PATH_INFO: `/v3/projects/0d7b8355a91a46b0a1a1e2b1641b8a32` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.148706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7b8355a91a46b0a1a1e2b1641b8a32)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:27.150767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:27.262953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7b8355a91a46b0a1a1e2b1641b8a32', 'request_id': 'req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:27.268642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7b8355a91a46b0a1a1e2b1641b8a32', 'request_id': 'req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:27.275118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7b8355a91a46b0a1a1e2b1641b8a32', 'request_id': 'req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:27.356302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] The token cache is being invalidate because project 0d7b8355a91a46b0a1a1e2b1641b8a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:32:27.356538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:27.357200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-43f140f0-dfd1-45bd-9d4f-4d776d8a013c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:27.358971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4175/8336] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:32:27 2022] DELETE /identity/v3/projects/0d7b8355a91a46b0a1a1e2b1641b8a32 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:27.367301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.367794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.367906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.388419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:27.389644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:27.425244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:27.450216 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4162/8337] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:27.463035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.463035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.463035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.482122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:27.483400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:27.493566 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4176/8338] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:27.497847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.508319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e81d8-66f6-4ecd-b5a1-2b206c59967f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.513232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.513935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.514473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.516605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.517321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:32:27.517637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:27.519322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:27.532422 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4163/8339] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:32:27.541990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.552432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1955e8-d17b-4484-bd23-632734d61b11 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.557204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.557839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.558121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.558396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.559069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:27.561266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:27.681445 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4177/8340] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:27 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:27.685585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.696918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b165264-7bfb-40fb-8ae9-1d6608f8f500 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.758882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.759538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.759981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.760267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.760952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:27.762913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:27.874384 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4164/8341] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:27 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:27.880206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.895922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac24a-1ce9-439d-b52f-180124509ce7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.900825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.901747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.902007 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.902286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.902925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:27.904572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:27.915529 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4178/8342] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:32:27.919775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.930909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e5dad-c50e-46cf-9408-5f8dc8292136 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.936557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbdece-ecc3-4839-972e-0547dad46f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.937103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbdece-ecc3-4839-972e-0547dad46f69 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.937582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbdece-ecc3-4839-972e-0547dad46f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.937784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbdece-ecc3-4839-972e-0547dad46f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.938537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbdece-ecc3-4839-972e-0547dad46f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:27.940365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbdece-ecc3-4839-972e-0547dad46f69 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:27.954091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4165/8343] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:27.959788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:27.975084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c90871-0fed-4c16-a1f1-cf20dbde9b59 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:27.981753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:27.982559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:27.982842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:27.983254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] PATH_INFO: `/v3/projects/c8d117e03f664e13b1f20ea07ff93790/users/1f919aea7a1b477f9c2bae1a0b281f32/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:27.986089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:28.005152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d117e03f664e13b1f20ea07ff93790, user_id=1f919aea7a1b477f9c2bae1a0b281f32, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:28.010486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:28.099439 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4179/8344] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:27 2022] PUT /identity/v3/projects/c8d117e03f664e13b1f20ea07ff93790/users/1f919aea7a1b477f9c2bae1a0b281f32/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:28.111532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:28.112307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:28.112491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:28.158163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] MFA Rules not processed for user `1f919aea7a1b477f9c2bae1a0b281f32`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:28.159463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:28.236822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4166/8345] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:28.247486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:28.250315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:28.318696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb552-6738-4c07-952a-2ca1f83e254a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:28.322505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b341f-d110-4045-b708-1bf99e29f7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:28.323174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b341f-d110-4045-b708-1bf99e29f7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:28.323459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b341f-d110-4045-b708-1bf99e29f7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:28.323766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b341f-d110-4045-b708-1bf99e29f7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:28.333992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b341f-d110-4045-b708-1bf99e29f7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:28.335513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b341f-d110-4045-b708-1bf99e29f7f3 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:28.346564 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4180/8346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:38.231272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:38.341461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:39.159321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:39.225179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe65920-67b5-485a-912b-3a57f66eac27 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:39.229856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:39.230495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:39.230781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:39.231086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] PATH_INFO: `/v3/users/1f919aea7a1b477f9c2bae1a0b281f32` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:39.232234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f919aea7a1b477f9c2bae1a0b281f32)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:39.234905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:39.459719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f919aea7a1b477f9c2bae1a0b281f32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:39.482064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f919aea7a1b477f9c2bae1a0b281f32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:39.482714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f919aea7a1b477f9c2bae1a0b281f32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:39.496765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f919aea7a1b477f9c2bae1a0b281f32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:39.497643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f919aea7a1b477f9c2bae1a0b281f32'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:39.602406 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4167/8347] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:32:39 2022] DELETE /identity/v3/users/1f919aea7a1b477f9c2bae1a0b281f32 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:39.607001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:39.607557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:39.607649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:39.627937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:39.629171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:39.704763 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4181/8348] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:39.716420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:39.718599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:39.785846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95080-27ea-4589-82b6-bd4b4ca28382 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:39.789688 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e9bc-ef21-475d-a7e1-e3e1ea1ec367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:39.790311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e9bc-ef21-475d-a7e1-e3e1ea1ec367 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:39.790598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e9bc-ef21-475d-a7e1-e3e1ea1ec367 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:39.790878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e9bc-ef21-475d-a7e1-e3e1ea1ec367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:39.803109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55e9bc-ef21-475d-a7e1-e3e1ea1ec367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:39.804872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55e9bc-ef21-475d-a7e1-e3e1ea1ec367 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:39.815545 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4168/8349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:32:40.111376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:40.112965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:40.132024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e346b-fbe9-4805-b453-de11884821ae None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:40.137697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:40.142088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.142088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.142088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] PATH_INFO: `/v3/projects/c8d117e03f664e13b1f20ea07ff93790` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.142088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d117e03f664e13b1f20ea07ff93790)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:40.143595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:40.284851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d117e03f664e13b1f20ea07ff93790', 'request_id': 'req-0f936ab3-0186-48c9-85ec-e5c97c7416d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:40.291752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d117e03f664e13b1f20ea07ff93790', 'request_id': 'req-0f936ab3-0186-48c9-85ec-e5c97c7416d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:40.298058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d117e03f664e13b1f20ea07ff93790', 'request_id': 'req-0f936ab3-0186-48c9-85ec-e5c97c7416d7'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:40.392047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] The token cache is being invalidate because project c8d117e03f664e13b1f20ea07ff93790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:32:40.392353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:40.393024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-0f936ab3-0186-48c9-85ec-e5c97c7416d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:40.394604 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4182/8350] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:32:40 2022] DELETE /identity/v3/projects/c8d117e03f664e13b1f20ea07ff93790 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:40.400219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.400765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.400854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.422667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:40.423930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:40.442565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:40.489925 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4169/8351] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:32:40.500269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.500269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.500269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.526782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:40.528088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:40.536760 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4183/8352] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:40.542724 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:40.554847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093ff0-b1d2-464a-9396-771c274f9f38 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:40.559749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:40.560366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.560647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.560920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.561621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:32:40.562435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:40.564103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:40.576861 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4170/8353] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:32:40.581440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:40.591538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d474f2-6219-4ccc-9edf-19a397bc55eb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:40.596372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:40.596982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.597276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.597549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.598183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:40.600139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:40.766361 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4184/8354] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:40 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:40.770647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:40.782955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a1f24-d970-4c16-94ef-cbf450bb0f9d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:40.859540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:40.860197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.860478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.860915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.861588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:40.863640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:40.958645 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4171/8355] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:40 2022] POST /identity/v3/users => generated 303 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:40.960258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:40.971750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824440f0-061c-46c3-a57c-374127cafbf4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:40.976398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:40.977021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:40.977292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:40.977568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:40.978228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:40.979892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:40.990788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4185/8356] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:40.994879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:41.005532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e21bd-2bb4-44d3-862b-8d1235de8b32 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:41.010290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f678-6c69-440b-9d9e-d008619bc07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:41.010899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f678-6c69-440b-9d9e-d008619bc07c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:41.011222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f678-6c69-440b-9d9e-d008619bc07c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:41.011506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f678-6c69-440b-9d9e-d008619bc07c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:41.012153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f678-6c69-440b-9d9e-d008619bc07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:41.013792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f678-6c69-440b-9d9e-d008619bc07c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:41.024994 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4172/8357] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:41.029638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:41.041260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f216f-f104-46b4-84ad-c88a4555d056 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:41.045758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:41.046936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:41.047254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:41.047542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] PATH_INFO: `/v3/projects/2686c3bd36b5421c8a32dc36957d806d/users/1e499317839947fb9b057dce0853fca3/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:41.069395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2686c3bd36b5421c8a32dc36957d806d, user_id=1e499317839947fb9b057dce0853fca3, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:41.076860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:41.157056 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4186/8358] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:41 2022] PUT /identity/v3/projects/2686c3bd36b5421c8a32dc36957d806d/users/1e499317839947fb9b057dce0853fca3/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:41.162389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49475bf-de0b-478d-9908-6ed7bd507ab1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:41.163164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49475bf-de0b-478d-9908-6ed7bd507ab1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:41.163629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49475bf-de0b-478d-9908-6ed7bd507ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:41.201167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e49475bf-de0b-478d-9908-6ed7bd507ab1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:41.207384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e49475bf-de0b-478d-9908-6ed7bd507ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:41.273283 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4173/8359] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:41.285051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:41.286823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:41.311491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:41.363485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee42192-f8a7-49fe-a23c-21ba9c261d1a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:41.368170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:41.368811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:41.369099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:41.369377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:41.380218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:41.381854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:41.393998 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4187/8360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:42.791892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:42.792392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:42.792484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:42.824865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] MFA Rules not processed for user `1e499317839947fb9b057dce0853fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:42.826131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:42.844537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:42.897748 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4174/8361] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:42.902867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:42.914782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9969-91ed-467b-8c4d-66ac7cf31d02 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:42.919732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:42.920335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:42.920620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:42.921525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:42.922271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:42.933557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:43.052428 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4188/8362] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:42 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:43.056376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:43.067188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c2a4-ddf5-4c2e-8176-1065da4099e5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:43.136311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:43.136923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:43.137206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:43.137481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:43.138122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:43.140080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:43.252920 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4175/8363] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:43 2022] POST /identity/v3/users => generated 309 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:43.256827 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:43.267573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c81287-4561-49d9-be3d-3d389d32edaf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:43.272396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:43.273535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:43.273535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:43.273535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:43.274233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:43.275949 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:43.287748 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4189/8364] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:43.292084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:43.303826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf78fb-3574-466d-9f3c-52af724050e5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:43.308599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:43.309252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:43.309533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:43.309806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] PATH_INFO: `/v3/projects/697d9888c9da4200b46b2c1187db2a96/users/aa30335395e84a90abbca4fb68b6e4ff/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:43.325678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=697d9888c9da4200b46b2c1187db2a96, user_id=aa30335395e84a90abbca4fb68b6e4ff, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:43.328461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:43.413488 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4176/8365] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:43 2022] PUT /identity/v3/projects/697d9888c9da4200b46b2c1187db2a96/users/aa30335395e84a90abbca4fb68b6e4ff/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:43.417762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:43.428811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d76bf-5139-4570-9915-53acc0b385c9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:43.491434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac93e06-7002-47c8-b747-60054199b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:43.492050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac93e06-7002-47c8-b747-60054199b5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:43.492333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac93e06-7002-47c8-b747-60054199b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:43.492607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac93e06-7002-47c8-b747-60054199b5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:43.493237 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac93e06-7002-47c8-b747-60054199b5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:43.494870 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac93e06-7002-47c8-b747-60054199b5b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:43.505214 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4190/8366] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:32:43.509271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:43.520991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fc83-498a-4566-b7af-e86e5d10be6d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:43.525772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:43.526704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:43.526986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:43.527349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] PATH_INFO: `/v3/projects/697d9888c9da4200b46b2c1187db2a96/users/aa30335395e84a90abbca4fb68b6e4ff/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:43.529262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] RBAC: Authorizing `identity:create_grant(project_id=697d9888c9da4200b46b2c1187db2a96, user_id=aa30335395e84a90abbca4fb68b6e4ff, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:43.532557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:43.543203 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4177/8367] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:43 2022] PUT /identity/v3/projects/697d9888c9da4200b46b2c1187db2a96/users/aa30335395e84a90abbca4fb68b6e4ff/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:44.953952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:44.954515 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:44.954678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:44.989703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] MFA Rules not processed for user `aa30335395e84a90abbca4fb68b6e4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:44.991246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:45.074331 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4191/8368] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:46.513628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:46.588016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f19e-d7b1-4498-9b7c-a902afe2266e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:46.592587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:46.593847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:46.594156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:46.594429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] PATH_INFO: `/v3/users/1e499317839947fb9b057dce0853fca3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:46.595575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e499317839947fb9b057dce0853fca3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:46.597501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:46.610106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:46.806453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e499317839947fb9b057dce0853fca3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:46.813823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e499317839947fb9b057dce0853fca3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:46.815290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e499317839947fb9b057dce0853fca3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:46.829074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e499317839947fb9b057dce0853fca3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:46.829808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e499317839947fb9b057dce0853fca3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:46.910275 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4178/8369] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:32:46 2022] DELETE /identity/v3/users/1e499317839947fb9b057dce0853fca3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:47.207559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:47.227353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7168-032f-42b4-a75f-e3aec26ed1f9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:47.236431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:47.286578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:47.287618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:47.290757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:47.290757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] PATH_INFO: `/v3/projects/2686c3bd36b5421c8a32dc36957d806d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:47.290757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2686c3bd36b5421c8a32dc36957d806d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:47.292289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:47.413882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2686c3bd36b5421c8a32dc36957d806d', 'request_id': 'req-ba7bc07a-f978-4621-b6c6-d1759dcabf00'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.422918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2686c3bd36b5421c8a32dc36957d806d', 'request_id': 'req-ba7bc07a-f978-4621-b6c6-d1759dcabf00'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.429467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2686c3bd36b5421c8a32dc36957d806d', 'request_id': 'req-ba7bc07a-f978-4621-b6c6-d1759dcabf00'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.509862 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] The token cache is being invalidate because project 2686c3bd36b5421c8a32dc36957d806d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:32:47.510160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.510805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.512363 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4192/8370] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:32:47 2022] DELETE /identity/v3/projects/2686c3bd36b5421c8a32dc36957d806d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:47.517086 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:47.518536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:47.532705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c07a97-fd97-484e-9599-9a91c65d6b87 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:47.591141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:47.591723 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:47.592009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:47.592289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] PATH_INFO: `/v3/users/aa30335395e84a90abbca4fb68b6e4ff` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:47.593481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa30335395e84a90abbca4fb68b6e4ff)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:47.595464 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:47.784811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa30335395e84a90abbca4fb68b6e4ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.799527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa30335395e84a90abbca4fb68b6e4ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.800261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa30335395e84a90abbca4fb68b6e4ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.819975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa30335395e84a90abbca4fb68b6e4ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.820786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dda46ef6-481e-44a8-ac62-fd8e3cbfe1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa30335395e84a90abbca4fb68b6e4ff'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:47.890716 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4179/8371] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:32:47 2022] DELETE /identity/v3/users/aa30335395e84a90abbca4fb68b6e4ff => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:48.151122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:48.152930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:48.166816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bc07a-f978-4621-b6c6-d1759dcabf00 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:48.225905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:48.226581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.226815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.227122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] PATH_INFO: `/v3/projects/697d9888c9da4200b46b2c1187db2a96` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.228362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=697d9888c9da4200b46b2c1187db2a96)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:48.230358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:48.377895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:48.382361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697d9888c9da4200b46b2c1187db2a96', 'request_id': 'req-b6828cab-4090-43d6-9ad8-29999296f98b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:48.388784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697d9888c9da4200b46b2c1187db2a96', 'request_id': 'req-b6828cab-4090-43d6-9ad8-29999296f98b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:48.405563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697d9888c9da4200b46b2c1187db2a96', 'request_id': 'req-b6828cab-4090-43d6-9ad8-29999296f98b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:48.488327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] The token cache is being invalidate because project 697d9888c9da4200b46b2c1187db2a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:32:48.488622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:48.489525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-b6828cab-4090-43d6-9ad8-29999296f98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:32:48.491620 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4193/8372] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:32:48 2022] DELETE /identity/v3/projects/697d9888c9da4200b46b2c1187db2a96 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:48.496835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.496974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.497147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.518184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:48.519455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:48.525933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:48.584443 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4180/8373] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:32:48.592129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.592420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.592726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.612647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:48.613867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:48.622558 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4194/8374] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:48.627702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:48.637642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574907d8-eb13-4cab-991f-9c6eb03fec30 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:48.643125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:48.646225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.646225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.646225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.646225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:32:48.646225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:48.646820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:48.660383 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4181/8375] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:32:48.665438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:48.676668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2b3f9-2d28-4609-b270-39adcd0dbd06 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:48.681425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:48.682029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.682394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.682732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.683463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:48.685598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:48.780354 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4195/8376] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:48 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:48.785060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:48.795403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99176a-d622-4a99-8dd6-59320b8f762c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:48.860744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:48.861359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.861641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.861915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.862587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:48.864548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:48.950165 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4182/8377] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:48 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:48.954352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:48.964941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386cd4e-9767-4baa-8b62-bec7ec0746da admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:48.969609 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:48.970203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:48.970484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:48.970753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:48.971449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:48.973069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:48.982994 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4196/8378] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:48.987409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:48.997666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118aef8-e345-4ef9-a763-84cf20edec91 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.002937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402ce79-d7f5-4930-b5b5-bf0f1474ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.003641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402ce79-d7f5-4930-b5b5-bf0f1474ce31 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.003925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402ce79-d7f5-4930-b5b5-bf0f1474ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.004201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402ce79-d7f5-4930-b5b5-bf0f1474ce31 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.004828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402ce79-d7f5-4930-b5b5-bf0f1474ce31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.006422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402ce79-d7f5-4930-b5b5-bf0f1474ce31 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.018476 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4183/8379] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:49.022751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:49.033846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5603fe-e00a-4518-aa2e-aa25898862f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.038489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.039217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.039503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.039780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] PATH_INFO: `/v3/projects/c540c0ed0b8a4305a289a9e0e8164f4b/users/a8a9fcecdbdc4c0bb81f9d6484fc01e0/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.054871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c540c0ed0b8a4305a289a9e0e8164f4b, user_id=a8a9fcecdbdc4c0bb81f9d6484fc01e0, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.059343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.196173 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4197/8380] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:49 2022] PUT /identity/v3/projects/c540c0ed0b8a4305a289a9e0e8164f4b/users/a8a9fcecdbdc4c0bb81f9d6484fc01e0/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:49.207167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.207491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.207774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.237012 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] MFA Rules not processed for user `a8a9fcecdbdc4c0bb81f9d6484fc01e0`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:49.238247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:49.305702 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4184/8381] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:49.310365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:49.377968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b36d-d682-4f87-beea-b248440ebfda admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.389789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.389789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.389789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.389789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.390087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.390087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.480712 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4198/8382] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:32:49 2022] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:32:49.484993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:49.492018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:49.497084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8683fd-3389-4b1d-babd-bd0927316bf0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.562513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.563230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.563486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.563764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.564802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.566790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.719058 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4185/8383] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:32:49 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:32:49.721025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:49.731823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c5426-42ee-420b-9b8b-3b0fccee22c2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.736587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.737196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.737500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.737760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.738747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.740912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.753002 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4199/8384] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:49.757334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:49.769677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f0563-f688-4bae-b6a0-1b15a3f3c735 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.774970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.776155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.776928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.777430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] PATH_INFO: `/v3/projects/2786f11733d84bed9b1673edb355fecf/users/7c241f63b38f49c0b2405669551fad94/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.796854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2786f11733d84bed9b1673edb355fecf, user_id=7c241f63b38f49c0b2405669551fad94, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.799590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.905578 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4186/8385] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:49 2022] PUT /identity/v3/projects/2786f11733d84bed9b1673edb355fecf/users/7c241f63b38f49c0b2405669551fad94/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:32:49.909850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:49.920387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720e37e-93fa-4d4a-a723-5928dbb0dc7d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:49.963468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:32:49.980552 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c490ef0-b6b8-45a5-9f31-3e93ba05fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:49.981182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c490ef0-b6b8-45a5-9f31-3e93ba05fbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:49.981456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c490ef0-b6b8-45a5-9f31-3e93ba05fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:49.981729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c490ef0-b6b8-45a5-9f31-3e93ba05fbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:49.982429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c490ef0-b6b8-45a5-9f31-3e93ba05fbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:49.984683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c490ef0-b6b8-45a5-9f31-3e93ba05fbc8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:49.995772 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4200/8386] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:32:50.000208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:50.011628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca138082-d5cb-43a7-acd7-ed046aa6cfd2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:50.016641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:50.017300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:50.017588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:50.017865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] PATH_INFO: `/v3/projects/2786f11733d84bed9b1673edb355fecf/users/7c241f63b38f49c0b2405669551fad94/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:50.019856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2786f11733d84bed9b1673edb355fecf, user_id=7c241f63b38f49c0b2405669551fad94, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:50.022590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:50.034465 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4187/8387] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:32:49 2022] PUT /identity/v3/projects/2786f11733d84bed9b1673edb355fecf/users/7c241f63b38f49c0b2405669551fad94/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:32:50.044318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:50.044947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:50.045434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:50.075644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] MFA Rules not processed for user `7c241f63b38f49c0b2405669551fad94`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:32:50.077061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:50.144986 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4201/8388] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:32:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:32:50.159267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:50.161138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:32:50.224350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5548ba-5984-4896-aac9-68b0d5cf3102 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:50.228188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7f9eb-07d8-4c21-aff0-9c60658286c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:50.229424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f9eb-07d8-4c21-aff0-9c60658286c9 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:50.229715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f9eb-07d8-4c21-aff0-9c60658286c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:50.229991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f9eb-07d8-4c21-aff0-9c60658286c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:50.240212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7f9eb-07d8-4c21-aff0-9c60658286c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:50.241581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7f9eb-07d8-4c21-aff0-9c60658286c9 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:50.251302 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4188/8389] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:32:50.454844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:32:50.468663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355b74-9417-40ab-986e-edee1852e4a2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:32:50.473282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:32:50.479802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:32:50.479802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:32:50.479802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:32:50.538142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:32:50.539644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:32:50.549421 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4202/8390] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:00.247001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=68,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:00.544775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=72 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:16.429180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:16.429654 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:16.429755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:16.450095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] MFA Rules not processed for user `4a1fe9d40733413a9c56393762549c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:16.453932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:16.512143 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4189/8391] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:16.776930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:16.783521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:16.843039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1458f-334c-4a00-960f-1c033e0a3113 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:16.847587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:16.848214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:16.848500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:16.848785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:16.850636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:16.863763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:16.865227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:16.877318 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4203/8392] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:17.330541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:17.336222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:17.451965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3d211-90f8-486a-9ef8-43733aa35b0c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:17.457058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:17.459162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:17.459162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:17.459162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:17.460254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:17.475785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:17.477403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:17.490501 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4190/8393] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:21.403285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:21.405388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:21.420362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5cd5-4590-4a54-acc3-6211f090b12a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:21.424292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:21.424941 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:21.425378 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:21.425653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:21.427507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:21.440477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:21.441927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:21.455862 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4204/8394] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:22.305415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:22.307063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:22.401973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2736d-3df4-4dd9-a52f-4bdc41c14ff1 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:22.410829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:22.411894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:22.412396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:22.412884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:22.415966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:22.449191 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:22.451908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:22.479382 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4191/8395] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:26.883624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:26.962171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f387ae-93d5-4660-bbd7-d781770c9b55 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:26.967315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:26.967992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:26.968274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:26.968553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] PATH_INFO: `/v3/users/a8a9fcecdbdc4c0bb81f9d6484fc01e0` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:26.969754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a9fcecdbdc4c0bb81f9d6484fc01e0)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:26.971725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:27.092848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:27.094578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:27.115417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce2b65-485e-4a6c-a7ea-5f9b6dd16916 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:27.126824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:27.126824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:27.126824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:27.126824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:27.127270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:27.141643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:27.143331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37c50-4749-4b19-b447-f69fb6ecf268 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:27.158168 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4192/8396] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:33:27.236442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a9fcecdbdc4c0bb81f9d6484fc01e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:27.253480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a9fcecdbdc4c0bb81f9d6484fc01e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:27.254280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a9fcecdbdc4c0bb81f9d6484fc01e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:27.254903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a9fcecdbdc4c0bb81f9d6484fc01e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:27.274466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a9fcecdbdc4c0bb81f9d6484fc01e0'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:27.336766 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4205/8397] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:33:26 2022] DELETE /identity/v3/users/a8a9fcecdbdc4c0bb81f9d6484fc01e0 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:27.342817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:27.343612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:27.343901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:27.361199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:27.367849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:27.369073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:27.435147 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4193/8398] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:27.446079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:27.447720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:27.460388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:27.518475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7946e1-72bf-4148-a683-bfa05c3988e4 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:27.522185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:27.522806 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:27.523121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:27.523482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:27.534513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:27.535999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:27.547135 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4206/8399] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:33:28.060969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:28.062738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:28.077525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5331fc-32bc-49b7-bbf3-34aa449f3e1c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:28.082855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:28.084248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:28.084604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:28.085722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] PATH_INFO: `/v3/projects/c540c0ed0b8a4305a289a9e0e8164f4b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:28.086269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c540c0ed0b8a4305a289a9e0e8164f4b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:28.088282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:28.266481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c540c0ed0b8a4305a289a9e0e8164f4b', 'request_id': 'req-3d07d4bf-24f7-4802-85d0-72a754ab7236'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.276399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c540c0ed0b8a4305a289a9e0e8164f4b', 'request_id': 'req-3d07d4bf-24f7-4802-85d0-72a754ab7236'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.284622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c540c0ed0b8a4305a289a9e0e8164f4b', 'request_id': 'req-3d07d4bf-24f7-4802-85d0-72a754ab7236'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.399289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] The token cache is being invalidate because project c540c0ed0b8a4305a289a9e0e8164f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:33:28.399592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.402215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.402449 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4194/8400] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:33:28 2022] DELETE /identity/v3/projects/c540c0ed0b8a4305a289a9e0e8164f4b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:28.406853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:28.418335 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109cfc6-2bfa-4b41-b749-8da2044bf50c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:28.492340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:28.493218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:28.493500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:28.493783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] PATH_INFO: `/v3/users/7c241f63b38f49c0b2405669551fad94` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:28.494995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c241f63b38f49c0b2405669551fad94)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:28.496997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:28.761987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c241f63b38f49c0b2405669551fad94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.773283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c241f63b38f49c0b2405669551fad94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.774434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c241f63b38f49c0b2405669551fad94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.775526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c241f63b38f49c0b2405669551fad94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.806762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-95bc523a-977c-42f3-9811-6bf269b62070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c241f63b38f49c0b2405669551fad94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:28.982591 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4207/8401] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:33:28 2022] DELETE /identity/v3/users/7c241f63b38f49c0b2405669551fad94 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:33:29.546414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:29.548705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:29.568177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07d4bf-24f7-4802-85d0-72a754ab7236 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:29.640283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:29.640939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:29.641226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:29.641503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] PATH_INFO: `/v3/projects/2786f11733d84bed9b1673edb355fecf` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:29.642673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2786f11733d84bed9b1673edb355fecf)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:29.644676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:29.835428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:29.853584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2786f11733d84bed9b1673edb355fecf', 'request_id': 'req-ab578491-8a56-40e4-bdc8-c90de0d0f12e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:29.860737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2786f11733d84bed9b1673edb355fecf', 'request_id': 'req-ab578491-8a56-40e4-bdc8-c90de0d0f12e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:29.866248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2786f11733d84bed9b1673edb355fecf', 'request_id': 'req-ab578491-8a56-40e4-bdc8-c90de0d0f12e'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:29.975352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] The token cache is being invalidate because project 2786f11733d84bed9b1673edb355fecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:33:29.975658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:29.976337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ab578491-8a56-40e4-bdc8-c90de0d0f12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:29.977859 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4195/8402] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:33:29 2022] DELETE /identity/v3/projects/2786f11733d84bed9b1673edb355fecf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:29.982883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:29.983479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:29.983479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.005269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:30.006519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:30.035512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:30.082307 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4208/8403] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:30.084032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.084531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.085000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.108893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:30.110142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:30.119556 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4196/8404] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:30.123918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.140679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eadf77-d3a6-4ff2-8cbc-ce0e03b15b72 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.145926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.146548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.151198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.151198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.151198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:33:30.151198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.151198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:30.163201 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4209/8405] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:33:30.167658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.177408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dcb3f-e624-43f2-90c7-b9c6c39064ae None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.182280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.182893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.183213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.183498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.184160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.186169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:30.321283 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4197/8406] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:33:30 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:33:30.326704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.337545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85676dd6-72ad-4170-9bb2-b51ffef85220 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.401103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.401717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.402257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.402531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.403189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.405182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:30.527574 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4210/8407] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:33:30 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:33:30.531790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.542784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf760571-3b30-45fb-bad6-6b69c1610d7c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.547701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.548315 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.548603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.548883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.549575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.551238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:30.562980 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4198/8408] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:33:30.567220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.578195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fad4c-65f4-48df-b5c7-038c8cc77b26 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.582953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ff470-b8c1-495e-a656-a2168d6544a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.583589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ff470-b8c1-495e-a656-a2168d6544a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.583869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ff470-b8c1-495e-a656-a2168d6544a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.584154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ff470-b8c1-495e-a656-a2168d6544a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.584816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ff470-b8c1-495e-a656-a2168d6544a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.586401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ff470-b8c1-495e-a656-a2168d6544a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:30.598253 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4211/8409] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:33:30.601975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.617978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613f56-0201-4268-9357-f0f58b7c4451 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.627672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.641921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.641921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.641921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] PATH_INFO: `/v3/projects/00004e4f7ce94c7f89bbc5605d8247ac/users/269a1d4d7d424fe79582fdfd259b6720/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.648035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00004e4f7ce94c7f89bbc5605d8247ac, user_id=269a1d4d7d424fe79582fdfd259b6720, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.650857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:30.754720 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4199/8410] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:33:30 2022] PUT /identity/v3/projects/00004e4f7ce94c7f89bbc5605d8247ac/users/269a1d4d7d424fe79582fdfd259b6720/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:33:30.764753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.765043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.765319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.798579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] MFA Rules not processed for user `269a1d4d7d424fe79582fdfd259b6720`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:30.799970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:30.888446 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4212/8411] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:30.893007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:30.963678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb798d9-007a-4589-bfa7-e0b4925830c1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:30.968882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:30.969504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:30.969789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:30.970066 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:30.970754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:30.972731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.121160 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4200/8412] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:33:30 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:33:31.125220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:31.136694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8fa7b-8d9c-4aad-ae1b-8c7d82bb02cb None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:31.164124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:31.199681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:31.200304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.201270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.201537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.202180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:31.204151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.415947 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4213/8413] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:33:31 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:33:31.420431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:31.430928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6752f6-b537-4239-a957-f017b9b2411a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:31.436107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:31.439206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.439206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.439206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.439206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:31.439797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.451576 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4201/8414] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:33:31.455864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:31.466353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f557f-5105-4069-aca0-347ed995878e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:31.471124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:31.471834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.472119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.472394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] PATH_INFO: `/v3/projects/499c978a48d740e693c1ae951133ac67/users/60320d53d1604cbe961eb30d043ca3f5/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.491681 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=499c978a48d740e693c1ae951133ac67, user_id=60320d53d1604cbe961eb30d043ca3f5, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:31.494398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.578731 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4214/8415] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:33:31 2022] PUT /identity/v3/projects/499c978a48d740e693c1ae951133ac67/users/60320d53d1604cbe961eb30d043ca3f5/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:31.582755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:31.593223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1140-67c9-4e59-b8c9-fec9e342ac5a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:31.624584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:31.652628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57bcf4-e6d7-4bf7-9ba2-d50cd5097218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:31.653244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57bcf4-e6d7-4bf7-9ba2-d50cd5097218 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.653586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57bcf4-e6d7-4bf7-9ba2-d50cd5097218 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.654124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57bcf4-e6d7-4bf7-9ba2-d50cd5097218 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.654815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57bcf4-e6d7-4bf7-9ba2-d50cd5097218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:31.656457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57bcf4-e6d7-4bf7-9ba2-d50cd5097218 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.666705 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4202/8416] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:33:31.671448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:31.683444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ecb9a-a496-40c9-a364-19288087c0be admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:31.688822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:31.689488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.689772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.690046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] PATH_INFO: `/v3/projects/499c978a48d740e693c1ae951133ac67/users/60320d53d1604cbe961eb30d043ca3f5/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.692017 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=499c978a48d740e693c1ae951133ac67, user_id=60320d53d1604cbe961eb30d043ca3f5, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:31.694804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.707068 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4215/8417] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:33:31 2022] PUT /identity/v3/projects/499c978a48d740e693c1ae951133ac67/users/60320d53d1604cbe961eb30d043ca3f5/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:33:31.717131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73274744-2abc-4559-92c8-47f53751096c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.717685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73274744-2abc-4559-92c8-47f53751096c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.718138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73274744-2abc-4559-92c8-47f53751096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.751365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-73274744-2abc-4559-92c8-47f53751096c None None] MFA Rules not processed for user `60320d53d1604cbe961eb30d043ca3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:31.752579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73274744-2abc-4559-92c8-47f53751096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:31.825169 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4203/8418] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:31.836683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:31.838442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:31.905009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40b85-5713-4707-a743-745be4a9c4af admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:31.910129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:31.910761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:31.911079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:31.911360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:31.925700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:31.925700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:31.933755 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4216/8419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:32.051696 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73274744-2abc-4559-92c8-47f53751096c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:32.053137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-73274744-2abc-4559-92c8-47f53751096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:32.068085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73274744-2abc-4559-92c8-47f53751096c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:32.071786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751967-2f14-4bd7-bb99-80b2cf28cb1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:32.072397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751967-2f14-4bd7-bb99-80b2cf28cb1f service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:32.072675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751967-2f14-4bd7-bb99-80b2cf28cb1f service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:32.072948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751967-2f14-4bd7-bb99-80b2cf28cb1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:32.145596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751967-2f14-4bd7-bb99-80b2cf28cb1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:32.147078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751967-2f14-4bd7-bb99-80b2cf28cb1f service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:32.167965 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4204/8420] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:37.981331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:38.048718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3770e4-a85f-456c-923e-f8ac5df6bda1 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:38.051148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:38.051745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:38.052101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:38.052374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] PATH_INFO: `/v3/users/269a1d4d7d424fe79582fdfd259b6720` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:38.053496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269a1d4d7d424fe79582fdfd259b6720)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:38.055463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:38.079220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:38.277178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269a1d4d7d424fe79582fdfd259b6720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:38.284173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269a1d4d7d424fe79582fdfd259b6720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:38.284845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269a1d4d7d424fe79582fdfd259b6720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:38.285461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269a1d4d7d424fe79582fdfd259b6720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:38.297711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269a1d4d7d424fe79582fdfd259b6720'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:38.379565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4217/8421] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:33:37 2022] DELETE /identity/v3/users/269a1d4d7d424fe79582fdfd259b6720 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:38.384263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:38.384756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:38.384864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:38.407298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:38.408550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:38.456710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:38.471956 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4205/8422] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:33:38.483060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:38.484584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:38.552992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d26b-38b9-438e-9a37-56caf7e2e8a3 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:38.556968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:38.557595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:38.557882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:38.558159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:38.569204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:38.570824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:38.593144 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4218/8423] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:39.150752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:39.152586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:39.168262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229097a-ca43-465f-bbbb-7baa52e7d8c4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:39.173213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:39.175885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:39.175885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:39.175885 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] PATH_INFO: `/v3/projects/00004e4f7ce94c7f89bbc5605d8247ac` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:39.177572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00004e4f7ce94c7f89bbc5605d8247ac)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:39.179544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:39.338143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00004e4f7ce94c7f89bbc5605d8247ac', 'request_id': 'req-f534099b-fddb-4c52-909e-b69aba3b5406'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.344729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00004e4f7ce94c7f89bbc5605d8247ac', 'request_id': 'req-f534099b-fddb-4c52-909e-b69aba3b5406'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.351144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00004e4f7ce94c7f89bbc5605d8247ac', 'request_id': 'req-f534099b-fddb-4c52-909e-b69aba3b5406'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.435459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] The token cache is being invalidate because project 00004e4f7ce94c7f89bbc5605d8247ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:33:39.436226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.437021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.440057 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4206/8424] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:33:39 2022] DELETE /identity/v3/projects/00004e4f7ce94c7f89bbc5605d8247ac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:39.445576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:39.458756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2dec4-f592-43d8-9fcf-5745eb5279be service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:39.520307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:39.520947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:39.521226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:39.521498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] PATH_INFO: `/v3/users/60320d53d1604cbe961eb30d043ca3f5` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:39.522621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60320d53d1604cbe961eb30d043ca3f5)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:39.524756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:39.903314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:39.906043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60320d53d1604cbe961eb30d043ca3f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.913838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60320d53d1604cbe961eb30d043ca3f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.914547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60320d53d1604cbe961eb30d043ca3f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.915197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60320d53d1604cbe961eb30d043ca3f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:39.928252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5e0c4b0d-0d81-466c-b2a4-33476cdb9432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60320d53d1604cbe961eb30d043ca3f5'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:40.084396 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4219/8425] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:33:39 2022] DELETE /identity/v3/users/60320d53d1604cbe961eb30d043ca3f5 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:40.560506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:40.562789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:40.583060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534099b-fddb-4c52-909e-b69aba3b5406 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:40.657880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:40.658536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:40.658822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:40.659131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] PATH_INFO: `/v3/projects/499c978a48d740e693c1ae951133ac67` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:40.660311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] RBAC: Authorizing `identity:delete_project(project_id=499c978a48d740e693c1ae951133ac67)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:40.662334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:40.780076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499c978a48d740e693c1ae951133ac67', 'request_id': 'req-67bfa390-4818-4d0f-8416-b4e4bda5bbad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:40.786985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499c978a48d740e693c1ae951133ac67', 'request_id': 'req-67bfa390-4818-4d0f-8416-b4e4bda5bbad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:40.797006 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499c978a48d740e693c1ae951133ac67', 'request_id': 'req-67bfa390-4818-4d0f-8416-b4e4bda5bbad'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:40.938416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] The token cache is being invalidate because project 499c978a48d740e693c1ae951133ac67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:33:40.938708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:40.939402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67bfa390-4818-4d0f-8416-b4e4bda5bbad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:40.940913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4207/8426] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:33:40 2022] DELETE /identity/v3/projects/499c978a48d740e693c1ae951133ac67 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:40.946748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:40.947275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:40.947366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:40.973808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:40.975182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:41.039197 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4220/8427] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:41.141200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.141388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.141664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.151208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:41.162255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:41.163507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:41.172045 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4208/8428] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:41.176464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.187075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eec0-93d4-4706-9e73-b7c32aacc4a0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.192061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.192667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.192951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.193226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.193871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:33:41.194173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.195879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.207565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4221/8429] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:33:41.216979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.226689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd7702-42ed-4dae-8502-f16404fb9965 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.232042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.232641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.232924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.233230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.233872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.235828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.388034 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4209/8430] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:33:41 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:33:41.389688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.400099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd8e9c-7142-49cc-a48c-e9c28e2f390b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.477584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.478194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.478476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.478750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.479446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.481960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.580703 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4222/8431] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:33:41 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:33:41.585062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.596672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c96b3-a73a-43b2-aaae-7959f2325d11 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.601419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.602075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.602363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.602643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.607837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.607837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.615880 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4210/8432] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:33:41.620486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.631535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b565b2e-0262-4339-a83f-cb20f7f2e5e6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.636285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.636885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.637172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.637451 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.638107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.639764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.650941 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4223/8433] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:33:41.656059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.668548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1ab44-0b90-4876-89ec-849505121754 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.673328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123d8b-2be7-4551-a5d0-97b9ab2dd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.674064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123d8b-2be7-4551-a5d0-97b9ab2dd914 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.674354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123d8b-2be7-4551-a5d0-97b9ab2dd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.674634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123d8b-2be7-4551-a5d0-97b9ab2dd914 admin admin] PATH_INFO: `/v3/projects/dde0aad9d4124125ad5e5ba2d27a25ee/users/a47671316599430eb6b6446299f6e5c1/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.690113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123d8b-2be7-4551-a5d0-97b9ab2dd914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde0aad9d4124125ad5e5ba2d27a25ee, user_id=a47671316599430eb6b6446299f6e5c1, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.693114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123d8b-2be7-4551-a5d0-97b9ab2dd914 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.742951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:41.744763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:41.778082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:41.802032 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4211/8434] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:33:41 2022] PUT /identity/v3/projects/dde0aad9d4124125ad5e5ba2d27a25ee/users/a47671316599430eb6b6446299f6e5c1/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:41.812366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.812856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.813143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.821576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376148b-838a-4243-8d5e-42455883ea21 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:41.847754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] MFA Rules not processed for user `a47671316599430eb6b6446299f6e5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:41.849125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:41.888673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:41.889790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:41.890441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:41.890866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:41.893503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:41.909443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:41.910983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:41.925958 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4224/8435] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:41.928353 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4212/8436] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:33:41.933995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:42.018836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c4ad4-e55e-4f93-8f18-7fd4fbf0cab6 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:42.023656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:42.024242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:42.024486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:42.024783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:42.025401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:42.027650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:42.224104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4225/8437] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:33:41 2022] POST /identity/v3/projects => generated 401 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:33:42.227845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:42.239078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc431a5-f3dc-43e1-bc6e-1479e4a82491 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:42.300675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:42.301284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:42.301563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:42.301835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:42.302460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:42.304398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:42.509639 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4213/8438] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:33:42 2022] POST /identity/v3/users => generated 307 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:33:42.514205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:42.524828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9f1d3-da0a-46ff-8388-74cde73a5c2e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:42.529675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:42.530275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:42.530560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:42.530844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:42.531526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:42.533125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:42.543661 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4226/8439] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:33:42.547897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:42.558082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d45198-c6fa-49fb-852f-582ee78d1c39 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:42.563404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:42.564058 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:42.564347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:42.564634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] PATH_INFO: `/v3/projects/0c2c8236658748fbbc8d563e970520a2/users/e77894e0f5404bc3adb7a197fc295831/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:42.586784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2c8236658748fbbc8d563e970520a2, user_id=e77894e0f5404bc3adb7a197fc295831, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:42.586784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:42.587493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:42.949495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4214/8440] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:33:42 2022] PUT /identity/v3/projects/0c2c8236658748fbbc8d563e970520a2/users/e77894e0f5404bc3adb7a197fc295831/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:42.953646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:42.964319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219106f6-3490-4591-bc01-aab0fc2408be admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:43.000001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:43.032857 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4b1d-2046-424c-873a-208eeb617f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:43.033840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4b1d-2046-424c-873a-208eeb617f54 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:43.034355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4b1d-2046-424c-873a-208eeb617f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:43.034685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4b1d-2046-424c-873a-208eeb617f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:43.035340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac4b1d-2046-424c-873a-208eeb617f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:43.037084 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac4b1d-2046-424c-873a-208eeb617f54 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:43.047973 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4227/8441] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:33:43.052400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:43.063240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e620b-7e58-431f-bd19-a64a0588bab3 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:43.067925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:43.068569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:43.068854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:43.069163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] PATH_INFO: `/v3/projects/0c2c8236658748fbbc8d563e970520a2/users/e77894e0f5404bc3adb7a197fc295831/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:43.071320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2c8236658748fbbc8d563e970520a2, user_id=e77894e0f5404bc3adb7a197fc295831, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:43.073984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:43.084353 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4215/8442] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:33:43 2022] PUT /identity/v3/projects/0c2c8236658748fbbc8d563e970520a2/users/e77894e0f5404bc3adb7a197fc295831/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:43.096540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:43.097133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:43.097477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:43.131802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] MFA Rules not processed for user `e77894e0f5404bc3adb7a197fc295831`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:43.131802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:43.199559 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4228/8443] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:43.210913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:43.213685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:43.277800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b1dcc-98ed-435a-832d-c76116ce7d03 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:43.281647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:43.282263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:43.282544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:43.282817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:43.292547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:43.293954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:43.303913 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4216/8444] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:43 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:43.568299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:43.582974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99e87-9b48-4cff-8e03-3b7fe48e765d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:43.586802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:43.587450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:43.587735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:43.588010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:43.648429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:43.649967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:43.661299 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4229/8445] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:43 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:53.299470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:53.656587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=75 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:33:57.675872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:57.677312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:57.758310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320635ac-95f0-4ab5-9d31-6303bd5c6b3c service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:57.763702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:57.764323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:57.764611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:57.764920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:57.767061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:57.784760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:57.786791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8d3f-b0a6-4d9e-91a4-7a6f78809fac service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:57.801735 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4217/8446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:58.681400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:58.744592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b45c-df60-411a-b8a5-40f906b9ba6b service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:58.749729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:58.750359 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:58.750638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:58.750911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] PATH_INFO: `/v3/users/a47671316599430eb6b6446299f6e5c1` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:58.752060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47671316599430eb6b6446299f6e5c1)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:58.754038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:58.922995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47671316599430eb6b6446299f6e5c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:58.930299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47671316599430eb6b6446299f6e5c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:58.935155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47671316599430eb6b6446299f6e5c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:58.935155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47671316599430eb6b6446299f6e5c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:58.943871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47671316599430eb6b6446299f6e5c1'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:59.019602 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4230/8447] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:33:58 2022] DELETE /identity/v3/users/a47671316599430eb6b6446299f6e5c1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:59.024356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:59.025103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:59.025103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:59.044764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:33:59.045973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:59.112074 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4218/8448] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:33:59.121948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:59.123450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:59.187348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca404-10e1-4eee-b043-5827e6e6dd78 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:59.191726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:59.192337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:59.192616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:59.192886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:59.202486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:59.203986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:59.214499 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4231/8449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:33:59.676426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:59.678553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:33:59.691621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c3c3-d676-4a9a-9d2d-7659669112fa None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:59.696507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:33:59.697197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:33:59.697478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:33:59.697754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] PATH_INFO: `/v3/projects/dde0aad9d4124125ad5e5ba2d27a25ee` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:33:59.698921 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde0aad9d4124125ad5e5ba2d27a25ee)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:33:59.700855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:33:59.826376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde0aad9d4124125ad5e5ba2d27a25ee', 'request_id': 'req-ad8581c0-51d2-45c0-a023-ea673c326aa4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:59.833513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde0aad9d4124125ad5e5ba2d27a25ee', 'request_id': 'req-ad8581c0-51d2-45c0-a023-ea673c326aa4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:59.840550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde0aad9d4124125ad5e5ba2d27a25ee', 'request_id': 'req-ad8581c0-51d2-45c0-a023-ea673c326aa4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:59.941284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] The token cache is being invalidate because project dde0aad9d4124125ad5e5ba2d27a25ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:33:59.941493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:59.942131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:33:59.943687 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4219/8450] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:33:59 2022] DELETE /identity/v3/projects/dde0aad9d4124125ad5e5ba2d27a25ee => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:33:59.947920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:33:59.958179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bb284-5f2c-4bb2-b9c5-8dcf388a8dc3 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:33:59.977159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:00.017418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:00.018058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:00.018342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:00.018620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] PATH_INFO: `/v3/users/e77894e0f5404bc3adb7a197fc295831` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:00.019823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77894e0f5404bc3adb7a197fc295831)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:00.021801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:00.278601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77894e0f5404bc3adb7a197fc295831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:00.287469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77894e0f5404bc3adb7a197fc295831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:00.288206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77894e0f5404bc3adb7a197fc295831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:00.288819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77894e0f5404bc3adb7a197fc295831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:00.301539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4ea3cf11-f39a-4a8a-94d7-c6aa896f26ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77894e0f5404bc3adb7a197fc295831'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:00.400569 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4232/8451] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:33:59 2022] DELETE /identity/v3/users/e77894e0f5404bc3adb7a197fc295831 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:00.808127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:00.809733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:00.823599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8581c0-51d2-45c0-a023-ea673c326aa4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:00.836788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:00.898253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:00.898960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:00.899446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:00.899732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] PATH_INFO: `/v3/projects/0c2c8236658748fbbc8d563e970520a2` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:00.901081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2c8236658748fbbc8d563e970520a2)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:00.903444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.028133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2c8236658748fbbc8d563e970520a2', 'request_id': 'req-3d9e0590-6534-4dcd-98f4-553ca0522f37'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:01.034714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2c8236658748fbbc8d563e970520a2', 'request_id': 'req-3d9e0590-6534-4dcd-98f4-553ca0522f37'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:01.041576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2c8236658748fbbc8d563e970520a2', 'request_id': 'req-3d9e0590-6534-4dcd-98f4-553ca0522f37'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:01.132022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] The token cache is being invalidate because project 0c2c8236658748fbbc8d563e970520a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:34:01.132240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:01.132943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3d9e0590-6534-4dcd-98f4-553ca0522f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:01.134483 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4220/8452] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:34:00 2022] DELETE /identity/v3/projects/0c2c8236658748fbbc8d563e970520a2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:01.139527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.140038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.140140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.161409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:01.162643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:01.226277 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4233/8453] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:01.235589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.235883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.236169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.258060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:01.259349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:01.268328 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4221/8454] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:01.272702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.283106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23843b9d-9726-4d59-bbee-64170e6bcbd6 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:01.287787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:01.290628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.290628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.290628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.290628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:01.290628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:01.291605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.306788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4234/8455] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:01.311108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.321308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad7e84-e294-4119-b995-746acdced339 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:01.326145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:01.326762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.327219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.327496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.328136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:01.330740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.460669 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4222/8456] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:01.461897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.473135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14327a50-9899-43c9-8d8e-6f0cbafde7ff admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:01.503992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:01.537468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:01.538094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.538380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.538661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.539338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:01.541327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.675649 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4235/8457] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:01.679746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.691393 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9e7a2-53a6-4b6d-8613-c099531c5d7f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:01.696051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:01.696666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.698815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.698815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.698815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:01.699478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.709577 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4223/8458] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:01.713685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.724524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb03e-95d9-490f-b94e-f9d02c27e702 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:01.732764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab28f-98c9-4149-bcaa-d3f171e18aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:01.733363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab28f-98c9-4149-bcaa-d3f171e18aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.733642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab28f-98c9-4149-bcaa-d3f171e18aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.733915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab28f-98c9-4149-bcaa-d3f171e18aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.735164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab28f-98c9-4149-bcaa-d3f171e18aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:01.736762 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab28f-98c9-4149-bcaa-d3f171e18aa5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.747777 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4236/8459] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:01.752222 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:01.762528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97f451-848c-45d9-909e-af2ca533986e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:01.767293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:01.768044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.768333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.768660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] PATH_INFO: `/v3/projects/796d2ee69f7046d49d223e4a3d25256e/users/2ba81ab7d4ab4c0c9db4d9b83ff0222d/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.784254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796d2ee69f7046d49d223e4a3d25256e, user_id=2ba81ab7d4ab4c0c9db4d9b83ff0222d, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:01.786975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:01.881273 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4224/8460] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:01 2022] PUT /identity/v3/projects/796d2ee69f7046d49d223e4a3d25256e/users/2ba81ab7d4ab4c0c9db4d9b83ff0222d/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:01.891971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:01.892254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:01.892533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:01.928422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] MFA Rules not processed for user `2ba81ab7d4ab4c0c9db4d9b83ff0222d`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:01.930685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:02.000633 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4237/8461] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:02.012163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.013877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:02.064175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:02.092613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fada7-4bfd-4a58-86d5-1d524b682038 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.100240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1029-4d9f-436c-aade-2f4818c3669e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.100873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1029-4d9f-436c-aade-2f4818c3669e service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.101177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1029-4d9f-436c-aade-2f4818c3669e service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.101470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1029-4d9f-436c-aade-2f4818c3669e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.112817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1029-4d9f-436c-aade-2f4818c3669e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.114270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1029-4d9f-436c-aade-2f4818c3669e service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.124229 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4225/8462] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:02.145141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.212676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd297768-410a-4c72-978e-8a3acfc0652b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.217536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.218189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.218492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.218808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] PATH_INFO: `/v3/users/2ba81ab7d4ab4c0c9db4d9b83ff0222d` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.220520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba81ab7d4ab4c0c9db4d9b83ff0222d)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.222496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.398489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:02.404732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba81ab7d4ab4c0c9db4d9b83ff0222d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:02.412922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba81ab7d4ab4c0c9db4d9b83ff0222d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:02.413637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba81ab7d4ab4c0c9db4d9b83ff0222d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:02.414294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba81ab7d4ab4c0c9db4d9b83ff0222d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:02.426570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba81ab7d4ab4c0c9db4d9b83ff0222d'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:02.492606 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4238/8463] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:34:02 2022] DELETE /identity/v3/users/2ba81ab7d4ab4c0c9db4d9b83ff0222d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:02.497237 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.497532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.497814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.521418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:02.523366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:02.586132 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4226/8464] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:02.596302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:02.597780 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:02.674419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fa32-0629-4422-9cd7-c41868dab3f7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:02.678165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a43a2-8862-431b-a245-1a9b3dcdb8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:02.678781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a43a2-8862-431b-a245-1a9b3dcdb8ad service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:02.679096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a43a2-8862-431b-a245-1a9b3dcdb8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:02.679377 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a43a2-8862-431b-a245-1a9b3dcdb8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:02.691433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a43a2-8862-431b-a245-1a9b3dcdb8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:02.692883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a43a2-8862-431b-a245-1a9b3dcdb8ad service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:02.703283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4239/8465] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:03.162816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.164432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:03.177278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3adb0-1ac3-4eba-9136-cf99e165fdb1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.182204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.182886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.183202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.183486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] PATH_INFO: `/v3/projects/796d2ee69f7046d49d223e4a3d25256e` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.186179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796d2ee69f7046d49d223e4a3d25256e)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.187065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.344664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796d2ee69f7046d49d223e4a3d25256e', 'request_id': 'req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:03.351082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796d2ee69f7046d49d223e4a3d25256e', 'request_id': 'req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:03.356852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796d2ee69f7046d49d223e4a3d25256e', 'request_id': 'req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:03.473742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] The token cache is being invalidate because project 796d2ee69f7046d49d223e4a3d25256e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:34:03.473742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:03.473742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-a99b9afd-e3b5-4cc2-bf8c-6326dbbcc358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:03.473742 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4227/8466] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:34:03 2022] DELETE /identity/v3/projects/796d2ee69f7046d49d223e4a3d25256e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:34:03.480928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.480928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.480928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.500156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:03.501369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:03.595355 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4240/8467] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:03.604423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.604714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.604993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.625890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:03.627238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:03.635497 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4228/8468] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:03.639837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.650488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ab849-6831-4b8d-83d6-be0580db29b9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.655463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.656161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.657063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.657345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.658000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:03.658307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.659957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.672902 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4241/8469] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:03.677366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.686990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfd182-9964-4649-93d3-e236e6c95198 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.691829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.692444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.692732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.693016 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.693652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.695624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.811428 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4229/8470] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:03.815625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.826736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23302d88-380f-4e61-8eec-03ecaa4673c8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:03.877072 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:03.890283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:03.891613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:03.891892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:03.892165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:03.892842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:03.894923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:03.976215 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4242/8471] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:03 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:03.977576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:03.998972 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9cc95-932d-4dd5-851f-6ad40f234d4d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:04.005602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:04.011772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:04.012061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:04.018083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:04.018083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:04.018083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:04.033783 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4230/8472] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:04.035140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:04.046728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b910e-64c6-400b-8a41-35f2d746f6ed admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:04.051692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5220fa-4eed-4779-a35f-4faaf437d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:04.052299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5220fa-4eed-4779-a35f-4faaf437d152 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:04.052586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5220fa-4eed-4779-a35f-4faaf437d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:04.052861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5220fa-4eed-4779-a35f-4faaf437d152 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:04.053502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5220fa-4eed-4779-a35f-4faaf437d152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:04.055190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5220fa-4eed-4779-a35f-4faaf437d152 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:04.067268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4243/8473] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:04.071489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:04.082698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae30fb-f780-4a40-969a-70212d1bf7db admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:04.087635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:04.088302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:04.092551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:04.092551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] PATH_INFO: `/v3/projects/9f04c1e1bd7648ff809cb435cbe8807d/users/992701a1595d4f3f92b8ef4b6ab8a451/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:04.104509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f04c1e1bd7648ff809cb435cbe8807d, user_id=992701a1595d4f3f92b8ef4b6ab8a451, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:04.107206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:04.175806 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4231/8474] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:04 2022] PUT /identity/v3/projects/9f04c1e1bd7648ff809cb435cbe8807d/users/992701a1595d4f3f92b8ef4b6ab8a451/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:04.187073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652857-272d-4218-8d43-269421f80a6f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:04.187369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652857-272d-4218-8d43-269421f80a6f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:04.188157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652857-272d-4218-8d43-269421f80a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:04.220112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-67652857-272d-4218-8d43-269421f80a6f None None] MFA Rules not processed for user `992701a1595d4f3f92b8ef4b6ab8a451`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:04.221437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-67652857-272d-4218-8d43-269421f80a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:04.294933 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4244/8475] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:04.306254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:04.308134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:04.314133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:04.372849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e69a5-4700-4cfb-aac5-95a40bd4fd67 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:04.377175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50a72a-de61-43aa-9c87-9967eeaed4f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:04.377792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50a72a-de61-43aa-9c87-9967eeaed4f1 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:04.378077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50a72a-de61-43aa-9c87-9967eeaed4f1 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:04.378509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50a72a-de61-43aa-9c87-9967eeaed4f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:04.388901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50a72a-de61-43aa-9c87-9967eeaed4f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:04.390382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50a72a-de61-43aa-9c87-9967eeaed4f1 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:04.400296 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4232/8476] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:14.290099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:14.437179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=25 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:22.900569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652857-272d-4218-8d43-269421f80a6f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:22.965771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652857-272d-4218-8d43-269421f80a6f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:22.971117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:22.971744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:22.972070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:22.972390 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] PATH_INFO: `/v3/users/992701a1595d4f3f92b8ef4b6ab8a451` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:22.973564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] RBAC: Authorizing `identity:delete_user(user_id=992701a1595d4f3f92b8ef4b6ab8a451)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:22.975839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:23.126368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992701a1595d4f3f92b8ef4b6ab8a451'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:23.133555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992701a1595d4f3f92b8ef4b6ab8a451'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:23.134247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992701a1595d4f3f92b8ef4b6ab8a451'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:23.134854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992701a1595d4f3f92b8ef4b6ab8a451'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:23.148443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992701a1595d4f3f92b8ef4b6ab8a451'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:23.206227 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4245/8477] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:34:22 2022] DELETE /identity/v3/users/992701a1595d4f3f92b8ef4b6ab8a451 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:23.210878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.212766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.212766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.231192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:23.232486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:23.297865 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4233/8478] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:23.309191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.310636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:23.377333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988469-3155-4c4f-9150-54c352ca126f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.386800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8de46-6b6c-459f-b233-c559ab851db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.387468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8de46-6b6c-459f-b233-c559ab851db6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.388242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8de46-6b6c-459f-b233-c559ab851db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.388242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8de46-6b6c-459f-b233-c559ab851db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.399120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8de46-6b6c-459f-b233-c559ab851db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:23.400630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8de46-6b6c-459f-b233-c559ab851db6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:23.410820 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4246/8479] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:23.901146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:23.901146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:23.916971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8864b-8b37-4730-ad94-96c982c06347 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:23.922023 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:23.925050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:23.925050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:23.925050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] PATH_INFO: `/v3/projects/9f04c1e1bd7648ff809cb435cbe8807d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:23.925715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f04c1e1bd7648ff809cb435cbe8807d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:23.927487 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.084538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f04c1e1bd7648ff809cb435cbe8807d', 'request_id': 'req-241a71a3-4e33-456b-8f41-ee44e2d3d49f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:24.090978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f04c1e1bd7648ff809cb435cbe8807d', 'request_id': 'req-241a71a3-4e33-456b-8f41-ee44e2d3d49f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:24.097400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f04c1e1bd7648ff809cb435cbe8807d', 'request_id': 'req-241a71a3-4e33-456b-8f41-ee44e2d3d49f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:24.160643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] The token cache is being invalidate because project 9f04c1e1bd7648ff809cb435cbe8807d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:34:24.160856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:24.161490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-241a71a3-4e33-456b-8f41-ee44e2d3d49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:24.163073 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4234/8480] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:34:23 2022] DELETE /identity/v3/projects/9f04c1e1bd7648ff809cb435cbe8807d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:24.168222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.168720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.168841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.189604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:24.190863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.209714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:24.254036 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4247/8481] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:24.263164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.268289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.268289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.286090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:24.287383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.295519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4235/8482] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:24.302324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.312770 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac956-6e43-4f42-b4d0-a77f63c755a0 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.317971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.318603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.318883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.319183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.319856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:24.320161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.321786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.334650 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4248/8483] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:24.339172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.349299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72772a90-183f-4532-887d-41ca7b5825f6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.354260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.354893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.355212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.355496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.356137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.358070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.456822 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4236/8484] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:24.461936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.473409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a46fc-90f0-497e-8cef-a0130dece0f1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.531190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.532550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.532836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.533113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.533742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.535725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.620183 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4249/8485] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:24.624309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.635798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bd300-6c36-4b5f-92b9-4437dc62a801 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.640788 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.641877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.642168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.642429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.643094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.644693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.655883 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4237/8486] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:24.660305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.670810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d15e-816f-4fff-9db2-cca25883236a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.675604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87a79-cf40-40ec-8ac2-38a2e66875ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.676211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87a79-cf40-40ec-8ac2-38a2e66875ad admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.676496 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87a79-cf40-40ec-8ac2-38a2e66875ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.676776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87a79-cf40-40ec-8ac2-38a2e66875ad admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.677415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87a79-cf40-40ec-8ac2-38a2e66875ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.679074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87a79-cf40-40ec-8ac2-38a2e66875ad admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.690531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4250/8487] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:24.694974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.705962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da52a1d-1a9e-4c56-a862-fb3dde742d06 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:24.711446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:24.712079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.712362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.712655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] PATH_INFO: `/v3/projects/9c7ba82fe2d044cbbdad652fc33aab67/users/de6d336036a7424c8deb563ecc49798a/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.727909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7ba82fe2d044cbbdad652fc33aab67, user_id=de6d336036a7424c8deb563ecc49798a, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:24.730692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:24.806287 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4238/8488] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:24 2022] PUT /identity/v3/projects/9c7ba82fe2d044cbbdad652fc33aab67/users/de6d336036a7424c8deb563ecc49798a/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:24.819212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:24.819506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:24.819788 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:24.849437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] MFA Rules not processed for user `de6d336036a7424c8deb563ecc49798a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:24.850769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.925539 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4251/8489] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:24.936814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:24.939303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:24.962467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:25.002286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf145e90-3408-4e9c-a610-f8fdc961ff3a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:25.005978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c882fb-3663-49d9-a6ca-ab245a6230ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:25.006641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c882fb-3663-49d9-a6ca-ab245a6230ae service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:25.006854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c882fb-3663-49d9-a6ca-ab245a6230ae service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:25.007160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c882fb-3663-49d9-a6ca-ab245a6230ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:25.015677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c882fb-3663-49d9-a6ca-ab245a6230ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:25.017108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c882fb-3663-49d9-a6ca-ab245a6230ae service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:25.026914 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4239/8490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:34:32.005218 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:32.006807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:32.028332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:32.074778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a862c9-753e-4128-836d-3ca12af8adc4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.081047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.081720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.081998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.082278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] PATH_INFO: `/v3/users/0f883ece2e5e49698d2bd382ab3a40dd` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.083593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f883ece2e5e49698d2bd382ab3a40dd)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.085589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:32.315516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f883ece2e5e49698d2bd382ab3a40dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:32.323130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f883ece2e5e49698d2bd382ab3a40dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:32.323892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f883ece2e5e49698d2bd382ab3a40dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:32.324525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f883ece2e5e49698d2bd382ab3a40dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:32.338868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f883ece2e5e49698d2bd382ab3a40dd'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:32.409093 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4252/8491] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:34:32 2022] DELETE /identity/v3/users/0f883ece2e5e49698d2bd382ab3a40dd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:32.413775 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.414310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.414435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.437220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:32.441165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:32.529977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4240/8492] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:32.541188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:32.545738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:32.603882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494b07d-b495-442f-a025-e3ad2a427d87 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.607543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bc343-d2e0-4b51-9fa5-58abc2633f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.608155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bc343-d2e0-4b51-9fa5-58abc2633f07 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.608440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bc343-d2e0-4b51-9fa5-58abc2633f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.608719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bc343-d2e0-4b51-9fa5-58abc2633f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.618491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bc343-d2e0-4b51-9fa5-58abc2633f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.619973 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bc343-d2e0-4b51-9fa5-58abc2633f07 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:32.629564 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4253/8493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:32.933143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:32.934613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:32.947360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d8c73-966a-4cde-bc25-febb3bc7ac11 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:32.954867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:32.955633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:32.956336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:32.956682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] PATH_INFO: `/v3/projects/0b461b8622c143ce8f77d8b48970cade` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:32.959181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b461b8622c143ce8f77d8b48970cade)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:32.961963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.075976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b461b8622c143ce8f77d8b48970cade', 'request_id': 'req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:33.082722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b461b8622c143ce8f77d8b48970cade', 'request_id': 'req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:33.088644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b461b8622c143ce8f77d8b48970cade', 'request_id': 'req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:33.170869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] The token cache is being invalidate because project 0b461b8622c143ce8f77d8b48970cade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:34:33.171205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:33.171905 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-69c26156-30a3-4c40-9ea8-e3feeccbaaf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:33.173938 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4241/8494] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:34:32 2022] DELETE /identity/v3/projects/0b461b8622c143ce8f77d8b48970cade => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:33.179093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.179566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.179662 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.200371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:33.201621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:33.236656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.263119 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4254/8495] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:33.272407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.272689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.273009 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.294131 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:33.295400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:33.304203 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4242/8496] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:33.308474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.319095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baeb237-941b-45ad-b95e-0b99c6d8306a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.324308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.324926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.325205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.325479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.326184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:33.326429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.328077 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.340314 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4255/8497] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:33.344896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.354616 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336dd33-1a06-4069-bd83-9d224301f881 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.359746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.360350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.361161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.361443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.362056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.364046 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.442351 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4243/8498] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:33 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:33.446861 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.457246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55889e-8240-4669-8c91-1c2410c85e80 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.535926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.536555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.536838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.538352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.538352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.540320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.637092 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4256/8499] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:33 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:33.641215 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.652302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b3eb7-4059-4a7a-b102-56a3d09e9d8f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.658062 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.658667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.658946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.659273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.660218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.661870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.672517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4244/8500] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:33.677439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.688095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3cc9a-1f27-491b-a683-5acd45bbebf6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.692954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e7af5-f836-47f9-b983-feb09776a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.693583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7af5-f836-47f9-b983-feb09776a2cf admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.693884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7af5-f836-47f9-b983-feb09776a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.694154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e7af5-f836-47f9-b983-feb09776a2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.694816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e7af5-f836-47f9-b983-feb09776a2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.696473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e7af5-f836-47f9-b983-feb09776a2cf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.707981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4257/8501] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:33.712194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.723084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b1000-524b-4538-baac-90e61ad4c41e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:33.727845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:33.728507 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.728796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.729106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] PATH_INFO: `/v3/projects/52ca499c5b634be39c2e11a47710355a/users/edfcc0981d364f7bbcb530a03e862844/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.731673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:33.745879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ca499c5b634be39c2e11a47710355a, user_id=edfcc0981d364f7bbcb530a03e862844, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:33.748586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:33.830551 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4245/8502] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:33 2022] PUT /identity/v3/projects/52ca499c5b634be39c2e11a47710355a/users/edfcc0981d364f7bbcb530a03e862844/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:33.839412 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:33.839520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:33.839808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:33.871018 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] MFA Rules not processed for user `edfcc0981d364f7bbcb530a03e862844`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:33.872291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:33.942040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4258/8503] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:33.953367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:33.956018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:34.018592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f1a56-2ae2-40d5-8538-a6ac3d8363c1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:34.022311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68c409-6572-485f-b8fb-4ef7b9e0fc18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:34.022922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68c409-6572-485f-b8fb-4ef7b9e0fc18 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:34.023247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68c409-6572-485f-b8fb-4ef7b9e0fc18 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:34.023532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68c409-6572-485f-b8fb-4ef7b9e0fc18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:34.033246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68c409-6572-485f-b8fb-4ef7b9e0fc18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:34.034695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68c409-6572-485f-b8fb-4ef7b9e0fc18 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:34.044251 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4246/8504] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:43.477743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.479257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:43.522024 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:43.549761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac91d5-ec32-49f4-8a75-fe146cdb8959 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:43.554596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:43.555391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.555717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.555999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] PATH_INFO: `/v3/users/de6d336036a7424c8deb563ecc49798a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.557153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6d336036a7424c8deb563ecc49798a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:43.559117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:43.735872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6d336036a7424c8deb563ecc49798a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:43.742871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6d336036a7424c8deb563ecc49798a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:43.743572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6d336036a7424c8deb563ecc49798a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:43.744186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6d336036a7424c8deb563ecc49798a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:43.756028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6d336036a7424c8deb563ecc49798a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:43.838699 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4259/8505] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:34:43 2022] DELETE /identity/v3/users/de6d336036a7424c8deb563ecc49798a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:43.843422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:43.843907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:43.843997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:43.864965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:43.866318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:43.929445 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4247/8506] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:43.939732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:43.941230 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:44.009634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260065a-37ac-416a-9b3b-5dc8089466e1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.013577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62364422-30ae-4a91-aff8-02a82dfdbc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.014198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364422-30ae-4a91-aff8-02a82dfdbc70 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.014489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364422-30ae-4a91-aff8-02a82dfdbc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.014761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62364422-30ae-4a91-aff8-02a82dfdbc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.025349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62364422-30ae-4a91-aff8-02a82dfdbc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.026803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62364422-30ae-4a91-aff8-02a82dfdbc70 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.037890 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4260/8507] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:44.505148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.508861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:44.569211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d927-27df-4dc6-b1ce-674ebec817ce None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.574224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.574880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.578865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.578865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] PATH_INFO: `/v3/projects/9c7ba82fe2d044cbbdad652fc33aab67` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.578865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7ba82fe2d044cbbdad652fc33aab67)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.578865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.684614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7ba82fe2d044cbbdad652fc33aab67', 'request_id': 'req-437b7531-9666-431b-9630-7185f5b540c6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:44.692743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7ba82fe2d044cbbdad652fc33aab67', 'request_id': 'req-437b7531-9666-431b-9630-7185f5b540c6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:44.694092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:44.700876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7ba82fe2d044cbbdad652fc33aab67', 'request_id': 'req-437b7531-9666-431b-9630-7185f5b540c6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:44.792963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] The token cache is being invalidate because project 9c7ba82fe2d044cbbdad652fc33aab67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:34:44.793293 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:44.793937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-437b7531-9666-431b-9630-7185f5b540c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:44.795526 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4248/8508] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:34:44 2022] DELETE /identity/v3/projects/9c7ba82fe2d044cbbdad652fc33aab67 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:44.801111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.801598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.801708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.821923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:44.823190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:44.881342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:44.896482 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4261/8509] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:44.904840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.905340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.905460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.927561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:44.928942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:44.937741 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4249/8510] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:44.942221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.952601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808bb2b-099b-478a-8882-54dfaa178a12 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.957239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.957849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.958120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.958397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.959062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:44.959372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:44.961044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:44.974761 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4262/8511] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:34:44.979168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:44.989824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefbf5b-1205-43cd-8e93-43b68282bddb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:44.994778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:44.995562 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:44.999904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:44.999904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:44.999904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.000678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.146996 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4250/8512] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:44 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:45.151300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.162198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035099-4e78-4a08-9902-e47531faa239 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.211423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.213135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.225535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.226190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.226476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.226756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.227431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.229603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.279851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b5b6-7bc0-44da-badf-23a76f48a073 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.285350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.286017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.286303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.286584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] PATH_INFO: `/v3/users/edfcc0981d364f7bbcb530a03e862844` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.287752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfcc0981d364f7bbcb530a03e862844)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.289743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.326008 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4263/8513] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:45.330487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.342048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26d8dd-8c51-470f-8ca0-1c3e992c5d37 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.349575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.350361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.350656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.350935 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.351627 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.353354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.364611 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4264/8514] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:45.368481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.378541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303c00-4936-40a7-ab9d-48eed88c21af admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.383367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.383957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.384243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.384518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.385179 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.386836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.397318 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4265/8515] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:34:45.401632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.412101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a4dce-daf0-46a9-94e5-fb122b4763b5 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.416784 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6146b0-64f5-4d29-9542-1d7f7579431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.417409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6146b0-64f5-4d29-9542-1d7f7579431a admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.420899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6146b0-64f5-4d29-9542-1d7f7579431a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.420899 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6146b0-64f5-4d29-9542-1d7f7579431a admin admin] PATH_INFO: `/v3/projects/885d773a019e4be7b5af2f254e0a5316/users/8491f673a7194278a76280aa9b61648c/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.433912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6146b0-64f5-4d29-9542-1d7f7579431a admin admin] RBAC: Authorizing `identity:create_grant(project_id=885d773a019e4be7b5af2f254e0a5316, user_id=8491f673a7194278a76280aa9b61648c, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.438217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6146b0-64f5-4d29-9542-1d7f7579431a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.532853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfcc0981d364f7bbcb530a03e862844'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:45.540055 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfcc0981d364f7bbcb530a03e862844'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:45.540795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfcc0981d364f7bbcb530a03e862844'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:45.552874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfcc0981d364f7bbcb530a03e862844'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:45.553561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-32521ac2-b60b-416b-a22b-9eab9b5a8ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfcc0981d364f7bbcb530a03e862844'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:45.568719 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4266/8516] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:45 2022] PUT /identity/v3/projects/885d773a019e4be7b5af2f254e0a5316/users/8491f673a7194278a76280aa9b61648c/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:34:45.580911 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.581198 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.581487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.608848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] MFA Rules not processed for user `8491f673a7194278a76280aa9b61648c`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:45.610061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.638107 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4251/8517] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:34:45 2022] DELETE /identity/v3/users/edfcc0981d364f7bbcb530a03e862844 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:34:45.643144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.643451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.643734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.663118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:45.664343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.681377 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4267/8518] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:45.685999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.687363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.694543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:45.702597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:45.727206 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4252/8519] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:45.737406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.739254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:45.756675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e382c6-35df-4236-99f9-1c80af46ecc5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.761629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.762341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.762767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.763080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.763715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.765640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.800224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cc40c-1cd2-438b-b08c-30657ec6e6b4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.803859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.804493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.804772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.805043 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.814701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.816166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:45.826721 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4253/8520] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:34:45.870467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4268/8521] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:45.874506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:45.885321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50813-1645-44d9-ada3-82b95678f907 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:45.944358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:45.945024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:45.945248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:45.945529 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:45.946163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:45.948129 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.079564 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4254/8522] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:45 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:46.080888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.092697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6235750-10c7-466c-85f3-0394789fc964 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.098943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.099982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.100397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.100742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.101589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.103409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.114889 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4269/8523] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:34:46.130207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.144597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a7dc-4f53-42f8-8ff3-e6b7e1be95f6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.151226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47398d7-86ed-4674-b988-d12fbe878631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.151226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47398d7-86ed-4674-b988-d12fbe878631 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.151226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47398d7-86ed-4674-b988-d12fbe878631 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.151226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47398d7-86ed-4674-b988-d12fbe878631 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.151759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47398d7-86ed-4674-b988-d12fbe878631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.153450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47398d7-86ed-4674-b988-d12fbe878631 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.167281 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4255/8524] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:46.168501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.179745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a39e2-3db3-4b02-a92a-0e5ba4daae87 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.184407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.185067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.185348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.185621 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] PATH_INFO: `/v3/projects/179d10d0e24f4e4e9300168f572aa804/users/07dcd499c82f4d9f855b7398c5525731/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.210226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179d10d0e24f4e4e9300168f572aa804, user_id=07dcd499c82f4d9f855b7398c5525731, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.214414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.298468 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4270/8525] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:46 2022] PUT /identity/v3/projects/179d10d0e24f4e4e9300168f572aa804/users/07dcd499c82f4d9f855b7398c5525731/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:46.308946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859e736-542c-485b-b94b-33360798bed1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.309326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859e736-542c-485b-b94b-33360798bed1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.309532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859e736-542c-485b-b94b-33360798bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.326295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.328673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:46.357734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3859e736-542c-485b-b94b-33360798bed1 None None] MFA Rules not processed for user `07dcd499c82f4d9f855b7398c5525731`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:46.358426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3859e736-542c-485b-b94b-33360798bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:46.407795 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.410124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf815e-412c-4ec2-b48f-01f2c8f1c755 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.415550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.418583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.418583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.418583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] PATH_INFO: `/v3/projects/52ca499c5b634be39c2e11a47710355a` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.418583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ca499c5b634be39c2e11a47710355a)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.420001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.433850 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4256/8526] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:46.438296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859e736-542c-485b-b94b-33360798bed1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.449130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859e736-542c-485b-b94b-33360798bed1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.454298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.458606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.458606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.458606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.458606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.458606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.518289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ca499c5b634be39c2e11a47710355a', 'request_id': 'req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:46.523690 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4257/8527] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:46.527023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ca499c5b634be39c2e11a47710355a', 'request_id': 'req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:46.527973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.535320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ca499c5b634be39c2e11a47710355a', 'request_id': 'req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:46.538050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:46.593117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97384-efeb-4774-a661-f1fdaeffcece admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.598494 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.599133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.599446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.599745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.600366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.602277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.656235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] The token cache is being invalidate because project 52ca499c5b634be39c2e11a47710355a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:34:46.656529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:46.657684 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-c68197b4-9dd9-4dd8-9074-2b51d5772e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:34:46.659223 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4271/8528] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:34:46 2022] DELETE /identity/v3/projects/52ca499c5b634be39c2e11a47710355a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:46.664019 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a118-ec78-4629-80a4-9ae97c00a554 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.664308 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a118-ec78-4629-80a4-9ae97c00a554 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.664589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a118-ec78-4629-80a4-9ae97c00a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.685331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-39d2a118-ec78-4629-80a4-9ae97c00a554 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:46.686482 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-39d2a118-ec78-4629-80a4-9ae97c00a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:46.694811 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4272/8529] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:46.702673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.702958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.703267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.731453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:46.733240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:46.745199 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4273/8530] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:46.752322 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4258/8531] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:46.752507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.752704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.754301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:46.762668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e94d2-b027-4952-94b7-dc99a4e08e7f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.767970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebc662-377d-4768-96b2-e2460e01dc30 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.770410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.771463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.771942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.772433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.772810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.773411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.773583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:34:46.773692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.773955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.774118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.774596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.776233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.776411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.788967 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4259/8532] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:34:46.792822 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4274/8533] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:34:46.795804 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.796137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.806170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e848abd-e470-4723-8133-4b411c46ee11 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.806698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7054c-9bd9-49ed-9114-0a706a269858 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:46.811152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.811543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:46.811764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.812054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.812203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:46.812332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.812489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:46.812769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] PATH_INFO: `/v3/projects/29a256ec16ef4f9e8da371448316ccba/users/aafe5ddfdde242979d7318434b0e61af/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:46.812972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.814927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.830406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a256ec16ef4f9e8da371448316ccba, user_id=aafe5ddfdde242979d7318434b0e61af, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:46.833160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:46.970040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4275/8534] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:46.974003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:46.980511 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4260/8535] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:46 2022] PUT /identity/v3/projects/29a256ec16ef4f9e8da371448316ccba/users/aafe5ddfdde242979d7318434b0e61af/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:46.988399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.043587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd17fca-94d7-456f-a1e2-02f782b30899 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.062250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b856-1b9d-42b5-8610-ec390169b2f2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.067667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.068939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.069463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.069917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.070584 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.072438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.086452 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4261/8536] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:47.090941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.103963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c10e13-a9ba-424e-9d8a-db1b9a99bc97 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.111169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10d17b-a3d9-4632-a87a-bb56a175c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.112193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d17b-a3d9-4632-a87a-bb56a175c939 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.112661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d17b-a3d9-4632-a87a-bb56a175c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.113148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d17b-a3d9-4632-a87a-bb56a175c939 admin admin] PATH_INFO: `/v3/projects/29a256ec16ef4f9e8da371448316ccba/users/aafe5ddfdde242979d7318434b0e61af/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.116332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10d17b-a3d9-4632-a87a-bb56a175c939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a256ec16ef4f9e8da371448316ccba, user_id=aafe5ddfdde242979d7318434b0e61af, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.119786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.120399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.120679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.120951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10d17b-a3d9-4632-a87a-bb56a175c939 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.121081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.121767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.123756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.131497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:47.138487 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4262/8537] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:47 2022] PUT /identity/v3/projects/29a256ec16ef4f9e8da371448316ccba/users/aafe5ddfdde242979d7318434b0e61af/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:34:47.155860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.156155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.156440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.185844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] MFA Rules not processed for user `aafe5ddfdde242979d7318434b0e61af`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:47.187122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:47.245231 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4276/8538] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:46 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:34:47.249203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.259695 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e18c8-ea40-4799-9efe-be5bed401daf admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.259945 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4263/8539] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:47.271397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.272880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:47.301606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:47.317726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.318341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.318652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.318929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.319596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.321187 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.331268 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4277/8540] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:47.334755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386935c-d0f8-4381-b45d-4cb8b1b49cf0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.335578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.338522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.339185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.339470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.339747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.341668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:47.346630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f1161-846b-4f3e-8a1f-f16e7ae8eb4b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.352799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.353324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.353616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.353946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.354616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.356337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.372460 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4278/8541] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:34:47.376485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.384565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d40f3-a7fe-4412-ae1d-16ca6fe9ea0b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.389565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.390256 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.390546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.391046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] PATH_INFO: `/v3/projects/aa117f0cf74342a3b24c0c247565a6c7/users/fcaddf25fc12498b90d2cc1ec08e5da3/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.409005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa117f0cf74342a3b24c0c247565a6c7, user_id=fcaddf25fc12498b90d2cc1ec08e5da3, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.411943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.427639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.430275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645e01-df31-43c4-8ea9-3f677a573316 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.440858 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4264/8542] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:34:47.475367 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4279/8543] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:47 2022] PUT /identity/v3/projects/aa117f0cf74342a3b24c0c247565a6c7/users/fcaddf25fc12498b90d2cc1ec08e5da3/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:47.594063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.594992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.595382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.626812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] MFA Rules not processed for user `fcaddf25fc12498b90d2cc1ec08e5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:47.628130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:47.662173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:47.701977 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4265/8544] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:34:47.707055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.771304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda1b5-efc3-4245-9ca4-9d02f00933fb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.776080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.776624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.776904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.777176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.778106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.780040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:47.866627 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4280/8545] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:34:47 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:47.870716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:47.882424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e53e0-0b53-4a2b-89fb-9c2b02350c4b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:47.954500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:47.955167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:47.955450 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:47.955729 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:47.956366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:47.958303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:48.069704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4266/8546] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:34:47 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:34:48.073779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:48.085262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa436b-2be5-4aeb-a94f-730f9554e8a6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:48.089968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:48.090577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.090856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.091164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.091830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:48.093469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:48.104961 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4281/8547] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:34:48.109593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:48.120456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc332c5-f160-489d-8571-23c641965ec7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:48.126104 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:48.126920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.127240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.127523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] PATH_INFO: `/v3/projects/04385e36a65e4f41aab4eceff7b42e68/users/f25ab44649ae45ab99061c93809e55d9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.145930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=04385e36a65e4f41aab4eceff7b42e68, user_id=f25ab44649ae45ab99061c93809e55d9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:48.148672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:48.238455 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4267/8548] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:48 2022] PUT /identity/v3/projects/04385e36a65e4f41aab4eceff7b42e68/users/f25ab44649ae45ab99061c93809e55d9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:34:48.242484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:48.253480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfff20b-9d69-471f-86b4-88f45c98b200 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:48.311185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ef561-424e-4bd4-825e-36577096f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:48.311693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef561-424e-4bd4-825e-36577096f010 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.311975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef561-424e-4bd4-825e-36577096f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.312245 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ef561-424e-4bd4-825e-36577096f010 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.312874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ef561-424e-4bd4-825e-36577096f010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:48.315170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ef561-424e-4bd4-825e-36577096f010 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:48.324895 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4282/8549] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:34:48.329030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:48.340290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e954d2-d845-4b7b-beec-fa5aade6b5bb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:48.345830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:48.346429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.346766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.347144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] PATH_INFO: `/v3/projects/04385e36a65e4f41aab4eceff7b42e68/users/f25ab44649ae45ab99061c93809e55d9/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.353773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=04385e36a65e4f41aab4eceff7b42e68, user_id=f25ab44649ae45ab99061c93809e55d9, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:48.353773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:48.363615 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4268/8550] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:34:48 2022] PUT /identity/v3/projects/04385e36a65e4f41aab4eceff7b42e68/users/f25ab44649ae45ab99061c93809e55d9/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:34:48.373152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.373446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.373726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.400282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:48.403634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] MFA Rules not processed for user `f25ab44649ae45ab99061c93809e55d9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:48.404885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:48.481417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4283/8551] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:34:48.498401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:48.500294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:48.583721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b42a3-a545-4e4f-a8c5-27ce5a25c5ea admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:48.589590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:48.590225 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:48.592298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:48.592298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:48.610566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:48.653502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:48.655358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:48.668929 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4269/8552] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:49.381444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:49.446765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356546f0-abbd-4f7c-aaa5-8586d59a4bec None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:49.450659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:49.451171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:49.451458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:49.451739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:49.453670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:49.520696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:49.522061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:49.532884 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4284/8553] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:51.132395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:51.149561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69972-f604-4e7e-92e3-dafbc003ab5a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:51.153912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec14c3-300b-4ee5-a5bf-37058c33ce24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:51.161730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec14c3-300b-4ee5-a5bf-37058c33ce24 service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:51.161730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec14c3-300b-4ee5-a5bf-37058c33ce24 service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:51.161730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec14c3-300b-4ee5-a5bf-37058c33ce24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:51.219428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec14c3-300b-4ee5-a5bf-37058c33ce24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:51.220863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec14c3-300b-4ee5-a5bf-37058c33ce24 service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:51.230967 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4270/8554] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:55.040205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:34:55.043543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:55.129306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebfccf-a483-494a-8948-567421bace5f service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:34:55.133405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:34:55.134357 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:55.134717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:55.135307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:55.146051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:34:55.150025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:34:55.150888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:34:55.162285 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4285/8555] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:34:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:34:59.118203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cb9eb-48e9-4da5-a407-07850eeb9744 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:34:59.118203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cb9eb-48e9-4da5-a407-07850eeb9744 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:34:59.118690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cb9eb-48e9-4da5-a407-07850eeb9744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:34:59.140224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c18cb9eb-48e9-4da5-a407-07850eeb9744 None None] MFA Rules not processed for user `fcaddf25fc12498b90d2cc1ec08e5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:34:59.142147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c18cb9eb-48e9-4da5-a407-07850eeb9744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:34:59.151495 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4271/8556] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:34:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:35:01.521600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:01.591529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5de9-1cc5-4cbe-8cfb-14f6e826f3bc service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:01.596883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:01.597532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:01.597820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:01.598107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] PATH_INFO: `/v3/users/8491f673a7194278a76280aa9b61648c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:01.599352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8491f673a7194278a76280aa9b61648c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:01.601319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:01.920566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8491f673a7194278a76280aa9b61648c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:01.930860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8491f673a7194278a76280aa9b61648c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:01.931804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8491f673a7194278a76280aa9b61648c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:01.932478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8491f673a7194278a76280aa9b61648c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:01.955645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8491f673a7194278a76280aa9b61648c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:02.048380 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4286/8557] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:35:01 2022] DELETE /identity/v3/users/8491f673a7194278a76280aa9b61648c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:02.053250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.053745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.053841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.075501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:02.076870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:02.152557 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4272/8558] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:35:02.163247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.164670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:02.227208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cd5ba-517e-41e8-b39c-13db0f64de1f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.230822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.231793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.232081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.232356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.242087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.243587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.254575 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4287/8559] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:02.749936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:02.750605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:02.764321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b1be-9f30-4299-b1a2-e462c2a736c4 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:02.786343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:02.787077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:02.787319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:02.787701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] PATH_INFO: `/v3/projects/885d773a019e4be7b5af2f254e0a5316` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:02.791527 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=885d773a019e4be7b5af2f254e0a5316)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:02.793611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:02.917849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:02.929502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885d773a019e4be7b5af2f254e0a5316', 'request_id': 'req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:02.940675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885d773a019e4be7b5af2f254e0a5316', 'request_id': 'req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:02.948349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885d773a019e4be7b5af2f254e0a5316', 'request_id': 'req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.073112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] The token cache is being invalidate because project 885d773a019e4be7b5af2f254e0a5316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:35:03.073752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.074239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.075862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4273/8560] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:35:02 2022] DELETE /identity/v3/projects/885d773a019e4be7b5af2f254e0a5316 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:03.081468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:03.096571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f61b34-0d91-42cd-8a1d-75aa2313c6be service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:03.114535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:03.164779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:03.170656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:03.170656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:03.170656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] PATH_INFO: `/v3/users/07dcd499c82f4d9f855b7398c5525731` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:03.170656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07dcd499c82f4d9f855b7398c5525731)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:03.170656 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:03.402521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07dcd499c82f4d9f855b7398c5525731'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.409922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07dcd499c82f4d9f855b7398c5525731'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.410632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07dcd499c82f4d9f855b7398c5525731'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.411291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07dcd499c82f4d9f855b7398c5525731'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.424958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07dcd499c82f4d9f855b7398c5525731'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:03.507516 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4288/8561] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:35:03 2022] DELETE /identity/v3/users/07dcd499c82f4d9f855b7398c5525731 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:04.086752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:04.088391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:04.090725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:04.092311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:04.103869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2462e3-ea38-4c3e-b91c-0e0cf3f47885 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:04.177789 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:04.178560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:04.178998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:04.179439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] PATH_INFO: `/v3/projects/179d10d0e24f4e4e9300168f572aa804` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:04.180680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=179d10d0e24f4e4e9300168f572aa804)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:04.182817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:04.195823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21501e-e191-4a69-a51f-f2ca866c8486 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:04.199500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:04.200117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:04.200396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:04.200692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:04.202400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:04.215376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:04.216815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:04.228121 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4289/8562] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:35:04.308218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179d10d0e24f4e4e9300168f572aa804', 'request_id': 'req-c4da6bc8-2013-4aa9-bf8f-11808230e54f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.315534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179d10d0e24f4e4e9300168f572aa804', 'request_id': 'req-c4da6bc8-2013-4aa9-bf8f-11808230e54f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.321787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179d10d0e24f4e4e9300168f572aa804', 'request_id': 'req-c4da6bc8-2013-4aa9-bf8f-11808230e54f'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.402702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] The token cache is being invalidate because project 179d10d0e24f4e4e9300168f572aa804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:35:04.403287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.403938 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.405615 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4274/8563] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:35:04 2022] DELETE /identity/v3/projects/179d10d0e24f4e4e9300168f572aa804 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:04.409663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:04.411269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:04.426706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87c58f-8930-4484-828f-8c70b4869302 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:04.436397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:04.488600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:04.496252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:04.496252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:04.496252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] PATH_INFO: `/v3/users/aafe5ddfdde242979d7318434b0e61af` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:04.496252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafe5ddfdde242979d7318434b0e61af)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:04.496252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:04.688445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafe5ddfdde242979d7318434b0e61af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.696842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafe5ddfdde242979d7318434b0e61af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.697715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafe5ddfdde242979d7318434b0e61af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.698454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafe5ddfdde242979d7318434b0e61af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.715932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-87b2e5a9-f0c0-4f40-bafd-0ed4ab23e56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafe5ddfdde242979d7318434b0e61af'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:04.829404 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4290/8564] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:35:04 2022] DELETE /identity/v3/users/aafe5ddfdde242979d7318434b0e61af => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:05.413269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:05.415396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:05.430121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da6bc8-2013-4aa9-bf8f-11808230e54f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:05.496430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:05.497292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.497641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.497992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] PATH_INFO: `/v3/projects/29a256ec16ef4f9e8da371448316ccba` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.499296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a256ec16ef4f9e8da371448316ccba)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:05.503083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:05.504833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:05.683330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a256ec16ef4f9e8da371448316ccba', 'request_id': 'req-38001812-362f-4fa2-b250-c8002b2fb1a5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:05.690401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a256ec16ef4f9e8da371448316ccba', 'request_id': 'req-38001812-362f-4fa2-b250-c8002b2fb1a5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:05.699172 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a256ec16ef4f9e8da371448316ccba', 'request_id': 'req-38001812-362f-4fa2-b250-c8002b2fb1a5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:05.776602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] The token cache is being invalidate because project 29a256ec16ef4f9e8da371448316ccba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:35:05.777178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:05.778587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-38001812-362f-4fa2-b250-c8002b2fb1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:05.780376 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4275/8565] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:35:05 2022] DELETE /identity/v3/projects/29a256ec16ef4f9e8da371448316ccba => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:05.791801 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.792365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.793274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.817626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:05.818614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:05.912785 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4291/8566] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:35:05.920545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.920825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.921107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.942716 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:05.943971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:05.953769 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4276/8567] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:35:05.957743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:05.968933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8dcd0-51f3-43ba-a6a1-340b06d80fc5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:05.975574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:05.977551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:05.977551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:05.977551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:05.978624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:35:05.979059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:05.982776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.004111 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4292/8568] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:35:06.008448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.021776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4e9a3-df47-405b-9588-2c5cbd08916a None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.035655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.036284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.036568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.036843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.037510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.039821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.150170 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4277/8569] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:06.154570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.165569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1830764-8e98-4d7d-9b69-ba154dbfd502 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.191635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:06.233556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.234087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.234884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.235200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.235833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.237757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.339774 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4293/8570] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:35:06.344010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.355534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d102-f903-440e-a9f3-e64bc84fd6c4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.362649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.363508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.363867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.363867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.364515 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.366182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.377345 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4278/8571] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:35:06.381616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.391946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5492d-5884-4ee0-862b-1c683b6729ce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.397258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb75d-5abe-4848-a9f8-9d53aac9a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.397865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb75d-5abe-4848-a9f8-9d53aac9a76e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.398151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb75d-5abe-4848-a9f8-9d53aac9a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.398429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb75d-5abe-4848-a9f8-9d53aac9a76e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.399105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb75d-5abe-4848-a9f8-9d53aac9a76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.400709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb75d-5abe-4848-a9f8-9d53aac9a76e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.413366 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4294/8572] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:35:06.417896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.428933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b055a4-4886-402e-9c1e-1bb5430688be admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.433614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.434261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.434545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.434822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] PATH_INFO: `/v3/projects/513a724139144d89943edb4fe314d503/users/c279952b2ec548e582e0a3135f244541/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.450866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] RBAC: Authorizing `identity:create_grant(project_id=513a724139144d89943edb4fe314d503, user_id=c279952b2ec548e582e0a3135f244541, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.453620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.526217 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4279/8573] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:35:06 2022] PUT /identity/v3/projects/513a724139144d89943edb4fe314d503/users/c279952b2ec548e582e0a3135f244541/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:35:06.538123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.538123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.538415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.569076 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] MFA Rules not processed for user `c279952b2ec548e582e0a3135f244541`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:06.570311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:06.635899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4295/8574] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:35:06.647115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:06.648874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:06.709596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699a8c-90a3-4047-b964-c2973b79569d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:06.713331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:06.713991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:06.714298 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:06.714575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:06.724111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:06.725537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:06.739617 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4280/8575] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:16.632856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:16.730603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:46.959485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:46.961091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:47.033970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39bb87-225f-43c6-b5f5-3d5fce3f949e None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.038316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.038930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.039241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.039516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.041311 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:47.125184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.127399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.166238 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4296/8576] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:47.604388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:47.617837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7d006-e6d9-4267-8c76-429b4d9ee32b service cinder] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:47.621743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:47.622463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:47.622750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:47.623056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:47.627451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:47.643895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:47.645334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:47.662468 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4281/8577] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:48.201817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.215719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ee64-0861-4a20-a5e0-006e7189d776 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.222676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.222676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.222676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.222676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.223622 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:48.236057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.238046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.249762 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4297/8578] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:48.280484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:48.281882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:48.365156 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3dab0-5866-4837-9f17-5c9ee91c90b8 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:48.370903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:48.371612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:48.371900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:48.372181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:48.374137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:48.390394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:48.392948 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:48.412146 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4282/8579] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:49.001683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:49.017045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100f090-4136-4e1f-b075-11e410274d66 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:49.022750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:49.023410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.023746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.023991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.030737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:49.051639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:49.051639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:49.060014 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4298/8580] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:49.291168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:49.293429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:49.319330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc314e-484a-4994-866f-a477e6247638 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:49.327512 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:49.328572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.328965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.329425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.334936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:49.355044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:49.365071 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7858-0068-410d-bf6e-24c2f05f29e9 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:49.371797 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4283/8581] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:49.826124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:49.826124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:49.841109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82accc18-c991-4c27-8ab7-8e30bf49172c service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:49.845129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:49.845729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:49.846010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:49.848714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:49.848714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:49.867064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:49.871733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:49.883038 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4299/8582] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:35:53.980057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d09b37-787c-416f-8894-fae0427e7653 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:53.980620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d09b37-787c-416f-8894-fae0427e7653 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:53.980620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d09b37-787c-416f-8894-fae0427e7653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:54.001083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d9d09b37-787c-416f-8894-fae0427e7653 None None] MFA Rules not processed for user `4a1fe9d40733413a9c56393762549c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:35:54.002286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d9d09b37-787c-416f-8894-fae0427e7653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:35:54.078676 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4284/8583] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:35:59.628054 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:35:59.712082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:35:59.730700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2061b-d241-4d5f-8730-f9d0bacba6d9 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:35:59.733855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:35:59.734616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:35:59.735075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:35:59.735521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] PATH_INFO: `/v3/users/c279952b2ec548e582e0a3135f244541` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:35:59.737046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c279952b2ec548e582e0a3135f244541)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:35:59.740294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:35:59.908648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c279952b2ec548e582e0a3135f244541'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:59.916596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c279952b2ec548e582e0a3135f244541'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:59.917345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c279952b2ec548e582e0a3135f244541'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:59.917963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c279952b2ec548e582e0a3135f244541'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:35:59.930768 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c279952b2ec548e582e0a3135f244541'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:36:00.044384 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4300/8584] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:35:59 2022] DELETE /identity/v3/users/c279952b2ec548e582e0a3135f244541 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:00.049044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.052482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.052482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.092566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:00.093832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:00.148223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:00.162481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4285/8585] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:36:00.172199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:00.173661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:00.234679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eac87-0826-4fd4-8bf4-22dc552561eb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:00.239099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da953559-f8c1-41b5-8ea1-12b3ae7da553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:00.239722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da953559-f8c1-41b5-8ea1-12b3ae7da553 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.240006 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da953559-f8c1-41b5-8ea1-12b3ae7da553 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.240291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da953559-f8c1-41b5-8ea1-12b3ae7da553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.256047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da953559-f8c1-41b5-8ea1-12b3ae7da553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:00.257488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da953559-f8c1-41b5-8ea1-12b3ae7da553 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:00.267492 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4301/8586] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:36:00.729843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:00.732324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:00.751541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a8c6-89d3-4be2-9331-65fb6eab0221 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:00.758887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:00.759630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:00.759893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:00.760175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] PATH_INFO: `/v3/projects/513a724139144d89943edb4fe314d503` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:00.761462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513a724139144d89943edb4fe314d503)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:00.763462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:00.891649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513a724139144d89943edb4fe314d503', 'request_id': 'req-b26d48eb-b8e8-4128-a0cc-5946aed70a36'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:36:00.899622 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513a724139144d89943edb4fe314d503', 'request_id': 'req-b26d48eb-b8e8-4128-a0cc-5946aed70a36'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:36:00.913648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513a724139144d89943edb4fe314d503', 'request_id': 'req-b26d48eb-b8e8-4128-a0cc-5946aed70a36'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:36:00.995128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] The token cache is being invalidate because project 513a724139144d89943edb4fe314d503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:36:00.995424 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:36:00.996063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b26d48eb-b8e8-4128-a0cc-5946aed70a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:36:00.997679 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4286/8587] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:36:00 2022] DELETE /identity/v3/projects/513a724139144d89943edb4fe314d503 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:01.003020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.003508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.003751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.056173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:01.057438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:01.115467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:01.137100 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4302/8588] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:36:01.150367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.150367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.150367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.174226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:01.175496 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:01.183819 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4287/8589] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:36:01.188305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.199638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e008f-5db9-43a2-bace-4edcd261fc4d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.204996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.207830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.207830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.207830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.207830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:36:01.207830 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.209470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.222503 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4303/8590] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:36:01.228373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.238056 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6dce30-a8a1-4c0c-9d24-253082e64ec0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.242781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.243418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.243721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.243996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.244625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.246563 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.369033 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4288/8591] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:01.372948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.386699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3286da9-665b-4d99-b2d7-e6f07b8ced8f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.470922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.471546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.471832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.472748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.473427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.475405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.585476 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4304/8592] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:01.586647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.598060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbdce-7218-42ef-bf41-2ca6cf5e18a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.607451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.608165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.608452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.608725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.609799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.611744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.623545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.625753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:01.626543 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4289/8593] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:36:01.630887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.641863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e31568-2c76-47c0-9bd9-93e09d39169a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.646880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.647672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.647959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.648556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.649355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.650999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.663241 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4290/8594] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:36:01.667452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:01.687412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e454-03bb-4ec1-9669-d31f0557581c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.693680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509062-099a-4589-b3fa-49e415e3c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.694363 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509062-099a-4589-b3fa-49e415e3c98a admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.694674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509062-099a-4589-b3fa-49e415e3c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.694925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509062-099a-4589-b3fa-49e415e3c98a admin admin] PATH_INFO: `/v3/projects/d3a7bd2f2a3d4318bc4445e9c4be13fb/users/cde9fe6d32c54f008d430dc9d3ef6e47/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.724426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb509062-099a-4589-b3fa-49e415e3c98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a7bd2f2a3d4318bc4445e9c4be13fb, user_id=cde9fe6d32c54f008d430dc9d3ef6e47, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.725176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb509062-099a-4589-b3fa-49e415e3c98a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.763860 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed869e-54b9-4a95-9757-c1b7591c05c6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:01.770422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:01.771186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.771473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.771776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.773653 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:01.838405 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4291/8595] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:36:01 2022] PUT /identity/v3/projects/d3a7bd2f2a3d4318bc4445e9c4be13fb/users/cde9fe6d32c54f008d430dc9d3ef6e47/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:36:01.852238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:01.852842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:01.853291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:01.853495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:01.855279 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:01.860275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:01.870443 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4305/8596] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:36:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:36:01.934010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] MFA Rules not processed for user `cde9fe6d32c54f008d430dc9d3ef6e47`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:01.935997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:02.011970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.074000 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4292/8597] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:36:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:36:02.075923 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.091403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361616e-cafd-45f2-af36-ba839fc9ef21 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.187065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.187065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.187065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.187065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.187610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.187610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.289444 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4306/8598] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:36:02 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:02.293768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.304872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cb07-4d4a-4f7c-8872-bbe118fa5a74 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.362090 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.362728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.363037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.363313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.363947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.365860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.464926 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4293/8599] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:36:02 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:36:02.469199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.482374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae952-3fe0-43e0-8fda-cf56a7e185ae admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.487396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.488734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.488734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.488734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.489278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.491093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.513439 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4307/8600] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:36:02.518283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.529880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7dbd4-470c-4633-adf0-09f4fd7f1af0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.535339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.536052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.536339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.536634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] PATH_INFO: `/v3/projects/673c6c01b4bf43e69d3c836d525e051f/users/30746e47c87447ffa514b16757684102/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.553739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=673c6c01b4bf43e69d3c836d525e051f, user_id=30746e47c87447ffa514b16757684102, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.556533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.641300 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4294/8601] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:36:02 2022] PUT /identity/v3/projects/673c6c01b4bf43e69d3c836d525e051f/users/30746e47c87447ffa514b16757684102/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:36:02.647194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.657536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b584-133e-4cee-8833-bab342a4527e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.716147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159488d-40ed-43df-9106-e6bb0b5474e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.716751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159488d-40ed-43df-9106-e6bb0b5474e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.717034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159488d-40ed-43df-9106-e6bb0b5474e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.717307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159488d-40ed-43df-9106-e6bb0b5474e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.717936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159488d-40ed-43df-9106-e6bb0b5474e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.719566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159488d-40ed-43df-9106-e6bb0b5474e2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.729373 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4308/8602] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:36:02.733600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.744429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a778-f875-4b29-a3a2-ebc0570310ab admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.749765 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.750418 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.750701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.750981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] PATH_INFO: `/v3/projects/673c6c01b4bf43e69d3c836d525e051f/users/30746e47c87447ffa514b16757684102/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.753045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673c6c01b4bf43e69d3c836d525e051f, user_id=30746e47c87447ffa514b16757684102, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:02.756242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:02.766647 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4295/8603] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:36:02 2022] PUT /identity/v3/projects/673c6c01b4bf43e69d3c836d525e051f/users/30746e47c87447ffa514b16757684102/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:36:02.777582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.777873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.778204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:02.806891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] MFA Rules not processed for user `30746e47c87447ffa514b16757684102`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:02.808147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:02.874287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:02.887718 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4309/8604] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:36:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:36:02.900160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:02.902634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:02.968236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26857a-24be-4192-90d3-2d8c05bd87b4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:02.972072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c344dc8-649f-4fdc-9641-a4393aa9197b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:02.972683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c344dc8-649f-4fdc-9641-a4393aa9197b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:02.972963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c344dc8-649f-4fdc-9641-a4393aa9197b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:02.973236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c344dc8-649f-4fdc-9641-a4393aa9197b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:03.018944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:03.031561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c344dc8-649f-4fdc-9641-a4393aa9197b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:03.032999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c344dc8-649f-4fdc-9641-a4393aa9197b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:03.042407 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4296/8605] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:36:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:36:06.591422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:06.595752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:06.617518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d1508-7668-47e4-8cfb-49c072e27f6b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:06.622057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:06.622922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:06.623363 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:06.623925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:06.639044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:06.641441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:06.657648 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4310/8606] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:36:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:36:13.086645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:16.025979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4878a-67d5-4be7-9f5f-31587401ca05 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:16.026601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4878a-67d5-4be7-9f5f-31587401ca05 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:16.026601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4878a-67d5-4be7-9f5f-31587401ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:16.048203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2fe4878a-67d5-4be7-9f5f-31587401ca05 None None] MFA Rules not processed for user `cde9fe6d32c54f008d430dc9d3ef6e47`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:36:16.049438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2fe4878a-67d5-4be7-9f5f-31587401ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:16.057512 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4297/8607] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:36:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:36:16.651555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:26.041890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:36:50.441460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:36:50.443290 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:50.531096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acb9a1-d90e-46d2-815a-5ac4c57b180a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:36:50.536392 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:36:50.537008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:36:50.537288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:36:50.537561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:36:50.540121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:36:50.559108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:36:50.560951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee5eb-c5e1-45db-9d9a-2646b9744ea1 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:36:50.586623 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4311/8608] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:36:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:37:00.433190 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec856740-d815-415b-a7bb-4428e0217ef6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:00.433743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec856740-d815-415b-a7bb-4428e0217ef6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:00.433743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec856740-d815-415b-a7bb-4428e0217ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:00.457117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ec856740-d815-415b-a7bb-4428e0217ef6 None None] MFA Rules not processed for user `fcaddf25fc12498b90d2cc1ec08e5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:00.458345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec856740-d815-415b-a7bb-4428e0217ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:00.525940 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4298/8609] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:37:00.573008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=36 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:10.518835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=25 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:12.196323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:12.196783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:12.198029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:12.219178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] MFA Rules not processed for user `cde9fe6d32c54f008d430dc9d3ef6e47`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:12.220440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:12.232258 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4312/8610] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:37:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:37:22.212416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:48.571307 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748947b-3ed5-4c7d-8e3a-265d7b4fef7d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:48.571858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748947b-3ed5-4c7d-8e3a-265d7b4fef7d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:48.571858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748947b-3ed5-4c7d-8e3a-265d7b4fef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:48.620085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9748947b-3ed5-4c7d-8e3a-265d7b4fef7d None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:48.621369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9748947b-3ed5-4c7d-8e3a-265d7b4fef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:48.637393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4299/8611] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 6 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:37:48.643623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:48.653869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45a2a1-d82c-4176-9d20-a6f6024a6e5a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:48.657707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:48.658384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:48.658612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:48.658883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:48.660635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:48.673231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:48.674711 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:48.685871 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4313/8612] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:37:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:37:49.190387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80191fe5-d41c-4fdb-a0e5-ab126d2fca96 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:49.190684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80191fe5-d41c-4fdb-a0e5-ab126d2fca96 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:49.190966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80191fe5-d41c-4fdb-a0e5-ab126d2fca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:49.212914 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-80191fe5-d41c-4fdb-a0e5-ab126d2fca96 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:37:49.214117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-80191fe5-d41c-4fdb-a0e5-ab126d2fca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:49.220785 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4300/8613] 10.222.0.20 () {58 vars in 1062 bytes} [Tue Sep 6 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:37:49.227453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:37:49.236194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375fab8-3fd7-4ee6-9c78-97b6c79e2268 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:37:49.239833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:37:49.240432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:37:49.240713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:37:49.240983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:37:49.242744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:37:49.321829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:37:49.323389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:37:49.352294 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4314/8614] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:37:59.206911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=20 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:37:59.348242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=44 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:20.868300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:20.868796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:20.868906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:20.890406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] MFA Rules not processed for user `cde9fe6d32c54f008d430dc9d3ef6e47`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:20.891637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:20.898656 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4301/8615] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:38:21.660427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:21.677223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5982c80-774c-486a-8a00-6846f66acade service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:21.682600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:21.683269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:21.683561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:21.683844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:21.685779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:21.703194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:21.704863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:21.725993 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4315/8616] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:26.136665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:26.138772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:26.163686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3a29b-72af-4e48-8024-713d57d3040e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:26.169715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:26.170338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:26.170624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:26.170951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:26.172747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:26.191457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:26.193327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:26.207892 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4302/8617] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:38:31.715882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:33.258513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:33.273904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774adc60-8507-4e31-a467-fc801ca2aab5 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:33.279906 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:33.280438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:33.280725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:33.281005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:33.282774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:33.300319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:33.305619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:33.317738 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4316/8618] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:36.200652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:38.455308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:38.470773 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744f55a-78f3-46ba-bb71-c5a8bf5b6627 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:38.476755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:38.477609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:38.478057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:38.478502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:38.480698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:38.502355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:38.505597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:38.521832 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4303/8619] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:42.745813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:42.763170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea94d5-247f-43c7-b3b7-0d966e0450e4 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:42.769056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:42.769671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:42.770164 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:42.770463 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:42.772332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:42.801464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:42.803119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:42.816647 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4317/8620] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:44.356880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:44.366942 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f4422-faae-4d3a-a75e-6d0df6d7c522 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:44.371557 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:44.372221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:44.372505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:44.372785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:44.374755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:44.388932 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:44.390414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:44.402401 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4304/8621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:48.176280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:48.186227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4134f8-3618-48d3-a741-462dbf9aba51 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:48.189872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:48.190470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:48.190755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:48.191091 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:48.192837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:48.255858 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:48.257293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:48.277271 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4318/8622] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:48.935978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:48.937419 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:48.953805 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c677c-8e2a-43bf-9063-a266be7f4a41 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:48.958516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:48.959179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:48.959497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:48.959777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] PATH_INFO: `/v3/users/4a1fe9d40733413a9c56393762549c7d` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:48.961047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1fe9d40733413a9c56393762549c7d)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:48.962944 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:49.119878 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1fe9d40733413a9c56393762549c7d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.126873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1fe9d40733413a9c56393762549c7d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.127589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1fe9d40733413a9c56393762549c7d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.140423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1fe9d40733413a9c56393762549c7d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.141073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-335b3c7b-5945-425c-8dd4-883778659a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1fe9d40733413a9c56393762549c7d'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.196890 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4305/8623] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:38:48 2022] DELETE /identity/v3/users/4a1fe9d40733413a9c56393762549c7d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:38:49.454583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:49.465918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656405a-ffa4-40e5-8caf-8cb80bf3d9c1 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:49.529791 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:49.530677 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:49.530964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:49.531269 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] PATH_INFO: `/v3/projects/eb7c997d05c141afb82389298ecb372c` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:49.532371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7c997d05c141afb82389298ecb372c)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:49.534258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:49.636443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7c997d05c141afb82389298ecb372c', 'request_id': 'req-4f67951d-53ad-4fe2-b52b-a7c9567f828c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.637537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:49.642437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7c997d05c141afb82389298ecb372c', 'request_id': 'req-4f67951d-53ad-4fe2-b52b-a7c9567f828c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.648897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7c997d05c141afb82389298ecb372c', 'request_id': 'req-4f67951d-53ad-4fe2-b52b-a7c9567f828c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.745828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] The token cache is being invalidate because project eb7c997d05c141afb82389298ecb372c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:38:49.746104 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.746729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4f67951d-53ad-4fe2-b52b-a7c9567f828c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:38:49.748308 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4319/8624] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:38:49 2022] DELETE /identity/v3/projects/eb7c997d05c141afb82389298ecb372c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:38:49.753575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:49.753867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:49.754146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:49.774085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:49.775308 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:49.834331 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4306/8625] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:38:49.842984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:49.843297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:49.843577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:49.863533 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:49.864809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:49.872957 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4320/8626] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:38:49.877327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:49.887863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3bb22-02ff-4ba6-a84c-aea5c29f4b51 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:49.892683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:49.893302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:49.893588 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:49.893867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:49.894526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:38:49.894835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:49.896510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:49.909643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4307/8627] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:38:49.914132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:49.923663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09dee2-4ad0-4bb9-b943-b770a00684ff None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:49.928484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:49.929087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:49.929368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:49.929643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:49.930271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:49.932268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:50.014988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4321/8628] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:38:49 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:38:50.018706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:50.030124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6765fcb-553a-402c-b9dd-6bacfa64f191 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:50.060060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:50.086239 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:50.086840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:50.090935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:50.090935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:50.090935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:50.090935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:50.198584 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4308/8629] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:38:50 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:38:50.202171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:50.212709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1100829-a9ff-4b44-9e06-03715cf3c2ed admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:50.217635 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:50.218235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:50.218513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:50.218785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:50.219474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:50.221057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:50.231304 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4322/8630] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:38:50.235174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:50.245764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee78817-0132-4d68-b10f-83ed344d5091 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:50.250850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122dd3-7567-45c4-89dd-4779ef7d56f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:50.251578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122dd3-7567-45c4-89dd-4779ef7d56f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:50.251859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122dd3-7567-45c4-89dd-4779ef7d56f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:50.252135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122dd3-7567-45c4-89dd-4779ef7d56f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:50.252843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122dd3-7567-45c4-89dd-4779ef7d56f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:50.254478 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122dd3-7567-45c4-89dd-4779ef7d56f4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:50.266414 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4309/8631] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:38:50.270145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:50.280732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb7ba2-833b-46e7-b39f-cd933a2577fc admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:50.285353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:50.286000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:50.286284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:50.286559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] PATH_INFO: `/v3/projects/edc027a6f642454d8592b308777d59e4/users/a36875e5990b487bb1357e0b46dac402/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:50.300873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc027a6f642454d8592b308777d59e4, user_id=a36875e5990b487bb1357e0b46dac402, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:50.303595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:50.360977 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4323/8632] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:38:50 2022] PUT /identity/v3/projects/edc027a6f642454d8592b308777d59e4/users/a36875e5990b487bb1357e0b46dac402/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:38:50.365838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de2b6-2efc-4390-b5eb-1f46adbeb241 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:50.366127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de2b6-2efc-4390-b5eb-1f46adbeb241 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:50.366432 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de2b6-2efc-4390-b5eb-1f46adbeb241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:50.386228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f22de2b6-2efc-4390-b5eb-1f46adbeb241 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:50.387461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f22de2b6-2efc-4390-b5eb-1f46adbeb241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:50.445543 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4310/8633] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:38:50.455908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:50.457714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:50.514195 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bee34-16da-40f4-89a5-662dbfc6c105 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:50.517840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:50.518447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:50.518730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:50.519021 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:50.528211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:50.529907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:50.539407 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4324/8634] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:38:56.623155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:56.624130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:56.624617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:56.656617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] MFA Rules not processed for user `a36875e5990b487bb1357e0b46dac402`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:38:56.658020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:38:56.746753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4311/8635] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:38:56.751327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:56.762081 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21da6-ae1a-4794-9493-5f69b41e2b93 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:56.767122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:56.767732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:56.773735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:56.773735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:56.773735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:56.773735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:56.923366 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4325/8636] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:38:56 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:38:56.924442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:56.935916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0e84-1153-49be-b2ad-f000b3665909 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:56.999155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:57.030202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:57.030202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:57.030202 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:57.030960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:57.032020 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:57.034452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:57.175436 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4312/8637] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:38:56 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:38:57.180034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:57.193888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436e7da-65d0-4dbd-96eb-0d5f2628d84c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:57.199868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:57.200502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:57.200781 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:57.201236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:57.202193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:57.204044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:57.217551 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4326/8638] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:38:57.222033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:57.234902 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c55e6d-6af8-4a33-888e-831678276701 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:57.240519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:57.241439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:57.241883 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:57.242383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] PATH_INFO: `/v3/projects/3c8379a1c62f462ba3dc67e02bff2ddb/users/24649773dd1f4002bd6e215fbc89cb37/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:57.263234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8379a1c62f462ba3dc67e02bff2ddb, user_id=24649773dd1f4002bd6e215fbc89cb37, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:57.266116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:57.352123 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4313/8639] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:38:57 2022] PUT /identity/v3/projects/3c8379a1c62f462ba3dc67e02bff2ddb/users/24649773dd1f4002bd6e215fbc89cb37/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:38:57.356422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:57.368796 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3206196-cf7d-4ec4-add8-89763a8cdef1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:57.427172 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:38:57.463364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:57.464795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:57.465113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:57.465397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:57.466074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:57.468707 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:57.494437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4327/8640] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:38:57.498840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:38:57.518485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c69ed7-b886-4b5a-b247-e260d3d35c1b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:38:57.526250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:38:57.527127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:38:57.527662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:38:57.528762 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] PATH_INFO: `/v3/projects/3c8379a1c62f462ba3dc67e02bff2ddb/users/24649773dd1f4002bd6e215fbc89cb37/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:38:57.531404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8379a1c62f462ba3dc67e02bff2ddb, user_id=24649773dd1f4002bd6e215fbc89cb37, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:38:57.543607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:38:57.565534 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4314/8641] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:38:57 2022] PUT /identity/v3/projects/3c8379a1c62f462ba3dc67e02bff2ddb/users/24649773dd1f4002bd6e215fbc89cb37/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:39:00.075358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:00.077638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:00.194462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4f677-1b36-44d9-9dbb-013e2d702714 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:00.367694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:00.368343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:00.368647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:00.368946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:00.372150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:00.398462 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:00.402097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1585-cbb8-4481-b41c-17d8edc22fc9 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:00.422381 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4328/8642] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:01.743500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:01.769252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481a05-b3b9-4bd8-b2bb-9d36bf7bb6f9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:01.781195 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:01.785218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:01.785218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:01.785218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:01.785218 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:01.811269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:01.813636 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:01.832321 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4315/8643] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:04.608585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89af98-92c8-4661-95b0-fa16ddf06a83 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:04.609555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89af98-92c8-4661-95b0-fa16ddf06a83 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:04.609839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89af98-92c8-4661-95b0-fa16ddf06a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:04.644421 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6f89af98-92c8-4661-95b0-fa16ddf06a83 None None] MFA Rules not processed for user `24649773dd1f4002bd6e215fbc89cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:04.645687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6f89af98-92c8-4661-95b0-fa16ddf06a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:04.724281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:04.730507 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4329/8644] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:04.744333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:04.756863 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:04.843547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7697-34c4-4b4b-8b74-77b066b84fe4 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:04.848143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e75b-6185-4927-9b59-c7bd28256d32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:04.848829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e75b-6185-4927-9b59-c7bd28256d32 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:04.849121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e75b-6185-4927-9b59-c7bd28256d32 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:04.849397 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e75b-6185-4927-9b59-c7bd28256d32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:04.940461 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e75b-6185-4927-9b59-c7bd28256d32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:04.945061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e75b-6185-4927-9b59-c7bd28256d32 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:04.953075 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4316/8645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:12.263141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:12.268318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:12.268318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:12.288647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] MFA Rules not processed for user `fcaddf25fc12498b90d2cc1ec08e5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:12.291303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:12.512528 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4330/8646] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:39:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:13.295359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeabfc7-231b-4759-9647-0da5a1650a9f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:13.301854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeabfc7-231b-4759-9647-0da5a1650a9f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:13.301854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeabfc7-231b-4759-9647-0da5a1650a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:13.336029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:13.353481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aaeabfc7-231b-4759-9647-0da5a1650a9f None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:13.356398 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aaeabfc7-231b-4759-9647-0da5a1650a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:13.373672 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4317/8647] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:13.390093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:13.412239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e1ba-e991-433c-9e67-41098e6a36b5 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:13.418227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d8c33-bd7b-46b3-83c8-7a8e681dcf55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:13.419113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d8c33-bd7b-46b3-83c8-7a8e681dcf55 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:13.419630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d8c33-bd7b-46b3-83c8-7a8e681dcf55 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:13.420111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d8c33-bd7b-46b3-83c8-7a8e681dcf55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:13.434696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d8c33-bd7b-46b3-83c8-7a8e681dcf55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:13.436370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d8c33-bd7b-46b3-83c8-7a8e681dcf55 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:13.447432 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4331/8648] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:15.145876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:15.146387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:15.146471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:15.166619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] MFA Rules not processed for user `a36875e5990b487bb1357e0b46dac402`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:15.167840 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:15.175424 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4318/8649] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:39:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:16.267779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:16.270719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:16.271764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:16.316668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:16.321805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:16.342375 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4332/8650] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:39:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:16.365081 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:16.404036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095beb09-d727-401d-8196-8d7ce3b7aba8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:16.420008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc149c8c-5bc7-4f5e-a863-296bf53c705b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:16.420643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc149c8c-5bc7-4f5e-a863-296bf53c705b service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:16.420922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc149c8c-5bc7-4f5e-a863-296bf53c705b service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:16.421263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc149c8c-5bc7-4f5e-a863-296bf53c705b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:16.446937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc149c8c-5bc7-4f5e-a863-296bf53c705b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:16.450855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc149c8c-5bc7-4f5e-a863-296bf53c705b service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:16.475814 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4319/8651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:18.517585 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:18.518318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:18.596461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532748a9-1c55-451e-b3c0-bd76d845d581 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:18.606089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:18.606792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:18.607147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:18.610064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] PATH_INFO: `/v3/users/cde9fe6d32c54f008d430dc9d3ef6e47` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:18.610064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde9fe6d32c54f008d430dc9d3ef6e47)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:18.612654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:18.792625 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde9fe6d32c54f008d430dc9d3ef6e47'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:18.799657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde9fe6d32c54f008d430dc9d3ef6e47'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:18.800349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde9fe6d32c54f008d430dc9d3ef6e47'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:18.800964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde9fe6d32c54f008d430dc9d3ef6e47'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:18.813097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde9fe6d32c54f008d430dc9d3ef6e47'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:18.901129 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4333/8652] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:39:18 2022] DELETE /identity/v3/users/cde9fe6d32c54f008d430dc9d3ef6e47 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:39:18.904877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:18.905351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:18.905436 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:18.926138 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:18.927396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:18.993885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4320/8653] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:39:19.004932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:19.007825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:19.012389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:19.085361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdc80-2d84-4ee2-b30f-b33f0e60d24a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:19.090277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:19.095404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:19.095404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:19.095404 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:19.103208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:19.104601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:19.114859 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4334/8654] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:19.415200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:19.416888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:19.440300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930ba0-f6ca-44d9-a04c-d33a4509f19e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:19.454351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:19.455297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:19.455580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:19.456045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] PATH_INFO: `/v3/projects/d3a7bd2f2a3d4318bc4445e9c4be13fb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:19.457844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a7bd2f2a3d4318bc4445e9c4be13fb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:19.459686 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:19.577173 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'request_id': 'req-4e14244a-96ff-4a81-a748-4cfab0b85b11'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.585310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'request_id': 'req-4e14244a-96ff-4a81-a748-4cfab0b85b11'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.592026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a7bd2f2a3d4318bc4445e9c4be13fb', 'request_id': 'req-4e14244a-96ff-4a81-a748-4cfab0b85b11'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.665083 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] The token cache is being invalidate because project d3a7bd2f2a3d4318bc4445e9c4be13fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:39:19.665288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.666270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.667807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4321/8655] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:39:19 2022] DELETE /identity/v3/projects/d3a7bd2f2a3d4318bc4445e9c4be13fb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:39:19.671933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:19.682575 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99426-9a8e-424b-8811-a211a439dd68 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:19.742159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:19.744361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:19.744778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:19.745246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] PATH_INFO: `/v3/users/30746e47c87447ffa514b16757684102` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:19.747865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30746e47c87447ffa514b16757684102)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:19.748995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:19.940823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30746e47c87447ffa514b16757684102'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.948199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30746e47c87447ffa514b16757684102'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.948920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30746e47c87447ffa514b16757684102'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.949525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30746e47c87447ffa514b16757684102'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:19.961638 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30746e47c87447ffa514b16757684102'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:20.032471 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4335/8656] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:39:19 2022] DELETE /identity/v3/users/30746e47c87447ffa514b16757684102 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:39:20.545958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:20.547564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:20.568093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14244a-96ff-4a81-a748-4cfab0b85b11 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:20.650342 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:20.651322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:20.651999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:20.652448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] PATH_INFO: `/v3/projects/673c6c01b4bf43e69d3c836d525e051f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:20.654245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673c6c01b4bf43e69d3c836d525e051f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:20.656684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:20.658608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:20.793560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673c6c01b4bf43e69d3c836d525e051f', 'request_id': 'req-67e85bac-1f13-4096-bdd0-a2a4616a9da8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:20.800110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673c6c01b4bf43e69d3c836d525e051f', 'request_id': 'req-67e85bac-1f13-4096-bdd0-a2a4616a9da8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:20.805760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673c6c01b4bf43e69d3c836d525e051f', 'request_id': 'req-67e85bac-1f13-4096-bdd0-a2a4616a9da8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:20.951975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] The token cache is being invalidate because project 673c6c01b4bf43e69d3c836d525e051f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:39:20.952532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:20.953333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-67e85bac-1f13-4096-bdd0-a2a4616a9da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:39:20.955118 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4322/8657] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:39:20 2022] DELETE /identity/v3/projects/673c6c01b4bf43e69d3c836d525e051f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:39:30.028411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:31.018341 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:51.379876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:51.381417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:51.468217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559bdb2-c151-413b-aee2-fdd72be2a504 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:51.534223 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:51.534829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:51.535149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:51.535422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:51.537196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:51.602527 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:51.604088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:51.613557 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4336/8658] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:53.578037 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:53.578580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:53.578580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:53.598629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] MFA Rules not processed for user `a36875e5990b487bb1357e0b46dac402`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:53.599851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:53.657801 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4323/8659] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:39:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:53.924134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:53.925539 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:53.956135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:39:53.981272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c198e3-3f05-4f43-8562-dbe07a196451 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:53.984893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:53.985525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:53.985807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:53.986082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:53.987871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:53.999851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:54.001352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ae5a-20fd-4f2d-a440-cdfc91bb5c44 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:54.012432 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4337/8660] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:39:58.629325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:58.630779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:58.649911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4fe2-6502-4274-a66b-3b3ae200131c None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:58.656440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:58.657299 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:58.657590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:58.657865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:58.660509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:58.732250 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:58.733835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:58.743485 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4324/8661] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:39:59.445096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:59.445663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:59.445663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:59.466069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:39:59.467342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:59.539794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4338/8662] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:39:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:39:59.552097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:39:59.553730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:39:59.572112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa97322-68ef-4015-8f6a-5e9084ca66ed service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:39:59.579851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70f4e8-e28b-4178-b8cb-86d3ef4e6ab1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:39:59.580491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70f4e8-e28b-4178-b8cb-86d3ef4e6ab1 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:39:59.580778 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70f4e8-e28b-4178-b8cb-86d3ef4e6ab1 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:39:59.581057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70f4e8-e28b-4178-b8cb-86d3ef4e6ab1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:39:59.592672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70f4e8-e28b-4178-b8cb-86d3ef4e6ab1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:39:59.594964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70f4e8-e28b-4178-b8cb-86d3ef4e6ab1 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:39:59.609369 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4325/8663] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:39:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:40:05.813388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:05.814842 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:05.826493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d9ec8-7b19-4c83-90fb-3c1d31cf6b8a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:05.830431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:05.831103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:05.831396 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:05.831675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:05.833428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:05.846046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:05.847581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284a44-fd03-4617-9658-04d3803038f6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:05.860422 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4339/8664] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:09.302924 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:09.303451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:09.303572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:09.370465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:09.371728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:09.432079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:09.437419 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4326/8665] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:40:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:09.587952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c0111-a09a-42ad-83e6-66abc27346c5 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:09.588442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c0111-a09a-42ad-83e6-66abc27346c5 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:09.588545 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c0111-a09a-42ad-83e6-66abc27346c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:09.642135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c25c0111-a09a-42ad-83e6-66abc27346c5 None None] MFA Rules not processed for user `cd53273c297e44518ba1bbe2c838e744`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:09.643407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c25c0111-a09a-42ad-83e6-66abc27346c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:09.722185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4340/8666] 10.222.0.20 () {58 vars in 1040 bytes} [Tue Sep 6 11:40:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:09.728506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:09.740806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48c4d2-1e85-48f1-9ea0-67c2f7000bdd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:09.746004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee81f6-c108-4936-b91e-2c3304594249 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:09.746714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee81f6-c108-4936-b91e-2c3304594249 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:09.747000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee81f6-c108-4936-b91e-2c3304594249 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:09.747335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee81f6-c108-4936-b91e-2c3304594249 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:09.756300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee81f6-c108-4936-b91e-2c3304594249 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:09.757920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee81f6-c108-4936-b91e-2c3304594249 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:09.767361 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4327/8667] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:40:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:40:11.320244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:11.320779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:11.320779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:11.340877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] MFA Rules not processed for user `a36875e5990b487bb1357e0b46dac402`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:11.342101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:11.349040 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4341/8668] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:40:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:19.763473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:21.334648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:33.903721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:33.907093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:33.907395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:33.930904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] MFA Rules not processed for user `fcaddf25fc12498b90d2cc1ec08e5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:40:33.932176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:33.942237 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4328/8669] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:40:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:40:43.923349 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:40:49.058062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:40:49.068522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7395cb-aa01-438c-ba5b-934af93d90a2 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:40:49.072096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:40:49.072697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:40:49.074415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:40:49.074415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:40:49.076035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:40:49.108883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:40:49.110964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2820b-a82b-41af-b5a5-897f112c4e86 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:40:49.136120 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4342/8670] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:40:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:40:59.119050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=11 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:14.596351 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:14.609827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c4689-2157-486b-aaf7-fbbbdc6445a5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:14.613134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:14.613792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:14.614117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:14.614402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:14.616257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:14.636979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:14.638684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:14.660857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4329/8671] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:21.269391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e56e-5219-4709-976d-7dddee342676 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:21.269822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e56e-5219-4709-976d-7dddee342676 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:21.269939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e56e-5219-4709-976d-7dddee342676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:21.289466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-caa8e56e-5219-4709-976d-7dddee342676 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:21.290678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-caa8e56e-5219-4709-976d-7dddee342676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:21.297787 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4343/8672] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 11:41:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:21.419502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:21.431072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd2bd-a7da-4f44-874c-66cf55258b8d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:21.436443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:21.437038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:21.437320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:21.437594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:21.446093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:21.447749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:21.456396 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4330/8673] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:41:29.405132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:29.405930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:29.406050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:29.425044 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] MFA Rules not processed for user `a36875e5990b487bb1357e0b46dac402`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:41:29.426365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:29.433413 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4344/8674] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:41:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:41:29.762624 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:29.772275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c45f3b-0559-4d5f-9722-a02e3e4dc7df service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:29.776013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:29.776612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:29.776900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:29.777176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:29.778950 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:29.791350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:29.792802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:29.804010 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4331/8675] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:39.419505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:39.797182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=18 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:41:44.865956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:41:44.876678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff496d2-7e00-4e63-97ef-82d7680e539f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:41:44.886442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:41:44.887327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:41:44.887536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:41:44.887865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:41:44.889756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:41:44.957489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:41:44.958937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0ee0a-fd22-45e4-adb0-48207a394d46 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:41:44.968524 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4345/8676] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:41:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:41:54.964205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=30 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:19.024867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:19.026523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:19.093641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe02b74-59e6-43be-8022-4c213e04635b service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:19.098444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:19.099112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:19.099407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:19.099707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] PATH_INFO: `/v3/users/fcaddf25fc12498b90d2cc1ec08e5da3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:19.101352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcaddf25fc12498b90d2cc1ec08e5da3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:19.103903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:19.314677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcaddf25fc12498b90d2cc1ec08e5da3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.322205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcaddf25fc12498b90d2cc1ec08e5da3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.322884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcaddf25fc12498b90d2cc1ec08e5da3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.334774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcaddf25fc12498b90d2cc1ec08e5da3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.335442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcaddf25fc12498b90d2cc1ec08e5da3'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.380228 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4332/8677] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:42:19 2022] DELETE /identity/v3/users/fcaddf25fc12498b90d2cc1ec08e5da3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:19.385478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:19.385971 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:19.386110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:19.407108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:19.408574 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:19.469106 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4346/8678] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:19.479228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:19.480755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:19.538722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401d358-dd32-4afd-a36c-796d769375f8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:19.542402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:19.543004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:19.543311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:19.543587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:19.552708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:19.554127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:19.564155 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4333/8679] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:19.834876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:19.836521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:19.852307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295658bd-48c3-46f2-ba04-f75e018bc623 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:19.857506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:19.858132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:19.858413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:19.858690 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] PATH_INFO: `/v3/projects/aa117f0cf74342a3b24c0c247565a6c7` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:19.859891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa117f0cf74342a3b24c0c247565a6c7)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:19.861822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:19.973003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa117f0cf74342a3b24c0c247565a6c7', 'request_id': 'req-a33d5d0e-860f-4379-ad83-ede7cd557887'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.979616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa117f0cf74342a3b24c0c247565a6c7', 'request_id': 'req-a33d5d0e-860f-4379-ad83-ede7cd557887'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:19.986536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa117f0cf74342a3b24c0c247565a6c7', 'request_id': 'req-a33d5d0e-860f-4379-ad83-ede7cd557887'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.061125 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] The token cache is being invalidate because project aa117f0cf74342a3b24c0c247565a6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:42:20.061447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.062089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.063614 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4347/8680] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:42:19 2022] DELETE /identity/v3/projects/aa117f0cf74342a3b24c0c247565a6c7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:20.067817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:20.078113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71419054-a01d-4244-bbf3-be99f12be7cc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:20.097727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:20.136306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:20.136941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:20.137228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:20.137509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] PATH_INFO: `/v3/users/f25ab44649ae45ab99061c93809e55d9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:20.138637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25ab44649ae45ab99061c93809e55d9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:20.140785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:20.320158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25ab44649ae45ab99061c93809e55d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.327157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25ab44649ae45ab99061c93809e55d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.327823 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25ab44649ae45ab99061c93809e55d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.340481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25ab44649ae45ab99061c93809e55d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.341061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-0354cde1-2286-4c5f-ae6d-7276910d839e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25ab44649ae45ab99061c93809e55d9'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.409277 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4334/8681] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:42:20 2022] DELETE /identity/v3/users/f25ab44649ae45ab99061c93809e55d9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:20.713546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:20.715048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:20.728364 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d5d0e-860f-4379-ad83-ede7cd557887 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:20.786734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:20.787426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:20.787709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:20.787981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] PATH_INFO: `/v3/projects/04385e36a65e4f41aab4eceff7b42e68` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:20.789107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04385e36a65e4f41aab4eceff7b42e68)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:20.791673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:20.908358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:20.924010 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04385e36a65e4f41aab4eceff7b42e68', 'request_id': 'req-6a2f0bd2-335e-4519-8631-b1964cb640b3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.929503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04385e36a65e4f41aab4eceff7b42e68', 'request_id': 'req-6a2f0bd2-335e-4519-8631-b1964cb640b3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:20.935660 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04385e36a65e4f41aab4eceff7b42e68', 'request_id': 'req-6a2f0bd2-335e-4519-8631-b1964cb640b3'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:21.015523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] The token cache is being invalidate because project 04385e36a65e4f41aab4eceff7b42e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:42:21.015722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:21.016348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6a2f0bd2-335e-4519-8631-b1964cb640b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:21.017824 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4348/8682] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:42:20 2022] DELETE /identity/v3/projects/04385e36a65e4f41aab4eceff7b42e68 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:21.022978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.023304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.023585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.045128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:21.046327 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:21.107179 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4335/8683] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:21.115447 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.115743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.116022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.136764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:21.137975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:21.146182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4349/8684] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:21.150137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.160278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f507-542c-4d5a-8d5c-baed34856d2b None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.165207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.165800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.166080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.166353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.167092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:42:21.167435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.169221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.182408 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4336/8685] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:42:21.186488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.195925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331b9a-32d7-43a4-aadb-5225e6054693 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.201339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.201942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.202228 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.202506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.203169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.205074 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.263214 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4350/8686] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:21.267510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.277678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443da37-d567-4fb4-9b3c-398a5a2f57e7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.306536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:21.337708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.338314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.338598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.338874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.339613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.342264 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.409612 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4337/8687] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:21.413525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.424458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd48ab-bee4-4876-8927-052962244bc9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.428980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.429570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.429848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.430119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.431367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.432943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.442828 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4351/8688] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:21.446758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.456993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b804d45-fb3e-4a47-a6b9-60956fc9326a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.461700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf51c4-a424-4588-a3c5-611ba24344cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.466337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf51c4-a424-4588-a3c5-611ba24344cf admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.466337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf51c4-a424-4588-a3c5-611ba24344cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.466337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf51c4-a424-4588-a3c5-611ba24344cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.466337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf51c4-a424-4588-a3c5-611ba24344cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.466337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf51c4-a424-4588-a3c5-611ba24344cf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.476098 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4338/8689] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:21.480765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.491612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2000c8-9d14-421b-87fd-319c8dd02497 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.497208 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.497856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.498137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.498414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] PATH_INFO: `/v3/projects/a67fdd17e5434da2a3b497b361005b61/users/7c59904d36bc4b40a5bcf9a8d3b5326b/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.512840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67fdd17e5434da2a3b497b361005b61, user_id=7c59904d36bc4b40a5bcf9a8d3b5326b, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.515555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.603971 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4352/8690] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:42:21 2022] PUT /identity/v3/projects/a67fdd17e5434da2a3b497b361005b61/users/7c59904d36bc4b40a5bcf9a8d3b5326b/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:21.615032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.615329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.615610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.643583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] MFA Rules not processed for user `7c59904d36bc4b40a5bcf9a8d3b5326b`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:21.644798 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:21.710022 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4339/8691] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:42:21.714602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.776947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022d46c-4468-4b4f-92a5-3448ccbc3592 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.781878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.782474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.782752 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.784557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.784557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.785616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:21.886225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4353/8692] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:21.890581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:21.902232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920891b-79e2-49ea-adfd-a268f4662018 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:21.959490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:21.960105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:21.960458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:21.960669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:21.961288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:21.963223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:22.067277 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4340/8693] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:42:21 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:22.071291 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:22.082511 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9a07-4b20-4e68-9bfe-f515b0229fd2 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:22.087263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c160a9-6de6-4e49-a036-1e2917d9ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:22.087867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c160a9-6de6-4e49-a036-1e2917d9ea01 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:22.088146 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c160a9-6de6-4e49-a036-1e2917d9ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:22.088418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c160a9-6de6-4e49-a036-1e2917d9ea01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:22.089049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c160a9-6de6-4e49-a036-1e2917d9ea01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:22.090637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c160a9-6de6-4e49-a036-1e2917d9ea01 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:22.101491 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4354/8694] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:22.106211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:22.116594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590b11-a14b-4ddb-b06e-86a4aa0c7c72 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:22.122567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:22.123256 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:22.123541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:22.123816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] PATH_INFO: `/v3/projects/e7cd7fcd7d1049d0925c9beff5e995c7/users/37a63f2fc9ca45228e243bb59b23eedb/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:22.138960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cd7fcd7d1049d0925c9beff5e995c7, user_id=37a63f2fc9ca45228e243bb59b23eedb, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:22.142015 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:22.186702 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4341/8695] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:42:22 2022] PUT /identity/v3/projects/e7cd7fcd7d1049d0925c9beff5e995c7/users/37a63f2fc9ca45228e243bb59b23eedb/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:22.198354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:22.198639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:22.198918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:22.230121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] MFA Rules not processed for user `37a63f2fc9ca45228e243bb59b23eedb`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:22.231720 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:22.244913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:22.300074 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4355/8696] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:22 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:22.328252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:22.330033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:22.335966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:22.399735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf9308-1866-43f6-a07b-398d96d434fb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:22.404758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0fea1-4ded-4bf7-a674-965da6ed341e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:22.405359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0fea1-4ded-4bf7-a674-965da6ed341e service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:22.405901 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0fea1-4ded-4bf7-a674-965da6ed341e service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:22.406174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0fea1-4ded-4bf7-a674-965da6ed341e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:22.414076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0fea1-4ded-4bf7-a674-965da6ed341e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:22.415694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0fea1-4ded-4bf7-a674-965da6ed341e service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:22.424473 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4342/8697] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:42:25.259336 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:25.327345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7e21-af37-4380-9cb0-11bad5f18381 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:25.332008 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:25.332644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:25.332929 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:25.333212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] PATH_INFO: `/v3/users/7c59904d36bc4b40a5bcf9a8d3b5326b` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:25.334550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c59904d36bc4b40a5bcf9a8d3b5326b)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:25.336546 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:25.514491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c59904d36bc4b40a5bcf9a8d3b5326b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:25.521549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c59904d36bc4b40a5bcf9a8d3b5326b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:25.522212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c59904d36bc4b40a5bcf9a8d3b5326b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:25.522807 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c59904d36bc4b40a5bcf9a8d3b5326b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:25.535578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c59904d36bc4b40a5bcf9a8d3b5326b'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:25.608360 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4356/8698] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:42:25 2022] DELETE /identity/v3/users/7c59904d36bc4b40a5bcf9a8d3b5326b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:25.612909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:25.613381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:25.613480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:25.632668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:25.635109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:25.693498 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4343/8699] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:25.703775 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:25.705257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:25.740794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:25.761673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7c51d-1df3-4ff5-a5b7-1f744ff6cc5e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:25.765299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:25.765866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:25.766143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:25.766413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:25.776799 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:25.778408 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:25.788594 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4357/8700] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:26.227712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:26.229246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:26.241704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00ac3-1908-47b3-95d9-ada99c87cb27 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:26.247159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:26.247794 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:26.248080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:26.248361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] PATH_INFO: `/v3/projects/a67fdd17e5434da2a3b497b361005b61` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:26.249501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67fdd17e5434da2a3b497b361005b61)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:26.251511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:26.388036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67fdd17e5434da2a3b497b361005b61', 'request_id': 'req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.394232 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67fdd17e5434da2a3b497b361005b61', 'request_id': 'req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.399994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67fdd17e5434da2a3b497b361005b61', 'request_id': 'req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.494623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] The token cache is being invalidate because project a67fdd17e5434da2a3b497b361005b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:42:26.494931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.495647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.497148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4344/8701] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:42:26 2022] DELETE /identity/v3/projects/a67fdd17e5434da2a3b497b361005b61 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:26.501381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:26.512805 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca10763-bd6d-4007-9aba-4ddf62ceedb7 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:26.570818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:26.571484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:26.571774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:26.572057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] PATH_INFO: `/v3/users/37a63f2fc9ca45228e243bb59b23eedb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:26.573851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a63f2fc9ca45228e243bb59b23eedb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:26.575817 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:26.748648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a63f2fc9ca45228e243bb59b23eedb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.755542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a63f2fc9ca45228e243bb59b23eedb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.756263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a63f2fc9ca45228e243bb59b23eedb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.756882 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a63f2fc9ca45228e243bb59b23eedb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.769106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4762235e-2428-4023-ba03-9ada0820d618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a63f2fc9ca45228e243bb59b23eedb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:26.865912 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4358/8702] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:42:26 2022] DELETE /identity/v3/users/37a63f2fc9ca45228e243bb59b23eedb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:27.284831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:27.286340 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:27.304154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ba1f0-8161-4407-b4ae-8a6256b9bbcb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:27.321541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:27.370177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:27.372489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:27.372489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:27.372489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] PATH_INFO: `/v3/projects/e7cd7fcd7d1049d0925c9beff5e995c7` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:27.372790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cd7fcd7d1049d0925c9beff5e995c7)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:27.374607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:27.501543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cd7fcd7d1049d0925c9beff5e995c7', 'request_id': 'req-2387f518-753f-431a-ad71-c9966d6f2dd0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:27.509969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cd7fcd7d1049d0925c9beff5e995c7', 'request_id': 'req-2387f518-753f-431a-ad71-c9966d6f2dd0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:27.515603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cd7fcd7d1049d0925c9beff5e995c7', 'request_id': 'req-2387f518-753f-431a-ad71-c9966d6f2dd0'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:27.568931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] The token cache is being invalidate because project e7cd7fcd7d1049d0925c9beff5e995c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:42:27.569174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:27.569812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2387f518-753f-431a-ad71-c9966d6f2dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:42:27.571349 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4345/8703] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:42:27 2022] DELETE /identity/v3/projects/e7cd7fcd7d1049d0925c9beff5e995c7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:27.576487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:27.577022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:27.577022 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:27.596544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:27.597743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:27.645645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:27.657185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4359/8704] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:27.665261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:27.665555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:27.666373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:27.686743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:27.688014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:27.696271 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4346/8705] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:27.700723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:27.711946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388ed89-168a-4559-9a14-4a1947bd2da8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:27.715829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:27.716442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:27.716725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:27.717003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:27.717643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:42:27.717950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:27.719592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:27.731681 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4360/8706] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:42:27.735959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:27.745910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d0c3-3820-4b0e-a447-5cd4d30d3f74 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:27.750925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:27.751564 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:27.751849 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:27.752142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:27.752764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:27.754666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:27.839616 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4347/8707] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:42:27 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:27.843676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:27.854586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc0b99-d52f-4402-b70e-22c0f578f75b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:27.911655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:27.912263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:27.912541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:27.912813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:27.913441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:27.915384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:28.014742 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4361/8708] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:42:27 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:28.018959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:28.029939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaad50-5b1d-4217-bcdb-06d6396729bc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:28.034760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:28.035429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:28.035710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:28.035981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:28.036612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:28.038189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:28.049852 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4348/8709] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:28.055489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:28.065646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e7cb5-5421-42a2-a595-4a15166b11c1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:28.070299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce198a9-ff0b-46c7-84e5-69c5c445a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:28.075665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce198a9-ff0b-46c7-84e5-69c5c445a413 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:28.075665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce198a9-ff0b-46c7-84e5-69c5c445a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:28.075665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce198a9-ff0b-46c7-84e5-69c5c445a413 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:28.075665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce198a9-ff0b-46c7-84e5-69c5c445a413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:28.075665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce198a9-ff0b-46c7-84e5-69c5c445a413 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:28.084167 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4362/8710] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:28.088785 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:28.098899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d59c1-369c-4d2e-abe2-7f9be3d3d074 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:28.104060 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:28.104783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:28.105065 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:28.105339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] PATH_INFO: `/v3/projects/0dfc5d591ce044de8497d55f8df5248a/users/6b891d06b3f9408aa56f2a7fcf042b88/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:28.120057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfc5d591ce044de8497d55f8df5248a, user_id=6b891d06b3f9408aa56f2a7fcf042b88, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:28.122815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:28.215377 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4349/8711] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:42:28 2022] PUT /identity/v3/projects/0dfc5d591ce044de8497d55f8df5248a/users/6b891d06b3f9408aa56f2a7fcf042b88/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:28.220512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e1c8-9661-4041-bd54-b696d3a2da76 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:28.220800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e1c8-9661-4041-bd54-b696d3a2da76 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:28.221073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e1c8-9661-4041-bd54-b696d3a2da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:28.240011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-42c6e1c8-9661-4041-bd54-b696d3a2da76 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:28.241967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-42c6e1c8-9661-4041-bd54-b696d3a2da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:28.299933 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4363/8712] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:28.309679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:28.311542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:28.361164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:28.373965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03461371-fe16-457a-8b98-e97262364547 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:28.378909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:28.378909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:28.378909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:28.378909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:28.388403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:28.389868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:28.400199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4350/8713] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:34.001098 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.001683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.001881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.033764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] MFA Rules not processed for user `6b891d06b3f9408aa56f2a7fcf042b88`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:34.035124 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:34.108065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:34.128578 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4364/8714] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:34.133472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:34.144387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ef846-af0e-4e5f-9070-01929fda530d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:34.149268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:34.149877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.150163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.150537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.151253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:34.153306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:34.251095 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4351/8715] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:42:34 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:42:34.255287 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:34.266665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535b60-e407-4cd0-b9bd-4a7c8a15f91b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:34.324126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68615211-f29f-418c-9659-922bec927887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:34.324737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615211-f29f-418c-9659-922bec927887 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.325025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615211-f29f-418c-9659-922bec927887 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.325301 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615211-f29f-418c-9659-922bec927887 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.325930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68615211-f29f-418c-9659-922bec927887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:34.327962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68615211-f29f-418c-9659-922bec927887 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:34.454980 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4365/8716] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:42:34 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:42:34.459072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:34.469606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcea69-b53b-4c28-9c67-df6bdf5cab14 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:34.475048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:34.475048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.475309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.475554 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.476230 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:34.477843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:34.489070 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4352/8717] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:34.493155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68615211-f29f-418c-9659-922bec927887 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:34.504419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68615211-f29f-418c-9659-922bec927887 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:34.509126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:34.509814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.510101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.510401 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] PATH_INFO: `/v3/projects/94b7e8422d604908a822fd0d13ed0b66/users/64df126528f342ec8c121c80e79f7882/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.525518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b7e8422d604908a822fd0d13ed0b66, user_id=64df126528f342ec8c121c80e79f7882, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:34.528233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:34.627154 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4366/8718] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:42:34 2022] PUT /identity/v3/projects/94b7e8422d604908a822fd0d13ed0b66/users/64df126528f342ec8c121c80e79f7882/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:34.631224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:34.642064 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece6857-7632-47a8-9e97-2fb5a91e7e4d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:34.703670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1777a2-4840-4b46-95f1-6a0970c49db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:34.704283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1777a2-4840-4b46-95f1-6a0970c49db0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.704609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1777a2-4840-4b46-95f1-6a0970c49db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.704891 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1777a2-4840-4b46-95f1-6a0970c49db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.705574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1777a2-4840-4b46-95f1-6a0970c49db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:34.707251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1777a2-4840-4b46-95f1-6a0970c49db0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:34.718248 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4353/8719] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:42:34.722920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:34.735297 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e082b7e-19ef-409a-b64b-5159da1e4465 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:34.740090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:34.740814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:34.741095 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:34.741370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] PATH_INFO: `/v3/projects/94b7e8422d604908a822fd0d13ed0b66/users/64df126528f342ec8c121c80e79f7882/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:34.743481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b7e8422d604908a822fd0d13ed0b66, user_id=64df126528f342ec8c121c80e79f7882, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:34.746222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:34.757089 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4367/8720] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:42:34 2022] PUT /identity/v3/projects/94b7e8422d604908a822fd0d13ed0b66/users/64df126528f342ec8c121c80e79f7882/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:42:40.326091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a238c3-7956-489f-a828-3909efc6202d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:40.326596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a238c3-7956-489f-a828-3909efc6202d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:40.326717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a238c3-7956-489f-a828-3909efc6202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:40.358792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-69a238c3-7956-489f-a828-3909efc6202d None None] MFA Rules not processed for user `64df126528f342ec8c121c80e79f7882`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:40.360188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-69a238c3-7956-489f-a828-3909efc6202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:40.432800 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4354/8721] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:40.450033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:40.451950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:40.567048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504cff4-6a46-4fe4-8f3e-87b10d6025b1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:40.573573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:40.574201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:40.574486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:40.574763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:40.619947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:40.637905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:40.639769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:40.649794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4368/8722] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:42:43.416722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc94b0-7823-413f-8e10-6e7c87eeb840 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:43.417208 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc94b0-7823-413f-8e10-6e7c87eeb840 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:43.417320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc94b0-7823-413f-8e10-6e7c87eeb840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:43.437511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ecdc94b0-7823-413f-8e10-6e7c87eeb840 None None] MFA Rules not processed for user `6b891d06b3f9408aa56f2a7fcf042b88`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:42:43.438850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ecdc94b0-7823-413f-8e10-6e7c87eeb840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:43.446968 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4355/8723] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:42:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:42:50.871697 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:53.430956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:42:57.771069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:42:57.772514 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:42:57.829661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3844f-1250-4f1e-bf27-2899a80b7715 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:42:57.833271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52978b-7f83-490b-a93e-f816f9bc4b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:42:57.833871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52978b-7f83-490b-a93e-f816f9bc4b91 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:42:57.834156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52978b-7f83-490b-a93e-f816f9bc4b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:42:57.834429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52978b-7f83-490b-a93e-f816f9bc4b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:42:57.844323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52978b-7f83-490b-a93e-f816f9bc4b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:42:57.845746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52978b-7f83-490b-a93e-f816f9bc4b91 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:42:57.855448 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4369/8724] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:42:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:07.851023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=26 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:35.781560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae182c-70d3-4d27-9ecd-ba4aea84343e None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:43:35.782168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae182c-70d3-4d27-9ecd-ba4aea84343e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:43:35.782168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae182c-70d3-4d27-9ecd-ba4aea84343e None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:43:35.783581 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4356/8725] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:43:35.791280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:43:35.791797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:43:35.791909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:43:35.813078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:43:35.814349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:43:35.822230 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4370/8726] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:43:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:43:35.835660 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae182c-70d3-4d27-9ecd-ba4aea84343e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:43:35.846876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae182c-70d3-4d27-9ecd-ba4aea84343e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:43:35.851603 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:43:35.852246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:43:35.852531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:43:35.852807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:43:35.860597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:43:35.862484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:43:35.870745 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4357/8727] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:43:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:45.807299 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:45.867169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:43:46.681778 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:43:46.683141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:43:46.754196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a6712-f308-478c-86ce-81f14d02f7a8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:43:46.759873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:43:46.760477 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:43:46.760757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:43:46.761029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:43:46.762716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:43:46.777418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:43:46.779189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:43:46.792145 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4371/8728] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:43:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:50.319430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:43:50.328409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1d6f-dde5-43c5-82ae-81dff0ba6bbb service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:43:50.332075 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:43:50.332693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:43:50.332978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:43:50.333255 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:43:50.334980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:43:50.346928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:43:50.353317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:43:50.359817 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4358/8729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:43:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:43:56.785075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=32 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:00.353420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:44:03.645448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:44:03.646875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:03.663692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c69a9-5784-4725-bc23-80f1f69aa70d service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:44:03.668928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:44:03.669540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:44:03.669840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:44:03.670099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:44:03.671892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:44:03.685991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:44:03.687614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:44:03.700645 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4372/8730] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:44:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:44:13.693371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:11.366943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:11.385523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11c68c-ac78-4c88-ba8e-0050df918b77 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:11.389715 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:11.390295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:11.390579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:11.390848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:11.392864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:11.437772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:11.439148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:11.449757 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4359/8731] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:17.416343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:17.456065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fcbc4-7877-47f6-a35d-31ec5b782c68 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:17.461672 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:17.462274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:17.462557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:17.462833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:17.464608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:17.523469 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:17.525056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:17.535199 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4373/8732] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:19.342437 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:19.360268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a1a6-d282-4bb8-a80a-c1dbec5a309e service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:19.366897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:19.367694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:19.368078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:19.368506 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:19.370657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:19.389356 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:19.391742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:19.407951 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4360/8733] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:21.908820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:21.923110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48053-81bd-4ac6-8575-9d93644ca0c1 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:21.928730 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:21.929329 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:21.929616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:21.929892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:21.931812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:21.946900 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:21.948567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:21.962265 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4374/8734] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:29.078178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:29.087615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee3a47-cb26-4e4b-beb2-08135b422622 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:29.091257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:29.091860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:29.092144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:29.092422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:29.094207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:29.158886 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:29.160350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:29.169933 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4361/8735] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:31.955350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=45 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:32.761648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:32.776037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aedfe-f211-4cbd-8a72-7787c3ea7eda service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:32.781403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:32.781998 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:32.782283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:32.782557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:32.784824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:32.800892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:32.802548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:32.816140 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4375/8736] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:36.518661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:36.533366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a812e2a-e336-4e8a-9fba-a87abb4e2b53 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:36.538717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:36.539358 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:36.539669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:36.539943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:36.541695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:36.560962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:36.562572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:36.575580 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4362/8737] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:45:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:45:36.674094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:36.676250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:36.689987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5de179-2e8a-4dd4-94d0-8b2eaa032a38 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:36.694613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:36.700220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:36.700220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:36.700220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] PATH_INFO: `/v3/users/a36875e5990b487bb1357e0b46dac402` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:36.700220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36875e5990b487bb1357e0b46dac402)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:36.700220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:36.922199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36875e5990b487bb1357e0b46dac402'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:36.929285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36875e5990b487bb1357e0b46dac402'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:36.929968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36875e5990b487bb1357e0b46dac402'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:36.930604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36875e5990b487bb1357e0b46dac402'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:36.943205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36875e5990b487bb1357e0b46dac402'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.021614 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4376/8738] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:45:36 2022] DELETE /identity/v3/users/a36875e5990b487bb1357e0b46dac402 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:45:37.277770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:37.289265 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5a4e-874d-4f45-871e-599791af8501 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:37.356301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:37.356976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:37.357259 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:37.358049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] PATH_INFO: `/v3/projects/edc027a6f642454d8592b308777d59e4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:37.359260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc027a6f642454d8592b308777d59e4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:37.361150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:37.378606 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:37.495796 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc027a6f642454d8592b308777d59e4', 'request_id': 'req-535aa461-dee3-42bf-b87b-b0ab3d9954e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.502551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc027a6f642454d8592b308777d59e4', 'request_id': 'req-535aa461-dee3-42bf-b87b-b0ab3d9954e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.508499 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc027a6f642454d8592b308777d59e4', 'request_id': 'req-535aa461-dee3-42bf-b87b-b0ab3d9954e6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.575539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] The token cache is being invalidate because project edc027a6f642454d8592b308777d59e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:45:37.576214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.576504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.578021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4363/8739] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:45:37 2022] DELETE /identity/v3/projects/edc027a6f642454d8592b308777d59e4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:45:37.582020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:37.583446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:37.597212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6fad-519d-4ea5-83aa-701974703b6e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:37.652997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:37.653623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:37.653902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:37.654174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] PATH_INFO: `/v3/users/24649773dd1f4002bd6e215fbc89cb37` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:37.655845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24649773dd1f4002bd6e215fbc89cb37)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:37.658005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:37.840721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24649773dd1f4002bd6e215fbc89cb37'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.848275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24649773dd1f4002bd6e215fbc89cb37'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.848957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24649773dd1f4002bd6e215fbc89cb37'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.849599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24649773dd1f4002bd6e215fbc89cb37'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.854178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:37.862789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-820327a1-8a08-446b-916b-d06d0927cd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24649773dd1f4002bd6e215fbc89cb37'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:37.952644 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4377/8740] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:45:37 2022] DELETE /identity/v3/users/24649773dd1f4002bd6e215fbc89cb37 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:45:38.211578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:45:38.213296 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:45:38.227482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa461-dee3-42bf-b87b-b0ab3d9954e6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:45:38.285640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:45:38.286283 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:45:38.286572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:45:38.286853 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] PATH_INFO: `/v3/projects/3c8379a1c62f462ba3dc67e02bff2ddb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:45:38.288049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8379a1c62f462ba3dc67e02bff2ddb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:45:38.289967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:45:38.422300 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8379a1c62f462ba3dc67e02bff2ddb', 'request_id': 'req-e610ef01-8853-4595-ab1d-2b33678e7d24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:38.428748 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8379a1c62f462ba3dc67e02bff2ddb', 'request_id': 'req-e610ef01-8853-4595-ab1d-2b33678e7d24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:38.434510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8379a1c62f462ba3dc67e02bff2ddb', 'request_id': 'req-e610ef01-8853-4595-ab1d-2b33678e7d24'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:38.535530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] The token cache is being invalidate because project 3c8379a1c62f462ba3dc67e02bff2ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:45:38.535841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:38.536504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-e610ef01-8853-4595-ab1d-2b33678e7d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:45:38.538006 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4364/8741] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:45:38 2022] DELETE /identity/v3/projects/3c8379a1c62f462ba3dc67e02bff2ddb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:45:48.009743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:45:48.532121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:46:50.705225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:50.705849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:50.705849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:50.735607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:50.736820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:50.814612 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4378/8742] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Sep 6 11:46:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:50.826651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1bfb2-afdf-4b52-ab7e-963376ac9029 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:50.827110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1bfb2-afdf-4b52-ab7e-963376ac9029 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:50.827242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1bfb2-afdf-4b52-ab7e-963376ac9029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:50.847859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-03a1bfb2-afdf-4b52-ab7e-963376ac9029 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:46:50.849047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-03a1bfb2-afdf-4b52-ab7e-963376ac9029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:46:50.857573 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4365/8743] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 11:46:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:46:50.863643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:46:50.874115 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a73d0-6e21-489b-a3b7-00c423371048 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:46:50.879389 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0e34-c860-40de-9dd5-e011587189b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:46:50.880003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0e34-c860-40de-9dd5-e011587189b5 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:46:50.880285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0e34-c860-40de-9dd5-e011587189b5 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:46:50.880559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0e34-c860-40de-9dd5-e011587189b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:46:50.889505 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0e34-c860-40de-9dd5-e011587189b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:46:50.891185 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0e34-c860-40de-9dd5-e011587189b5 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:46:50.901978 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4379/8744] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:46:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:47:00.842343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:00.897905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=46 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:06.659164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:06.659814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:06.659814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:06.679511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:47:06.680652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:06.689805 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4366/8745] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Sep 6 11:47:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:47:06.701318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:06.701767 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:06.701885 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:06.721594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:47:06.722772 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:06.731225 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4380/8746] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 11:47:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:47:06.737648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:06.748010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab9725-816b-4dc3-bd0d-5683369e35e8 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:06.753048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:06.753637 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:06.753919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:06.754279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:06.762535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:06.764290 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:06.773795 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4367/8747] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:47:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:47:16.716183 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:16.770321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:40.518430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:40.520486 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:40.596731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039214d-6c01-478a-bf2b-8f8481a091d9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:40.602467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:40.603099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:40.603382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:40.603654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:40.605420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:40.673592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:40.675250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:40.686099 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4381/8748] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:47:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:47:40.745004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:40.746476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:40.805441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf651-f15d-42af-a140-b3bac4f6d602 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:40.809421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:40.810474 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:40.810760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:40.811073 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:40.812815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:40.830051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:40.831613 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:40.844948 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4368/8749] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:47:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:47:42.032903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:42.042691 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76152272-1b2e-40ba-bc5d-d501936f9e6a service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:42.046292 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:42.046889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:42.047203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:42.047481 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:42.049221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:42.065165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:42.066606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:42.081037 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4382/8750] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:47:45.248692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:45.250441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:45.263865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20e06-2e40-4683-993f-874d205cea1a service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:45.267677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:45.268289 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:45.268639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:45.268895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:45.270693 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:45.361372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:45.362811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:45.373512 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4369/8751] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:47:52.073288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=62 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:52.726970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:52.730738 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:52.760894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2457-762b-497b-93b4-26738ce4cad7 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:52.765841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:52.766494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:52.766773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:52.767284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] PATH_INFO: `/v3/users/6b891d06b3f9408aa56f2a7fcf042b88` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:52.768488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b891d06b3f9408aa56f2a7fcf042b88)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:52.771361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:53.023319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b891d06b3f9408aa56f2a7fcf042b88'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.033822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b891d06b3f9408aa56f2a7fcf042b88'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.034593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b891d06b3f9408aa56f2a7fcf042b88'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.035348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b891d06b3f9408aa56f2a7fcf042b88'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.049147 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b891d06b3f9408aa56f2a7fcf042b88'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.134097 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4383/8752] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:47:52 2022] DELETE /identity/v3/users/6b891d06b3f9408aa56f2a7fcf042b88 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:47:53.440760 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:53.455667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38145a2-09cd-4f10-96f1-da6b60d4bba0 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:53.533027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:53.533881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:53.534310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:53.534735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] PATH_INFO: `/v3/projects/0dfc5d591ce044de8497d55f8df5248a` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:53.536114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfc5d591ce044de8497d55f8df5248a)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:53.538226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:53.564329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:53.646167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfc5d591ce044de8497d55f8df5248a', 'request_id': 'req-164e202b-31f0-4b81-8250-53f41cf90d73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.653330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfc5d591ce044de8497d55f8df5248a', 'request_id': 'req-164e202b-31f0-4b81-8250-53f41cf90d73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.660266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfc5d591ce044de8497d55f8df5248a', 'request_id': 'req-164e202b-31f0-4b81-8250-53f41cf90d73'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.739626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] The token cache is being invalidate because project 0dfc5d591ce044de8497d55f8df5248a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:47:53.739927 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.740525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:53.742100 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4370/8753] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:47:53 2022] DELETE /identity/v3/projects/0dfc5d591ce044de8497d55f8df5248a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:47:53.746550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:53.748191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:53.764241 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61c3f-7ab2-4716-a875-f18f4fa15ea9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:53.834564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:53.835246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:53.835528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:53.835800 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] PATH_INFO: `/v3/users/64df126528f342ec8c121c80e79f7882` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:53.839570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64df126528f342ec8c121c80e79f7882)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:53.841907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:54.121150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64df126528f342ec8c121c80e79f7882'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.131504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64df126528f342ec8c121c80e79f7882'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.132352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64df126528f342ec8c121c80e79f7882'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.132967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64df126528f342ec8c121c80e79f7882'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.152257 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-6867d8e1-a0eb-42e6-85e3-6aac2289eab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64df126528f342ec8c121c80e79f7882'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.153976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:47:54.211415 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4384/8754] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:47:53 2022] DELETE /identity/v3/users/64df126528f342ec8c121c80e79f7882 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:47:54.487852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:47:54.489690 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:47:54.507457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e202b-31f0-4b81-8250-53f41cf90d73 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:47:54.578824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:47:54.579535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:47:54.579854 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:47:54.580102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] PATH_INFO: `/v3/projects/94b7e8422d604908a822fd0d13ed0b66` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:47:54.581324 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b7e8422d604908a822fd0d13ed0b66)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:47:54.584035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:47:54.733582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b7e8422d604908a822fd0d13ed0b66', 'request_id': 'req-2c1d4f92-0d1a-4938-8869-2f70497593d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.741676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b7e8422d604908a822fd0d13ed0b66', 'request_id': 'req-2c1d4f92-0d1a-4938-8869-2f70497593d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.747988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b7e8422d604908a822fd0d13ed0b66', 'request_id': 'req-2c1d4f92-0d1a-4938-8869-2f70497593d6'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.821947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] The token cache is being invalidate because project 94b7e8422d604908a822fd0d13ed0b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:47:54.822306 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.822920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2c1d4f92-0d1a-4938-8869-2f70497593d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:47:54.824599 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4371/8755] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:47:54 2022] DELETE /identity/v3/projects/94b7e8422d604908a822fd0d13ed0b66 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:04.247438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:04.816706 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:06.623933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:06.624519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:06.624758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:06.689283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:06.690567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:06.767133 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4385/8756] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:06.777420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:06.779180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:06.779180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:06.807818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:06.809350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:06.824604 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4372/8757] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:06.829755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:06.843417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49112431-07fa-459c-aa9f-5abeadb06a9d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:06.851035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:06.852136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:06.852536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:06.852820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:06.853551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:06.854057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:06.856968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:06.875175 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4386/8758] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:48:06.887061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:06.898076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed684563-fff0-4a08-97d6-c68347480cb9 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:06.903213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:06.903868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:06.904158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:06.904439 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:06.905105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:06.907384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:07.051893 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4373/8759] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:06 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:07.057590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:07.075057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf78c0-73e0-4add-a62e-8780d4937308 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:07.147156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:07.148055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.148434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.148818 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.149560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:07.151777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:07.240858 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4387/8760] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:07 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:07.247212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:07.261989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c9e8-c883-4ae2-acf0-109d6b1f8579 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:07.269187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:07.270203 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.270651 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.271171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.272311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:07.274990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:07.290918 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4374/8761] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:07.296339 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:07.312519 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5c169-f4d9-4e39-b1f9-99ce327bbfa9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:07.319629 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40044736-8765-4fb0-8b70-a88f9ebbf00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:07.320537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40044736-8765-4fb0-8b70-a88f9ebbf00f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.321000 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40044736-8765-4fb0-8b70-a88f9ebbf00f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.321458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40044736-8765-4fb0-8b70-a88f9ebbf00f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.322503 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40044736-8765-4fb0-8b70-a88f9ebbf00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:07.325204 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40044736-8765-4fb0-8b70-a88f9ebbf00f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:07.342211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4388/8762] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:07.349373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:07.364376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8603e9-6815-43c6-bd8c-5ac62a533180 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:07.372725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:07.373777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.374251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.374727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] PATH_INFO: `/v3/projects/d7a6f20b7d4143dda501dce5b788f4f6/users/4d8b745bd5c84c3780ade7252222f1d4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.399135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a6f20b7d4143dda501dce5b788f4f6, user_id=4d8b745bd5c84c3780ade7252222f1d4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:07.401896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:07.477390 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4375/8763] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:07 2022] PUT /identity/v3/projects/d7a6f20b7d4143dda501dce5b788f4f6/users/4d8b745bd5c84c3780ade7252222f1d4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:07.492509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.492996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.493467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.541375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] MFA Rules not processed for user `4d8b745bd5c84c3780ade7252222f1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:07.543366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:07.594584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:07.644357 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4389/8764] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:07.649500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:07.721319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8b4b-9c2d-40b0-8ffa-06a45c5efafc admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:07.729184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:07.729824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.730286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.730670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.731396 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:07.733384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:07.829404 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4376/8765] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:07 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:07.833758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:07.845647 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bde53-0e77-4c8a-939f-3c13cda8a11d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:07.918521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:07.919342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:07.919634 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:07.919980 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:07.920706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:07.924211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:08.041800 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4390/8766] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:07 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:08.046007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:08.058448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cada88-bc52-451f-803d-9807f03a7dde admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:08.069167 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:08.070128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.070477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.070841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.071980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:08.074852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:08.094445 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4377/8767] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:08.103728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:08.122244 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e4e7f-22f6-440f-8399-38461f65f76f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:08.129466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:08.130202 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.130484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.130764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] PATH_INFO: `/v3/projects/e2092d74a5c249869ecdd12efc7429d4/users/cc9be9e86a2b4204b035a1b09d4c733c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.149322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2092d74a5c249869ecdd12efc7429d4, user_id=cc9be9e86a2b4204b035a1b09d4c733c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:08.154879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:08.226182 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4391/8768] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:08 2022] PUT /identity/v3/projects/e2092d74a5c249869ecdd12efc7429d4/users/cc9be9e86a2b4204b035a1b09d4c733c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:08.230810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:08.242229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7c8e0-4edc-4172-a8d2-e8fd17c472e8 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:08.311743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03685de-e1a0-4f71-ba49-390a9182247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:08.312416 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03685de-e1a0-4f71-ba49-390a9182247f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.312744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03685de-e1a0-4f71-ba49-390a9182247f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.313027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03685de-e1a0-4f71-ba49-390a9182247f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.313757 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03685de-e1a0-4f71-ba49-390a9182247f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:08.315520 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03685de-e1a0-4f71-ba49-390a9182247f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:08.318118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:08.330630 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4378/8769] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:08.335040 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:08.348188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc338d3-169d-4852-b3c3-7902ce691718 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:08.355565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac5a07-b515-4f03-853f-c9c8b6a94b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:08.356182 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac5a07-b515-4f03-853f-c9c8b6a94b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.356474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac5a07-b515-4f03-853f-c9c8b6a94b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.356740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac5a07-b515-4f03-853f-c9c8b6a94b63 admin admin] PATH_INFO: `/v3/projects/e2092d74a5c249869ecdd12efc7429d4/users/cc9be9e86a2b4204b035a1b09d4c733c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.359056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac5a07-b515-4f03-853f-c9c8b6a94b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2092d74a5c249869ecdd12efc7429d4, user_id=cc9be9e86a2b4204b035a1b09d4c733c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:08.364510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac5a07-b515-4f03-853f-c9c8b6a94b63 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:08.377420 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4392/8770] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:08 2022] PUT /identity/v3/projects/e2092d74a5c249869ecdd12efc7429d4/users/cc9be9e86a2b4204b035a1b09d4c733c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:08.392933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.393257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.393532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.431911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] MFA Rules not processed for user `cc9be9e86a2b4204b035a1b09d4c733c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:08.434052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:08.520837 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4379/8771] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:08.536508 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.536782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.537053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.560924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] MFA Rules not processed for user `4d8b745bd5c84c3780ade7252222f1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:08.562732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:08.643221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4393/8772] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:08.659238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:08.661314 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:08.761260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fd2eb-62a9-4e2d-bea2-134d8f0cd6ff None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:08.767400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984609e-4e57-4670-b8bd-05c1b334210c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:08.768035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984609e-4e57-4670-b8bd-05c1b334210c service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:08.768312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984609e-4e57-4670-b8bd-05c1b334210c service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:08.768586 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984609e-4e57-4670-b8bd-05c1b334210c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:08.778159 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984609e-4e57-4670-b8bd-05c1b334210c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:08.784913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984609e-4e57-4670-b8bd-05c1b334210c service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:08.796193 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4380/8773] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:09.407871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:09.409576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:09.455878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:09.518306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17dfde-5058-42ff-af17-3744918e301b None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:09.523963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:09.524597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:09.524872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:09.525151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:09.526981 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:09.540718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:09.542395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:09.554745 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4394/8774] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:18.791226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=73 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:19.047309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9670-ec7a-4a58-a55b-475ab638bd68 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:19.047607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9670-ec7a-4a58-a55b-475ab638bd68 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:19.047889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9670-ec7a-4a58-a55b-475ab638bd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:19.096526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3e9b9670-ec7a-4a58-a55b-475ab638bd68 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:19.097752 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3e9b9670-ec7a-4a58-a55b-475ab638bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:19.107876 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4381/8775] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 6 11:48:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:19.115343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:19.127814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749df2a-913c-4004-b9f1-b5cd3e9ff73f service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:19.139522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:19.139522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:19.139522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:19.139522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:19.140028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:19.152176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:19.153824 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971af9f-56d1-4003-9c8c-66a9f6d69671 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:19.167842 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4395/8776] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:20.069538 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:20.070123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:20.070123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:20.093999 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:20.095252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:20.105719 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4382/8777] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Sep 6 11:48:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:21.287073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.287513 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.287761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.307111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:21.308316 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.317518 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4396/8778] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:21.328582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.329949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.397182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28ec7-df0f-4a5e-93ea-34466b664762 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.400817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be0960-a008-4c26-adb3-4476256923ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.401425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0960-a008-4c26-adb3-4476256923ed service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.401712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0960-a008-4c26-adb3-4476256923ed service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.401991 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be0960-a008-4c26-adb3-4476256923ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.413057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0960-a008-4c26-adb3-4476256923ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.414516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be0960-a008-4c26-adb3-4476256923ed service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.425517 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4383/8779] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:21.560568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.572394 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373dd03-07b9-4621-a4e3-3bb7bbbfc2db None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.577888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.578478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.578848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.579165 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.588180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.593296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.599396 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4397/8780] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:21.614623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69051-8706-4ffa-8a40-9c67c1497991 None None] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.614917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69051-8706-4ffa-8a40-9c67c1497991 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.615228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69051-8706-4ffa-8a40-9c67c1497991 None None] PATH_INFO: `/` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.616601 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4384/8781] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:21.621341 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] Authenticating service token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:48:21.633001 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.641726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa510a0-2fdb-4900-b3ba-21ad6174536a service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.647105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3ea6-dfad-40ef-a470-47c55b003bc9 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9be9e86a2b4204b035a1b09d4c733c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2092d74a5c249869ecdd12efc7429d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.647727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3ea6-dfad-40ef-a470-47c55b003bc9 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.648013 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3ea6-dfad-40ef-a470-47c55b003bc9 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.648296 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3ea6-dfad-40ef-a470-47c55b003bc9 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] PATH_INFO: `/v3/projects/e2092d74a5c249869ecdd12efc7429d4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.649429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b3ea6-dfad-40ef-a470-47c55b003bc9 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2092d74a5c249869ecdd12efc7429d4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.651261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b3ea6-dfad-40ef-a470-47c55b003bc9 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.652887 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4398/8782] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/projects/e2092d74a5c249869ecdd12efc7429d4 => generated 391 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:21.863089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69051-8706-4ffa-8a40-9c67c1497991 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:21.873733 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69051-8706-4ffa-8a40-9c67c1497991 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:21.877639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:21.878228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:21.879063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:21.879338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:21.881072 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:21.893362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:21.895370 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:21.905850 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4385/8783] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:22.116418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287215-b47d-4928-afb4-4c74761e12ed None None] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.116731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287215-b47d-4928-afb4-4c74761e12ed None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.117027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287215-b47d-4928-afb4-4c74761e12ed None None] PATH_INFO: `/` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.118352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4399/8784] 10.222.0.20 () {54 vars in 912 bytes} [Tue Sep 6 11:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 11:48:22.122857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] Authenticating service token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Sep 06 11:48:22.135857 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.145699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-db9f-4471-bebb-b9355eed3571 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.150273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281accc-5c92-43a5-bbcf-736fd0bbf482 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc9be9e86a2b4204b035a1b09d4c733c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2092d74a5c249869ecdd12efc7429d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.150888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281accc-5c92-43a5-bbcf-736fd0bbf482 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.151205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281accc-5c92-43a5-bbcf-736fd0bbf482 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.151485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281accc-5c92-43a5-bbcf-736fd0bbf482 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] PATH_INFO: `/v3/projects/e2092d74a5c249869ecdd12efc7429d4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.152600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281accc-5c92-43a5-bbcf-736fd0bbf482 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] RBAC: Authorizing `identity:get_project(project_id=e2092d74a5c249869ecdd12efc7429d4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.154384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281accc-5c92-43a5-bbcf-736fd0bbf482 tempest-ServersAdminNegativeTestJSON-690292975 tempest-ServersAdminNegativeTestJSON-690292975-project-admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.156199 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4386/8785] 10.222.0.20 () {58 vars in 1443 bytes} [Tue Sep 6 11:48:22 2022] GET /identity/v3/projects/e2092d74a5c249869ecdd12efc7429d4 => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:22.381887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287215-b47d-4928-afb4-4c74761e12ed None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:22.392871 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287215-b47d-4928-afb4-4c74761e12ed None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:22.396974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:22.397567 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:22.397851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:22.398127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:22.399881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:22.412235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:22.413665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:22.424571 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4400/8786] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:24.147831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.148389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.148389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.168746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:24.169979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:24.180051 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4387/8787] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:48:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:24.191376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:24.199987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72209c79-998b-471d-94ea-2b1be11d7a98 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:24.203624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4164df-67c5-4a7b-8356-5ba6d79db3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:24.204215 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4164df-67c5-4a7b-8356-5ba6d79db3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:24.204498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4164df-67c5-4a7b-8356-5ba6d79db3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:24.204774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4164df-67c5-4a7b-8356-5ba6d79db3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:24.215422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4164df-67c5-4a7b-8356-5ba6d79db3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:24.216920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4164df-67c5-4a7b-8356-5ba6d79db3d1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:24.228320 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4401/8788] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:48:26.509547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:26.573649 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdff95-7b35-4b67-95f2-a913be41f9c1 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:26.578153 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:26.578782 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.579189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.579392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] PATH_INFO: `/v3/users/4d8b745bd5c84c3780ade7252222f1d4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.580533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8b745bd5c84c3780ade7252222f1d4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:26.582485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:26.785928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:26.797838 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8b745bd5c84c3780ade7252222f1d4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:26.805600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8b745bd5c84c3780ade7252222f1d4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:26.806295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8b745bd5c84c3780ade7252222f1d4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:26.818013 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8b745bd5c84c3780ade7252222f1d4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:26.818661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8b745bd5c84c3780ade7252222f1d4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:26.915853 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4388/8789] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:26 2022] DELETE /identity/v3/users/4d8b745bd5c84c3780ade7252222f1d4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:26.920499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:26.920974 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:26.921075 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:26.940678 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:26.941953 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:27.000869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4402/8790] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:27.015990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.015990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:27.071475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935e3e-ba62-48a9-9176-b8fa06b5e7fd admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.075362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.075989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.076273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.076547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.088106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.090574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.101584 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4389/8791] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:27.334009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.335538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:27.349133 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bb097-1e34-4cc7-b355-6cf5d0f62c23 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.352960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.353598 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.353880 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.354156 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] PATH_INFO: `/v3/projects/d7a6f20b7d4143dda501dce5b788f4f6` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.355300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a6f20b7d4143dda501dce5b788f4f6)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.357211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.469227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:27.470612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a6f20b7d4143dda501dce5b788f4f6', 'request_id': 'req-3121f768-2ff6-4510-b4fc-d3d8575c3e94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.477324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a6f20b7d4143dda501dce5b788f4f6', 'request_id': 'req-3121f768-2ff6-4510-b4fc-d3d8575c3e94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.483790 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a6f20b7d4143dda501dce5b788f4f6', 'request_id': 'req-3121f768-2ff6-4510-b4fc-d3d8575c3e94'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.548029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] The token cache is being invalidate because project d7a6f20b7d4143dda501dce5b788f4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:27.548231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.548884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.550427 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4403/8792] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:27 2022] DELETE /identity/v3/projects/d7a6f20b7d4143dda501dce5b788f4f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:27.554595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:27.564735 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f2da-647a-445c-8f47-b74eedd7c267 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:27.621500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:27.622121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:27.622403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:27.622680 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] PATH_INFO: `/v3/users/cc9be9e86a2b4204b035a1b09d4c733c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:27.623830 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9be9e86a2b4204b035a1b09d4c733c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:27.625809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:27.797019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9be9e86a2b4204b035a1b09d4c733c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.802605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:27.804580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9be9e86a2b4204b035a1b09d4c733c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.805269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9be9e86a2b4204b035a1b09d4c733c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.817410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9be9e86a2b4204b035a1b09d4c733c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:27.818047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6feacd29-060b-4700-995a-6b02734247a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9be9e86a2b4204b035a1b09d4c733c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:28.023588 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4390/8793] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:48:27 2022] DELETE /identity/v3/users/cc9be9e86a2b4204b035a1b09d4c733c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:28.420310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:28.421883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:28.436459 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f768-2ff6-4510-b4fc-d3d8575c3e94 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:28.499816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:28.503307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.503307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.503307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] PATH_INFO: `/v3/projects/e2092d74a5c249869ecdd12efc7429d4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.503307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2092d74a5c249869ecdd12efc7429d4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:28.504214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:28.606630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2092d74a5c249869ecdd12efc7429d4', 'request_id': 'req-4fd3ca06-243f-4265-a00d-cf427942e98c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:28.612123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2092d74a5c249869ecdd12efc7429d4', 'request_id': 'req-4fd3ca06-243f-4265-a00d-cf427942e98c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:28.619003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2092d74a5c249869ecdd12efc7429d4', 'request_id': 'req-4fd3ca06-243f-4265-a00d-cf427942e98c'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:28.680310 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] The token cache is being invalidate because project e2092d74a5c249869ecdd12efc7429d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:48:28.680529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:28.681167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4fd3ca06-243f-4265-a00d-cf427942e98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:48:28.682643 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4404/8794] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:48:28 2022] DELETE /identity/v3/projects/e2092d74a5c249869ecdd12efc7429d4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:48:28.688585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.689049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.689166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.709540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:28.710744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:28.775857 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4391/8795] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:28.785190 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.785521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.785845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.805884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:28.807151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:28.815593 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4405/8796] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:28.819974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:28.829833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5372-d85e-47fb-af02-0ba32703c5bd None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:28.834984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:28.835631 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.835915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.836322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.836973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:48:28.837305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:28.838981 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:28.852286 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4392/8797] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:48:28.855977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:28.865748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05a0c-cae9-4df6-ad2c-9e7cc8ef33b1 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:28.870456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:28.871093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:28.871376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:28.871650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:28.872265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:28.874161 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:28.962997 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4406/8798] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:48:28 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:48:28.967261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:28.977859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d359-dc93-4301-9b9e-5e83c157bf8f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.035843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.036460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.036744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.037024 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.037662 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.039597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.098079 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4393/8799] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:48:28 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:48:29.103571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.115069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e71d3-2455-422f-8d15-f6cd2fcf781a admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.119844 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.120910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.120910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.121112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.121645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.123275 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.134256 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4407/8800] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:29.138459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.149552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae3d8-7154-407e-b1b0-d082ac434b94 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.154336 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b4ce4-51b0-4b22-bb1b-b0c3811c3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.154959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b4ce4-51b0-4b22-bb1b-b0c3811c3d9f admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.158234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b4ce4-51b0-4b22-bb1b-b0c3811c3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.158234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b4ce4-51b0-4b22-bb1b-b0c3811c3d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.158234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b4ce4-51b0-4b22-bb1b-b0c3811c3d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.158234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b4ce4-51b0-4b22-bb1b-b0c3811c3d9f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.168564 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4394/8801] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:48:29.172792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.183332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277c15-c5b2-488e-b6ac-98525397794e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.188407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.189101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.189387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.189668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] PATH_INFO: `/v3/projects/ed84581848dc4945aceddca0cbb802a4/users/3181493b161543c69b83f3f368360031/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.205142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed84581848dc4945aceddca0cbb802a4, user_id=3181493b161543c69b83f3f368360031, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.208554 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.303546 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4408/8802] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:48:29 2022] PUT /identity/v3/projects/ed84581848dc4945aceddca0cbb802a4/users/3181493b161543c69b83f3f368360031/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:48:29.308618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b1a6-6ce1-4d6f-9e3e-541ad3576bef None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.308911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b1a6-6ce1-4d6f-9e3e-541ad3576bef None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.309189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b1a6-6ce1-4d6f-9e3e-541ad3576bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.329900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-f693b1a6-6ce1-4d6f-9e3e-541ad3576bef None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:29.331142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f693b1a6-6ce1-4d6f-9e3e-541ad3576bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.363604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:29.390548 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4395/8803] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:29.401276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:29.403004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:29.408776 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:29.461123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4607a-d1a4-47c3-95d3-ec3dd98e7e4e admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:29.465605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e500758-ca9e-4bc5-8315-7a385d3ee823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:29.466211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e500758-ca9e-4bc5-8315-7a385d3ee823 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:29.466532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e500758-ca9e-4bc5-8315-7a385d3ee823 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:29.466852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e500758-ca9e-4bc5-8315-7a385d3ee823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:29.476206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e500758-ca9e-4bc5-8315-7a385d3ee823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:29.477676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e500758-ca9e-4bc5-8315-7a385d3ee823 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:29.487489 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4409/8804] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:34.993827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:34.994409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:34.994526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.025130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] MFA Rules not processed for user `3181493b161543c69b83f3f368360031`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:35.027205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:35.104404 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4396/8805] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:35.115963 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:35.116455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:35.116562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.141184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] MFA Rules not processed for user `3181493b161543c69b83f3f368360031`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:35.142547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:35.151843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4410/8806] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:48:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:48:35.167084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:35.170793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:35.249803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fb648-1b79-4b10-9191-4e2b6dc3a034 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:35.256219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fb7e4-46a9-431e-910f-7e0ac17be9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:35.256851 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb7e4-46a9-431e-910f-7e0ac17be9a9 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:35.257139 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb7e4-46a9-431e-910f-7e0ac17be9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:35.257426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb7e4-46a9-431e-910f-7e0ac17be9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:35.266044 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fb7e4-46a9-431e-910f-7e0ac17be9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:35.267732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fb7e4-46a9-431e-910f-7e0ac17be9a9 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:35.278292 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4397/8807] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:36.938599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:36.940065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.012475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b554-0e4c-492d-b64f-ab61432b7cf4 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:37.017615 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:37.018583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:37.018583 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:37.019058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:37.020804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:37.033216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:37.034828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:37.045159 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4411/8808] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:43.016260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931dba-6422-4a62-a22f-d2d90fc2c316 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.016811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931dba-6422-4a62-a22f-d2d90fc2c316 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.016811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931dba-6422-4a62-a22f-d2d90fc2c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:43.058856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-48931dba-6422-4a62-a22f-d2d90fc2c316 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:43.060568 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-48931dba-6422-4a62-a22f-d2d90fc2c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:43.068319 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4398/8809] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Sep 6 11:48:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:43.079425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:43.081417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:43.097897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0cdee-9e7a-424b-a469-5c3bcde6c694 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:43.102260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:43.102884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.103200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.103476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:43.111528 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:43.112986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:43.121498 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4412/8810] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:43.997498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a902-7407-4586-8aaf-74f9e2502ae8 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:43.998140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a902-7407-4586-8aaf-74f9e2502ae8 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:43.998888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a902-7407-4586-8aaf-74f9e2502ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.024897 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8505a902-7407-4586-8aaf-74f9e2502ae8 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:44.026155 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8505a902-7407-4586-8aaf-74f9e2502ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.037129 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4399/8811] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:48:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:44.057449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:44.058904 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:44.079645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f201a34-e04b-4664-8d8e-a57c16958764 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:44.085725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:44.086428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:44.086753 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:44.087079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:44.099083 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:44.099325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:44.111743 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4413/8812] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:49.137152 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.137919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.138095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.158841 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:48:49.160698 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:49.172094 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4400/8813] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:48:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:48:49.186276 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:49.197590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e2ee-1e86-4eff-b3ec-ca415093632e service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:49.203386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:49.203991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:49.204526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:49.204526 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:49.216303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:49.218068 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:49.230700 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4414/8814] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:52.392206 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.402639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffa6a8-f82f-4b03-b584-d717808ae5fb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.406579 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.407231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.407518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.407811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.409514 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.421969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.423484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.434577 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4401/8815] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:52.606118 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.618420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781f90f-ca65-4803-99bf-ab0165fd2375 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.623561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.624169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.624460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.624745 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.626641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.654175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.655851 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27affc87-f2ee-4ef2-a5a0-72e9b62cf09b service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:52.666705 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4415/8816] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:48:52.957477 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:48:52.966344 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa63d2-6d22-4c57-8bc3-7dbbb1905e54 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:48:52.970223 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:48:52.970881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:48:52.971267 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:48:52.971546 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:48:52.973305 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:48:52.983618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:48:52.990596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:48:52.992099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:48:53.006704 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4402/8817] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:48:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:02.662258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:03.011124 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:12.975547 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:12.976152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:12.976152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:12.995458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:12.996674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:13.003673 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4416/8818] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Sep 6 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:49:13.015240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:13.024545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39d11-64e8-4c7c-9f8b-4b86727914bc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:13.028287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:13.028893 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:13.029165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:13.029441 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:13.037508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:13.038930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:13.046654 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4403/8819] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:22.990109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:23.043291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:26.828122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:26.850803 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c105b9-ff4b-4435-a4e8-a817f0516760 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:26.855437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:26.856061 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:26.856344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:26.856620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] PATH_INFO: `/v3/users/3181493b161543c69b83f3f368360031` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:26.857739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3181493b161543c69b83f3f368360031)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:26.859693 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.023424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3181493b161543c69b83f3f368360031'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.030259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3181493b161543c69b83f3f368360031'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.030917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3181493b161543c69b83f3f368360031'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.031879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3181493b161543c69b83f3f368360031'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.043614 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-5c9f5308-8158-4176-ada3-4d87bdfb39e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3181493b161543c69b83f3f368360031'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.118750 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4417/8820] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:49:26 2022] DELETE /identity/v3/users/3181493b161543c69b83f3f368360031 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:27.349658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.368262 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ab800-349f-4d22-baf8-1ea4b8ecf679 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.432790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.433444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.433725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.433998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] PATH_INFO: `/v3/projects/ed84581848dc4945aceddca0cbb802a4` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.436625 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed84581848dc4945aceddca0cbb802a4)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.437227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.539249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed84581848dc4945aceddca0cbb802a4', 'request_id': 'req-1f76b479-920c-47ec-9601-d2f66c95b8a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.546093 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed84581848dc4945aceddca0cbb802a4', 'request_id': 'req-1f76b479-920c-47ec-9601-d2f66c95b8a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.552137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed84581848dc4945aceddca0cbb802a4', 'request_id': 'req-1f76b479-920c-47ec-9601-d2f66c95b8a2'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.593285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] The token cache is being invalidate because project ed84581848dc4945aceddca0cbb802a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:49:27.593585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.594238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-1f76b479-920c-47ec-9601-d2f66c95b8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:49:27.595753 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4404/8821] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:49:27 2022] DELETE /identity/v3/projects/ed84581848dc4945aceddca0cbb802a4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:27.601353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.603783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.603783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.623512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:27.624728 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.683981 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4418/8822] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:27.692413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.692708 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.692989 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.712793 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:27.714030 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:27.722347 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4405/8823] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:27.726996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.737055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1fddb-a844-4b74-83cc-4f3fba499420 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.742303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.742895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.743209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.743484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.744114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:49:27.744420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.746002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.757945 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4419/8824] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:49:27.762501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.772319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bfcc2-e67f-46d2-a89b-05dca67308ed None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.776882 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.777473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.777754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.778029 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.778657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.780585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:27.875255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4406/8825] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:49:27 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:49:27.879441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:27.890646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9f7aa-a562-4479-bd32-9522fb7752a1 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:27.936561 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:27.946703 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:27.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:27.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:27.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:27.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:27.950584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.027306 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4420/8826] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:49:27 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:49:28.031858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.042229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468bcc0-2e28-40e7-a0ac-d0728277ace5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.046966 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.047592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.047875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.048154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.048895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.050594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.061369 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4407/8827] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:28.067476 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.078826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cac40-0a45-4f25-bf93-c80cc34c6525 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.084038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c0fa2-d9a7-4cb4-87bc-0c38f0ce7e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.084868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0fa2-d9a7-4cb4-87bc-0c38f0ce7e52 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.085483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0fa2-d9a7-4cb4-87bc-0c38f0ce7e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.086086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c0fa2-d9a7-4cb4-87bc-0c38f0ce7e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.086813 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0fa2-d9a7-4cb4-87bc-0c38f0ce7e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.088507 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c0fa2-d9a7-4cb4-87bc-0c38f0ce7e52 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.099402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4421/8828] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:49:28.108404 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.119235 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88943bbf-a330-4191-92d5-3e424607ad44 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.124448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.125108 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.125394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.125672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] PATH_INFO: `/v3/projects/79eeb48bec764f39b1f0953ae0812355/users/8baf03f68275463e8a86261e7ccab728/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.143121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eeb48bec764f39b1f0953ae0812355, user_id=8baf03f68275463e8a86261e7ccab728, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.145833 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.239800 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4408/8829] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:49:28 2022] PUT /identity/v3/projects/79eeb48bec764f39b1f0953ae0812355/users/8baf03f68275463e8a86261e7ccab728/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:49:28.245499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655b99-3124-40e6-ab5c-e4a240810453 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.245786 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655b99-3124-40e6-ab5c-e4a240810453 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.246064 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655b99-3124-40e6-ab5c-e4a240810453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.265332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-2c655b99-3124-40e6-ab5c-e4a240810453 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:28.266569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2c655b99-3124-40e6-ab5c-e4a240810453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.327750 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4422/8830] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:28.339257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:28.341234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:28.374786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:28.402490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef3936-0bed-485a-9619-1c14f1a1ec6d admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:28.407234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec1b38-aaf8-4c10-9dff-ab084cf831fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:28.407847 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec1b38-aaf8-4c10-9dff-ab084cf831fa service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:28.408130 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec1b38-aaf8-4c10-9dff-ab084cf831fa service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:28.408403 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec1b38-aaf8-4c10-9dff-ab084cf831fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:28.418825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec1b38-aaf8-4c10-9dff-ab084cf831fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:28.420285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec1b38-aaf8-4c10-9dff-ab084cf831fa service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:28.430377 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4409/8831] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:33.378837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:33.379358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:33.379448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:33.410409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] MFA Rules not processed for user `8baf03f68275463e8a86261e7ccab728`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:33.411674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:33.510233 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4423/8832] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:33.521184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f6e7d-f955-4efd-9613-373981e28ffc None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:33.522319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f6e7d-f955-4efd-9613-373981e28ffc None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:33.522319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f6e7d-f955-4efd-9613-373981e28ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:33.543575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8f7f6e7d-f955-4efd-9613-373981e28ffc None None] MFA Rules not processed for user `8baf03f68275463e8a86261e7ccab728`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:49:33.544839 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f7f6e7d-f955-4efd-9613-373981e28ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:33.555983 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4410/8833] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:49:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:49:33.564063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:49:33.566078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:49:33.635652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:33.655930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b712287-a9a6-4b18-906e-0538d101ca4a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:49:33.662332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7730fa-fcd1-4213-bc10-b5064e7d98ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:49:33.663205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7730fa-fcd1-4213-bc10-b5064e7d98ba service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:49:33.663493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7730fa-fcd1-4213-bc10-b5064e7d98ba service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:49:33.663771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7730fa-fcd1-4213-bc10-b5064e7d98ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:49:33.672540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7730fa-fcd1-4213-bc10-b5064e7d98ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:49:33.674149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7730fa-fcd1-4213-bc10-b5064e7d98ba service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:49:33.685778 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4424/8834] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:49:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:49:43.537466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=17 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:49:43.770564 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=7 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:19.001533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.002105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.002105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.023145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] MFA Rules not processed for user `8baf03f68275463e8a86261e7ccab728`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:19.024388 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:19.031641 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4411/8835] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:50:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:19.279052 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954063c-351f-4470-a531-4c08f5b252ea None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.279556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954063c-351f-4470-a531-4c08f5b252ea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.279665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954063c-351f-4470-a531-4c08f5b252ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.299236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a954063c-351f-4470-a531-4c08f5b252ea None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:50:19.300433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a954063c-351f-4470-a531-4c08f5b252ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:19.307046 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4425/8836] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:50:19.318992 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:50:19.320442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:50:19.333188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58131485-d71e-43f2-b07a-aa022b8f444e None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:50:19.336931 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:50:19.337532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:50:19.337815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:50:19.338088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:50:19.346292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:50:19.348246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:50:19.355854 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4412/8837] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:50:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:50:29.294027 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:50:29.352291 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:09.686478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:09.689937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:09.689937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:09.740665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:09.741987 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:09.820269 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4426/8838] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:51:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:09.834039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:09.834039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:09.841475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:09.851182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3aa2-c047-4aa1-8e4f-d75bc29ada85 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:09.857482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:09.861879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:09.861879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:09.861879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:09.865442 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4563f77-1ed3-4c21-90ac-2bb40dc66c7a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:09.870151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:09.870822 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:09.871525 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:09.871804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:09.872079 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] PATH_INFO: `/v3/users/8baf03f68275463e8a86261e7ccab728` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:09.872335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:09.873386 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baf03f68275463e8a86261e7ccab728)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:09.875471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:09.884885 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4413/8839] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:51:10.091565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baf03f68275463e8a86261e7ccab728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.099682 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baf03f68275463e8a86261e7ccab728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.100479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baf03f68275463e8a86261e7ccab728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.101114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baf03f68275463e8a86261e7ccab728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.115093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-3bcb7536-1523-4e7b-9e83-06ab518189ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baf03f68275463e8a86261e7ccab728'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.174398 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4427/8840] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:51:09 2022] DELETE /identity/v3/users/8baf03f68275463e8a86261e7ccab728 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:51:10.483460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:10.495666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a38fb-d429-4d32-8fbc-d77a59e708b7 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:10.563335 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:10.564140 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:10.564536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:10.564935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] PATH_INFO: `/v3/projects/79eeb48bec764f39b1f0953ae0812355` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:10.567087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79eeb48bec764f39b1f0953ae0812355)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:10.569552 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:10.685263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eeb48bec764f39b1f0953ae0812355', 'request_id': 'req-dfc045cd-19e9-42e4-bdb1-179b32d5d391'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.694362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eeb48bec764f39b1f0953ae0812355', 'request_id': 'req-dfc045cd-19e9-42e4-bdb1-179b32d5d391'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.706910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eeb48bec764f39b1f0953ae0812355', 'request_id': 'req-dfc045cd-19e9-42e4-bdb1-179b32d5d391'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.778737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] The token cache is being invalidate because project 79eeb48bec764f39b1f0953ae0812355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:51:10.779077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.779764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-dfc045cd-19e9-42e4-bdb1-179b32d5d391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:51:10.781393 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4414/8841] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:51:10 2022] DELETE /identity/v3/projects/79eeb48bec764f39b1f0953ae0812355 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:51:10.789759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:10.790530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:10.790726 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:10.814536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:10.815888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:10.877701 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:10.893447 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4428/8842] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:10.902394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:10.903116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:10.903116 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:10.928285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:10.929558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:10.938298 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4415/8843] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:10.943577 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:10.956307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084c760-6cc5-4cf2-8d94-8688246aa44f None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:10.969898 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:10.970579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:10.970874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:10.971180 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:10.973251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:51:10.973251 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:10.974450 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:10.989157 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4429/8844] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:51:10.994045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:11.004589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4d3b-2340-4da0-95c5-94ee0059a603 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:11.009906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:11.012670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.012670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.012670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.012670 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:11.013866 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:11.137755 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4416/8845] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:51:10 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:51:11.142267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:11.154984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ca30-a21d-44d0-8c73-5bdcdb7d057b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:11.225877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:11.226506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.226894 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.227294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.227779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:11.229765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:11.323417 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4430/8846] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:51:11 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:51:11.327913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:11.339996 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be9faa-5b54-406f-8454-10688f06412e admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:11.346528 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:11.347212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.347504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.347816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.348483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:11.350254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:11.362684 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4417/8847] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:51:11.369414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:11.385152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4797361-de20-43a1-8007-ecc7d00d1347 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:11.391999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9ba6-7c41-4878-b6d6-62e0811c7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:11.392926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9ba6-7c41-4878-b6d6-62e0811c7d7f admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.393443 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9ba6-7c41-4878-b6d6-62e0811c7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.393765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9ba6-7c41-4878-b6d6-62e0811c7d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.395152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b9ba6-7c41-4878-b6d6-62e0811c7d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:11.396946 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b9ba6-7c41-4878-b6d6-62e0811c7d7f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:11.411351 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4431/8848] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:51:11.416076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:11.428935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37153-d052-414d-b465-f386b789c9a0 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:11.434026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:11.434718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.435004 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.435389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] PATH_INFO: `/v3/projects/bbe9b44c84c6418387b9c76f8dda94df/users/3d09c9d5440c4987a99e81bfed501cb5/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.455490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe9b44c84c6418387b9c76f8dda94df, user_id=3d09c9d5440c4987a99e81bfed501cb5, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:11.458791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:11.552779 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4418/8849] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:51:11 2022] PUT /identity/v3/projects/bbe9b44c84c6418387b9c76f8dda94df/users/3d09c9d5440c4987a99e81bfed501cb5/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:51:11.558769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90520e4-1489-4a24-ba60-68fb768ad3bd None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.559105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90520e4-1489-4a24-ba60-68fb768ad3bd None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.559246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90520e4-1489-4a24-ba60-68fb768ad3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.581694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d90520e4-1489-4a24-ba60-68fb768ad3bd None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:11.583581 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d90520e4-1489-4a24-ba60-68fb768ad3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:11.649730 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4432/8850] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:11.661702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:11.662939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:11.686369 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:11.743326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5a46-d9a1-4d4c-823f-6bc1db36d939 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:11.747359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:11.748010 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:11.748295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:11.748574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:11.760360 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:11.761915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:11.774012 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4419/8851] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:17.974349 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f580-f138-43f8-8381-3025ec161a27 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:17.974922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f580-f138-43f8-8381-3025ec161a27 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:17.974922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f580-f138-43f8-8381-3025ec161a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:18.016855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-e3b7f580-f138-43f8-8381-3025ec161a27 None None] MFA Rules not processed for user `3d09c9d5440c4987a99e81bfed501cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:18.029205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e3b7f580-f138-43f8-8381-3025ec161a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:18.125365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:18.159431 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4433/8852] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:51:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:18.177096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:18.181061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:18.327502 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ea781-c569-41e9-80b3-5011fa151057 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:18.336872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3aea6-fde8-468f-b66b-1a53b9a70c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:18.337896 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3aea6-fde8-468f-b66b-1a53b9a70c40 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:18.338390 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3aea6-fde8-468f-b66b-1a53b9a70c40 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:18.338862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3aea6-fde8-468f-b66b-1a53b9a70c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:18.354331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3aea6-fde8-468f-b66b-1a53b9a70c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:18.356951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3aea6-fde8-468f-b66b-1a53b9a70c40 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:18.374021 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4420/8853] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:51:21.222975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:21.223687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:21.223687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:21.254418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] MFA Rules not processed for user `3d09c9d5440c4987a99e81bfed501cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:21.256556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:21.271221 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4434/8854] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:51:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:21.747158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:21.747922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:21.748526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:21.784929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:51:21.786682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:21.796511 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4421/8855] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:51:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:51:21.813205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:21.830530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2a2b-9a76-4514-b180-b1db3fe7bece None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:21.836303 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:21.837209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:21.837755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:21.838170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:21.848213 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:21.849919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:21.861781 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4435/8856] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:51:31.775888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=65 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:31.855258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=13 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:51:57.716620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:51:57.718385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:57.800742 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5811a6-091c-4d2e-b96b-038f56259eb5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:51:57.807186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:51:57.807958 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:51:57.808343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:51:57.809531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:51:57.811137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:51:57.826829 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:51:57.828611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3b569-3949-4b01-afc3-d090aa524ba1 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:51:57.845117 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4422/8857] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:51:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:52:07.695409 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:07.697272 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:07.718510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436800-9cff-4743-b12e-71a0dec5fcd0 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:07.725675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:07.726628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:07.727099 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:07.731226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:07.731226 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:07.751163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:07.754758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:07.773151 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4436/8858] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:52:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:52:07.837120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=32 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:11.864484 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c05561-ffbb-4c7e-baab-af4c89a87bb6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:11.865597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c05561-ffbb-4c7e-baab-af4c89a87bb6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:11.865597 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c05561-ffbb-4c7e-baab-af4c89a87bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:11.894119 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-c1c05561-ffbb-4c7e-baab-af4c89a87bb6 None None] MFA Rules not processed for user `3720ac834902404a9992a0a6aa43081a`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:11.895510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c1c05561-ffbb-4c7e-baab-af4c89a87bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:11.907323 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4423/8859] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:52:11.929636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:11.946121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94e79-5d79-4a13-9e8e-b4dbba75a56e service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:11.952440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670bb1d-fbc9-427f-8758-d1b1bc8e99c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:11.953420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670bb1d-fbc9-427f-8758-d1b1bc8e99c7 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:11.953916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670bb1d-fbc9-427f-8758-d1b1bc8e99c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:11.954414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670bb1d-fbc9-427f-8758-d1b1bc8e99c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:11.967566 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670bb1d-fbc9-427f-8758-d1b1bc8e99c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:11.970453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670bb1d-fbc9-427f-8758-d1b1bc8e99c7 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:11.984773 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4437/8860] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:52:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:52:21.882311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:21.979666 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=12 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:39.851217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:39.851217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:39.851217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:39.868943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] MFA Rules not processed for user `3d09c9d5440c4987a99e81bfed501cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:39.870350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:39.887154 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4424/8861] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:52:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:52:49.863408 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:52:53.611658 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:53.612178 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:53.612282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:53.632425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:52:53.633756 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:52:53.646631 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4438/8862] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:52:53.663807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:52:53.677556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596933ba-cbb9-412d-8d8a-cbd8d5e1c759 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:52:53.683272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:52:53.683892 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:52:53.684284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:52:53.684492 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:52:53.696747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:52:53.698174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:52:53.709151 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4425/8863] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:52:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:03.627254 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:03.703856 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:29.082749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:29.092488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9278c-c229-464e-9f9b-1a829d527f33 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:29.096688 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:29.097249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:29.097549 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:29.097785 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:29.100235 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:29.114765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:29.116326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:29.127520 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4439/8864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:30.325508 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:30.335433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5325c1-fa12-433d-9f74-30a0370e8eab service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:30.338997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:30.339633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:30.339912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:30.340185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:30.341990 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:30.356600 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:30.358107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:30.370762 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4426/8865] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:39.122692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:40.365526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:53:47.053859 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:47.065832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30992ff6-c0af-4be2-b49d-eed3d966bf8d service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:47.070979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:47.071661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:47.071944 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:47.072221 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:47.074002 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:47.086966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:47.088612 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:47.100187 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4440/8866] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:48.714768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:48.716320 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:48.727671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a11c-daae-4bbc-875a-1ff76b64dbe6 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:48.731627 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:48.732253 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:48.732533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:48.733027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:48.735113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:48.746377 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:48.747862 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:48.759370 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4427/8867] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:52.419053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:53:52.433544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8863bb-a402-43da-b883-d045e82a7c63 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:53:52.439440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:53:52.440066 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:53:52.440354 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:53:52.441192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:53:52.443358 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:53:52.456962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:53:52.458641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5e40d-81b5-456f-b3ed-6e27eb39877e service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:53:52.471352 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4441/8868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:53:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:53:58.755211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:00.526095 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:00.528333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:00.559920 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9d44-045c-4f37-a293-44ef44d31f2c service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:00.570045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:00.571137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:00.571658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:00.572174 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:00.575433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:00.597423 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:00.599909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:00.618754 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4428/8869] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:02.465518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=12 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:07.161874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:07.162845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:07.162845 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:07.182437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] MFA Rules not processed for user `3d09c9d5440c4987a99e81bfed501cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:54:07.183809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:07.192297 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4442/8870] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:54:08.023269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:08.035968 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483ddf-19fe-49c0-a02b-2a8fbba01e65 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:08.042069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:08.042850 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:08.043266 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:08.043665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:08.045711 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:08.068575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:08.070207 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:08.086982 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4429/8871] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:54:17.177128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:18.077596 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=12 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:54:57.359130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:57.372471 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e674598-fb6c-43ec-a13e-70088209ddb7 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:57.377968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:57.378599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:57.378909 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:57.379205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:57.381373 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:57.393808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:57.395560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:57.406443 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4443/8872] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:54:57.874790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:54:57.887451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f65ee-5e65-4e4d-acf3-bb868289c551 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:54:57.891634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:54:57.892620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:54:57.892620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:54:57.893053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:54:57.894604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:54:57.931292 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:54:57.932746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2b82-7000-4a80-8ac4-b26d4ef245b9 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:54:57.947903 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4430/8873] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:54:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:55:07.401820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:07.939468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:14.349271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:55:14.359744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4ad9e-9e9e-43d1-8a45-23e3906b1b12 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:55:14.363579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:55:14.364258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:55:14.364540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:55:14.365028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:55:14.366646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:55:14.425128 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:55:14.427837 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:55:14.438435 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4444/8874] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:55:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:55:24.433829 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=19 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:34.799258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8e61-4d63-4ece-8a5c-7754f27a4725 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:55:34.800136 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8e61-4d63-4ece-8a5c-7754f27a4725 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:55:34.800331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8e61-4d63-4ece-8a5c-7754f27a4725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:55:34.844642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-57ac8e61-4d63-4ece-8a5c-7754f27a4725 None None] MFA Rules not processed for user `3d09c9d5440c4987a99e81bfed501cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:55:34.846650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57ac8e61-4d63-4ece-8a5c-7754f27a4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:55:34.898148 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4431/8875] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:55:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:55:35.337490 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:55:35.362143 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491577-b09c-4bed-b07b-a302ef2192f4 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:55:35.368616 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:55:35.369664 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:55:35.370194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:55:35.370665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:55:35.373278 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:55:35.391932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:55:35.393700 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:55:35.409593 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4445/8876] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:55:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:55:44.893164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=11 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:55:45.402833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=11 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:23.555960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:23.556525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:23.556642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:23.612434 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] MFA Rules not processed for user `c06e2a3faa864da19cef4089e8392702`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:56:23.613668 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:56:23.688997 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4432/8877] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Sep 6 11:56:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:56:23.695398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:56:23.705225 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159695-98a0-42cc-b6de-68759e924a5a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:56:23.710039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c06e2a3faa864da19cef4089e8392702', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:56:23.710673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:56:23.710955 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:56:23.711265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:56:23.720709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:56:23.722263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:56:23.738402 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4446/8878] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:56:33.685247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=38 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:56:33.728848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:02.722689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:02.755135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38b34-6c41-4f0e-8161-a2bf565db593 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:02.760951 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:02.761560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:02.761843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:02.762114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:02.771460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:02.773791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:02.784391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4433/8879] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:09.144628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:09.158992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a625-0d3e-40ef-a6d0-1c7484c844e8 service cinder] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:09.173499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:09.173499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:09.173499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:09.173499 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:09.181917 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:09.184238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:09.203243 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4447/8880] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:12.779880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=13 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:19.194675 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:31.345182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:31.356154 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfd3ca-1eb8-483b-931e-9778e88f7a1d service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:31.360387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:31.361051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:31.361343 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:31.361656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:31.372157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:31.379768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:31.383694 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4434/8881] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:35.292848 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:35.313265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce6906-479f-478f-a726-b860da084a18 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:35.326242 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:35.327384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:35.327902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:35.328415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:35.331590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:35.361468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:35.364071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:35.378335 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4448/8882] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:35.518018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:35.533609 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73a85-c239-4e10-b433-f999704633c8 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:35.542700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:35.543774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:35.544254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:35.544739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] PATH_INFO: `/v3/users/3d09c9d5440c4987a99e81bfed501cb5` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:35.546582 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d09c9d5440c4987a99e81bfed501cb5)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:35.549102 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:35.803000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d09c9d5440c4987a99e81bfed501cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:35.811776 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d09c9d5440c4987a99e81bfed501cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:35.812556 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d09c9d5440c4987a99e81bfed501cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:35.834994 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d09c9d5440c4987a99e81bfed501cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:35.836047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-c5c98cf7-7284-4a6a-9494-d9fb21201cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d09c9d5440c4987a99e81bfed501cb5'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:35.916372 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4435/8883] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:57:35 2022] DELETE /identity/v3/users/3d09c9d5440c4987a99e81bfed501cb5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:57:36.216262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:36.228286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd95b-1bf9-475a-bb08-83fba4ac48ca service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:36.311448 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:36.312260 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:36.312426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:36.312626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] PATH_INFO: `/v3/projects/bbe9b44c84c6418387b9c76f8dda94df` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:36.313727 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe9b44c84c6418387b9c76f8dda94df)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:36.315740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:36.550793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe9b44c84c6418387b9c76f8dda94df', 'request_id': 'req-1e72050b-446e-4fda-8138-d583a12bf846'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:36.557220 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe9b44c84c6418387b9c76f8dda94df', 'request_id': 'req-1e72050b-446e-4fda-8138-d583a12bf846'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:36.564537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe9b44c84c6418387b9c76f8dda94df', 'request_id': 'req-1e72050b-446e-4fda-8138-d583a12bf846'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:36.644240 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] The token cache is being invalidate because project bbe9b44c84c6418387b9c76f8dda94df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:57:36.644674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:36.645419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-1e72050b-446e-4fda-8138-d583a12bf846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:57:36.647065 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4449/8884] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:57:36 2022] DELETE /identity/v3/projects/bbe9b44c84c6418387b9c76f8dda94df => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:36.652949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:36.653481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:36.653598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:36.695328 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:36.696617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:36.765666 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4436/8885] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:36.773683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:36.773984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:36.774247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:36.795773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:36.800137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:36.806628 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4450/8886] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:36.811475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:36.822128 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a711-f399-4489-9c78-9249d1967de5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:36.827322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:36.827976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:36.828302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:36.828587 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:36.829242 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:57:36.829553 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:36.831243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:36.845110 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4437/8887] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:57:36.849869 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:36.860232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556d86-b8e6-4145-b514-098182cbcc8a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:36.865250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:36.865855 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:36.866137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:36.867030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:36.874611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:36.874611 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:37.006162 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4451/8888] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:57:36 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:57:37.011430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:37.025498 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914540e-74e5-4d97-abe1-df3d3f51b203 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:37.081510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:37.108679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:37.109361 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:37.109643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:37.109919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:37.110565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:37.113141 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:37.246901 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4438/8889] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:57:37 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:57:37.251812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:37.266934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322b68-9aac-41c6-ab97-b4a719935eb7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:37.274990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:37.276312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:37.276737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:37.277217 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:37.278328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:37.280718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:37.294853 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4452/8890] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:57:37.299846 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:37.313186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c956a-cd9b-4dcd-bf18-05943277da52 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:37.318199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf332-fd83-4268-b53f-8f486d5350b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:37.318954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf332-fd83-4268-b53f-8f486d5350b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:37.319422 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf332-fd83-4268-b53f-8f486d5350b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:37.320409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf332-fd83-4268-b53f-8f486d5350b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:37.321530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cf332-fd83-4268-b53f-8f486d5350b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:37.323615 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cf332-fd83-4268-b53f-8f486d5350b5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:37.336306 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4439/8891] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:57:37.352985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:37.352985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0926896-0cb1-4c47-9b9a-edb73419a713 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:37.357498 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:37.358207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:37.358487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:37.358777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] PATH_INFO: `/v3/projects/27b27569b95443409ce3122494d2fa2f/users/28c8864e0ffd4c00808bd9649b4981c4/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:37.377207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b27569b95443409ce3122494d2fa2f, user_id=28c8864e0ffd4c00808bd9649b4981c4, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:37.381751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:37.544794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4453/8892] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:57:37 2022] PUT /identity/v3/projects/27b27569b95443409ce3122494d2fa2f/users/28c8864e0ffd4c00808bd9649b4981c4/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:57:37.555904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62e08-2d61-4603-bbb1-fc3ec9598368 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:37.556325 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62e08-2d61-4603-bbb1-fc3ec9598368 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:37.556610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62e08-2d61-4603-bbb1-fc3ec9598368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:37.578353 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-32c62e08-2d61-4603-bbb1-fc3ec9598368 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:37.579623 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-32c62e08-2d61-4603-bbb1-fc3ec9598368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:37.649091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4440/8893] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:37.659089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:37.660897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:37.677109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:37.729966 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcdc7a-92f9-4d34-b7b6-2e4d78ade673 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:37.733747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222aedd-f472-4544-990b-151d03ca7be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:37.734361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222aedd-f472-4544-990b-151d03ca7be9 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:37.734649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222aedd-f472-4544-990b-151d03ca7be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:37.734927 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222aedd-f472-4544-990b-151d03ca7be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:37.745057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222aedd-f472-4544-990b-151d03ca7be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:37.747892 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222aedd-f472-4544-990b-151d03ca7be9 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:37.759787 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4454/8894] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:45.364918 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.365781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.365781 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.419661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] MFA Rules not processed for user `28c8864e0ffd4c00808bd9649b4981c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:45.421019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:45.520653 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4441/8895] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:57:45.535184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.535759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.536154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.565819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] MFA Rules not processed for user `28c8864e0ffd4c00808bd9649b4981c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:57:45.567487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:45.576565 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4455/8896] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:57:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:57:45.594089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:45.595865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:45.689110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:45.736868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1c8b-4b87-4843-97dc-28de71bc8fd7 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:45.747834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c90e4f-6f37-46ff-8dd7-1d29e1732723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:45.750810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90e4f-6f37-46ff-8dd7-1d29e1732723 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:45.750810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90e4f-6f37-46ff-8dd7-1d29e1732723 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:45.750810 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90e4f-6f37-46ff-8dd7-1d29e1732723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:45.762599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c90e4f-6f37-46ff-8dd7-1d29e1732723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:45.765955 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c90e4f-6f37-46ff-8dd7-1d29e1732723 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:45.784842 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4442/8897] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:57:46.168542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:57:46.180350 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84095a45-70e2-4836-a7f8-fd0f8c9c4fe9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:57:46.187964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:57:46.187964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:57:46.187964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:57:46.187964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:57:46.188559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:57:46.198353 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:57:46.200014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b45608-d95d-4f5d-91e0-b62ad09edf86 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:57:46.209284 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4456/8898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:57:55.776595 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=13 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:57:56.205186 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=29 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:03.452650 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:03.453417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:03.453417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:03.475286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] MFA Rules not processed for user `28c8864e0ffd4c00808bd9649b4981c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:03.477074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:03.485161 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4443/8899] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:58:13.468936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:29.602491 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:29.603101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:29.603101 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:29.640323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] MFA Rules not processed for user `d7fac79d1cad45f7b67ba2f8117899db`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:29.641734 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:29.722789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4457/8900] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:29.734959 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:29.744497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:29.754446 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d5a91-d30d-4172-ae5d-77e97fe1f816 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:29.759952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:29.760852 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:29.761034 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:29.761221 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:29.773937 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:29.777481 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:29.794699 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:29.800703 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4444/8901] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:29.806876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0abe6-839b-48c9-b1fa-d334b55eeb6d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:29.813650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:29.814189 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:29.815270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:29.815270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] PATH_INFO: `/v3/users/28c8864e0ffd4c00808bd9649b4981c4` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:29.816792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c8864e0ffd4c00808bd9649b4981c4)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:29.819563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:30.009698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c8864e0ffd4c00808bd9649b4981c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.017831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c8864e0ffd4c00808bd9649b4981c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.018593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c8864e0ffd4c00808bd9649b4981c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.019248 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c8864e0ffd4c00808bd9649b4981c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.032597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-cb768dbf-9bc1-481d-afec-f18f57398e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c8864e0ffd4c00808bd9649b4981c4'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.153758 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4458/8902] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:29 2022] DELETE /identity/v3/users/28c8864e0ffd4c00808bd9649b4981c4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:58:30.459826 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:30.472204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a0ae-695c-4e29-a474-c9f809db533a service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:30.547998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:30.548641 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:30.548929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:30.549472 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] PATH_INFO: `/v3/projects/27b27569b95443409ce3122494d2fa2f` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:30.550611 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b27569b95443409ce3122494d2fa2f)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:30.552674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:30.670903 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b27569b95443409ce3122494d2fa2f', 'request_id': 'req-b3fa1599-8ee2-4490-8fe4-2babd9455229'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.677717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b27569b95443409ce3122494d2fa2f', 'request_id': 'req-b3fa1599-8ee2-4490-8fe4-2babd9455229'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.684033 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b27569b95443409ce3122494d2fa2f', 'request_id': 'req-b3fa1599-8ee2-4490-8fe4-2babd9455229'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.792148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] The token cache is being invalidate because project 27b27569b95443409ce3122494d2fa2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:30.792884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.793145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b3fa1599-8ee2-4490-8fe4-2babd9455229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:30.794636 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4445/8903] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:30 2022] DELETE /identity/v3/projects/27b27569b95443409ce3122494d2fa2f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:30.801028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:30.801556 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:30.802152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:30.868352 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:30.869587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:30.907103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:30.937203 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4459/8904] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:30.945544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:30.945911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:30.946219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:30.967220 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:30.968429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:30.976669 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4446/8905] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:30.982475 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:30.994057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48fc1-0166-47db-a13f-460e3f7e55d9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:30.999557 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.000177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.000460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.000737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.001402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:58:31.001771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.003795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.020001 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4460/8906] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:58:31.025185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:31.034575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ef29d-d2cb-4143-9e12-d33d209b2002 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:31.039524 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.040148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.040435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.040713 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.041354 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.043503 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.167366 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4447/8907] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:31 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:31.171956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:31.183512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89bc66-9432-4390-9a4e-bbd961ab76e8 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:31.241043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.241652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.241932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.242203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.242836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.245736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.359925 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4461/8908] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:31 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:58:31.364123 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:31.375919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b9a5-7c1a-4251-a241-5bf740bfc96b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:31.380687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.384940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.384940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.384940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.384940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.384940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.394696 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4448/8909] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:31.398956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:31.410355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbecf4f-0d16-4a05-b7b9-1eef450847eb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:31.415153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8462bf5-4c57-42f7-95e4-c4006e3fb6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.415833 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8462bf5-4c57-42f7-95e4-c4006e3fb6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.421637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8462bf5-4c57-42f7-95e4-c4006e3fb6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.421637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8462bf5-4c57-42f7-95e4-c4006e3fb6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.421637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8462bf5-4c57-42f7-95e4-c4006e3fb6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.421637 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8462bf5-4c57-42f7-95e4-c4006e3fb6f7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.441406 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4462/8910] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:31.445709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:31.456321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d619e1d-4ae7-4523-a41e-07ee6cf3fce9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:31.461113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.461831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.462091 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.462346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] PATH_INFO: `/v3/projects/140aa59b328c4e52a73f8aa83fda4d24/users/6dcae20b838f402ea5745125942233ce/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.465802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:31.477961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=140aa59b328c4e52a73f8aa83fda4d24, user_id=6dcae20b838f402ea5745125942233ce, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.481163 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.580425 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4449/8911] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:31 2022] PUT /identity/v3/projects/140aa59b328c4e52a73f8aa83fda4d24/users/6dcae20b838f402ea5745125942233ce/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:31.592426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.592718 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.592982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.622400 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] MFA Rules not processed for user `6dcae20b838f402ea5745125942233ce`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:31.623167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:31.689843 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4463/8912] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:31.700685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:31.702639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:31.784542 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f14d7-0d1c-49f4-bce6-f53bc4109cee admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:31.788334 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe50ab4-d605-47ea-9b8d-d220cfe29501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:31.788933 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50ab4-d605-47ea-9b8d-d220cfe29501 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:31.789214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50ab4-d605-47ea-9b8d-d220cfe29501 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:31.789489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe50ab4-d605-47ea-9b8d-d220cfe29501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:31.799273 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe50ab4-d605-47ea-9b8d-d220cfe29501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:31.801052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe50ab4-d605-47ea-9b8d-d220cfe29501 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:31.811191 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4450/8913] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:41.687157 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:41.806367 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:50.417907 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:50.489721 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beb7e1-06ee-4356-a1b7-253382525053 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:50.494361 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:50.495129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:50.496026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:50.496366 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] PATH_INFO: `/v3/users/6dcae20b838f402ea5745125942233ce` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:50.497540 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcae20b838f402ea5745125942233ce)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:50.499667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:50.675415 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcae20b838f402ea5745125942233ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:50.682224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcae20b838f402ea5745125942233ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:50.682890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcae20b838f402ea5745125942233ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:50.687435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcae20b838f402ea5745125942233ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:50.697033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcae20b838f402ea5745125942233ce'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:50.823479 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4464/8914] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:58:50 2022] DELETE /identity/v3/users/6dcae20b838f402ea5745125942233ce => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:50.828113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:50.828645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:50.828763 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:50.848726 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:50.850052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:50.910787 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4451/8915] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:50.920764 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:50.922219 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:50.982979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237817d6-32b1-47b4-bdff-ca0f41d72a85 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:50.986999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26d7b0-ac2f-427c-a043-62ffc6012ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:50.987512 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26d7b0-ac2f-427c-a043-62ffc6012ebc service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:50.987797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26d7b0-ac2f-427c-a043-62ffc6012ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:50.988069 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26d7b0-ac2f-427c-a043-62ffc6012ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.004028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26d7b0-ac2f-427c-a043-62ffc6012ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:51.006671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26d7b0-ac2f-427c-a043-62ffc6012ebc service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:51.030835 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4465/8916] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:58:51.328861 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:51.330448 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:51.343764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a19f2-9f5f-4d62-95b1-d3102acf54a0 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:51.348540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:51.349187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:51.349468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:51.349984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] PATH_INFO: `/v3/projects/140aa59b328c4e52a73f8aa83fda4d24` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.351818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140aa59b328c4e52a73f8aa83fda4d24)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:51.356109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:51.505495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140aa59b328c4e52a73f8aa83fda4d24', 'request_id': 'req-038b569b-b61b-49fa-8703-24a2be0256c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:51.512068 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140aa59b328c4e52a73f8aa83fda4d24', 'request_id': 'req-038b569b-b61b-49fa-8703-24a2be0256c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:51.518042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140aa59b328c4e52a73f8aa83fda4d24', 'request_id': 'req-038b569b-b61b-49fa-8703-24a2be0256c8'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:51.586986 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] The token cache is being invalidate because project 140aa59b328c4e52a73f8aa83fda4d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:58:51.587252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:51.587881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-038b569b-b61b-49fa-8703-24a2be0256c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:58:51.589455 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4452/8917] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:58:51 2022] DELETE /identity/v3/projects/140aa59b328c4e52a73f8aa83fda4d24 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:58:51.594759 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:51.595340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:51.595340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.616053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:51.618928 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:51.635919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:51.681016 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4466/8918] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:51.691057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:51.691057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:51.691057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.712036 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:51.726467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:51.726467 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4453/8919] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:51.727742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:51.738181 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77462-e39c-4ff6-b69d-3beea633f457 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:51.742887 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:51.743542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:51.743834 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:51.744108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.744758 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:58:51.745087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:51.746686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:51.759022 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4467/8920] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 11:58:51.763576 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:51.773591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e862ea-3a1c-4d2c-aff4-975f6e1e9b96 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:51.778455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:51.781837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:51.781837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:51.781837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.781837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:51.782700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:51.865907 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4454/8921] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:58:51 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:58:51.870107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:51.880715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea9150-0350-42bb-a795-b300cfe0ce08 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:51.940273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:51.940878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:51.941262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:51.941541 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:51.942175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:51.944134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:52.021759 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4468/8922] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:58:51 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:58:52.025843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:52.037157 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dcce2-bc3b-47d0-ab54-3713ceab6b49 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:52.041922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:52.047381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:52.047381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:52.047381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:52.047381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:52.047381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:52.057519 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4455/8923] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:52.062387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:52.072952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81e9bd-9043-4c95-b9fa-282b829150f6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:52.078413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e024-aee1-4764-8959-b888f5837b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:52.079051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e024-aee1-4764-8959-b888f5837b23 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:52.079345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e024-aee1-4764-8959-b888f5837b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:52.079623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e024-aee1-4764-8959-b888f5837b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:52.080271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e024-aee1-4764-8959-b888f5837b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:52.081877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e024-aee1-4764-8959-b888f5837b23 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:52.094915 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4469/8924] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:58:52.099276 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:52.112278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7f4b6-8252-4eb8-b76f-6d1b5bde5438 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:52.118739 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:52.119375 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:52.119664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:52.119946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] PATH_INFO: `/v3/projects/684b9ec6439e4eb59ec1e80fb5370ea9/users/da026286e1c54d2bbb0c41b128db9f75/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:52.137263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684b9ec6439e4eb59ec1e80fb5370ea9, user_id=da026286e1c54d2bbb0c41b128db9f75, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:52.140107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:52.217837 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4456/8925] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:58:52 2022] PUT /identity/v3/projects/684b9ec6439e4eb59ec1e80fb5370ea9/users/da026286e1c54d2bbb0c41b128db9f75/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:58:52.227965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:52.228259 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:52.228537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:52.257487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] MFA Rules not processed for user `da026286e1c54d2bbb0c41b128db9f75`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:58:52.258712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:52.324467 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4470/8926] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:58:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:58:52.335535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:58:52.337310 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:58:52.360468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:58:52.397014 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30cae-bcac-44e0-ad11-3b20df91f054 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:58:52.401669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a400da-468d-4ef0-9ee2-f8e6cb3db671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:58:52.402288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a400da-468d-4ef0-9ee2-f8e6cb3db671 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:58:52.402572 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a400da-468d-4ef0-9ee2-f8e6cb3db671 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:58:52.402848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a400da-468d-4ef0-9ee2-f8e6cb3db671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:58:52.411774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a400da-468d-4ef0-9ee2-f8e6cb3db671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:58:52.418317 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a400da-468d-4ef0-9ee2-f8e6cb3db671 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:58:52.422856 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4457/8927] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:58:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:00.008542 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:00.040592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:00.114843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff7aa1-6a67-4819-ab6b-8125f0fcfc2c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:00.119673 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:00.120315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:00.120596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:00.120897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] PATH_INFO: `/v3/users/da026286e1c54d2bbb0c41b128db9f75` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:00.122123 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da026286e1c54d2bbb0c41b128db9f75)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:00.127132 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:00.413209 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da026286e1c54d2bbb0c41b128db9f75'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:00.421243 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da026286e1c54d2bbb0c41b128db9f75'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:00.422879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da026286e1c54d2bbb0c41b128db9f75'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:00.423836 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da026286e1c54d2bbb0c41b128db9f75'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:00.443232 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da026286e1c54d2bbb0c41b128db9f75'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:00.534623 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4471/8928] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 11:59:00 2022] DELETE /identity/v3/users/da026286e1c54d2bbb0c41b128db9f75 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:00.539417 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:00.540146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:00.540146 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:00.567967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:00.569231 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:00.645046 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4458/8929] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:00.656194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:00.658312 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:00.734425 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4ade1-6951-4e73-b450-94cbb4a4c18d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:00.738304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b711c2-c793-406f-a7aa-7d652e8d2f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:00.738774 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b711c2-c793-406f-a7aa-7d652e8d2f22 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:00.739097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b711c2-c793-406f-a7aa-7d652e8d2f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:00.739379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b711c2-c793-406f-a7aa-7d652e8d2f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:00.750360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b711c2-c793-406f-a7aa-7d652e8d2f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:00.751884 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b711c2-c793-406f-a7aa-7d652e8d2f22 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:00.764691 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4472/8930] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:01.089389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:01.092761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:01.114379 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6e0f-9427-4720-a528-5cb2a87dd5ab None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:01.125730 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:01.130837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.130837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.130837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] PATH_INFO: `/v3/projects/684b9ec6439e4eb59ec1e80fb5370ea9` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.130837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=684b9ec6439e4eb59ec1e80fb5370ea9)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:01.130837 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:01.263134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684b9ec6439e4eb59ec1e80fb5370ea9', 'request_id': 'req-911acc7e-1f95-4812-905e-af2118205a2c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:01.270895 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684b9ec6439e4eb59ec1e80fb5370ea9', 'request_id': 'req-911acc7e-1f95-4812-905e-af2118205a2c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:01.281759 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684b9ec6439e4eb59ec1e80fb5370ea9', 'request_id': 'req-911acc7e-1f95-4812-905e-af2118205a2c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:01.338993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] The token cache is being invalidate because project 684b9ec6439e4eb59ec1e80fb5370ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 11:59:01.339539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:01.340280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-911acc7e-1f95-4812-905e-af2118205a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 11:59:01.342849 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4459/8931] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 11:59:01 2022] DELETE /identity/v3/projects/684b9ec6439e4eb59ec1e80fb5370ea9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:01.351661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.352246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.352246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.374314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:01.375708 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:01.421814 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:01.468552 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4473/8932] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:59:01.471952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.471952 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.472684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.508051 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:01.509426 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:01.523810 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4460/8933] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:01.528020 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:01.542371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82588cbc-9f10-46a9-9fda-e3832b6fa383 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:01.551277 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:01.552365 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.552883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.553371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.554582 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 11:59:01.555151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:01.557494 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:01.580898 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4474/8934] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 11:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 11:59:01.587599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:01.601410 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a185b6-3e0b-40f7-bdd6-877a27a16ab6 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:01.607074 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:01.608555 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.609133 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.609531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.610479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:01.612577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:01.727553 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4461/8935] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:59:01 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:59:01.733283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:01.745601 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672bf57-9865-4aea-8d5b-602f37f9cf16 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:01.812595 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:01.813129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.813411 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.813685 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.814323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:01.816337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:01.906416 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4475/8936] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:59:01 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 11:59:01.910245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:01.923473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2e52c-e75a-4692-85f0-7db06877f95b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:01.928906 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:01.929575 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.929910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.930187 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.930816 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:01.932509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:01.945280 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4462/8937] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:01.951493 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:01.963472 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff20c-b791-4034-a050-bee9a50eadea admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:01.969315 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ef13a-e4b9-415e-b2d9-c3fc42e1fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:01.969952 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef13a-e4b9-415e-b2d9-c3fc42e1fb72 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:01.970233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef13a-e4b9-415e-b2d9-c3fc42e1fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:01.970619 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef13a-e4b9-415e-b2d9-c3fc42e1fb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:01.971344 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef13a-e4b9-415e-b2d9-c3fc42e1fb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:01.973003 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef13a-e4b9-415e-b2d9-c3fc42e1fb72 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:01.985521 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4476/8938] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 11:59:01.991960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:02.004184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594db8d6-873e-49c8-a78f-3a293e6bf943 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:02.009543 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:02.010233 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:02.010516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:02.010791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] PATH_INFO: `/v3/projects/bd1282dd54c14401bf4e63d865a67dee/users/a4cff140fd1740ff80c13526874a7113/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:02.013941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:02.183516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1282dd54c14401bf4e63d865a67dee, user_id=a4cff140fd1740ff80c13526874a7113, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:02.186673 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:02.273017 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4463/8939] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:59:01 2022] PUT /identity/v3/projects/bd1282dd54c14401bf4e63d865a67dee/users/a4cff140fd1740ff80c13526874a7113/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:02.280327 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aed9f9-ec9d-44a8-9f87-59b02b7d1014 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:02.280630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aed9f9-ec9d-44a8-9f87-59b02b7d1014 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:02.280877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aed9f9-ec9d-44a8-9f87-59b02b7d1014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:02.302191 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-77aed9f9-ec9d-44a8-9f87-59b02b7d1014 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:02.303484 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-77aed9f9-ec9d-44a8-9f87-59b02b7d1014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:02.380004 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4477/8940] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:02.393381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:02.396993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:02.473509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216149f-cdbf-4aa7-9868-c2b35045e3fb admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:02.478204 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:02.478956 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:02.479319 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:02.479645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:02.491570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:02.493110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:02.504755 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4464/8941] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:09.071709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db40f-7627-4315-8420-01339d753440 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.072483 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db40f-7627-4315-8420-01339d753440 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.072665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db40f-7627-4315-8420-01339d753440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.108936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-295db40f-7627-4315-8420-01339d753440 None None] MFA Rules not processed for user `a4cff140fd1740ff80c13526874a7113`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:09.111723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-295db40f-7627-4315-8420-01339d753440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:09.193748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:09.228130 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4478/8942] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:09.233067 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.244038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b00a-bbd7-4972-8cd0-f36a99d86a89 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.250581 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.251246 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.251534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.251818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.252458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.254420 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.340735 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4465/8943] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 11:59:09 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:59:09.345607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295db40f-7627-4315-8420-01339d753440 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.358449 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295db40f-7627-4315-8420-01339d753440 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.434706 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.436051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.436340 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.436628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.437281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.439434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.558896 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4479/8944] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 11:59:09 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 11:59:09.563880 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.577160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa80b8e-f3d3-456d-9b5e-ae0f6e661822 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.582800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.583645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.583899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.584244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.584976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.586695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.599263 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4466/8945] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:09.604324 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.617112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0732-b564-455e-ade3-1b1b90414e78 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.622478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.624122 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.624410 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.624687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] PATH_INFO: `/v3/projects/869fd6df39594ee6961252c9d0cfafb3/users/feb7567d87a44b0da91c62a5d60c7a95/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.642895 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869fd6df39594ee6961252c9d0cfafb3, user_id=feb7567d87a44b0da91c62a5d60c7a95, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.645712 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.754211 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4480/8946] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:59:09 2022] PUT /identity/v3/projects/869fd6df39594ee6961252c9d0cfafb3/users/feb7567d87a44b0da91c62a5d60c7a95/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 11:59:09.755811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.772821 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c543a3-2c33-4e6e-a00e-fb1e30ddb8b2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.854282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711781-70f4-4ec5-a2c5-58b220b75bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.854825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711781-70f4-4ec5-a2c5-58b220b75bdb admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.855143 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711781-70f4-4ec5-a2c5-58b220b75bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.855429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711781-70f4-4ec5-a2c5-58b220b75bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.856271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711781-70f4-4ec5-a2c5-58b220b75bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.858457 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711781-70f4-4ec5-a2c5-58b220b75bdb admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.875642 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4467/8947] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 11:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 11:59:09.882108 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:09.902322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2487ded-9b7f-48b1-88ac-f58ef7283344 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:09.914485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57076b65-cbb9-4eab-b1a0-5d49f201feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:09.915214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57076b65-cbb9-4eab-b1a0-5d49f201feaa admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:09.915872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57076b65-cbb9-4eab-b1a0-5d49f201feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:09.916504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57076b65-cbb9-4eab-b1a0-5d49f201feaa admin admin] PATH_INFO: `/v3/projects/869fd6df39594ee6961252c9d0cfafb3/users/feb7567d87a44b0da91c62a5d60c7a95/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:09.920926 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57076b65-cbb9-4eab-b1a0-5d49f201feaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=869fd6df39594ee6961252c9d0cfafb3, user_id=feb7567d87a44b0da91c62a5d60c7a95, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:09.926751 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57076b65-cbb9-4eab-b1a0-5d49f201feaa admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:09.952353 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4481/8948] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 11:59:09 2022] PUT /identity/v3/projects/869fd6df39594ee6961252c9d0cfafb3/users/feb7567d87a44b0da91c62a5d60c7a95/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 11:59:16.492452 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:16.493021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:16.493021 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:16.523912 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] MFA Rules not processed for user `feb7567d87a44b0da91c62a5d60c7a95`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:16.525550 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:16.570699 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:16.604643 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4468/8949] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:16.629579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a9ceb-56e0-4ba2-9ea7-8ac4f2719e86 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:16.630458 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a9ceb-56e0-4ba2-9ea7-8ac4f2719e86 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:16.630736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a9ceb-56e0-4ba2-9ea7-8ac4f2719e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:16.711572 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-581a9ceb-56e0-4ba2-9ea7-8ac4f2719e86 None None] MFA Rules not processed for user `3a5944ef46aa40078b84b486b24822eb`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:16.712819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-581a9ceb-56e0-4ba2-9ea7-8ac4f2719e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:16.784166 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4482/8950] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Sep 6 11:59:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 11:59:16.790567 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:16.801311 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec7bcc-3b9e-4f83-9076-ed4bf857cf52 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:16.805193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:16.806079 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:16.806442 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:16.807101 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:16.871337 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:16.872818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:16.883134 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4469/8951] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:17.168840 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e97e-be07-4904-b4a1-cf3d1a2287bb None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:17.169117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e97e-be07-4904-b4a1-cf3d1a2287bb None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:17.169419 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e97e-be07-4904-b4a1-cf3d1a2287bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:17.177761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:17.237063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-0890e97e-be07-4904-b4a1-cf3d1a2287bb None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:17.241965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0890e97e-be07-4904-b4a1-cf3d1a2287bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:17.321816 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4483/8952] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:17.451201 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:17.452801 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:17.554935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299eff8-1cfb-4a21-9cd8-ed64438bf6d6 service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:17.560648 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:17.561355 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:17.561640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:17.561923 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:17.571032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:17.572653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:17.582616 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4470/8953] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:59:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:59:27.318671 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=38 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:27.477866 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:27.478154 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:27.478432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:27.499070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] MFA Rules not processed for user `a4cff140fd1740ff80c13526874a7113`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:27.505854 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:27.508118 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4484/8954] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:27.549610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:27.559134 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc308-b073-479c-a44c-87e9db4c503d service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:27.563458 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:27.564050 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:27.564333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:27.564605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:27.566303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:27.610401 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:27.640909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:27.641522 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:27.661690 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4471/8955] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:28.308864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:28.311294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:28.315701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:28.317127 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:28.381621 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502acfef-6194-494f-bae7-0b224690f0eb service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:28.385261 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:28.385915 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:28.386150 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:28.386427 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:28.388339 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:28.398281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0f05-26a0-4820-8d6e-c19dee334205 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:28.402626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:28.403446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:28.404114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:28.404318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85442e45-fede-4b77-b381-afd5780af207 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:28.404438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:28.404657 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:28.406456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:28.415655 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4472/8956] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 11:59:28.418654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:28.421264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:28.431869 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4485/8957] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:31.647919 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:31.648485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:31.648485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:31.669371 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 11:59:31.670605 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:31.679925 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4473/8958] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 11:59:31.695746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:31.717348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fe155-abda-4754-b7e9-c35b6adaeec1 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:31.722441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:31.723704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:31.723704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:31.723704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:31.734875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:31.737374 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:31.748764 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4486/8959] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 11:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 11:59:32.433076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:32.444415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cffe-9bf6-4a17-a14a-242df3bfbb05 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:32.453619 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:32.454252 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:32.454540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:32.454814 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:32.456960 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:32.470389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:32.472476 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:32.499369 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4474/8960] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:33.889424 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:33.890991 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:33.908864 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ade1a-6dcb-4162-9e04-a55ffcd13be1 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:33.918997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:33.919968 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:33.920521 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:33.921249 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:33.931789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:33.951692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:33.953313 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:33.975156 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4487/8961] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:42.478330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=54 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:43.960055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=52 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:46.394998 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:46.409364 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e745e-5320-41a3-9a35-1bb4d97eb040 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:46.415040 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:46.415656 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:46.415943 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:46.416301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:46.418084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 11:59:46.430467 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:46.435148 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:46.444716 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4475/8962] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 11:59:56.439518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 11:59:59.377145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 11:59:59.387867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef386e-20e2-4187-905c-5dc48088e83a service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 11:59:59.392295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 11:59:59.392897 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 11:59:59.393188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 11:59:59.393464 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 11:59:59.403342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 11:59:59.404789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 11:59:59.414517 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4488/8963] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 11:59:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:01.938953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:00:01.956813 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38a13-bd24-4670-b98f-174c89e4c8f5 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:00:01.965800 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:00:01.966874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:00:01.967399 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:00:01.968493 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:00:01.972287 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:00:01.989523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:00:01.995626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:00:02.006255 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4476/8964] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:00:09.410250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:00:11.999400 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:06.682206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:06.694429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f7775-1d20-4677-802b-fec33c57897f service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:06.699543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:06.700141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:06.700426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:06.700702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:06.702430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:06.715078 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:06.716667 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202a0d-30c8-418e-ac07-f42cb262cce8 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:06.726463 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4489/8965] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:02:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:02:16.643979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:02:16.645389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:16.659876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ad5f-ef9a-448f-8dce-92eb7511cad8 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:02:16.664894 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:02:16.665518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:02:16.665806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:02:16.666084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:02:16.668717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:02:16.680063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:02:16.681634 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:02:16.691870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4477/8966] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:02:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:02:16.722238 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:02:26.687480 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:36.766197 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582baf76-9684-48fd-b931-663bd3c2fcf7 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:36.766722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582baf76-9684-48fd-b931-663bd3c2fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:36.766847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582baf76-9684-48fd-b931-663bd3c2fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:36.788152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-582baf76-9684-48fd-b931-663bd3c2fcf7 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:03:36.789375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-582baf76-9684-48fd-b931-663bd3c2fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:36.804085 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4490/8967] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:03:36.845385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:03:36.858098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19344-c8ed-44f5-9684-09450bfd1d29 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:03:36.863098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:03:36.863695 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:36.863985 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:36.864263 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:36.872612 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:03:36.874170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:03:36.882308 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4478/8968] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:03:38.012793 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd999-b5b0-48f6-9797-94cabcdb5302 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:38.013326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd999-b5b0-48f6-9797-94cabcdb5302 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:38.013435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd999-b5b0-48f6-9797-94cabcdb5302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:38.033201 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-f38dd999-b5b0-48f6-9797-94cabcdb5302 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:03:38.034445 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f38dd999-b5b0-48f6-9797-94cabcdb5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:38.042289 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4491/8969] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:03:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:03:38.055332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:03:38.066205 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10ec83-3cd0-41e8-a6e8-3d0043754a17 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:03:38.071790 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:03:38.072394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:38.072676 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:38.072949 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:38.081471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:03:38.082973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:03:38.091229 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4479/8970] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:03:47.879623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:47.880207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:47.880207 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:47.901281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] MFA Rules not processed for user `a4cff140fd1740ff80c13526874a7113`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:03:47.902489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:47.909663 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4492/8971] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:03:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:03:48.087980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=12 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:03:48.176526 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:03:48.185725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d802e6-1ab2-46c0-bd40-f6cb2e748994 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:03:48.189608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:03:48.190197 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:48.190479 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:48.190780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:48.192537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:48.202186 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:03:48.203638 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167f7f5-c5af-4350-b2d5-55c40b1ce076 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:03:48.211989 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4480/8972] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:03:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:03:48.635337 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:03:48.648492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c813-bc73-4a74-a7e8-8899cf47ba91 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:03:48.653588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:03:48.654375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:48.654719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:48.655094 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:48.656908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:48.669433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:03:48.671038 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:03:48.682267 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4493/8973] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:03:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:03:51.276313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:51.276825 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:51.276936 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:51.297412 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:03:51.301712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:51.306807 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4481/8974] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:03:51.320645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:03:51.332112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b216-8367-4b0f-b6f2-be33f21afa19 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:03:51.337168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:03:51.338093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:51.338093 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:51.338355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:51.346820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:03:51.348502 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:03:51.357334 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4494/8975] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:03:59.377285 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:03:59.386887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10b8b-b23d-4694-8790-84157739a31d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:03:59.392217 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:03:59.392819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:03:59.393194 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:03:59.393471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:03:59.395280 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:03:59.405570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:03:59.407096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:03:59.415911 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4482/8976] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:03:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:04:01.354141 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=24 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:09.411678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=15 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:16.235945 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:04:16.247915 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddabde-ca5b-4314-ab99-b153bc21029a service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:04:16.253306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:04:16.254169 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:04:16.255268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:04:16.255268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:04:16.266969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:04:16.268999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:04:16.280805 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4495/8977] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:04:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:04:26.276114 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:38.030329 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:04:38.039413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10188734-c345-4783-a013-7f5b03acf915 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:04:38.043590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:04:38.044179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:04:38.044485 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:04:38.044768 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:04:38.055691 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:04:38.057111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:04:38.069109 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4483/8978] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:04:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:04:39.271901 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:04:39.281506 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a656bda-0bd9-482b-9ddb-0620c9c00109 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:04:39.285325 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:04:39.285920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:04:39.286203 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:04:39.286478 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:04:39.297523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:04:39.299062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:04:39.310039 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4496/8979] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:04:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:04:48.064002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:04:49.305168 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:23.227697 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:23.229303 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:23.298935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7825a6-9d79-411a-a23a-8118d2585b24 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:23.308787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aa371-c9d8-4b25-aa28-29a4b64b5cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:23.312646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aa371-c9d8-4b25-aa28-29a4b64b5cd0 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:23.312646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aa371-c9d8-4b25-aa28-29a4b64b5cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:23.312646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aa371-c9d8-4b25-aa28-29a4b64b5cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:23.322178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aa371-c9d8-4b25-aa28-29a4b64b5cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:23.324188 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aa371-c9d8-4b25-aa28-29a4b64b5cd0 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:23.336858 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4484/8980] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:32.090065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:32.102005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2158740-01e4-4586-894b-e1f3aae39cc6 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:32.109321 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:32.117936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:32.117936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:32.117936 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:32.130736 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:32.132420 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:32.143854 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4497/8981] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:33.332084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=19 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:33.367809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:33.369184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:33.369184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:33.389685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:05:33.390890 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:33.398379 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4485/8982] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 12:05:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:05:33.439057 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:33.451652 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add2b0-be8f-4076-8dba-0e8d1c89ceb8 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:33.456733 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:33.457270 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:33.457550 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:33.457816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:33.466345 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:33.467965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:33.476274 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4498/8983] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:05:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:05:34.415460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:34.425039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c7c5-a557-4ccf-8753-4a4b7dc254f3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:34.428908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:34.429537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:34.429817 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:34.430089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:34.491808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:34.493359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:34.512078 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4486/8984] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:38.152206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:38.189802 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee823e-03d2-44a4-adcd-54a77006c8e8 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:38.195403 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:38.196174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:38.196461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:38.196735 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:38.198466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:38.211070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:38.212651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:38.223342 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4499/8985] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:42.061049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:42.121257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87b01-a2c3-49d5-871a-b615016b4bd2 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:42.127471 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:42.128236 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:42.128954 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:42.129969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:42.132171 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:42.154644 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:42.156803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:42.167494 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4487/8986] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:42.187809 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:42.202636 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d0b0-7e3d-49fe-b4bb-dcfaa4c36982 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:42.209579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:42.210825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:42.211382 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:42.211878 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] PATH_INFO: `/v3/users/a4cff140fd1740ff80c13526874a7113` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:42.213797 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cff140fd1740ff80c13526874a7113)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:42.216628 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:42.426212 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cff140fd1740ff80c13526874a7113'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.436348 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cff140fd1740ff80c13526874a7113'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.442103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cff140fd1740ff80c13526874a7113'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.442103 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cff140fd1740ff80c13526874a7113'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.452286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cff140fd1740ff80c13526874a7113'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.508242 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4500/8987] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:05:42 2022] DELETE /identity/v3/users/a4cff140fd1740ff80c13526874a7113 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:42.768345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:42.790570 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46a00-047c-4f30-bea6-eed8d074a603 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:42.867332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:42.868003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:42.868366 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:42.868629 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] PATH_INFO: `/v3/projects/bd1282dd54c14401bf4e63d865a67dee` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:42.870007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1282dd54c14401bf4e63d865a67dee)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:42.872940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:42.957721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:42.961558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1282dd54c14401bf4e63d865a67dee', 'request_id': 'req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.968744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1282dd54c14401bf4e63d865a67dee', 'request_id': 'req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:42.974445 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1282dd54c14401bf4e63d865a67dee', 'request_id': 'req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.033614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] The token cache is being invalidate because project bd1282dd54c14401bf4e63d865a67dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:05:43.034103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.035362 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.040941 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4488/8988] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:05:42 2022] DELETE /identity/v3/projects/bd1282dd54c14401bf4e63d865a67dee => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:43.041368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:43.042787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:43.056644 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a017d-9833-47d1-9042-a1cd5b521c87 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:43.115655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:43.116304 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:43.116591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:43.116868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] PATH_INFO: `/v3/users/feb7567d87a44b0da91c62a5d60c7a95` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:43.118184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb7567d87a44b0da91c62a5d60c7a95)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:43.120563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:43.131919 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:43.277023 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb7567d87a44b0da91c62a5d60c7a95'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.285105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb7567d87a44b0da91c62a5d60c7a95'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.285713 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb7567d87a44b0da91c62a5d60c7a95'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.286318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb7567d87a44b0da91c62a5d60c7a95'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.299039 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-ae9146f9-e5b0-4f5c-a85b-e943bde9e830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb7567d87a44b0da91c62a5d60c7a95'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.367783 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4501/8989] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:05:43 2022] DELETE /identity/v3/users/feb7567d87a44b0da91c62a5d60c7a95 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:43.682122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:43.683928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:43.701845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108fe96-5575-4e41-a0db-8a8ca7cf9c8a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:43.776376 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:43.777227 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:43.777547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:43.778061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] PATH_INFO: `/v3/projects/869fd6df39594ee6961252c9d0cfafb3` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:43.780094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869fd6df39594ee6961252c9d0cfafb3)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:43.782640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:43.904531 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869fd6df39594ee6961252c9d0cfafb3', 'request_id': 'req-2e218e15-97d8-45d3-be76-f0d67de53539'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.911112 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869fd6df39594ee6961252c9d0cfafb3', 'request_id': 'req-2e218e15-97d8-45d3-be76-f0d67de53539'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:43.917831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869fd6df39594ee6961252c9d0cfafb3', 'request_id': 'req-2e218e15-97d8-45d3-be76-f0d67de53539'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:44.000277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] The token cache is being invalidate because project 869fd6df39594ee6961252c9d0cfafb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:05:44.000513 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:44.001333 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-2e218e15-97d8-45d3-be76-f0d67de53539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:05:44.002876 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4489/8990] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:05:43 2022] DELETE /identity/v3/projects/869fd6df39594ee6961252c9d0cfafb3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:44.008543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8604-2516-4456-881f-99baef438178 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.008883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8604-2516-4456-881f-99baef438178 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.009255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8604-2516-4456-881f-99baef438178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.034480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-4b3d8604-2516-4456-881f-99baef438178 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:05:44.036034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4b3d8604-2516-4456-881f-99baef438178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:44.107534 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4502/8991] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:05:44.116209 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.116504 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.116779 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.137756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:05:44.138967 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:44.147081 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4490/8992] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:05:44.151509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8604-2516-4456-881f-99baef438178 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.161497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8604-2516-4456-881f-99baef438178 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.166166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.166761 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.167089 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.167371 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.167999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:05:44.168300 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.170432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.182651 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4503/8993] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 12:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:05:44.187766 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.197970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2355-f91c-4899-81c5-ef352caa3d40 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.202761 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.203421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.203703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.203993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.204618 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.206509 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.322754 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4491/8994] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/projects => generated 393 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:05:44.328188 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.339865 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d5e8-0fbe-416b-8962-fa168f5eef30 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.408501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.409196 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.412314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.412314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.412314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.412314 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.486603 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4504/8995] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:05:44.491473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.502620 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ff1a9-fad2-4a27-8253-8e765fc5df97 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.507661 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.508113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.508407 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.508665 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.509295 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.510876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.521633 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4492/8996] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:05:44.526504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.534332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:44.538811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419bd4-c75a-49ea-b2d5-42a685d8b55d admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.544431 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181320a-a1cb-48c3-9484-9e9e23eaafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.545142 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181320a-a1cb-48c3-9484-9e9e23eaafa8 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.545435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181320a-a1cb-48c3-9484-9e9e23eaafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.545747 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181320a-a1cb-48c3-9484-9e9e23eaafa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.546591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181320a-a1cb-48c3-9484-9e9e23eaafa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.548579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181320a-a1cb-48c3-9484-9e9e23eaafa8 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.563245 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4505/8997] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:05:44.567352 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.578525 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa913ae-efa1-4a59-9b3b-4b73e229a9b6 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.584482 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.585151 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.585428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.585709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] PATH_INFO: `/v3/projects/36e1c59f75934cc38e904fa0dae0d587/users/38e0c4e314274ad0bbdc4125638b0916/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.601166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e1c59f75934cc38e904fa0dae0d587, user_id=38e0c4e314274ad0bbdc4125638b0916, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.604828 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.652604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:44.659091 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4493/8998] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:05:44 2022] PUT /identity/v3/projects/36e1c59f75934cc38e904fa0dae0d587/users/38e0c4e314274ad0bbdc4125638b0916/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:44.670136 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.670523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.670902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.702828 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] MFA Rules not processed for user `38e0c4e314274ad0bbdc4125638b0916`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:05:44.704092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:44.783685 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4506/8999] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:05:44.788635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.858875 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29885b-e574-45f0-9834-7c363caa43f2 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:44.863577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:44.864182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:44.864460 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:44.864737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:44.865444 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:44.867381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:44.952537 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4494/9000] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:05:44.957794 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:44.971985 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e726d-7cee-405a-a2d6-bdbed0c26de8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:45.040518 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:45.041263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.041605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.041950 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.042674 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:45.045037 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:45.126531 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4507/9001] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 12:05:44 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:05:45.130655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:45.142057 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cd402-86e2-43bd-afd8-7c18cd29d968 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:45.152323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:45.152323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.152323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.152323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.152843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:45.152843 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:45.162125 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4495/9002] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:05:45.167439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:45.180134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a60c-de87-4982-a183-b1172b03f303 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:45.186534 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:45.191046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.191046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.191046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] PATH_INFO: `/v3/projects/dcf3afc0c55c424289a0ef4f74ec6a7b/users/e6a32325503442f8af3777c7d99f7209/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.205893 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf3afc0c55c424289a0ef4f74ec6a7b, user_id=e6a32325503442f8af3777c7d99f7209, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:45.209105 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:45.257704 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4508/9003] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:05:45 2022] PUT /identity/v3/projects/dcf3afc0c55c424289a0ef4f74ec6a7b/users/e6a32325503442f8af3777c7d99f7209/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:45.261769 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:45.274430 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06643-ac1a-47f1-872a-b4fb13ad580a admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:45.340939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090c576-c09d-46a2-b9a3-63ea49844076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:45.341658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c576-c09d-46a2-b9a3-63ea49844076 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.342042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c576-c09d-46a2-b9a3-63ea49844076 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.342384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090c576-c09d-46a2-b9a3-63ea49844076 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.343178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090c576-c09d-46a2-b9a3-63ea49844076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:45.345098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090c576-c09d-46a2-b9a3-63ea49844076 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:45.357043 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4496/9004] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:05:45.361375 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:45.372908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694be9-4b08-4563-9adc-3ea7e4ae3a39 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:45.377698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:45.378286 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.378569 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.378847 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] PATH_INFO: `/v3/projects/dcf3afc0c55c424289a0ef4f74ec6a7b/users/e6a32325503442f8af3777c7d99f7209/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.380838 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf3afc0c55c424289a0ef4f74ec6a7b, user_id=e6a32325503442f8af3777c7d99f7209, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:45.383524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:45.394857 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4509/9005] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:05:45 2022] PUT /identity/v3/projects/dcf3afc0c55c424289a0ef4f74ec6a7b/users/e6a32325503442f8af3777c7d99f7209/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:05:45.404974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.405269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.405545 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.433475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] MFA Rules not processed for user `e6a32325503442f8af3777c7d99f7209`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:05:45.435313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:45.505639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:45.517076 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4497/9006] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:05:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:05:45.535933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:45.537969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:45.586135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:05:45.622111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486b23-9cea-48e2-8d2c-700ef3e4319f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:45.633210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb2fcf-89e0-43a2-9334-45d308859994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:45.633210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2fcf-89e0-43a2-9334-45d308859994 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:45.633210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2fcf-89e0-43a2-9334-45d308859994 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:45.633210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2fcf-89e0-43a2-9334-45d308859994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:45.691417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb2fcf-89e0-43a2-9334-45d308859994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:45.691648 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb2fcf-89e0-43a2-9334-45d308859994 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:45.701028 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4510/9007] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:51.318834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:51.318834 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:51.428059 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb32308-eafe-46e6-943a-6e9f628acaeb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:51.432876 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:51.433653 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:51.434085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:51.434549 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:51.448594 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:51.450178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:51.463654 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4498/9008] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:05:55.643497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:55.644111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:55.644111 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:55.667112 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] MFA Rules not processed for user `38e0c4e314274ad0bbdc4125638b0916`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:05:55.668679 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:55.677391 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4511/9009] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:05:56.672764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:05:56.676409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:56.765523 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a9d65-7a9a-495c-b6ed-c56c13143ddc service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:05:56.771391 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:05:56.772007 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:05:56.774928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:05:56.774928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:05:56.774928 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:05:56.788602 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:05:56.790219 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:05:56.805456 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4499/9010] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:05:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:06:00.159288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:06:00.172046 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2005a7-26d4-4683-801c-961d151110d9 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:06:00.185823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:06:00.187592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:06:00.187592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:06:00.187592 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:06:00.189126 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:06:00.202588 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:06:00.205367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ae186-c174-4e5b-b870-914996a02f4f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:06:00.215143 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4512/9011] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:06:06.149962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:06:06.162965 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce8936-bb49-479e-9837-abc35ee49362 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:06:06.168855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:06:06.169532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:06:06.169888 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:06:06.170234 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:06:06.172106 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:06:06.186751 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:06:06.188421 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:06:06.200616 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4500/9012] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:06:10.210594 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=49 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:06:16.195953 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=72 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:06.310932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:06.311536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:06.311536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:06.339696 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] MFA Rules not processed for user `38e0c4e314274ad0bbdc4125638b0916`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:07:06.341750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:06.352788 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4513/9013] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:07:06.745179 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:06.747192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:06.767731 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f611-0334-4f58-8661-e3c0470e1992 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:06.773078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:06.773913 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:06.774383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:06.774819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:06.782580 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:06.798539 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:06.806455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:06.817212 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4501/9014] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:08.633933 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:08.636261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:08.675465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fc517-c95b-4069-bb4b-3f9598558219 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:08.680821 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:08.681432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:08.681962 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:08.682416 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:08.685056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:08.698579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:08.702782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092bc7-116c-4cde-9824-a53ffa2a4909 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:08.714131 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4514/9015] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:16.805770 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:18.709558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=16 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:07:21.636743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:07:21.649085 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2c1b-3fb9-4ccb-bf2d-55d76ed232b7 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:07:21.654669 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:07:21.655302 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:07:21.655589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:07:21.655867 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:07:21.657630 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:07:21.670229 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:07:21.671889 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:07:21.682243 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4502/9016] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:07:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:07:31.677874 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:49.484488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:08:49.485031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:08:49.485031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:08:49.504746 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] MFA Rules not processed for user `38e0c4e314274ad0bbdc4125638b0916`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:08:49.506014 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:08:49.513283 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4515/9017] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:08:49.840534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:08:49.860807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361e68a-f2f4-483a-b047-e4cad9c90ab5 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:08:49.866428 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:08:49.867516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:08:49.867934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:08:49.868740 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:08:49.870700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:08:49.881722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:08:49.883500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:08:49.894178 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4503/9018] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:08:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:08:59.499414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:08:59.890359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=10 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:34.688092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:34.701626 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fff65-6cf0-4e01-b80b-ae147f281b94 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:34.705467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:34.706305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:34.706670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:34.707048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:34.708999 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:34.721012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:34.722645 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd64046-13cc-4cd4-a32b-d86efe18f3d7 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:34.732239 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4516/9019] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:09:34.905745 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:34.919069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a65f-9d83-40de-97eb-36c5f74d0fbf service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:34.924228 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:34.924832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:34.925115 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:34.925392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:34.927224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:34.953486 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:34.955178 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:34.966423 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4504/9020] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:09:35.286922 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:35.287247 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:35.287522 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:35.347109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:09:35.348338 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:35.368617 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4517/9021] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:09:35.378934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:35.388910 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496b54-39ee-418f-a691-77d1ef28d59a service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:35.392569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:35.393161 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:35.393440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:35.393712 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:35.403976 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:35.405475 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:35.417068 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4505/9022] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:09:35.485461 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:35.498062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc274-dcd3-4873-8678-6d9262b00cea None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:35.503080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:35.503702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:35.503982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:35.504255 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:35.505960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:35.519943 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:35.521570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:35.532127 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4518/9023] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:09:38.407540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:38.416824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78977d3-2d79-41c5-aa94-32065f4fbeb8 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:38.421166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:38.421764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:38.422047 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:38.422322 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:38.424118 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:38.438248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:38.439714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:38.451729 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4506/9024] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:09:39.638578 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:39.647783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756cd4-ae51-4b41-a275-ca66b66c5d79 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:39.651754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:39.652342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:39.652620 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:39.652890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:39.654608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:39.667749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:39.669200 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:39.679988 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4519/9025] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:09:48.445786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=23 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:49.675293 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=39 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:09:50.185939 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:09:50.194791 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9609e8-fe24-41c8-b805-d23e8f0bdf31 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:09:50.199372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:09:50.199961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:09:50.200240 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:09:50.200511 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:09:50.202260 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:09:50.211675 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:09:50.213092 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002f7d7-6ec8-425c-96a6-c4fdeccb62f1 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:09:50.220974 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4507/9026] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:09:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:10:00.217490 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:25.512597 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:10:25.523659 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159bc1-e71d-4eef-a2df-70f9ed6d5d3a service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:10:25.530009 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:10:25.532639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:10:25.532639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:10:25.532639 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:10:25.533222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:10:25.549760 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:10:25.557214 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:10:25.565441 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4520/9027] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:10:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:10:35.560372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:10:41.329026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:10:41.329590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:10:41.329590 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:10:41.354617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] MFA Rules not processed for user `38e0c4e314274ad0bbdc4125638b0916`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:10:41.356414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:10:41.367337 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4508/9028] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:10:45.942429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:10:45.954853 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabbf96-c006-4f08-a556-8a4b55402893 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:10:45.961149 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:10:45.961852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:10:45.962137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:10:45.962414 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:10:45.964613 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:10:45.977740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:10:45.979559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:10:45.991794 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4521/9029] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:10:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:10:46.680607 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:10:46.682045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:10:46.699694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cead-50ce-4db7-bfbb-906f4db7a07f None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:10:46.705359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:10:46.705971 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:10:46.706257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:10:46.706534 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:10:46.715577 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:10:46.717365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:10:46.726803 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4509/9030] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:10:54.173631 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:10:54.183175 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c52cd2-ac02-41a9-89f0-53438a741d1d service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:10:54.187059 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:10:54.187663 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:10:54.187947 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:10:54.188222 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:10:54.197798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:10:54.199261 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:10:54.209675 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4522/9031] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:10:56.722532 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:04.204750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=12 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:11:19.416026 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:11:19.425784 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5af7-20e1-420e-9813-7f588abe7b31 service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:11:19.429386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:11:19.429969 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:11:19.430254 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:11:19.430598 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:11:19.437806 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:11:19.439244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:11:19.447943 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4510/9032] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:11:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:11:29.444238 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:16.708957 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:12:16.720590 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5e77-ee89-40bc-a620-a9ead10e9121 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:12:16.726369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:12:16.726369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:12:16.726369 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:12:16.726779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:12:16.735480 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:12:16.737049 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:12:16.748104 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4523/9033] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:12:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:12:25.645980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:12:25.659321 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31126e-7ace-4b0d-b4ff-12934846db59 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:12:25.664505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3752f13-9564-4cce-89a7-9304a61255c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:12:25.665184 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3752f13-9564-4cce-89a7-9304a61255c0 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:12:25.665548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3752f13-9564-4cce-89a7-9304a61255c0 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:12:25.665899 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3752f13-9564-4cce-89a7-9304a61255c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:12:25.675984 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3752f13-9564-4cce-89a7-9304a61255c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:12:25.678008 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3752f13-9564-4cce-89a7-9304a61255c0 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:12:25.688571 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4511/9034] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:12:26.678106 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:12:26.688876 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f39e0a-7e6a-4fcc-b8c0-6f0cd1598d74 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:12:26.693939 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:12:26.694607 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:12:26.694890 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:12:26.695199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:12:26.696956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:12:26.712710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:12:26.715630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:12:26.725437 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4524/9035] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:12:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:12:35.150827 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:12:35.151365 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:12:35.151574 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:12:35.172271 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] MFA Rules not processed for user `38e0c4e314274ad0bbdc4125638b0916`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:12:35.173593 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:12:35.181048 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4512/9036] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:12:35.541563 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:12:35.555725 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff931456-fc8d-4f38-a822-8d549850d469 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:12:35.559982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:12:35.560593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:12:35.563398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:12:35.563398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:12:35.569537 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:12:35.571134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:12:35.581185 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4525/9037] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:12:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:12:45.166346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:45.577067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=18 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:12:47.856345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:12:47.869643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75534b-8141-4fc7-94b6-e1ff1ebc2a76 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:12:47.877922 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011493d6-6485-457d-8292-80e3829ca7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:12:47.878709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011493d6-6485-457d-8292-80e3829ca7b7 service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:12:47.879096 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011493d6-6485-457d-8292-80e3829ca7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:12:47.879518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011493d6-6485-457d-8292-80e3829ca7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:12:47.894001 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011493d6-6485-457d-8292-80e3829ca7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:12:47.896088 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011493d6-6485-457d-8292-80e3829ca7b7 service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:12:47.913232 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4513/9038] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:12:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:12:57.906973 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:39.842530 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:39.921135 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eb80a-8c45-4212-af88-1a7173cbc676 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:39.925783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:39.926446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:39.926731 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:39.927036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] PATH_INFO: `/v3/users/38e0c4e314274ad0bbdc4125638b0916` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:39.928171 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e0c4e314274ad0bbdc4125638b0916)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:39.930092 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:40.084309 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e0c4e314274ad0bbdc4125638b0916'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.091835 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e0c4e314274ad0bbdc4125638b0916'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.092599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e0c4e314274ad0bbdc4125638b0916'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.093224 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e0c4e314274ad0bbdc4125638b0916'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.106757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e0c4e314274ad0bbdc4125638b0916'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.200094 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4526/9039] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:13:39 2022] DELETE /identity/v3/users/38e0c4e314274ad0bbdc4125638b0916 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:40.205042 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:40.205495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:40.205495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:40.247988 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:40.249842 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:40.309608 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4514/9040] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:40.320268 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:40.321698 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:40.380485 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54553bd8-814b-4ac2-a46a-3c1ceefba4ba admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:40.384823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:40.385460 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:40.385744 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:40.386016 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:40.395113 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:40.396551 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:40.407944 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4527/9041] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:13:40.635727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:40.637185 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:40.652027 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9022d-5bb4-4662-a669-d2abd9442977 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:40.657192 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:40.657824 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:40.658117 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:40.658385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] PATH_INFO: `/v3/projects/36e1c59f75934cc38e904fa0dae0d587` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:40.659655 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e1c59f75934cc38e904fa0dae0d587)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:40.661566 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:40.744103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e1c59f75934cc38e904fa0dae0d587', 'request_id': 'req-43f5c87e-c801-4cf9-9b74-4179209d6cc4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.750459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e1c59f75934cc38e904fa0dae0d587', 'request_id': 'req-43f5c87e-c801-4cf9-9b74-4179209d6cc4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.756483 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e1c59f75934cc38e904fa0dae0d587', 'request_id': 'req-43f5c87e-c801-4cf9-9b74-4179209d6cc4'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.817402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] The token cache is being invalidate because project 36e1c59f75934cc38e904fa0dae0d587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:13:40.817700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.818413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:40.820112 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4515/9042] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:13:40 2022] DELETE /identity/v3/projects/36e1c59f75934cc38e904fa0dae0d587 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:40.827281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:40.838810 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5296c-bf6d-49cb-ae85-0816952996b5 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:40.849284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:40.896918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:40.897553 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:40.897839 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:40.898119 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] PATH_INFO: `/v3/users/e6a32325503442f8af3777c7d99f7209` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:40.899367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a32325503442f8af3777c7d99f7209)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:40.901294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:41.092977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a32325503442f8af3777c7d99f7209'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.099879 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a32325503442f8af3777c7d99f7209'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.101071 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a32325503442f8af3777c7d99f7209'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.101694 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a32325503442f8af3777c7d99f7209'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.114159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-445d07e5-a8ea-4f7d-b41e-061874fc06e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a32325503442f8af3777c7d99f7209'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.216809 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4528/9043] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:13:40 2022] DELETE /identity/v3/users/e6a32325503442f8af3777c7d99f7209 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:41.681510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:41.683247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:41.700551 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c87e-c801-4cf9-9b74-4179209d6cc4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:41.771170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:41.771815 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:41.772097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:41.772373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] PATH_INFO: `/v3/projects/dcf3afc0c55c424289a0ef4f74ec6a7b` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:41.773521 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf3afc0c55c424289a0ef4f74ec6a7b)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:41.775456 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:41.783684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:41.894160 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf3afc0c55c424289a0ef4f74ec6a7b', 'request_id': 'req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.901279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf3afc0c55c424289a0ef4f74ec6a7b', 'request_id': 'req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.907792 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf3afc0c55c424289a0ef4f74ec6a7b', 'request_id': 'req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.971870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] The token cache is being invalidate because project dcf3afc0c55c424289a0ef4f74ec6a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:13:41.972097 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.972732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-3ee95060-661c-43e0-bbe8-8a4a8c71b60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:13:41.974325 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4516/9044] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:13:41 2022] DELETE /identity/v3/projects/dcf3afc0c55c424289a0ef4f74ec6a7b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:41.979920 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:41.980381 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:41.980468 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.020160 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:42.021376 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:42.080634 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4529/9045] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:42.089094 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.089409 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.089692 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.110257 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:42.111510 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:42.119433 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4517/9046] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:42.124343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.134571 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d585f-e24b-4914-b6ca-a8d969f8796d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.139852 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.140444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.140722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.140994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.141624 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92878) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:13:42.141925 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.143958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.155425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4530/9047] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 12:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:13:42.159855 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.169373 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2f9a-f01b-4d1d-b0ee-c2473281d07d None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.174070 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.174679 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.174993 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.175316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.176019 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.177859 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.306146 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4518/9048] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 12:13:42 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:13:42.310405 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.317669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:42.321863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10f5f-c307-470c-b3ea-9e16cc212dd7 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.380942 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.381610 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.381891 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.382173 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.382831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.384849 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.490899 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4531/9049] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 12:13:42 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:13:42.495385 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.506537 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09bc4e-53bc-4aa3-a575-4001edc6a4e9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.511177 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.511780 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.512249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.512530 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.513166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.514754 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.527166 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4519/9050] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:13:42.531433 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.541937 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c317de-c9bf-4eae-857d-5ca14625580f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.547117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcecfb4-7dd4-4fa7-8331-e0942855c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.547714 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcecfb4-7dd4-4fa7-8331-e0942855c301 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.547994 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcecfb4-7dd4-4fa7-8331-e0942855c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.548266 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcecfb4-7dd4-4fa7-8331-e0942855c301 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.548924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcecfb4-7dd4-4fa7-8331-e0942855c301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.550570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcecfb4-7dd4-4fa7-8331-e0942855c301 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.562134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4532/9051] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:13:42.566411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.576887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ceaac-2f9b-4ff4-9d01-8bce496ea2c5 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.581382 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.582182 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.582470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.582744 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] PATH_INFO: `/v3/projects/7e98949fac3f403faa6fa0e0c2e86c44/users/6394701f1951428995065bf1007c34fa/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.598166 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e98949fac3f403faa6fa0e0c2e86c44, user_id=6394701f1951428995065bf1007c34fa, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.600860 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.667917 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4520/9052] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:13:42 2022] PUT /identity/v3/projects/7e98949fac3f403faa6fa0e0c2e86c44/users/6394701f1951428995065bf1007c34fa/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:42.673819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c7b1a-7cc0-4bbc-94cf-a84153027f7e None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.674116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c7b1a-7cc0-4bbc-94cf-a84153027f7e None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.674398 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c7b1a-7cc0-4bbc-94cf-a84153027f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.693850 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-275c7b1a-7cc0-4bbc-94cf-a84153027f7e None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:42.695096 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-275c7b1a-7cc0-4bbc-94cf-a84153027f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:42.754826 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4533/9053] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:42.764678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:42.766497 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:42.825678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055179f-57b0-4f1e-bf52-58ffb74bda08 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:42.829406 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:42.830017 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:42.830304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:42.830604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:42.840466 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:42.842540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:42.872335 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4521/9054] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:13:48.183399 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.183910 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.183984 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.221025 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] MFA Rules not processed for user `6394701f1951428995065bf1007c34fa`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:48.226524 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:48.308665 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4534/9055] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:48.312962 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:48.323350 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d3896-ea9b-45f0-b077-159dc4df7ec3 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:48.329258 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:48.329873 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.330158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.330433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.331110 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:48.333189 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:48.436772 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4522/9056] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 12:13:48 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:13:48.438579 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:48.452063 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10335a18-98a4-40c4-9ff5-f53e6c4afec8 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:48.464035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:48.521343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:48.522388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.522913 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.523323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] PATH_INFO: `/v3/users` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.524608 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:48.526792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:48.639375 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4535/9057] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 12:13:48 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:13:48.641200 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:48.647916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:48.651811 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c24663-0238-4a37-ae20-0656d3b46a64 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:48.656714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:48.657318 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.657604 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.657879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.658516 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:48.660797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:48.675074 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4523/9058] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:13:48.676236 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:48.687951 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8435d55-8376-438e-95ce-bbca0477bd6f admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:48.692863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:48.693523 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.693804 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.694097 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] PATH_INFO: `/v3/projects/aba64d4298344fef86bd7db83bdd9196/users/4c4578095ecd47b09a9120bd23458371/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.714529 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba64d4298344fef86bd7db83bdd9196, user_id=4c4578095ecd47b09a9120bd23458371, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:48.717285 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:48.812062 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4536/9059] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:13:48 2022] PUT /identity/v3/projects/aba64d4298344fef86bd7db83bdd9196/users/4c4578095ecd47b09a9120bd23458371/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:48.816045 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:48.827331 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a2777-483e-43d4-9dfe-7ec0ccd99e2b admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:48.885169 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11255d-bbcf-4e97-8f14-c3c191c90e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:48.885777 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11255d-bbcf-4e97-8f14-c3c191c90e83 admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.886061 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11255d-bbcf-4e97-8f14-c3c191c90e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.886330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11255d-bbcf-4e97-8f14-c3c191c90e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.886964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11255d-bbcf-4e97-8f14-c3c191c90e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:48.888666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11255d-bbcf-4e97-8f14-c3c191c90e83 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:48.915429 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4524/9060] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:13:48.919562 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:48.936107 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f5b5f-e16e-4a63-96c6-d8f4213de59c admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:48.944082 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:48.944755 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:48.945034 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:48.945307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] PATH_INFO: `/v3/projects/aba64d4298344fef86bd7db83bdd9196/users/4c4578095ecd47b09a9120bd23458371/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:48.947492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba64d4298344fef86bd7db83bdd9196, user_id=4c4578095ecd47b09a9120bd23458371, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:48.950384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:48.963311 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4537/9061] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:13:48 2022] PUT /identity/v3/projects/aba64d4298344fef86bd7db83bdd9196/users/4c4578095ecd47b09a9120bd23458371/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:13:54.596381 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f4322-b47c-443e-ba81-da1960f3938b None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:54.596865 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f4322-b47c-443e-ba81-da1960f3938b None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:54.597249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f4322-b47c-443e-ba81-da1960f3938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:54.629368 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-9e4f4322-b47c-443e-ba81-da1960f3938b None None] MFA Rules not processed for user `4c4578095ecd47b09a9120bd23458371`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:54.630701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-9e4f4322-b47c-443e-ba81-da1960f3938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:54.713550 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4525/9062] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:54.733427 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:54.735331 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:54.831670 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07845dd3-0760-4e3f-8673-f43b6f42d9f9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:54.838307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:54.839033 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:54.839395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:54.839739 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:54.899053 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:54.901573 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:54.905863 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:54.914149 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4538/9063] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:13:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:13:57.432431 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:57.432964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:57.433122 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:57.455831 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] MFA Rules not processed for user `6394701f1951428995065bf1007c34fa`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:13:57.457142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:57.464536 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4526/9064] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:13:57.808948 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:57.811043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:57.871199 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c96a87-ef7f-45d9-bb68-1245d8f97567 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:57.874841 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:57.875488 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:57.876305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:57.876305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:57.877888 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:57.888843 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:57.890294 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:57.899250 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4539/9065] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:13:58.344214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:13:58.345755 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:58.441433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc3e11-74c2-4fb3-bd25-dfa6b998e3ca None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:13:58.448003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:13:58.448783 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:13:58.449098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:13:58.449224 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:13:58.452069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:13:58.467560 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:13:58.468211 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:13:58.473113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=100 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:13:58.479817 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4527/9066] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:13:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:14:07.895062 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=28 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:08.549926 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:14:10.273599 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:14:10.283417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ea8d2-fb47-439f-bddf-18ca8dcd8110 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:14:10.287282 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:14:10.287881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:14:10.288162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:14:10.288435 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:14:10.297779 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:14:10.299265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:14:10.309006 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4540/9067] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:14:20.304676 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:07.894142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:07.895666 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:08.003585 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d5462-582b-493c-8321-6502ff943e7e service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:08.007162 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:08.007758 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:08.008038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:08.008313 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:08.010547 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:08.049312 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:08.050747 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcb580-4400-45cb-8dd1-b435056bf17f service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:08.062211 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4528/9068] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:16:08.317326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:08.337227 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627867e4-0884-4ca5-afcf-3b74772c1319 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:08.340965 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:08.341646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:08.341930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:08.342206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:08.343958 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:08.358938 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:08.360407 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:08.371908 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4541/9069] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:16:18.056844 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=59 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:18.366432 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=11 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:21.718121 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:21.718628 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:21.718722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:21.773286 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:16:21.774548 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:21.842806 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4529/9070] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:16:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:16:21.979931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:21.981439 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:22.071771 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe06e-d996-49b8-92ec-87b4ce731310 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:22.077158 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598bf41-c598-4e3b-975f-dda3e41c2f55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:22.077763 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598bf41-c598-4e3b-975f-dda3e41c2f55 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:22.078048 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598bf41-c598-4e3b-975f-dda3e41c2f55 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:22.078326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598bf41-c598-4e3b-975f-dda3e41c2f55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:22.086555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598bf41-c598-4e3b-975f-dda3e41c2f55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:22.088239 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598bf41-c598-4e3b-975f-dda3e41c2f55 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:22.097180 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4542/9071] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:16:25.243268 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:25.253635 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22b649-21d4-41cf-b8b0-7544f9807417 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:25.257683 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:25.258309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:25.258601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:25.258881 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:25.260848 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:25.316038 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:25.320180 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:25.341398 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4530/9072] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:16:32.093792 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=41 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:35.332505 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=51 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:35.537318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:35.537823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:35.537912 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:35.559087 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] MFA Rules not processed for user `6c2ddfc46e6c414085493829459e5ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:16:35.560360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:35.570827 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4543/9073] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Sep 6 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:16:35.584725 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:35.594646 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106df5-ab2f-4c0b-8520-84096aeca61e service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:35.599098 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a5944ef46aa40078b84b486b24822eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:35.600147 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:35.600465 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:35.600746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:35.611282 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:35.612736 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:35.623481 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4531/9074] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:16:35.795729 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:35.805323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a191f-877f-4614-8cdb-1cd21bf3dd2c None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:35.808905 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:35.809501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:35.809782 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:35.810060 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:35.812004 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:35.821795 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:35.823252 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:35.832363 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4544/9075] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 12:16:35.906978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:35.917488 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1eb15-2c77-421b-bab0-1bbf93185dce service glance] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:35.921384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:35.922099 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:35.922389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:35.922672 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:35.924601 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:35.938700 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:35.940746 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc204aa-5306-453c-b576-dc005fb36287 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:35.952792 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4532/9076] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 12:16:36.014145 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:36.015584 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:36.031422 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6f7c4-21ae-40a3-829d-2a64b500d5c1 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:36.036559 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:36.037159 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:36.037444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:36.037723 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:36.039457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:36.051121 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:36.052702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:36.062945 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4545/9077] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:16:38.061389 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9531819-1354-4714-af2c-3ea901f831c4 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:38.061832 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9531819-1354-4714-af2c-3ea901f831c4 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:38.061935 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9531819-1354-4714-af2c-3ea901f831c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:38.082245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d9531819-1354-4714-af2c-3ea901f831c4 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:16:38.083491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d9531819-1354-4714-af2c-3ea901f831c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:38.090785 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4533/9078] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:16:38.102976 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:38.115170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186035c-b789-4cbd-9c7b-71573d51c934 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:38.120174 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d852a-b491-401d-8891-400141d3875b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:38.120765 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d852a-b491-401d-8891-400141d3875b service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:38.121045 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d852a-b491-401d-8891-400141d3875b service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:38.121320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d852a-b491-401d-8891-400141d3875b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:38.130281 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d852a-b491-401d-8891-400141d3875b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:38.131961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d852a-b491-401d-8891-400141d3875b service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:38.140174 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4546/9079] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:16:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:16:48.076304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=15 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:48.136868 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=21 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:16:54.074270 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:54.074727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:54.074864 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:54.094384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:16:54.095643 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:16:54.103927 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4534/9080] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:16:54.116618 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d852a-b491-401d-8891-400141d3875b service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:16:54.127504 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d852a-b491-401d-8891-400141d3875b service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:16:54.132492 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:16:54.133088 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:16:54.133372 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:16:54.133649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:16:54.141661 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:16:54.143306 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:16:54.151410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4547/9081] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:16:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:17:04.088980 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:04.148177 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:22.718082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:17:22.747738 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab3c74-c687-48c2-b0b0-7d8326061bdb None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:17:22.752718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:17:22.753316 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:17:22.753614 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:17:22.753908 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:17:22.755678 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:17:22.767111 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:17:22.768681 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:17:22.778949 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4535/9082] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:17:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:17:31.627355 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:17:31.646320 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00e20-1821-48a9-9c71-28b524f7dc7c service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:17:31.651589 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:17:31.652334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:17:31.652593 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:17:31.652874 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:17:31.654646 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:17:31.666649 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:17:31.668351 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:17:31.678919 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4548/9083] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:17:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:17:32.774771 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=13 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:17:41.673986 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=9 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:07.587818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:18:07.589898 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:18:07.605868 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb23ce6-8639-4a0e-a2ba-78c0cf821a97 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:18:07.613323 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:18:07.614213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:18:07.614687 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:18:07.615199 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:18:07.617212 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:18:07.632003 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:18:07.633877 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074d57-8dff-42e7-a3c5-421337aeafda service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:18:07.646455 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4536/9084] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:18:09.893811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:18:09.907258 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97077-e191-43f4-8ed9-9601556319a4 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:18:09.912977 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:18:09.913587 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:18:09.913872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:18:09.914151 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:18:09.915992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:18:09.928972 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:18:09.930558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:18:09.941802 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4549/9085] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:18:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:18:14.827176 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:18:14.827946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:18:14.828087 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:18:14.849330 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] MFA Rules not processed for user `6394701f1951428995065bf1007c34fa`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:18:14.850799 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:18:14.857902 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4537/9086] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:18:19.937166 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:20.307558 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:18:20.317283 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57041-c528-4fe5-9297-af9860653fc7 service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:18:20.320988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:18:20.321586 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:18:20.321867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:18:20.322139 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:18:20.323969 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:18:20.334886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:18:20.337319 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:18:20.346318 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4550/9087] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:18:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:18:24.844284 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=9 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:30.341982 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:18:33.434764 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:18:33.447930 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba642-6e22-4cf3-91da-d05d04bb07b3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:18:33.454435 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:18:33.454591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:18:33.454812 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:18:33.455132 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:18:33.456904 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:18:33.470346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:18:33.472089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:18:33.483349 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4538/9088] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:18:43.478940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=6 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:21:33.411815 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:21:33.430831 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e03942-cec2-4b99-aee1-9ee5ece35d31 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:21:33.434543 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:21:33.435216 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:21:33.436035 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:21:33.436438 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:21:33.443967 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:21:33.445395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:21:33.453968 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4551/9089] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:21:43.449808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=10 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:11.243269 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:11.269018 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772de758-6b14-4dcf-a972-01d3167ac0fa service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:11.275694 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:11.276433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:11.276721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:11.277000 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:11.285114 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:11.296272 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:11.299429 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4539/9090] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:13.612964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:13.623456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d50a-e409-4fc8-b821-41dfdb9ea532 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:13.627516 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:13.628129 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:13.628418 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:13.628704 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:13.641520 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:13.643127 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:13.655745 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4552/9091] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 12:22:14.862415 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:14.873089 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0d67b-c423-440e-914a-f484dca7916a service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:14.876578 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:14.877170 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:14.877453 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:14.877727 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:14.888997 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:14.890413 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:14.901442 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4540/9092] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:18.709479 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:18.719267 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c580-d145-47a2-b2ee-9dd08eaa143f service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:18.723343 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:18.724028 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:18.724387 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:18.724668 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:18.793710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:18.795194 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:18.815543 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4553/9093] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:22.558443 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:22.573947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538564e0-eb6d-4692-897a-72b1c469dfe4 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:22.579084 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:22.579677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:22.579961 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:22.580489 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:22.582244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:22.608884 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:22.610533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:22.620689 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4541/9094] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:25.649823 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:25.661886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7358e-cd86-46aa-bc21-0d0c87acbb57 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:25.667086 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:25.667702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:25.667983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:25.668457 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:25.677766 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:25.682058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:25.691003 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4554/9095] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:26.289872 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:26.302028 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99f909-152d-4bad-8dd2-ef156a80a8e4 service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:26.306879 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:26.308103 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:26.308544 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:26.308674 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] PATH_INFO: `/v3/users/6394701f1951428995065bf1007c34fa` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:26.309820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6394701f1951428995065bf1007c34fa)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:26.311809 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:26.499682 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6394701f1951428995065bf1007c34fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:26.508288 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6394701f1951428995065bf1007c34fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:26.512345 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6394701f1951428995065bf1007c34fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:26.522705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6394701f1951428995065bf1007c34fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:26.523721 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6394701f1951428995065bf1007c34fa'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:26.650158 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4542/9096] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:22:26 2022] DELETE /identity/v3/users/6394701f1951428995065bf1007c34fa => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:26.881630 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:26.893872 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7521e-22f5-4878-bb7a-d572ab7e525b service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:26.954916 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:26.956080 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:26.956402 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:26.956716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] PATH_INFO: `/v3/projects/7e98949fac3f403faa6fa0e0c2e86c44` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:26.957975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e98949fac3f403faa6fa0e0c2e86c44)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:26.960116 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:27.063501 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e98949fac3f403faa6fa0e0c2e86c44', 'request_id': 'req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.069090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e98949fac3f403faa6fa0e0c2e86c44', 'request_id': 'req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.070960 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:27.075535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e98949fac3f403faa6fa0e0c2e86c44', 'request_id': 'req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.153417 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] The token cache is being invalidate because project 7e98949fac3f403faa6fa0e0c2e86c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:22:27.153640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.154271 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.155872 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4555/9097] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:22:26 2022] DELETE /identity/v3/projects/7e98949fac3f403faa6fa0e0c2e86c44 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:27.159911 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:27.161709 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:27.174786 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128a94a-13f7-4afe-8d57-55ff1c21a284 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:27.234787 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:27.235473 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:27.235797 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:27.236078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] PATH_INFO: `/v3/users/4c4578095ecd47b09a9120bd23458371` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:27.237429 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4578095ecd47b09a9120bd23458371)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:27.239470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:27.253569 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:27.438940 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4578095ecd47b09a9120bd23458371'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.445947 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4578095ecd47b09a9120bd23458371'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.446647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4578095ecd47b09a9120bd23458371'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.460275 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4578095ecd47b09a9120bd23458371'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.460946 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-00d808d9-86aa-4103-8561-bc516f74c6ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4578095ecd47b09a9120bd23458371'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.554391 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4543/9098] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:22:27 2022] DELETE /identity/v3/users/4c4578095ecd47b09a9120bd23458371 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:27.808881 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:27.810333 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:27.825846 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5560f4d-25b0-4ab7-a35a-7d8b6a74a795 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:27.887367 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:27.888073 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:27.888302 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:27.888606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] PATH_INFO: `/v3/projects/aba64d4298344fef86bd7db83bdd9196` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:27.889716 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba64d4298344fef86bd7db83bdd9196)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:27.891783 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:27.990395 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba64d4298344fef86bd7db83bdd9196', 'request_id': 'req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:27.996605 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba64d4298344fef86bd7db83bdd9196', 'request_id': 'req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:28.002816 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba64d4298344fef86bd7db83bdd9196', 'request_id': 'req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:28.093380 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] The token cache is being invalidate because project aba64d4298344fef86bd7db83bdd9196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:22:28.093591 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:28.094233 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-8b5c5e8c-bc2c-458d-a693-ceb0e24b3173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:22:28.095879 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4556/9099] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:22:27 2022] DELETE /identity/v3/projects/aba64d4298344fef86bd7db83bdd9196 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:28.101491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.101803 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.102063 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.132347 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:22:28.133558 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:28.192586 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4544/9100] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:22:28.200362 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.200651 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.200930 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.221205 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:22:28.222510 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:28.230978 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4557/9101] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:22:28.235245 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.244963 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518c85-ba7f-4718-8dfa-49b50cb1b6ad None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.249533 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.250135 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.250440 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.250717 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.251392 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 12:22:28.251703 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.253304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.264870 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4545/9102] 10.222.0.20 () {58 vars in 1153 bytes} [Tue Sep 6 12:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 12:22:28.269393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.279334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6628ab-76d9-455d-a7a8-1f671230570d None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.284043 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.284640 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.284924 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.285206 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.285832 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.287769 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.396456 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4558/9103] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 12:22:28 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:22:28.401540 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.412414 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67339c-aabb-4980-9889-84732fb00f0c admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.472916 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.473608 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.473802 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.474078 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.474719 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.476710 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.573491 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:28.578843 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4546/9104] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 12:22:28 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:22:28.583318 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.594642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e49f-a24b-41b4-b3ed-34c83c18dfce admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.605328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.605328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.605328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.605328 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.605710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.605710 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.612645 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4559/9105] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:22:28.616737 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.627080 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42eb9-433b-4c95-ba78-a1a1e80c99a4 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.631934 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696f897-bc58-4e6f-9963-3b41e93d33db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.637705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f897-bc58-4e6f-9963-3b41e93d33db admin admin] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.637705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f897-bc58-4e6f-9963-3b41e93d33db admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.637705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f897-bc58-4e6f-9963-3b41e93d33db admin admin] PATH_INFO: `/v3/roles` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.637705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696f897-bc58-4e6f-9963-3b41e93d33db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.637705 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696f897-bc58-4e6f-9963-3b41e93d33db admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.646745 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4547/9106] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:22:28.651470 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.661669 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96377b8-c06d-48f6-a641-882b9b853c07 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.666384 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.667085 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.667368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.667642 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] PATH_INFO: `/v3/projects/b9854a67f3494f36b5ff21ef252b0f54/users/0839807df0844e76bff94839b3bc0949/roles/2b2cdc35bd8e4dbca625836e27a9d865` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.682497 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9854a67f3494f36b5ff21ef252b0f54, user_id=0839807df0844e76bff94839b3bc0949, role_id=2b2cdc35bd8e4dbca625836e27a9d865)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.685193 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.754516 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4560/9107] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:22:28 2022] PUT /identity/v3/projects/b9854a67f3494f36b5ff21ef252b0f54/users/0839807df0844e76bff94839b3bc0949/roles/2b2cdc35bd8e4dbca625836e27a9d865 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:28.759750 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387f0f-a57d-4612-b1c8-cf0b7997d357 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.760743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387f0f-a57d-4612-b1c8-cf0b7997d357 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.761022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387f0f-a57d-4612-b1c8-cf0b7997d357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.780332 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-1a387f0f-a57d-4612-b1c8-cf0b7997d357 None None] MFA Rules not processed for user `a9bd1fec8f644330ae0ff1570223a1be`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:22:28.781541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1a387f0f-a57d-4612-b1c8-cf0b7997d357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:28.841528 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4548/9108] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:22:28.851342 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:28.853041 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:28.871918 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:28.912058 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71583-8a63-4550-858f-fddc5dd3e9ba admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:28.916273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:28.916875 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:28.917155 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:28.917428 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:28.926975 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:28.928441 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:28.939514 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4561/9109] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:34.274022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.274501 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.274592 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.311425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] MFA Rules not processed for user `0839807df0844e76bff94839b3bc0949`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:22:34.312718 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:34.388142 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4549/9110] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:22:34.392289 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:34.402465 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ad67d-bdde-493f-a83b-f8d6c1f062df service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:34.407956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:34.408602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.409090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.409437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.409990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:34.412032 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:34.502516 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4562/9111] 10.222.0.20 () {60 vars in 1153 bytes} [Tue Sep 6 12:22:34 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:22:34.506822 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:34.520144 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8427506-89e8-46e4-97d1-d95a0ecc2d18 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:34.586657 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:34.587714 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.587900 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.588462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.589145 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:34.591297 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:34.683506 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4550/9112] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Sep 6 12:22:34 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 12:22:34.687641 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:34.698996 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ff94e-f81b-4b9a-8df0-0ba8ac459de6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:34.703819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:34.704437 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.704722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.705030 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.706036 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:34.707617 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:34.720916 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4563/9113] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:22:34.724887 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:34.736247 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7fc4-7e13-4fd0-9c9b-259cd622cdf7 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:34.742378 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:34.743100 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.743386 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.743664 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] PATH_INFO: `/v3/projects/daeb193dd4704e90a44b4bd30e75b3de/users/8b8f1948af224cfc9d89fe2fc3d3868c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.748970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:34.761626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeb193dd4704e90a44b4bd30e75b3de, user_id=8b8f1948af224cfc9d89fe2fc3d3868c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:34.764500 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:34.842706 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4551/9114] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:22:34 2022] PUT /identity/v3/projects/daeb193dd4704e90a44b4bd30e75b3de/users/8b8f1948af224cfc9d89fe2fc3d3868c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:34.846686 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:34.857970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c99b2-381d-4b44-8929-ebfc9c49d1f9 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:34.920632 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:34.921253 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.921536 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.921811 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] PATH_INFO: `/v3/roles` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.922454 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:34.924150 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:34.935273 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4564/9115] 10.222.0.20 () {58 vars in 1122 bytes} [Tue Sep 6 12:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 12:22:34.939281 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:34.950869 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b159-94eb-4bf8-84f5-655a10bc31f1 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:34.956107 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793eccf-51ca-4264-bf21-d2a6537cbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:34.956819 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793eccf-51ca-4264-bf21-d2a6537cbe9f admin admin] REQUEST_METHOD: `PUT` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:34.957109 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793eccf-51ca-4264-bf21-d2a6537cbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:34.957387 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793eccf-51ca-4264-bf21-d2a6537cbe9f admin admin] PATH_INFO: `/v3/projects/daeb193dd4704e90a44b4bd30e75b3de/users/8b8f1948af224cfc9d89fe2fc3d3868c/roles/46571a7e08c246cc9af7ce6c064eecdb` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:34.959536 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793eccf-51ca-4264-bf21-d2a6537cbe9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=daeb193dd4704e90a44b4bd30e75b3de, user_id=8b8f1948af224cfc9d89fe2fc3d3868c, role_id=46571a7e08c246cc9af7ce6c064eecdb)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:34.962175 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793eccf-51ca-4264-bf21-d2a6537cbe9f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:34.973862 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4552/9116] 10.222.0.20 () {60 vars in 1483 bytes} [Tue Sep 6 12:22:34 2022] PUT /identity/v3/projects/daeb193dd4704e90a44b4bd30e75b3de/users/8b8f1948af224cfc9d89fe2fc3d3868c/roles/46571a7e08c246cc9af7ce6c064eecdb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:22:35.607964 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:35.609737 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:35.694750 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf308-a9f0-45cb-bbca-b1463b95af6b admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:35.717826 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:35.769787 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:35.770535 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:35.770798 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:35.771326 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:35.774683 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:35.789820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:35.793140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:35.817425 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4565/9117] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:40.768105 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff61c1-37c0-4df4-9c23-6f745a2d8f56 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:40.768642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff61c1-37c0-4df4-9c23-6f745a2d8f56 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:40.768642 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff61c1-37c0-4df4-9c23-6f745a2d8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:40.822455 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-adff61c1-37c0-4df4-9c23-6f745a2d8f56 None None] MFA Rules not processed for user `8b8f1948af224cfc9d89fe2fc3d3868c`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:22:40.824164 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-adff61c1-37c0-4df4-9c23-6f745a2d8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:40.948450 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4553/9118] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:22:40.954011 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:40.956856 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:41.060570 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7417-19da-4b8c-808a-047760881369 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:41.066889 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:41.067687 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:41.068026 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:41.068368 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:41.137273 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:41.139153 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:41.149006 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4566/9119] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:43.767808 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:43.768251 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:43.768372 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:43.789451 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] MFA Rules not processed for user `0839807df0844e76bff94839b3bc0949`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:22:43.790704 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:43.799820 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4554/9120] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:22:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:22:44.126167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:44.184413 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e96c-dd18-473d-9da5-c5a2caa26d2c service nova] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:44.188070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:44.188680 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:44.188979 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:44.189265 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:44.191031 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:44.197263 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=100 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:44.201643 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:44.203163 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:44.211388 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4567/9121] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:44.654032 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:44.677039 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0802747-2f41-410b-aca9-751df79ccdf5 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:44.683720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:44.684359 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:44.684701 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:44.684929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:44.686743 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:44.700658 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:44.702294 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9895e-8254-42c0-bebd-e4285585b45e service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:44.714069 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4555/9122] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:22:54.245604 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=3 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:54.709249 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:22:56.957067 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:22:56.958532 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:22:56.969134 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e70c-a637-4871-b5e5-ea23c9e04694 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:22:56.981748 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:22:56.982360 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:22:56.982655 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:22:56.982932 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:22:56.993323 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:22:56.994749 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:22:57.005375 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4568/9123] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:23:07.000742 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:24:59.218685 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:24:59.219213 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:24:59.219326 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:24:59.250076 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:24:59.251459 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:24:59.320639 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4556/9124] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:24:59.491231 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:24:59.493012 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:24:59.567397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551e49b-8a60-4c3a-854c-c35c044e7981 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:24:59.572602 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5512b5-670a-4aa6-b20f-376c4e6d4338 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:24:59.573152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5512b5-670a-4aa6-b20f-376c4e6d4338 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:24:59.573440 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5512b5-670a-4aa6-b20f-376c4e6d4338 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:24:59.573719 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5512b5-670a-4aa6-b20f-376c4e6d4338 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:24:59.582560 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5512b5-670a-4aa6-b20f-376c4e6d4338 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:24:59.584210 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5512b5-670a-4aa6-b20f-376c4e6d4338 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:24:59.592713 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4569/9125] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:24:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 12:25:01.269964 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:25:01.284807 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6cbb-2bdc-437e-8814-604a8d8a92b3 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:25:01.291142 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:25:01.292052 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:01.292338 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:01.292617 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:01.294394 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:25:01.313438 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:25:01.315652 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:25:01.328053 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4557/9126] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:25:09.589819 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=32 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:10.726332 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe932-02bb-4d48-a302-981c53ce4612 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:10.727051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe932-02bb-4d48-a302-981c53ce4612 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:10.727051 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe932-02bb-4d48-a302-981c53ce4612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:10.747288 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-3d3fe932-02bb-4d48-a302-981c53ce4612 None None] MFA Rules not processed for user `0839807df0844e76bff94839b3bc0949`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:25:10.748426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-3d3fe932-02bb-4d48-a302-981c53ce4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:25:10.755410 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4570/9127] 10.222.0.20 () {58 vars in 958 bytes} [Tue Sep 6 12:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:25:11.322519 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=38 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:11.460979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:25:11.472518 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1972-6b98-4e65-a9d5-46fb06afc1da service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:25:11.477667 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:25:11.478279 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:11.478565 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:11.478845 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:11.480610 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:25:11.492571 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:25:11.494125 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:25:11.505272 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4558/9128] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:25:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:25:13.987757 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:13.988280 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:13.988500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:14.009152 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:25:14.010455 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:25:14.018453 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4571/9129] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:25:14.037049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:25:14.049053 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3ce7e-5d3f-4a21-9a24-4921d50bd51b service placement] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:25:14.054383 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:25:14.055049 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:14.055975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:14.055975 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:14.065069 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:25:14.066702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:25:14.075824 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4559/9130] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:25:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:25:22.436877 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:25:22.451931 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ca19-9cc1-40e3-bfbe-3b3627d2c624 None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:25:22.456130 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:25:22.456988 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:22.457274 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:22.457548 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:22.459379 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:25:22.480456 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:25:22.482825 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:25:22.490564 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4572/9131] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:25:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:25:23.542561 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:25:23.556165 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e69b9-0f11-4226-86ba-96138b209049 service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:25:23.562639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:25:23.569645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:25:23.569645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:25:23.569645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:25:23.569645 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:25:23.582309 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:25:23.584022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37109270-0b9c-4ba8-ad02-b5023fcd64cf service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:25:23.604779 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4560/9132] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:25:32.486934 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=12 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:25:33.591077 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=18 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:26:38.392397 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:26:38.411867 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c6e2a-66fc-4370-9ccb-3d4921128287 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:26:38.415544 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:26:38.416140 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:26:38.416426 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:26:38.416705 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:26:38.418509 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:26:38.462902 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:26:38.464388 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:26:38.472936 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4573/9133] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:26:48.468808 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=24 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:06.885835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01cba-0f30-47ec-b618-2e14bef63850 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:06.885835 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01cba-0f30-47ec-b618-2e14bef63850 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:06.886395 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01cba-0f30-47ec-b618-2e14bef63850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:06.944243 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-52b01cba-0f30-47ec-b618-2e14bef63850 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:27:06.945463 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-52b01cba-0f30-47ec-b618-2e14bef63850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:06.963153 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4561/9134] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Sep 6 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:27:07.004211 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:07.044322 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6b5e6-2014-4ef5-84d6-d937e505a4d4 service neutron] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:07.049531 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:07.050167 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:07.050453 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:07.050732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:07.060055 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:07.061650 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:07.069789 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4574/9135] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:27:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:27:16.960244 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=18 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:17.066487 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=16 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:17.332425 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] REQUEST_METHOD: `POST` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:17.332677 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:17.333168 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:17.353137 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.auth.core [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:27:17.359728 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:17.368220 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4562/9136] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:27:17.383997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:17.391956 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412709-4d34-4088-948e-3a8f08d04e5a service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:17.396883 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:17.397473 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:17.397754 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:17.398029 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:17.406090 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:17.407743 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:17.416594 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4575/9137] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:27:19.642193 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:19.652048 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d368bac-44fe-4b76-bded-de47e9d66e44 None None] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:19.655684 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:19.656301 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:19.656583 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:19.656858 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:19.658599 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:19.688035 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:19.689633 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:19.701260 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4563/9138] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:20.923117 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:20.935446 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd7a7-321d-4aca-bb88-13e4675151e9 service swift] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:20.939109 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:20.939717 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:20.940005 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:20.940284 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:20.942047 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:20.963983 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:20.965444 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa7a79-0b24-45d9-a85c-24e0e882e09d service neutron] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:20.977134 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4576/9139] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:21.836732 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:21.847978 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122905-4f17-49bf-8d0c-e9d0d76a3a59 service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:21.854120 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c2ddfc46e6c414085493829459e5ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:21.854722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:21.855002 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:21.855304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:21.857226 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:21.869818 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:21.871468 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:21.882651 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4564/9140] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:23.292600 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] REQUEST_METHOD: `POST` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:23.293056 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:23.293170 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:23.312500 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.auth.core [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] MFA Rules not processed for user `1866762d940c472abd6e41d57e1d3c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92878) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 12:27:23.313702 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:23.321364 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4577/9141] 10.222.0.20 () {58 vars in 967 bytes} [Tue Sep 6 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 12:27:23.334433 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:23.345929 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6059b0-1651-4a69-9f13-1fd3a8382a8d service nova] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:23.351702 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd53273c297e44518ba1bbe2c838e744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:23.352304 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:23.352591 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:23.352870 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:23.360957 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:23.362535 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:23.370777 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4565/9142] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Sep 6 12:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 12:27:28.210262 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:28.212334 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:28.240538 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f417-75cf-4d9b-b89a-a306d260108a None None] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:28.246184 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:28.246820 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:28.247176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:28.247623 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:28.249722 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:28.262466 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:28.264250 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:28.275541 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4578/9143] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:29.689626 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:29.699158 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6dbc-3a9f-4a6b-baee-6fc90796efaa service swift] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:29.702720 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3720ac834902404a9992a0a6aa43081a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:29.703346 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:29.703632 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:29.703909 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:29.776541 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:29.777970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:29.788246 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4566/9144] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:33.376120 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:33.396162 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dfd8-ca07-44d7-8917-0946a067a7c4 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:33.401565 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:33.402307 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:33.402596 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:33.402873 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:33.404665 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:33.416970 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:33.418606 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:33.429115 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4579/9145] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:37.295277 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:37.312941 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454f36-108e-4154-89af-01734b5cc24d service neutron] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:37.317589 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:37.318214 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:37.318495 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:37.318772 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] PATH_INFO: `/v3/users/0839807df0844e76bff94839b3bc0949` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:37.320022 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0839807df0844e76bff94839b3bc0949)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:37.321979 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:37.502707 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0839807df0844e76bff94839b3bc0949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:37.511384 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0839807df0844e76bff94839b3bc0949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:37.512113 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0839807df0844e76bff94839b3bc0949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:37.526462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0839807df0844e76bff94839b3bc0949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:37.527248 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0839807df0844e76bff94839b3bc0949'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:37.529970 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:37.536370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:37.548954 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335e64-68a6-47bb-b3fa-32ef2bcfd918 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:37.554393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:37.554997 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:37.555370 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:37.555654 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:37.557430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:37.569732 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:37.571356 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:37.581455 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4580/9146] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:27:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:27:37.613297 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4567/9147] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:27:37 2022] DELETE /identity/v3/users/0839807df0844e76bff94839b3bc0949 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:27:37.877555 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:37.879176 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:37.912148 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed18b4-d75f-4067-852e-6ac24028a455 service placement] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:37.971070 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:37.971709 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:37.971990 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:37.972264 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] PATH_INFO: `/v3/projects/b9854a67f3494f36b5ff21ef252b0f54` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:37.973391 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9854a67f3494f36b5ff21ef252b0f54)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:37.975467 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:38.082305 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9854a67f3494f36b5ff21ef252b0f54', 'request_id': 'req-4402cdbe-6805-4055-8862-4cc9921047a6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.088137 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9854a67f3494f36b5ff21ef252b0f54', 'request_id': 'req-4402cdbe-6805-4055-8862-4cc9921047a6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.094295 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9854a67f3494f36b5ff21ef252b0f54', 'request_id': 'req-4402cdbe-6805-4055-8862-4cc9921047a6'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.095995 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:38.179138 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] The token cache is being invalidate because project b9854a67f3494f36b5ff21ef252b0f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:27:38.179434 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.180065 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.181563 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4581/9148] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:27:37 2022] DELETE /identity/v3/projects/b9854a67f3494f36b5ff21ef252b0f54 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:27:38.185734 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:38.196982 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28f6e-104f-4c89-90fb-d950752cee5f admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:38.254749 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:38.255411 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:38.255689 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:38.256647 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] PATH_INFO: `/v3/users/8b8f1948af224cfc9d89fe2fc3d3868c` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:38.257774 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8f1948af224cfc9d89fe2fc3d3868c)` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:38.259722 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:38.415756 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8f1948af224cfc9d89fe2fc3d3868c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.422917 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8f1948af224cfc9d89fe2fc3d3868c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.423639 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8f1948af224cfc9d89fe2fc3d3868c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.436402 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8f1948af224cfc9d89fe2fc3d3868c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.437082 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.notifications [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8f1948af224cfc9d89fe2fc3d3868c'} {{(pid=92879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.498201 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4568/9149] 10.222.0.20 () {58 vars in 1224 bytes} [Tue Sep 6 12:27:38 2022] DELETE /identity/v3/users/8b8f1948af224cfc9d89fe2fc3d3868c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:27:38.770989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:27:38.770989 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:27:38.785393 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402cdbe-6805-4055-8862-4cc9921047a6 admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:27:38.847789 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9bd1fec8f644330ae0ff1570223a1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd30074e8f6b499db04c6cc2b896adb1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:27:38.848429 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:27:38.848715 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:27:38.848992 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] PATH_INFO: `/v3/projects/daeb193dd4704e90a44b4bd30e75b3de` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:27:38.850740 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=daeb193dd4704e90a44b4bd30e75b3de)` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:27:38.852812 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:27:38.974576 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daeb193dd4704e90a44b4bd30e75b3de', 'request_id': 'req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.980692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daeb193dd4704e90a44b4bd30e75b3de', 'request_id': 'req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:38.986961 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daeb193dd4704e90a44b4bd30e75b3de', 'request_id': 'req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb'} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:39.058603 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] The token cache is being invalidate because project daeb193dd4704e90a44b4bd30e75b3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92878) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 12:27:39.058903 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:39.059568 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.notifications [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92878) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 12:27:39.061071 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4582/9150] 10.222.0.20 () {58 vars in 1233 bytes} [Tue Sep 6 12:27:38 2022] DELETE /identity/v3/projects/daeb193dd4704e90a44b4bd30e75b3de => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 12:27:48.494573 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:DELETE=11,keystone:SELECT=55,keystone:INSERT=1 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:27:49.055246 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=53 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:34.611820 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Authenticating user token {{(pid=92879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:32:34.613278 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:32:34.709196 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7790e0-7d24-4ff7-b6a0-01d6b01e18b9 admin admin] Validating token access rules against request {{(pid=92879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:32:34.774974 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:32:34.775640 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] REQUEST_METHOD: `GET` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:32:34.775907 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] SCRIPT_NAME: `/identity` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:32:34.776181 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:32:34.777925 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.fernet_utils [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:32:34.789671 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:32:34.791470 ncdv-master-1 devstack@keystone.service[92879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b34f07-ccc7-4c14-8fbd-e927132966cf service placement] RBAC: Authorization granted {{(pid=92879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:32:34.802540 ncdv-master-1 devstack@keystone.service[92879]: [pid: 92879|app: 0|req: 4569/9151] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:32:41.540777 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Authenticating user token {{(pid=92878) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 12:32:41.542192 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:32:41.559908 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb576a8-8798-4ee0-a582-5bb80aeef3eb admin admin] Validating token access rules against request {{(pid=92878) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 12:32:41.564886 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7fac79d1cad45f7b67ba2f8117899db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4e815d95a246d5ab51c3c2719e5df8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92878) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 12:32:41.565489 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] REQUEST_METHOD: `GET` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 12:32:41.565773 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] SCRIPT_NAME: `/identity` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 12:32:41.566050 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92878) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 12:32:41.568474 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.fernet_utils [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92878) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 12:32:41.580110 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 12:32:41.581692 ncdv-master-1 devstack@keystone.service[92878]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c8c80-ea60-47ed-9732-79811efb7402 service placement] RBAC: Authorization granted {{(pid=92878) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 12:32:41.591989 ncdv-master-1 devstack@keystone.service[92878]: [pid: 92878|app: 0|req: 4583/9152] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Sep 6 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 12:32:44.797462 ncdv-master-1 devstack@keystone.service[92879]: DEBUG dbcounter [-] [92879] Writing DB stats keystone:SELECT=63 {{(pid=92879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 12:32:51.587430 ncdv-master-1 devstack@keystone.service[92878]: DEBUG dbcounter [-] [92878] Writing DB stats keystone:SELECT=6 {{(pid=92878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}